Right you are. Saw that post yesterday, which is probably what got me thinking about NoSQL in the first place. Definitely worth including.
Ideas or Examples of NoSQL for News?
Normally, I like my data structured, and that tends to mean some flavor of SQL. But I’ve been seeing glimpses of NoSQL popping up lately and I’m wondering if anyone here can share a few good uses of NoSQL in the newsroom. A few I’ve seen:
- Simon Willison likes Redis
- The NY Times used MongoDB for dynamic forms
- ProPublica’s TableFu is something of a NoSQL-style Google Spreadsheet ORM
What else is out there? And what code can you share?
Leave a Reply
You must be logged in to post a comment.
10 Answers
I suspect you'll see more of Mongo in our apps at the NYT. It even does some geospatial stuff. And for those of you who like a GUI interface, there's MongoHub.
Leave a Reply
You must be logged in to post a comment.
Not necessarily news, but hummingbird is way sweet:
I've been playing around with a similar idea, that is less gilt/commerce specific. And a while ago I was playing with tokyo tyrant with better-represent-me, which collected news about congressional reps daily is semi-live, and way slowww cause I never finished it, anyway here's the code:
http://github.com/thejefflarson/better-represent-me
It was made with and older version of django, and essentially serialized models straight to tokyo tyrant (not the best idea), but it was fun.
As for ideas, I'm betting that anytime you're storing json in the db for extensible attributes it's time for mongo or redis.
Also, for crowdsourcing projects and surveys its a godsend (see nytimes), because writes are super efficient and fast.
And finally, Foursquare is using mongo for geo queries. So address lookups would be a use case, although mongo is a bit limited in it's understanding of geo stuff at the moment. They say that'll change soon enough, however.
Leave a Reply
You must be logged in to post a comment.
Sunlight Foundation is a news organization, even if folks don't put them in that category first.
Matt Hampel recently pointed me to this brief blog post about Sunlight's interest in MongoDB.
Leave a Reply
You must be logged in to post a comment.
The Business Insider is using MongoDB. Great explainer on the rationale and their implementation here: http://www.businessinsider.com/how-we-use-mongodb-2009-11
Leave a Reply
You must be logged in to post a comment.
The BBC uses CouchDB. Last year, their engineer, Enda Farrell, gave an overview of how they're using it for their key-value store. He mentions it powers their home page, iPlayer and LabUK. (Slides)
Leave a Reply
You must be logged in to post a comment.
You'll find quite a few NoSQL usecases here: http://nosql.mypopescu.com/tagged/usecase Simply put this blog is focused on NoNSQL only.
Leave a Reply
You must be logged in to post a comment.
I just learned about a NOSQL Summer. It's not news specific, but it might be worth keeping an eye on — or attending if it's in your city.
Leave a Reply
You must be logged in to post a comment.
My team at the Chicago Tribune used Mongo to build http://schools.chicagotribune.com. It felt like a good fit because the data provided by the IL State Board of Education is pretty obtuse (almost 9000 columns of data per school) and very little of the data is truly relational.
Chris Groskopf, who captained our implementation of Mongo is talking about the project at Mongo Chicago
Leave a Reply
You must be logged in to post a comment.
I'm using MongoDB to build a (hiper)local, location aware, news aggregator.
I've used many NoSQL in other contexts and think MongoDB is the way to go for document store. It's simple, efficient and feature rich.
Of course, specific apps may make a better use of Redis, Tokyo or even Cassandra.
Leave a Reply
You must be logged in to post a comment.
For those anywhere near Charleston, S.C., there's a meetup planned Oct. 28 on No Sql databases, with reps. from Boomtown talking about MongoDB and from Collecta talking about others like Riak and CouchDB. The invite: http://anyvite.com/events/home/wxjobn4otj/dsscxsomasd6bh/guslyqh36hgqipwqmxye
Lord knows why I was on the mailing list, so I'll pass it on to y'all. :)
Leave a Reply
You must be logged in to post a comment.
Your Answer
Please login to post questions.

What does this crowd think about how Google App Engine compares to Mongo and the rest? I’m so terrible at systems administration that there’s part of me that would give up the farm to Google in exchange for making my life easier. Should I be teaching myself Mongo instead?