Ideas or Examples of NoSQL for News?
Normally, I like my data structured, and that tends to mean some flavor of SQL. But I’ve been seeing glimpses of NoSQL popping up lately and I’m wondering if anyone here can share a few good uses of NoSQL in the newsroom. A few I’ve seen:
- Simon Willison likes Redis
- The NY Times used MongoDB for dynamic forms
- ProPublica’s TableFu is something of a NoSQL-style Google Spreadsheet ORM
What else is out there? And what code can you share?
Not necessarily news, but hummingbird is way sweet:
I've been playing around with a similar idea, that is less gilt/commerce specific. And a while ago I was playing with tokyo tyrant with better-represent-me, which collected news about congressional reps daily is semi-live, and way slowww cause I never finished it, anyway here's the code:
It was made with and older version of django, and essentially serialized models straight to tokyo tyrant (not the best idea), but it was fun.
As for ideas, I'm betting that anytime you're storing json in the db for extensible attributes it's time for mongo or redis.
Also, for crowdsourcing projects and surveys its a godsend (see nytimes), because writes are super efficient and fast.
And finally, Foursquare is using mongo for geo queries. So address lookups would be a use case, although mongo is a bit limited in it's understanding of geo stuff at the moment. They say that'll change soon enough, however.
The Business Insider is using MongoDB. Great explainer on the rationale and their implementation here: http://www.businessinsider.com/how-we-use-mongodb-2009-11
My team at the Chicago Tribune used Mongo to build http://schools.chicagotribune.com. It felt like a good fit because the data provided by the IL State Board of Education is pretty obtuse (almost 9000 columns of data per school) and very little of the data is truly relational.
Chris Groskopf, who captained our implementation of Mongo is talking about the project at Mongo Chicago
I'm using MongoDB to build a (hiper)local, location aware, news aggregator.
I've used many NoSQL in other contexts and think MongoDB is the way to go for document store. It's simple, efficient and feature rich.
Of course, specific apps may make a better use of Redis, Tokyo or even Cassandra.
For those anywhere near Charleston, S.C., there's a meetup planned Oct. 28 on No Sql databases, with reps. from Boomtown talking about MongoDB and from Collecta talking about others like Riak and CouchDB. The invite: http://anyvite.com/events/home/wxjobn4otj/dsscxsomasd6bh/guslyqh36hgqipwqmxye
Lord knows why I was on the mailing list, so I'll pass it on to y'all. :)
Please login to post questions.