Search code examples
javanosqlbigdatasqlfire

Timeline data- store solution

I'm facing a funny problem: I have to display an aggregated feed of Facebook, Foursquare and Twitter for my users and I don't know what solution to use. A lot of batches are running in parallel, and there are many updates in the activity streams.

I need to manipulate lists of activities, so I first tried Redis, but the replication doesn't work when you are using many sunionstore commands. I've been thinking of :

  • noSQL -> HBase.

  • newSQL -> VoltDB and SQLFire.

  • data-grid -> Infinispan, GridGain and Gigaspace

What do you think I should use? Do you have any other ideas?

Solution

  • We use Hazelcast in production for 2 years now and are very pleased with its performance and scalability.

    We use Gridgain as well, but as a compute grid, not a data grid

    I think Hazelcast should be a good way to go, as you can have batches and real-time insert, and its API and docs are good