Search code examples
scalaapache-sparkkey-value-store

Scala persistent key value store?


Please advise on persistent key value store for Scala. Is it possible to use Scala Spark components to build such a store with good access times? (I am new to Spark and planing to use it). Thanks!


Solution

  • Spark is a library used for data processing. The underlying datastore is normally Hadoop. So there is a conceptual difference between what Spark is and what a data store is.

    You are looking for a persistant key-value store, I would suggest Redis because it is easy to setup, is relatively mature and has a Scala client.

    However, you could also use any key-value store depending on your specific needs and what may already exist in your environment. Take a look at these Websites for some guidance: