Search code examples
elasticsearchpublish-subscribeignite

Pub-sub between Elastic Search and Apache Ignite

I have implemented a custom CacheStore in Ignite to communicate with Elastic Search. My question is, is there any way to make Ignite get any change that happens in the Elastic Search DB?

Solution

  • Ignite's CacheStore are pull-oriented: they pull data from DB but DB does not push updates to Ignite. This is because most DBs don't have robust update notify mechanism (and in the case of MVCC/SQL transactions this is actually not possible to implement correctly for all cases).

    You can try starting Ignite's DataStreamer somewhere on the side of Elasticsearch, push all updates to it. This will require development work, of course.