Search code examples
apache-kafkamicroservicesscheduled-taskslegacy

How to create kafka event from database?


There is a legacy service that writes values to the database. I need to converting values to events and then sending it to kafka.

I'm going to make a service that, once in a fixed delay checks for new records and sends them, also writing the submitted records ids to the technical table, but maybe there is some other way, best practice or pattern.

enter image description here


Solution

  • You may want to look into Debezium that implements Change Data Capture on relational and NoSql data stores and streams the data into Kafka.

    https://github.com/debezium/debezium

    https://debezium.io/documentation