Search code examples
apache-kafkaapache-kafka-connectdebezium

Set up kafka-connect on local in Ubuntu to use with debezium and WSO2 stream processor?


This is a newbie question but i am not able to figure out how to install kafka-connect on my local machine ubuntu 18.04 to use it with debezium. I already have kafkaz zoopeeker and wso2 stream processor working fine but for kafka-connect i am facing bottleneck. We could use confluent for it but i don't want to use confluent here. I want to have separate components. Once i get kafka connect installed locally i can follow the instructions on debezium tutorial on their web-site to install mongodb connector plugin.

If you have any link or source for this kafka-connect set please ping.


Solution

  • The documentation details how to run Kafka Connect. Specifically:

    bin/connect-standalone.sh config/connect-standalone.properties connector1.properties
    

    You'll need to install Debezium too, before launching the Kafka Connect worker.

    For more background info on Kafka Connect see http://rmoff.dev/ksldn19-kafka-connect.