apache-kafka-connectdebezium
Why Debezium creates Topics for all the tables, even when table.whitelist is specified
I am using Debezium plugin for Kafka Connect to stream MySQL Database changes.
I have explicitly mentioned my whitelist table in the
connector.properties
table.whitelist=tripDriverMapping
database.tables=azuga.tripDriverMapping
Why does Debezium create topics for all the tables in the database? Is there any workaround to avoid creation of all these unnecessary topics as I'm going to consume from only one topic.
Solution
The correct configuration for the connector is:
database.whitelist=azuga
table.whitelist=azuga.tripDriverMapping
database.whitelist might be optional
- How to access Kafka Connect created by Strimzi?
- Can we attach a init-container with strimzi kafka container?
- Postgres Debezium does not publish the previous state of a record
- ERROR Uncaught exception in REST call to /metrics (org.apache.kafka.connect.runtime.rest.errors.ConnectExceptionMapper:61)
- Create Kafka connector but start as paused
- How Kafka Connect Cluster is operated in production (number, distribution, etc.)
- Kafka Connect docker image not recognizing AWS environment variable credentials?
- Confluent Kafka: Data from Topic (single payload) to multiple tables
- How to connect to a MongoDB over SSH from Debezium
- IBM EVENTSTREAM Kafka Connector on openshift Debezium oracle connector Encountering Error
- Strimzi Kafka Connect Cluster - Resource planning
- Kafka Connect running out of heap space
- How many kafka connect clusters are optimal?
- MSK connector failed to find class in MSK cluster with KRaft mode
- Inputing data in a Kafka Topic from XML with FilePulse - ExplodeFilter
- Kafka Connect Transformations - RegexRouter replacement topic names in lowercase
- SQL connector to KSQLDB , how to do it in docker.yml?
- Why Debezium Connector can't connect to a SASL activated broker?
- Debezium source connector, add a field to the `after` object
- Can kafka connect - mongo source run as cluster (max.tasks > 1)
- Produce Avro messages in Confluent Control Center UI
- Connection Timeout: Cant connect mongo with debezium for CDC
- DebeziumException "The connector previously stopped while taking a snapshot, but now the connector is configured to never allow snapshots"
- Need to move small JSON messages from Kafka to HDFS with Kafka Connect but without using Confluent libs, if not completely free
- Error creating CDC Azure Database MySQL to Apache Kafka
- How to change the "kafka connect" component port?
- How to tell debezuim Mysql source connector to stop retaking snapshots of existing tables in kafka topic?
- Kafka Connect Sink JsonConverter DataException: Converting byte[] to Kafka Connect data failed due to serialization error
- Sending data to QuestDB using Kafka Connect and the HTTP transport, rather than TCP
- What is a simple, effective way to debug custom Kafka connectors?