Search code examples
apache-kafkaapache-kafka-connectdebezium

How can I increase the tasks.max for debezium sql connnector?

I tried setting the configuration for debezium MySQL connector for the property 'tasks.max=50'

But the connector in logs shows error as below: 'java.lang.IllegalArgumentException: Only a single connector task may be started'

I am using MSK Connector with debezium custom plugin and Debezium version 1.8.

Solution

  • It's not possible.

    The database bin log must be read sequentially by only one task.

    Run multiple connectors for different tables if you want to distribute workload