Search code examples
apache-kafkaapache-kafka-connect

Kafka Connect "Received unknown topic or partition error in fetch for partition..." Overlogging

Our Kafka Connect server gets filled up very quickly by connect.log. The WARN that keeps appearing in the log file is:

WARN [Consumer clientId=consumer-connect-cluster-2, groupId=connect-cluster] Received unknown topic or partition error in fetch for partition connect-statuses-2 (org.apache.kafka.clients.consumer.internals.Fetcher:1340)

What may cause this warning and why it is logging as a spam?. It is getting logged more than 1000 times in a second, how can I stop that? Also is it safe to delete that consumer group?

Solution

  • Restarting the brokers solved the issue, for now. Couldn't find the reason behind it.