Is there a limit on consumers and consumer groups?

Question

Is there any limit on the number of consumers or consumer groups in Kafka?

I am planning to push 200 MB of data every 10 mins to a topic and have 200+ distinct consumers listen and consume from this topic. Is there any other recommended way to do this?

Answer 1

In Kafka, there is no limit on the number of Consumer groups for a particular topic. However, the increase in consumer groups increases network utilization.

Worth noting that newer versions of Kafka, store offsets in the internal Kafka topic called __consumer_offsets.