Search code examples
amazon-ec2apache-nifiaws-msk

How to find group.id property of a kafka topic in Amazon MSK?


I am trying to consume messages from a Kafka topic in Amazon MSK using Apache NiFi. NiFi ConsumeKafka processor requires group.id property of Kafka.Where or How can I find the group.id property for the MSK cluster?


Solution

  • You can set the group.id property to whatever you want - this simply allows you to group multiple consumers (i.e. multiple NiFi nodes) together to consume from a single topic concurrently.

    Read up on Kafka Consumer Groups

    E.g. https://blog.cloudera.com/scalability-of-kafka-messaging-using-consumer-groups/