Search code examples
apache-kafkakafka-topic

Kafka-producer duplicate check


How can I verify duplication of messages in a particular topic? I have producer which sends messages to topic and consumer consumes those messages. so I wnt to verify that the messages consumed by consumer are not duplicated.


Solution

  • You can use Idempotent Producer to avoid message duplication. read here for more information abouth Idempotent producer.