Search code examples
javaapache-kafkaapache-kafka-streams

Kafka streams repartitioning

In Kafka streams when function to modify the key is used then Kafka Streams creates internal repartitioned topic. I wonder what is number of partition of newly created topic? When new topic partition number is grater than 1 then other consumers from consumers group also are involved for consuming that internal topic?

I am trying to scale one of my consumers but I try to understand first how does it works.

Solution

  • If you don't set it using Repartitioned.numberOfPartitions(), then it's the same as the input topic.

    Reference - Is there a way to repartition the input topic in Kafka streams?