Search code examples
javaperformanceapache-kafkakafka-cluster

Understand Kafka write speed

Given that
1. Five machine Kafka cluster
2. 1 topic with 1 partition
3. persisted storage for msgs
4. Each msg of 1 KB
5. 10 producers

Now, Will the max write capability of this cluster BE EQUAL TO max write capability of one java thread onto a disk? If No, what will it be?

Solution

  • if you only have one partiton then kafka cannot scale your topic and use only one machine out of your 5 instance cluster.

    cannot tell how well you code your java but results will be similar to kafka I assume with small differences as kafka is optimised for disk writes.