I have a storm topology that subscribes events from Kafaka queue. The topology works fine while the number of workers config.setNumWorkers is set to 1. When I update the number of workers to more than one or 2, the KafkaSpout fails to acknowledge the messages while looking at storm UI. What might be the possible cause, I am not able to figure out, the exactness of problem.
I have a 3 node cluster running one nimbus and 2 supervisors.
My Problem got resolve. The reason being kafka unable to acknowledge the spout message was the conflict with the Hostname. I had mistakenly the same host name in /etc/hostname and /etc/hosts file of the both workers. When I check the worker I was able to get the exception - unable to communicate with host. So there by I figured out, the problem was was host name .I updated the host name in etc/hosts mapping and /etc/host name file. The message started to be acknowledged. Thank you.