running storm crawler in local mode without the dependency of zookeeper ,nimbus

I am storing urls in mysql and the indexed data in lucene .I am running storm crawler as applcation server in multiple machines using tomcat. do i actually need zookeeper,nimbus and storm to distribute urls(from mysql) among servers..??

Solution

See FAQ

Q: Do I need a Storm cluster to run StormCrawler?

A: No. It can run in local mode and will just use the Storm libraries as dependencies. It makes sense to install Storm in pseudo-distributed mode though so that you can use its UI to monitor the topologies.