SC when downloaded has a setup for localhost ES, which works perfectly with --local and --remote. When I change this to write to a Dev Elastic Search server (cluster) and I have updated, ES_IndexInit.sh and es_conf.yaml (es.indexer.addresses and cluster.name) to have the correct values for the properties. ES_IndexInit creates the indexes on that server just fine as expected, but this never writes to that server. I see no errors in the logs and I see the URL shows as discovered in the logs. This does not even write to the Status Index. I am not sure what I am missing?
Definitely a version conflict. The version 1.7 of the ES module depends on ES 6.0.0 and 1.8 depends on 6.2.2.
I'd recommend that you use the latest version of StormCrawler available as it contains numerous improvements and bugfixes.