I'm sending my logs to Kinesis Firehose using the API (C#). The Kinesis is sending it to Elasticsearch and I'm analyzing this data using Kibana. For some reason, I see the records in Kibana in delay of few minutes (2-5). I don't know in which step the delay is. Why is it taking so long to the data to appear?
I needed to change the 'ES buffer interval (sec)*' in the stream details from 300 to 60.