Search code examples
logstashelastic-stacklogstash-configurationelkamazon-elasticsearch

Encountered a retryable error. Will Retry with exponential backoff 413

Logstash keep encountering following error message that logs cannot be sent to AWS ElasticSearch.

[2021-04-28T16:01:28,253][ERROR][logstash.outputs.amazonelasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=>413, :url=>"https://search-xxxx.ap-southeast-1.es.amazonaws.com:443/_bulk"}

That's why I always need to restart logstash and cannot configure why it causes that issue. Regarding Logstash documentation I reduce pipeline.batch.size size to 100 but it didn't help. Please let me know how to resolve that issue. Thanks.

pipeline.batch.size: 125
pipeline.batch.delay: 50
Solution

  • I've fixed issue that we need to adjust as to choose correct ES instance size based on max_content_length.

    https://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/aes-limits.html