Search code examples
amazon-web-serviceselasticsearchfilebeat

Push data directly from Filebeats to AWS ES managed service

My issue is that I am trying to stream data from Filebeat to AWS ElasticSearch.

I approached this by providing the AWS endpoint in the beats output entry.

I tried both port 80 and 443 to no avail.

I checked this post, and from this I suppose that it is possible to push directly to AWSbut still cannot figure out how.

It would be really helpful if any of you has been through this and could shed some light!

Thank you!

Solution

  • Turns out it was a problem with permissions.

    Make sure that the logs filebeat is trying to stream have the same permission as the filebeat.yml.

    You can simply issue a chmod 777 to both files.

    Finally, make sure, to prepend :443 after AWS ES endpoint.