Search code examples
pythonamazon-web-servicesboto3aws-glueaws-xray

Using AWS X-Ray within a Glue Python Shell Job


Is it possible to use x-ray patching for boto3 within a Glue python shell job using the standard deployed environment?

The aws-xray-sdk library is not in the list of supported libraries. But not including the ability to instrument boto3, which is in the supported library list, would seem like a glaring omission.

Thank you in advance for your consideration and response.


Solution

  • You can try the easy install method suggested by Prabhakar to include the aws-xray-sdk in your glue job. But the SDK needs the X-Ray Daemon to send data to the AWS X-Ray service. You'll need to spin up the daemon and have its host and port open to receive segments from your glue job. You'll also need to set the AWS_XRAY_DAEMON_ADDRESS env var to the daemon's address.