Search code examples
amazon-web-servicesamazon-ec2amazon-s3emr

Error while submitting aws emr job from command line


I am getting below error form aws emr. I have submitted job from cli. The job status is pending.

A client error (ThrottlingException) occurred when calling the ListSteps operation: Rate exceeded

How to see the all the active jobs in emr cluster and how to kill them from cli and also from the aws console.

Regards sanjeeb


Solution

  • AWS APIs are rate limited. According to the AWS docs the recommended approach to dealing with a throttling response is to implement exponential backoff in your retry logic means when you get ThrottlingException try to catch it and sleep for some time say half second and then retry ...