Search code examples
google-app-enginememorytask-queueratebucket

Exceeded soft private memory limit of 128 MB with X MB after servicing Y requests total

I get the dreaded Exceeded-memory-error in my App Engine-application that have a Cron-job pushing multiple small tasks to a queue.

I don't think any single task should trigger the critical error so I'm guessing that they are somehow connected; sharing the memory that is lacking. I'm running my queue with a Maximum Rate of 4/s and a Bucket Size of 5.

How can I be sure and what can/should I do?

Exceeded soft private memory limit of 128 MB with 131 MB after servicing 18 requests total
Exceeded soft private memory limit of 128 MB with 128 MB after servicing 1933 requests total
Exceeded soft private memory limit of 128 MB with 153 MB after servicing 3697 requests total
Solution

  • When a task have been executing for 10 min, it will terminate. The error-message for this can be somewhat confusing.