We are using a dynamodb with on-demand capacity mode. We are suddenly seeing few of our requests getting write throttled. During the same time frame there is sudden spike in Write Capacity Units (WCU).
I have checked the incoming traffic/ write request count and it is pretty much the same.
It's possible
You can return the consumed capacity for each write operation which will allow you to understand which items are consuming more capacity. ReturnConsumedCapacity
On-demand mode tables can throttle for 3 reasons:
You can enable CloudWatch Contributor Insights to understand if you have a hot key(s).