Optimizing usage of DynamoDB and other AWS services for analytics
Optimizing the use of DynamoDB and other AWS services for analytics involves several best practices, particularly when integrating them with DynamoDB for bulk processing and analytics tasks. Let us review some of these practices now.
Rate-limiting read and write throughput consumption
When performing analytics or bulk processing tasks directly on DynamoDB, it is crucial to implement effective rate-limiting mechanisms. These measures prevent these operations from impacting the performance of live OLTP traffic handled by the same DynamoDB tables.
While rate-limiting based on Transactions Per Second (TPS) or Requests Per Second (RPS) can be effective, using Read Capacity Units (RCU) and Write Capacity Units (WCU) for rate-limiting is more accurate. The ReturnConsumedCapacity
property, supported by all dataplane APIs in DynamoDB, can be combined with a token bucket algorithm to implement precise rate-limiting.