AWS Kinesis is a scalable streaming service that can be used to ingest data and is fully managed. The ingestion can be done via the Kinesis Client Library or the Kinesis Streams API (1), in both cases data is durably stored up to 24 hours to different workflows can be executed like batch processing.
Kinesis can ingest data directly to S3 which makes a good integration to have the data out of the processing workers represented by the Kinesis apps. AWS Lambda (3) is used to process real-time data and the results of this processing are durably stored in DynamoDB (4).
This design promotes scalability on the worker tier (Kinesis Apps) by decoupling the storage to managed services for different purposes.
