Monitoring Amazon Kinesis agent/service
We introduced Amazon Kinesis in the previous section, but we did not really look into it in depth. Amazon Kinesis is a data streaming family of services made of Kinesis Data Streams, Kinesis Firehose, Kinesis Analytics, and Kinesis Video Streams. Our focus in this section will be on Kinesis Data Streams and Kinesis Firehose. These two services are used to stream data from various sources and various activities can occur after the extraction process. Kinesis Data Streams allows you to use the Kinesis Producer Library, also known as the KPL, to read data from a source and send it to the Kinesis service. It serves as an agent to collect information and forward the data collected to the Kinesis service in the AWS console. You can see how to create a simple Kinesis data stream here: https://docs.aws.amazon.com/streams/latest/dev/tutorial-stock-data-kplkcl2-create-stream.html.
In some cases, data is collected as it is generated and sent to other...