Chapter 5: Real-Time Data Insights Using Amazon Kinesis

Solution for Activity 6: Performing Data Transformations for Incoming Data

1. Start by creating a Kinesis Firehose Data Stream and follow the steps that we completed in the last exercise.
2. We disabled data transformation using Lambda in the last exercise. This time, enable the Transform source records with AWS Lambda option.
3. Once enabled, create a Lambda function to do the data transformation for incoming data:
   

   Figure 5.54: The Transform source records with AWS Lambda window

4. There are already some sample functions that have been provided by Amazon. You can click on Create New and it will open up the list of transformation functions provided by AWS. Let's choose General Firehose Processing:
   

   Figure 5.55: The Choose Lambda blueprint window

5. This opens up the Lambda function window. Here, you need to provide the name of the function, along with the IAM role information:
   

   Figure 5.56: The Basic information window...