Creating the CloudFormation stack
First, let’s go through the prerequisites for this section.
Prerequisites for creating the CloudFormation stack
Make sure that the Amazon OpenSearch, Delta Lake, and Apache Hudi connections have been created. Also, make sure that you have a KeyPair. This KeyPair will be used to connect to one of the EC2 instances created by the CloudFormation template.
The CloudFormation template will create IAM roles and policies, too. These roles and policies are required for the jobs to function. Please review the definition of these roles, policies, networks, and security groups, and ensure that they align with the standards of your organization. In the following sections, first, we will create the stack and then create the dataset.
Creating the stack
The CloudFormation stack creates 61 resources. These resources can be found in the Resources tab of the CloudFormation stack.
Import the template in CloudFormation and enter the name of...
