Orchestrating using AWS Step Functions
AWS Step Functions allows you to author a workflow where each step is decoupled but the application state can be maintained. AWS Step Functions is integrated with multiple AWS services to allow flexibility to call the specific service in each of the tasks.
You can see a list of natively supported integrations here: https://docs.aws.amazon.com/step-functions/latest/dg/concepts-service-integrations.html. AWS Step Functions supports the Amazon States Language, which allows a workflow to be authored and maintained like a JavaScript Object Notation (JSON) file. You can harness AWS Step Functions to execute any complex ETL workflow in Amazon Redshift.
Getting ready
To complete this recipe, you will need the following:
- An Amazon Redshift cluster deployed in the
eu-west-1
AWS region—note that we will refer to the cluster ID as[Your-Redshift_Cluster]
- Amazon Redshift cluster master user credentials—note that we will...