Ingesting data from transactional sources using AWS DMS
When you have transactional data sources—either on-premises or on AWS RDS—and you want to replicate or migrate that data to your data warehouse in Amazon Redshift for consolidation or reporting, you can use AWS DMS. AWS DMS is a fully managed service that helps you to do full loading from your transactional source to the target data warehouse as well as near-real-time change data capture (CDC) from source to target.
In this recipe, we will do full replication of the parts
table from Amazon RDS MySQL, serving as a transactional source to the Amazon Redshift database warehouse.
Getting ready
To complete this recipe, you will need the following:
- An Amazon Redshift cluster deployed in the
eu-west-1
AWS region. - Amazon Redshift cluster master user credentials.
- An IAM user with access to Amazon Redshift, Amazon RDS, and AWS DMS.
- An Amazon RDS MySQL cluster deployed in the
eu-west-1
AWS region...