Change Data Capture
The Change Data Capture (CDC) tool in Azure Data Factory enables real-time data synchronization by efficiently tracking and capturing only the changed data. It optimizes data integration workflows, reduces processing time, and ensures data consistency across systems. With built-in connectors and support for hybrid environments, CDC empowers organizations to stay up to date with analytics and reporting.
Getting ready
Before getting started with the recipe, log in to your Microsoft Azure account.
We assume you have a pre-configured resource group and storage account with Azure Data Lake Gen2, Azure Data Factory, and Azure SQL Database. To set these up, please refer to Chapter 1, Getting Started with ADF, and the Creating and executing our first job in ADF recipe.
- In Azure SQL Database, you will need to have movielens CSV files to be loaded to the dbo schema with the following table name:
dbo.movielens_ratings. - In Azure Data Lake Gen2...
