Understanding data migration challenges

In this section, we will cover the data migration challenges that we face while migrating an on-premises data warehouse to the cloud, the ways of mitigating these challenges, and the successful migration journey to Synapse using Azure Synapse Pathway.

Data warehouses are usually used to store large amounts of data for analytical purposes. The data is ingested from a variety of sources and transactional systems into this data warehouse store, where raw data is transformed based on the schema and stored for future analytical purposes to derive business insights. Over a period of time, the data becomes overwhelming, such that the scalability becomes bottlenecked in an on-premises store, which is one of the compelling reasons for most organizations to adopt cloud data warehouses.

Let's take an example of an on-premises Teradata Data Warehouse where the customer intends to move it to Azure Synapse. There are significant design differences...