The Transforming Options Available in ADF

Azure Synapse Pipelines and ADF ingest and transform data. While Spark and T-SQL offer code-based solutions to run ingestion and transformation tasks, ADF and Azure Synapse Pipelines offer a low-code alternative, where the ingestion and transformation process can be drawn on a canvas by dragging and dropping activities and setting their properties and conditions. The personal productivity advantage is considerable, and if you face limitations of the low-code approach unexpectedly, you can still add an activity that calls a Spark Notebook, a T-SQL script, or a stored procedure.

Note

This section primarily focuses on the Ingest and transform data by using Azure Synapse Pipelines or Azure Data Factory concept of the DP-203: Data Engineering on Microsoft Azure exam.

Synapse pipelines are simply ADF pipelines whose functionalities are ported into the Synapse workspace and can be considered, for all intents and purposes, functionally equivalent...