Configuring partitions to optimize data flows
Data flows, by default, create partitions behind the scenes to make transformation activities such as join, filter, and sort run faster. Partitions split the large data into multiple smaller pieces so that the backend processes in the data flows can divide and conquer their tasks and finish the execution quickly.
In this recipe, we will take a slow-running data flow and adjust the partitioning to reduce the execution time.
Getting ready
Create a Synapse Analytics workspace as explained in the Provisioning an Azure Synapse Analytics workspace recipe.
Complete the Performing data transformation using activities such as join, sort, and filter and Monitoring data flows and pipelines recipes in this chapter.
How to do it…
Perform the following steps to optimize data flows:
- Log in to portal.azure.com, go to All resources, and search for packtadesynapse. Click on the workspace. Click Open Synapse Studio. Click...
