Parameterizing Synapse data flows
Adding parameters to data flows provides flexibility and agility for data flows while performing their transformations. In this recipe, we will create a data flow that accepts a parameter, filters the data based on the value passed in the parameter, and copies the data to Parquet files.
Getting ready
Create a Synapse Analytics workspace as explained in the Provisioning an Azure Synapse Analytics workspace recipe in Chapter 8, Processing Data Using Azure Synapse Analytics.
Complete the Copying data using a Synapse data flow recipe in this chapter to create the Copy_CSV_to_Parquet data flow..
How to do it…
In this recipe, we will add a parameter to the Copy_CSV_to_Parquet dataflow (which was created in the Copying data using a Synapse data flow recipe), and make the Copy_CSV_to_Parquet data flow copy selective rows based on the value passed to the parameter by the Copy_Data_Flow pipeline (created in the Copying data using a Synapse...
