Testing the master pipeline
Now that the development of the master pipeline is complete, we should validate whether the pipeline runs successfully or not. Let's invoke it manually and check the outcome of the run:
- Connect to the Azure Cloud Shell and invoke the following commands:
DATAFACTORYNAME="trainingdatafactory100" RESOURCEGROUPNAME="training_rg" PIPELINENAME="electroniz_master_pipeline" az datafactory pipeline create-run --factory-name $DATAFACTORYNAME --name $PIPELINENAME --resource-group $RESOURCEGROUPNAME \ --parameters "{\"STORAGE_ACCOUNT\":\"traininglakehouse\",\"BRONZE_LAYER_NAMESPACE\":\"bronze\", \ \"SILVER_LAYER_NAMESPACE\":\"silver\",\"STORE_SALES_FOLDER\":\"sales\", \ \"TABLE_LIST\":\"products,store_customers,store_orders\",\"CURRENCY_LIST\":\"CAD,INR,EUR\",\"CURRENCY_FOLDER\":\...