Scheduling the master pipeline
Scheduling a pipeline for automated execution at a given time requires you to create a trigger in the Azure data factory. Let's find out how to do this:
- Using the panel on the left-hand side, click on Manage. Then, click on Triggers. Finally, click on New:
- Name:
electroniz_master_trigger
- Start date: Choose a date and time
- Time Zone: Choose your time zone
- Recurrence:
Every 1 hour
- Activated:
Yes
.
Finally, click on OK:
- Name:
- Using the pane on the left-hand side, click on Author. Click on the electroniz_master_pipeline underneath Pipeline:
- Click on Add Trigger. Then, click on New/Edit.
- Choose the following trigger:
electroniz_master_trigger
. - Click on OK.
In the Edit trigger panel, add the Trigger Run parameters as follows:
- Name:
STORAGE_ACCOUNT
Type:String
Value:traininglakehouse
- Name:
BRONZE_LAYER_NAMESPACE
Type:String
Value:bronze
- Name:
SILVER_LAYER_NAMESPACE
Type:String
Value...