Scheduling and Monitoring Pipeline Tests

In Chapter 7, Managing Batches and Pipelines, you were briefly introduced to Azure DevOps for version control. Azure DevOps provides another feature called Azure Pipelines, which can be used to create Continuous Integration (CI)/Continuous Deployment (CD) pipelines to deploy ADF. CI/CD is an automated method of continuously testing and deploying applications to a production environment.

Note

This section primarily focuses on the Schedule and monitor pipeline tests concept of the DP-203: Data Engineering on Microsoft Azure exam.

In this section, you will learn how to create, schedule, and monitor a CI/CD pipeline.

Note

You can learn more about CI/CD for Azure Synapse Analytics at https://packt.link/LN9rJ.

Perform the following high-level steps to create a CI/CD pipeline using Azure pipelines:

1. Sign in to your Azure DevOps account.
2. On the Azure DevOps screen, select Releases under Pipelines and click the New Pipeline...