Monitoring Synapse integration pipelines using Log Analytics and workbooks

One of the key tasks after developing complex Synapse integration pipelines is to monitor them for aspects such as long-running activities, large data movements, and common errors. In this recipe, we will integrate a Synapse workspace with Azure Log Analytics and deploy a ready-made workbook to monitor the pipelines. In this recipe, at a high level, we will be performing the following tasks:

• Import a pipeline from a template. The pipeline’s execution data will be monitored using an Azure Log Analytics workspace and workbook.
• Integrate a Synapse workspace with Azure Log Analytics.
• Deploy a workbook for monitoring the Synapse integration pipeline.

Getting ready

To get started, log into https://portal.azure.com using your Azure credentials and perform the following steps:

1. Create a Synapse Analytics workspace, as explained in the Provisioning an Azure Synapse Analytics workspace...