You're reading from Azure Data Engineering Cookbook Get well versed in various data engineering techniques in Azure using this recipe-based guide

Product type Paperback

Published in Sep 2022

Publisher Packt

ISBN-13 9781803246789

Length 608 pages

Edition 2nd Edition

Languages

SQL

Tools

Azure

Concepts

Data Engineering

Authors (3):

Ahmad Osama

Nagaraj Venkatesan

Luca Zanna

View More author details

Table of Contents (16) Chapters

Preface

1. Chapter 1: Creating and Managing Data in Azure Data Lake

2. Chapter 2: Securing and Monitoring Data in Azure Data Lake FREE CHAPTER

3. Chapter 3: Building Data Ingestion Pipelines Using Azure Data Factory

4. Chapter 4: Azure Data Factory Integration Runtime

5. Chapter 5: Configuring and Securing Azure SQL Database

6. Chapter 6: Implementing High Availability and Monitoring in Azure SQL Database

7. Chapter 7: Processing Data Using Azure Databricks

8. Chapter 8: Processing Data Using Azure Synapse Analytics

9. Chapter 9: Transforming Data Using Azure Synapse Dataflows

10. Chapter 10: Building the Serving Layer in Azure Synapse SQL Pool

11. Chapter 11: Monitoring Synapse SQL and Spark Pools

12. Chapter 12: Optimizing and Maintaining Synapse SQL and Spark Pools

13. Chapter 13: Monitoring and Maintaining Azure Data Engineering Pipelines

14. Index

Why subscribe?

15. Other Books You May Enjoy

Creating workbooks in a Log Analytics workspace to visualize monitoring data

Workbooks help you visually explore data stored in Log Analytics workspaces. Workbooks make exploring data stored in a Log Analytics workspace easier since you don’t need to write Kusto queries to read the data. In this recipe, we will create two workbooks – one each for monitoring Synapse Spark and SQL pools.

Getting ready

To get started, log in to https://portal.azure.com using your Azure credentials:

Complete the Configuring a Log Analytics workspace for Synapse dedicated SQL pools and Configuring a Log Analytics workspace for Synapse Spark pools recipes covered earlier in this chapter.
Download the SQLPool_Queries.sql script from https://github.com/PacktPublishing/Azure-Data-Engineering-Cookbook-2nd-edition/blob/main/chapter11/SQLPool_Queries.sql and run it in Packtadesqlpool, as explained in step 1 of the How to do it… section of the Using Kusto queries to monitor...