You're reading from Azure Data Engineer Associate Certification Guide Ace the DP-203 exam with advanced data engineering skills

Product type Paperback

Published in May 2024

Publisher Packt

ISBN-13 9781805124689

Length 548 pages

Edition 2nd Edition

Languages

SQL

Tools

Azure

Concepts

Big Data

Authors (3):

Newton Alex

Giacinto Palmieri

Mr. Surendra Mettapalli

View More author details

Table of Contents (17) Chapters

Preface

1. Part 1: Azure Basics FREE CHAPTER

2. Chapter 1: Introducing Azure Basics

3. Part 2: Data Storage

4. Chapter 2: Implementing a Partition Strategy

5. Chapter 3: Designing and Implementing the Data Exploration Layer

6. Part 3:Data Processing

7. Chapter 4: Ingesting and Transforming Data

8. Chapter 5: Developing a Batch Processing Solution

9. Chapter 6: Developing a Stream Processing Solution

10. Chapter 7: Managing Batches and Pipelines

11. Part 4:Secure, Monitor, and Optimize Data Storage and Processing

12. Chapter 8: Implementing Data Security

13. Chapter 9: Monitoring Data Storage and Data Processing

14. Chapter 10: Optimizing and Troubleshooting Data Storage and Data Processing

15. Chapter 11: Accessing the Online Practice Resources

16. Other Books You May Enjoy

SQL Serverless and Spark Clusters

Data exploration often consists of running a series of queries against raw data to grasp its structure and content, keeping in mind the need to plan the transformations required to make it feasible for data analysis. Azure offers many tools that can be used for this purpose, particularly Synapse Analytics Serverless SQL pool and the various implementations of Apache Spark, such as Synapse Spark and Databricks.

Note

This section primarily focuses on the Creating and executing queries by using a compute solution that leverages SQL serverless and Spark cluster topic of the DP-203: Data Engineering on Microsoft Azure exam.

Starting with Synapse Analytics Serverless pool, the easiest way to introduce the Serverless SQL pool is by comparing and contrasting it with the other options available in Synapse to run SQL pools – for example, dedicated SQL pools. The SQL server instances consist of clusters (pool and cluster can be considered synonyms...

The rest of the chapter is locked

You're reading from Azure Data Engineer Associate Certification Guide Ace the DP-203 exam with advanced data engineering skills

Table of Contents (17) Chapters Close

SQL Serverless and Spark Clusters

Unlock this book and the full library FREE for 7 days

Authors (3)

Personalised recommendations for you

Table of Contents (17) Chapters