Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Cloud Scale Analytics with Azure Data Services

You're reading from   Cloud Scale Analytics with Azure Data Services Build modern data warehouses on Microsoft Azure

Arrow left icon
Product type Paperback
Published in Jul 2021
Publisher Packt
ISBN-13 9781800562936
Length 520 pages
Edition 1st Edition
Tools
Arrow right icon
Author (1):
Arrow left icon
Patrik Borosch Patrik Borosch
Author Profile Icon Patrik Borosch
Patrik Borosch
Arrow right icon
View More author details
Toc

Table of Contents (20) Chapters Close

Preface 1. Section 1: Data Warehousing and Considerations Regarding Cloud Computing
2. Chapter 1: Balancing the Benefits of Data Lakes Over Data Warehouses FREE CHAPTER 3. Chapter 2: Connecting Requirements and Technology 4. Section 2: The Storage Layer
5. Chapter 3: Understanding the Data Lake Storage Layer 6. Chapter 4: Understanding Synapse SQL Pools and SQL Options 7. Section 3: Cloud-Scale Data Integration and Data Transformation
8. Chapter 5: Integrating Data into Your Modern Data Warehouse 9. Chapter 6: Using Synapse Spark Pools 10. Chapter 7: Using Databricks Spark Clusters 11. Chapter 8: Streaming Data into Your MDWH 12. Chapter 9: Integrating Azure Cognitive Services and Machine Learning 13. Chapter 10: Loading the Presentation Layer 14. Section 4: Data Presentation, Dashboarding, and Distribution
15. Chapter 11: Developing and Maintaining the Presentation Layer 16. Chapter 12: Distributing Data 17. Chapter 13: Introducing Industry Data Models 18. Chapter 14: Establishing Data Governance 19. Other Books You May Enjoy

Setting up a Synapse Spark pool

Now, let's examine the basic steps to spin up a Synapse Spark pool in this section.

This task is very easy to handle in a Synapse workspace:

  1. Please navigate to the Management pane and there, in the Analytics pools section, select Apache Spark pools.
  2. In the Details pane, click + New. The configuration blade for a new Apache Spark pool is displayed:

    Figure 6.1 – Create Apache Spark pool – The Basics blade

  3. Here you will name your new Spark pool and configure the node size value, enable Autoscale, and set the lower and upper boundaries for the autoscaling feature, if enabled. The last row in this view shows the potential cost of the lowest and the highest autoscaling setting. Click Next: Additional settings.
  4. In the upper area of the Additional settings blade, you can now configure Auto-pause and Number of minutes idle, which sets the amount of idle time that will elapse before the cluster pauses. In the Component...
lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at €18.99/month. Cancel anytime