You're reading from Azure Databricks Cookbook Accelerate and scale real-time analytics solutions using the Apache Spark-based analytics service

Product type Paperback

Published in Sep 2021

Publisher Packt

ISBN-13 9781789809718

Length 452 pages

Edition 1st Edition

Languages

SQL

Tools

Azure

Concepts

Data Streaming

Authors (2):

Vinod Jaiswal

Phani Raj

View More author details

Table of Contents (12) Chapters

Preface

1. Chapter 1: Creating an Azure Databricks Service

2. Chapter 2: Reading and Writing Data from and to Various Azure Services and File Formats FREE CHAPTER

3. Chapter 3: Understanding Spark Query Execution

4. Chapter 4: Working with Streaming Data

5. Chapter 5: Integrating with Azure Key Vault, App Configuration, and Log Analytics

6. Chapter 6: Exploring Delta Lake in Azure Databricks

7. Chapter 7: Implementing Near-Real-Time Analytics and Building a Modern Data Warehouse

8. Chapter 8: Databricks SQL

9. Chapter 9: DevOps Integrations and Implementing CI/CD for Azure Databricks

10. Chapter 10: Understanding Security and Monitoring in Azure Databricks

11. Other Books You May Enjoy

Deploying Azure Databricks in a VNet and accessing a secure storage account

In this recipe, you will learn how to deploy an Azure Databrick service in your own Virtual Network (VNet). Deploying Azure Databricks in a VNet enables you to connect to services such as Azure Storage over private endpoints. It also allows you to connect to on-premises data sources and restrict outgoing traffic. Control plane resources will be deployed to a Microsoft-managed VNet. Only data plane resources can be deployed in your own VNet.

Getting ready

Before you start this recipe, you need to create a VNet. To do so, follow the steps mentioned in the following article:

https://docs.microsoft.com/en-us/azure/virtual-network/quick-create-portal

Ensure you have created two subnets, including the IP range, with the names shown in the following screenshot in the VNet you have created. Provide CIDR ranges in a block up to /26 in size (for this recipe, since we are creating a small cluster) while providing...