Technical requirements
To follow along with the examples shown in the recipes, you will need to have the following:
- An Azure subscription and required permissions on the subscription, as mentioned in the Technical requirements section of Chapter 1, Creating an Azure Databricks Service.
- An Azure Databricks workspace with a Spark 3.x cluster. All the notebooks used in this chapter are executed on a Spark 3. 0.1 cluster.
- You can find the scripts for this chapter in the GitHub repository at https://github.com/PacktPublishing/Azure-Databricks-Cookbook/tree/main/Chapter07. The
Chapter07
folder contains all the notebooks, Python code, and a few Parquet files required for the demonstration.