Integrating Databricks with Azure Key Vault
Azure Key Vault is a useful service for storing keys and secrets that are used by various other services and applications. It is important to integrate Azure Key Vault with Databricks, as you could store the credentials of objects such as a SQL database or data lake inside the key vault. Once integrated, Databricks can reference the key vault, obtain the credentials, and access the database or data lake account. In this recipe, we will cover how you can integrate Databricks with Azure Key Vault.
Getting ready
Create a Databricks workspace and a cluster as explained in the Configuring the Azure Databricks environment recipe of this chapter.
Log in to portal.azure.com, click Create a resource, search for Key Vault, and click Create. Provide the key vault details, as shown in the following screenshot, and click Review + create:
Figure 7.9 – Creating a key vault
How to do it…
Perform the following...