Connecting to cloud object storage using Unity Catalog

Databricks Unity Catalog allows you to manage and access data in cloud object storage using a unified namespace and a consistent set of APIs. With Unity Catalog, you can do the following:

• Create and manage storage credentials, external locations, storage locations, and volumes using SQL commands or the Unity Catalog UI
• Access data from various cloud platforms (AWS S3, Azure Blob Storage, or Google Cloud Storage) and storage formats (Parquet, Delta Lake, CSV, or JSON) using the same SQL syntax or Spark APIs
• Apply fine-grained access control and data governance policies to your data using Databricks SQL Analytics or Databricks Runtime

In this recipe, you will learn what Unity Catalog is and how it integrates with AWS S3.

Getting ready

Before you start setting up and configuring Unity Catalog, you need to have the following prerequisites:

• A Databricks workspace with administrator privileges
...