Running SQL queries in Databricks SQL
SQL queries in Databricks SQL allows BI users or data analysts to create and run ad hoc SQL queries on data in a data lake and schedule the queries to run at regular intervals. BI users or analysts can create reports based on business requirements and it's easy for traditional BI users to be onboarded to Databricks SQL to write SQL queries and get a similar experience they are used to in on-prem databases.
Getting ready
Before starting, execute the following notebooks:
- https://github.com/PacktPublishing/Azure-Databricks-Cookbook/blob/main/Chapter06/6_1.Reading%20Writing%20to%20Delta%20Tables.ipynb.
Running the preceding notebook will create Customer and Orders external Delta tables.
- https://github.com/PacktPublishing/Azure-Databricks-Cookbook/blob/main/Chapter07/7.1-End-to-End%20Data%20Pipeline.ipynb
Running the preceding notebook will create the VehicleSensor-related Delta tables.
You need to create the SQL endpoints...
