Part 2 – Data Engineering Capabilities within Databricks
In this part, we will comprehensively explore advanced Databricks features, guiding you through orchestrating and scheduling data pipelines, building dynamic pipelines with Delta Live Tables, enforcing data governance with Unity Catalog, and integrating DataOps and DevOps practices. It offers practical, hands-on guidance for enhancing data engineering processes, ensuring data quality and compliance, and promoting a culture of continuous improvement within the Databricks ecosystem.
This part contains the following chapters:
- Chapter 8, Orchestration and Scheduling Data Pipeline with Databricks Workflows
- Chapter 9, Building Data Pipelines with Delta Live Tables
- Chapter 10, Data Governance with Unity Catalog
- Chapter 11, Implementing DataOps and DevOps on Databricks
...