Deployment, Execution, and Documentation Automation
In this chapter, you will learn how to automate the operation of your data platform by setting up environments and jobs that automate the release and execution of your code following your deployment design.
You will learn about the notification system to alert the relevant people when a job is canceled or fails, either because of an error or a test not passing and providing an error.
You will also learn about the documentation, lineage graph, and source data freshness dashboard, which is automatically generated from the metadata provided in the YAML files of the project.
In this chapter, you will learn about the following topics:
- Designing your deployment automation
- Advanced automation – hooks and run-operations
- Documentation
