Summary
In this chapter, you explored many operational topics and were exposed to the best practices for SLA setting and management for important contract terms. Data contracts were defined, and references were provided for further reading. All of this led to the development of quality data factory outputs. Solution monitoring with observability was stressed and the necessary capabilities were elaborated upon. You were also exposed to the essential need for data anomaly detection so that you can detect data drift and gross data errors before they get into the factory’s curated data product. Lastly, you saw how blue/green deployment versus other release practices affect the data in the factory and why operational tradeoffs will have to be negotiated with the software developers as part of your data engineering solution.
In the next chapter, you will be provided with best practices to build out the framework for your data services.
