Implementing data observability
A data mesh is about converting data into a product and applying the application management and monitoring concepts to data. While application observability has evolved and matured over time, today, we have mature monitoring and observability tools and products. However, data observability is a relatively new concept since data as a product is a new concept. Data observability is the ability of an organization to know the health and performance of its data. It is a combination of all the governance aspects covered so far in this chapter and some monitoring. It is important to tie all these governance aspects into a monitoring system that will help maintain the health, performance, and quality of your data. Figure 4.7 shows how the various monitoring aspects become a part of the data observability framework:
Figure 4.7 – Data observability
Some monitoring aspects can be automated. For example, data quality alerts can...
