Data Observability Elements

In the previous chapter, we covered the methods that can be used to collect observability metrics in the context of a data application. We will now focus on the observations themselves. What do you need to collect to keep the data application under control?

In the general observability paradigm, which involves collecting data, the application, and the application’s infrastructure, as described in Chapter 2, Fundamentals of Data Observability, we saw that observability metrics can be gathered from diverse sources. In Chapter 3, Data Observability Techniques, we learned how to extract information directly from data applications. In this chapter, we will focus on which metrics can be collected from the data application itself. We will list and describe all the elements that can be used as service-level indicators (SLIs) of the data. We will learn how to add SLIs in Chapter 4.

Using an open source library, based on the monkey patching methods presented...