Static and dynamic elements
First, let’s focus on what we consider as a data observability element in this case. A data observability element is a piece of data you can retrieve from the running application that aims to make the pipeline observable. If it can be monitored, the same element can then become a SLI.
It’s important to make a clear distinction between two categories of observations: static and dynamic.
The set of static elements represents the assets, whereas the set of dynamic elements represents the usages of those assets. For instance, the application will be ranged in the static category, while the application will be run in the dynamic one.
The static elements correspond to all the observations that can be manually reported by a human documenting their data usage because they represent assets that are located and (virtually) accessible and can used or reused. Dynamic observations are often linked to the execution or usage of static elements and...