Determining SLOs

We have already described the SLA-SLO-SLI paradigm in Chapter 2, Fundamentals of Data Observability. The agreements are individual (implicit or explicit) contracts between a producer and a consumer that set the requirements that the produced data has to meet in order to be considered healthy. The objectives are targets that the producer must meet in order to fulfill their agreements. Finally, indicators are means of gauging whether the objectives are respected or not.

But first, let’s see where SLOs can be added.

Project versus data source SLOs

The objectives can be set at different levels, depending on the needs of the stakeholders. Indeed, some objectives can be set at the project or pipeline level, and others at the data source level. You can see this at the micro and macroscopic level. Depending on the scope of responsibility you have, you may need to set the objective at one level or the other.

At the microscopic level, the objectives set on...