Piecing it all together
When a pipeline goes down or a resource is reaching its limit and needs to be configured to scale further, you need to act quickly. In order to do so, you need to know where to look for the diagnostics and investigate the situation. Hence, it’s very important that the monitoring system is centralized to a single pane of glass that everyone can look at. This single pane of glass should be the data mesh portal. All of the dashboards and the alert management system should be brought to the portal with granular access rights defined to have access to different levels. The higher-level dashboard should only be visible to the data mesh ops team. Individual landing zone dashboards should also be accessible to the concerned landing zone team but not to any other landing zone team. These access levels can also be easily set if everything is in one place.
