Sending telemetry to other consumers
It is common for the data collected by observability systems to be of use in other systems. Logs are often used in SIEM systems and aggregate metrics are of interest in BI systems. There are two different strategies that can be used to share telemetry with other consumers:
- Sharing data in the collection pipeline: Sharing data in the collection pipeline is dependent on the data collection pipeline being used. We’ve talked a lot about the OpenTelemetry collector, which offers the ability to filter and send data to multiple backend systems. Similarly, AWS, GCP, and Azure offer options for writing telemetry to multiple backend systems. A consideration is that this type of solution will increase costs by storing multiple copies of the same data. Spending time with other consumers to understand their needs to minimize this cost is advised.
- Querying data from Grafana directly: Querying data from Grafana is done using a scheduled job...
