Monitoring Stream Processing

As you learned in Chapter 6, Developing a Stream Processing Solution, the two services that are most typically used in Azure for stream processing are Event Hubs (the service dedicated to providing a data stream) and Stream Analytics (the service dedicated to analyzing this data stream and providing some data points as a result). Monitoring stream processing will then consist of the collection and visualization of logs and metrics from these services.

Note

This section primarily focuses on the Monitor stream processing concept of the DP-203: Data Engineering on Microsoft Azure exam.

Start with Event Hubs to access your previously created Event Hubs namespace within the Azure portal. In this example, you will work with the previously created Event Hubs namespace, DP203EHNS.

Note

To create an Event Hubs namespace, DP203EHNS, refer to the steps in the Streaming Solution Using Event Hubs and ASA section of Chapter 6, Developing a Stream Processing...