Summary

In this chapter, you gained an understanding of the application architecture for creating big data and intelligent solutions using Azure technologies. Azure provides several services and integrations that assist in developing big data pipelines that can ingest data in various forms and from different sources, consolidate the data, and ultimately convert it into a more acceptable form for human consumption. We can then build dashboards and visualizations using powerful tools, such as Power BI.

We then must consider that data might not always be from static sources, such as databases or files, but it might come in varied volumes and velocities from smart devices. These devices can send data based on different parameters, and the data might not be standardized or structured. In this case, we use IoT solutions and messaging systems to handle and react to the incoming event data from these devices.

After figuring out how to collate and aggregate big data, we need to apply...