Summary
In this chapter, we covered the third “V” – velocity – in the “Four Vs” of data. We discussed the different real-time data sources and ways of ingesting them. We also looked at how to process this data in real time over smaller and larger periods. To analyze small chunks of streaming data, we used Azure Stream Analytics, while for time series analysis over larger periods of historic data, we used Azure Data Explorer. Optionally, machine learning models can be built on the Data Explorer data using Azure Machine Learning. Finally, data can be served in Cosmos DB or as real-time dashboards on Power BI.
In the next chapter, we will look at more recent technologies, such as generative AI, and the architecture needed to leverage this revolutionary AI technology.