Solution architecture

Now that the BI team has refined the requirements and a cloud platform has been chosen, it is time to come up with a secure and scalable design. The NIA business intelligence team went with the following solution architecture:

Figure 4.6: Solution architecture for NIA

The design in Figure 4.6 shows the solution architecture and the data flow between the individual components. Here's an explanation for each of the workflow segments, as marked (numbered) in the diagram:

1. Structured data such as Airlines Data, Custom Data, and Baggage Data is ingested using Azure Data Factory. This includes other data sources, such as data from the parking systems and weather data. ADF provides the ability for NIA to configure an integration runtime that can be used as a gateway to connect to NIA's on-premises data sources from within Azure.
2. All unstructured data, including IoT Sensors data, Traffic Video streaming, and Social Media...