Data flow

1. Data from semi-structured and structured sources is read using Azure Synapse pipelines and written into the bronze layer of the data lake.
2. Data is then moved between the bronze, silver, and gold layers using more pipelines.
3. Data from the Medallion storage system is used by Synapse Spark clusters or Synapse SQL pools to further conduct analytics on it.
4. Analytical data from Synapse is pushed to Cosmos DB and Azure Data Share and read by Power BI to expose the data to various consumers, such as applications, dashboards, and other teams.
5. The data in Cosmos DB can be searched using Azure AI Search through the mobile app or website.
6. Power BI surfaces the analytics in the form of dashboards.
7. Azure Data Share shares the data with external parties that need the data for their processing purposes.

Now, let’s look at some scenarios where this architecture can be applicable.