Azure services

The following sections will elaborate on each of the Azure services that are shown in the solution design of Figure 4.1. For each service, it will first explain why this component is needed, then why Azure services are fit for purpose for Coolies, and then finally show a brief practical example of the core part of the implementation.

Azure Data Lake Storage Gen2

Role in the design

Azure Data Lake Storage Gen2 works as Coolies' central data store. This enables Coolies to bring massive amounts of data from varying sources together. Moreover, the type and format of Coolies' datasets vary significantly (structured, semi-structured, and unstructured), which requires a more capable data store than mere tabular storage, which is where Azure Data Lake Storage Gen2 is needed. Azure Data Lake Storage Gen2 can store schema-less data as blobs and can handle varying formats (for instance, text files, images, videos, social media feeds, and zipped files). The ability...