Transforming Data on Azure
Azure offers a wide range of services for data processing. One of the key features of Azure is its ability to easily transform data from various sources into a format that is suitable for further analysis and reporting.
In this chapter, we will discuss the following:
- Designing data pipelines on Azure
- Transforming data on Azure
- Data transformation architectures
- Data transformations in data lake tiers
- Operationalizing data pipelines on Azure
This chapter will introduce the various tools and services available on Azure for data transformation, including Azure Data Factory, (ADF) Azure Stream Analytics, and Azure Databricks. We will explore the core features and capabilities of each service, and show in which scenarios they work best. In line with the previous chapter, the focus will be put on both batch processing and real-time processing.
Next, we will look at some example architectures and provide a quick guide on how to...