Azure cloud big data services
Like Amazon and Google, Microsoft provides a full stack of big data cloud services, including the big data ETL service, ADF; the big data processing service tool, Azure HDInsight; and the big data analytic service, Azure Data Bricks.
Azure ADF
ADF is a cloud-based data integration service for creating data-driven workflows that automatically move and transform data. ADF is a pipeline – a logical grouping of activities to perform a data-driven task, such as the following:
- Data moving – This takes an ingestion source, pulls it into the Azure cloud, and puts it into a data lake
- Data transformation – This connects the data lake to Databricks, runs a stored procedure, and transforms data to produce a new dataset for further analytics
Essentially, ADF is a data ETL service integrating hybrid data at an enterprise level. More details about ADF are available at https://azure.microsoft.com/en-us/products/data-factory...