Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Learning Hub

Conferences

Free Learning

You're reading from Hands-On Data Warehousing with Azure Data Factory ETL techniques to load and transform data from various sources, both on-premises and on cloud

Product type Paperback

Published in May 2018

Publisher Packt

ISBN-13 9781789137620

Length 284 pages

Edition 1st Edition

Languages

SQL

Tools

Azure

Concepts

Big Data

Authors (3):

Christian Cote

Giuseppe Ciaburro

Michelle Gutzait

View More author details

Table of Contents (8) Chapters

Preface

1. The Modern Data Warehouse FREE CHAPTER

2. Getting Started with Our First Data Factory

3. SSIS Lift and Shift

4. Azure Data Lake

5. Machine Learning on the Cloud

6. Introduction to Azure Databricks

7. Reporting on the Modern Data Warehouse

The Modern Data Warehouse

Azure Data Factory (ADF) is a service that is available in the Microsoft Azure ecosystem. This service allows the orchestration of different data loads and transfers in Azure.

Back in 2014, there were hardly any easy ways to schedule data transfers in Azure. There were a few open source solutions available, such as Apache Falcon and Oozie, but nothing was easily available as a service in Azure. Microsoft introduced ADF in public preview in October 2014, and the service went to general availability in July 2015.

The service allows the following actions:

Copying data from various sources and destinations
Calling various computation services, such as HDInsight and Azure data warehouse data transformations
Orchestrating the preceding activities using time slices and retrying the activities when there is an error

All these activities were available via the Azure portal at first, and in Visual Studio 2013 before general availability (GA).

You have been reading a chapter from

Hands-On Data Warehousing with Azure Data Factory

Published in: May 2018

Publisher: Packt

ISBN-13: 9781789137620

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $19.99/month. Cancel anytime

Authors (3)

Cote

Christian Cote is an IT professional with more than 15 years of experience working in a data warehouse, Big Data, and business intelligence projects. Christian developed expertise in data warehousing and data lakes over the years and designed many ETL/BI processes using a range of tools on multiple platforms. He's been presenting at several conferences and code camps. He currently co-leads the SQL Server PASS chapter. He is also a Microsoft Data Platform Most Valuable Professional (MVP).

See other products by Cote

Michelle Gutzait

Michelle Gutzait has been in IT for 30 years as a developer, business analyst, and database

See other products by Michelle Gutzait

Giuseppe Ciaburro

Giuseppe Ciaburro holds a PhD and two master's degrees. He works at the Built Environment Control Laboratory - Università degli Studi della Campania "Luigi Vanvitelli". He has over 25 years of work experience in programming, first in the field of combustion and then in acoustics and noise control. His core programming knowledge is in MATLAB, Python and R. As an expert in AI applications to acoustics and noise control problems, Giuseppe has wide experience in researching and teaching. He has several publications to his credit: monographs, scientific journals, and thematic conferences. He was recently included in the world's top 2% scientists list by Stanford University (2022).

See other products by Giuseppe Ciaburro