Orchestration and Control Flow

Azure Data Factory is an excellent tool for designing and orchestrating your Extract, Transform, Load (ETL) processes. In this chapter, we introduce several fundamental data factory concepts and guide you through the creation and scheduling of increasingly complex data-driven workflows. All the work in this chapter is done using the Microsoft data factory online portal. You’ll learn how to create and configure linked services and datasets, take advantage of built-in expressions and functions, and, most importantly, learn how and when to use the most popular Data Factory activities.

This chapter covers the following topics:

• Using parameters and built-in functions
• Using the Metadata and Stored Procedure activities
• Using the ForEach and Filter activities
• Chaining and branching activities within a pipeline
• Using the Lookup, Web, and Execute Pipeline activities
• Creating event-based pipeline triggers