Implementing control flow activities
In this recipe, we'll learn how to implement common control flow activities such as Get Metadata
, Filter
, ForEach
, and Stored Procedure
. Control flows help in building complex iterative and conditional logic to support data ingestion.
In this recipe, we'll implement the following scenario using control flow activities.
We have a data lake directory that contains multiple file formats, such as .txt
, .csv
, and .tif
. We need to copy .txt
files from the directory to another directory. We'll also maintain a log of the file copy operation in an Azure SQL Database table.
Getting ready
Before you start, do the following:
- Log into Azure from PowerShell. To do this, execute the following command and follow the instructions to log into Azure:
Connect-AzAccount
- Open https://portal.azure.com and log in using your Azure credentials.
How to do it…
Let's get started by creating the Azure SQL database...