Audit Transformation: logging in Data Flow
When you run SSIS packages through the SSDT environment it's possible to see any unexpected errors, the tasks and components that are currently executing, and the data that is moving within the pipeline, all in real time. All this gives us the impression that everything is under control. In the real world, however, SSIS packages run in batch mode and it's very difficult to know what is happening if the logs are not activated and used.
SSIS provides an automatic logging system that is shown in Chapter 11, Event Handling and Logging, and also provides several system variables that could be used to store extra information about the tasks that are running!
Getting ready
To get ready for this recipe, use the following steps:
Open SQL Server Data Tools (SSDT) and create a new SSIS project.
Provide a name and a location for the SSIS project and proceed.
Select the package created by default and rename it to
P01_Audit.dtsx
.
How to do it...
Consider a Data Warehousing...