Chapter 11. Defining the ETL/ELT
Extraction, Transformation, and Loading or Extraction, Loading, and Transformation tools are very common on the market. Implementing a business intelligence and data warehouse project without using one of these tools is highly unlikely as they offer so many benefits. However, just because you implement one of these tools does not mean that there are some areas which are overlooked and not included in the framework. This chapter outlines some of those areas that are often overlooked but are essential within your ETL/ELT framework. The following recipes focus on building the key framework components to be included in each ETL/ELT mapping or process:
Abstracting your source system
Separating your extraction from your loading and transforming routines
Adding additional columns to facilitate error trapping and correction
Designing ETL error trapping, detection, and correction routines
Designing ETL data reconciliation routines
Designing a notification routine
