Adding additional columns to facilitate error trapping and correction
Error detection, trapping, and correction are complex operations within the business intelligence and data warehouse solution. Adding them into ETL/ELT slows down the performance of the mappings and process flows. For this reason, it is recommended to add columns to the tables and mappings in order to detect, trap, and correct errors post mapping or process flow.
Getting ready
Identify all the fact tables within the data model, and understand their natural or business keys.
How to do it...
In a business intelligence or data warehouse solution, fact tables normally use surrogate keys (system generated columns to replace business or natural keys) to link dimensional information. Once information in the fact tables is processed, it is hard to relate records with errors back to the dimensional information:
1. Identify all the dimensions which relate to the fact tables and determine the business or natural keys.
2. Include these...