Managing data errors

Data errors in the context of ODI refer to records that do not conform to a set of keys, constraints, references, and conditions that describe the values, patterns, uniqueness, and relationships we require of that data. Examples in the context of an Order Processing scenario include:

• An order where the customer ID is incorrect or missing

• An order where the customer ID exists and is correct, but the corresponding customer record has an incorrect or missing reference to a sales person or partner to whom we can pay commission as the source of the sale

What we're really dealing with here is a basic level of data quality enforcement.

Detecting and diverting data errors

The first step in managing errors of any kind is to identify when they arise and isolate their effects. When dealing with data quality we typically want data that does not comply with our quality rules to be temporarily diverted into some kind of holding area (occasionally called an "error hospital") where corrections...