Implementing data quality rules
The remainder of this chapter describes the end-to-end process of implementing data quality rules. This process is similar to any other IT implementation in that it has a design stage, a build stage, and a testing stage.
What is unique to data quality implementation work is the need to be ready to iterate. When a design is documented, you can feel that you have full confidence it is completely correct, and then in the build and test phases, you will find that the data requires additional subtleties in the rules that were previously unanticipated.
We will describe the implementation work in the following three sections.
Designing rules
The process of designing a data quality rule starts with the data discovery process outlined in Chapter 5. By the end of Chapter 5, we understood the business strategy and successfully linked it to the data that mattered. We profiled that data and learned about its values and patterns. The rule design phase...