Ongoing data quality rule improvement

Once a data quality initiative is completed and a set of valuable rules are in place, it is critical to maintain these. It would be wonderful if the rules could remain consistent for a few years at least, but in my experience, this is never the case. Some rules may stay consistent for 10 years, while others will change within months (or even weeks!) of being initially established. The rules that stay consistent for longer are generally those that address long-standing legislative requirements such as taxation. Those that change more regularly are those most closely tied to how the business operates.

For example, product data tends to evolve quite quickly. If you consider an organization that makes technology products such as mobile phones, the level of change will be high. For example, in 2010, the network capabilities of a phone were limited to 2G and 3G and a rule might have checked that every handset had one of these values. In 2023, 4G and...