Chapter 9. Analyzing the Data

Data discovery enables the identification of data discrepancies and business rules which are required to be implemented to enhance data quality. This chapter covers developing data discovery scripts to uncover data issues and gaps. The recipes for data discovery include the following:

• Building high and low data profiling scripts

• Building domain/distinct values profiling

• Building record count profiling scripts

• Building density data profiling scripts

• Building hierarchy data profiling scripts

• Building significant columns data profiling scripts

• Building data lengths data profiling scripts

• Building changing information data profiling scripts

• Building automated data profiling with Oracle Warehouse Builder

Introduction

Data profiling is an effective tool within a business intelligence and warehousing solution to gain a deeper understanding of the information. This process is undertaken to refine and validate assumptions about the information. Business rules are often defined...