Data Quality: The Accuracy Dimension is about assessing the quality of corporate data and improving its accuracy using the data profiling method. Corporate data is increasingly important as companies continue to find new ways to use it. Likewise, improving the accuracy of data in information systems is fast becoming a major goal as companies realize how much it affects their bottom line. Data profiling is a new technology that supports and enhances the accuracy of databases throughout major IT shops. Jack Olson explains data profiling and shows how it fits into the larger picture of data quality. * Provides an accessible, enjoyable introduction to the subject of data accuracy, peppered with real-world anecdotes. * Provides a framework for data profiling with a discussion of analytical tools appropriate for assessing data accuracy. * Is written by one of the original developers of data profiling technology. * Is a must-read for any data management staff, IT management staff, and CIOs of companies with data assets.
Inhaltsverzeichnis
1;Front Cover;1 2;Data Quality: The Accuracy Dimension;4 3;Copyright Page;5 4;Contents;10 5;Foreword;8 6;Preface;16 7;Part I: Understanding Data Accuracy;20 7.1;Chapter 1. The Data Quality Problem;22 7.1.1;1.1 Data Is a Precious Resource;22 7.1.2;1.2 Impact of Continuous Evolution of Information Systems;24 7.1.3;1.3 Acceptance of Inaccurate Data;27 7.1.4;1.4 The Blame for Poor-Quality Data;28 7.1.5;1.5 Awareness Levels ;29 7.1.6;1.6 Impact of poor-Quality Data;31 7.1.7;1.7 Requirements for Making Improvements;33 7.1.8;1.8 Expected Value Returned for Quality program;34 7.1.9;1.9 Data Quality Assurance Technology;35 7.1.10;1.10 Closing Remarks;41 7.2;Chapter 2. Definition of Accurate Data;43 7.2.1;2.1 Data Quality Definitions;43 7.2.2;2.2 Principle of Unintended Uses ;46 7.2.3;2.3 Data Accuracy Defined;48 7.2.4;2.4 Distribution of Inaccurate Data;51 7.2.5;2.5 Can Total Accuracy Be Achieved?;53 7.2.6;2.6 Finding Inaccurate Values;54 7.2.7;2.7 How Important Is It to Get Close?;59 7.2.8;2.8 Closing Remarks;60 7.3;Chapter 3. Sources of Inaccurate Data;62 7.3.1;3.1 Initial Data Entry;63 7.3.2;3.2 Data Accuracy Decay;69 7.3.3;3.3 Moving and Restructuring Data;71 7.3.4;3.4 Using Data;81 7.3.5;3.5 Scope of Problems;82 7.3.6;3.6 Closing Remarks;83 8;Part II: Implementing a Data Quality Assurance Program;84 8.1;Chapter 4. Data Quality Assurance;86 8.1.1;4.1 Goals of a Data Quality Assurance Program;87 8.1.2;4.2 Structure of a Data Quality Assurance Program;88 8.1.3;4.3 Closing Remarks ;97 8.2;Chapter 5. Data Quality Issues Management;99 8.2.1;5.1 Turning Facts into Issues;100 8.2.2;5.2 Assessing Impact;104 8.2.3;5.3 Investigating Causes;106 8.2.4;5.4 Developing Remedies;113 8.2.5;5.5 Implementing Remedies;118 8.2.6;5.6 Post-implementation Monitoring;118 8.2.7;5.7 Closing Remarks;120 8.3;Chapter 6. The Business Case for Accurate Data;122 8.3.1;6.1 The Value of Accurate Data;122 8.3.2;6.2 Costs Associated with Achieving Accurate Data;127 8.3.3;6.3 Building the Business Case;127 8
.3.4;6.4 Closing Remarks;137 9;Part III: Data Profiling Technology ;138 9.1;Chapter 7. Data Profiling Overview;140 9.1.1;7.1 Goals of Data Profiling;141 9.1.2;7.2 General Model;142 9.1.3;7.3 Data Profiling Methodology;149 9.1.4;7.4 Analytical Methods Used in Data Profiling;155 9.1.5;7.5 When Should Data Profiling Be Done?;159 9.1.6;7.6 Closing Remarks;160 9.2;Chapter 8. Column Property Analysis;162 9.2.1;8.1 Definitions;162 9.2.2;8.2 The Process for Profiling Columns;171 9.2.3;8.3 Profiling Properties for Columns;174 9.2.4;8.4 Mapping with Other Columns;186 9.2.5;8.5 Value-Level Remedies;188 9.2.6;8.6 Closing Remarks;190 9.3;Chapter 9. Structure Analysis;192 9.3.1;9.1 Definitions;192 9.3.2;9.2 Understanding the Structures Being Profiled;206 9.3.3;9.3 The Process for Structure Analysis;207 9.3.4;9.4 The Rules for Structure;212 9.3.5;9.5 Mapping with Other Structures;229 9.3.6;9.6 Structure-Level Remedies;231 9.3.7;9.7 Closing Remarks;232 9.4;Chapter 10. Simple Data Rule Analysis;234 9.4.1;10.1 Definitions;235 9.4.2;10.2 The Process for Analyzing Simple Data Rules;239 9.4.3;10.3 Profiling Rules for Single Business Objects;244 9.4.4;10.4 Mapping with Other Applications;249 9.4.5;10.5 Simple Data Rule Remedies;251 9.4.6;10.6 Closing Remarks;254 9.5;Chapter 11.Complex Data Rule Analysis;256 9.5.1;11.1 Definitions;256 9.5.2;11.2 The Process for Profiling Complex Data Rules;257 9.5.3;11.3 Profiling Complex Data Rules;259 9.5.4;11.4 Mapping with Other Applications;263 9.5.5;11.5 Multiple-Object Data Rule Remedies;264 9.5.6;11.6 Closing Remarks;264 9.6;Chapter 12. Value Rule Analysis;265 9.6.1;12.1 Definitions;265 9.6.2;12.2 Process for Value Rule Analysis;266 9.6.3;12.3 Types of Value Rules;268 9.6.4;12.4 Remedies for Value Rule Violations;271 9.6.5;12.5 Closing Remarks;272 9.7;Chapter 13. Summary;274 9.7.1;13.1 Data Quality Is a Major Issue for Corporations;274 9.7.2;13.2 Moving to a Position of High Data Quality Requires an Explicit Effort;275 9.7.3;13.3 Data Accuracy Is
the Cornerstone for Data Quality Assurance;276 10;Appendix A. Examples of Column Properties , Data Structure, Data Rules , and Value Rules;279 10.1;A.1 Business Objects;279 10.2;A.2 Tables;279 10.3;A.3 Column Properties;282 10.4;A.4 Structure Rules;285 10.5;A.5 Simple Data Rules;288 10.6;A.6 Complex Data Rules;289 10.7;A.7 Value Rules;290 11;Appendix B. Content of a Data Profiling Repository;291 11.1;B.1 Schema Definition;291 11.2;B.2 Business Objects;291 11.3;B.3 Domains;292 11.4;B.4 Data Source;292 11.5;B.5 Table Definitions;293 11.6;B.6 Synonyms;295 11.7;B.7 Data Rules;296 11.8;B.8 Value Rules;296 11.9;B.9 Issues;297 12;References;298 12.1;Books on Data Quality Issues;298 12.2;Books on Data Quality Technologies;298 12.3;Articles;300 13;Index;302 14;About the Author;313