The Practitioner's Guide to Data Quality Improvement (The MK/OMG Press) [Paperback]

Some of the other reviews that have been posted here provide some interesting observations from perspectives that are not always centered on data architecture or general enterprise architecture, and the hope of this reviewer is that he will be able to offer feedback to others on this text based on his consulting experience in these areas. In his preface, David Loshin comments that "this book is intended to provide the fundamentals for developing the enterprise data quality program, and is intended to guide both the manager and the practitioner in establishing operational data quality control throughout an organization, with particular focus on the ability to build a business case for instituting a data quality program", "the assessment of levels of data quality maturity", "the guidelines and techniques for evaluating data quality and identifying metrics related to the achievement of business objectives", "the techniques for measuring, reporting, and taking action based on these metrics", and "the policies and processes used in exploiting data quality tools and technologies for data quality improvement".

With these goals in mind, this reviewer thinks Loshin succeeded in this effort. Taking into account the fact that data quality is an enormous practice area, and success requires understanding of both data and the business to succeed, this introductory text walks the reader step-by-step through a considerable number of topics over which many authors would likely stumble. Some of the explanations that Loshin provides, such as the one in the chapter entitled "Developing a Business Case and a Data Quality Road Map" on how data flaws can incur business impacts, are extremely well done, especially when married with effective diagrams. And in his chapter entitled "Metrics and Performance Improvement", the author provides an explanation on drilling through key performance indicators that this reviewer has not seen elsewhere until this effort, and the presentation is exceedingly well done. Other areas of this text that this reviewer especially appreciates are the chapters entitled "Data Requirements Analysis", "Metadata and Data Standards", and "Inspection, Monitoring, Auditing, and Tracking".

This reviewer however would like to make potential readers of this book aware that most of what Loshin provides here is high level walkthroughs and examples of pertinent elements within data quality, rather than practical advice on how to approach much of the lower level work that should be expected to take place on a day-to-day basis. For example, in the chapter entitled "Entity Identity Resolution", the author provides a section on matching algorithms that briefly discusses parsing and standardization, abbreviation expansion, edit distance, phonetic comparison, and n-gramming, which consumes just a few short paragraphs. The author does not explain that there are many more matching algorithms currently in use in industry, that in most cases matching exercises need to take into account multiple rather than single algorithms in isolation, that in the world today internationalization takes an ever more important role when performing matching, and that there is a wide variety of commercial tooling available that needs to be assessed based on the needs of the organization.

However, armed with this knowledge the reader is sure to make use of this work by utilizing it while planning and strategizing data quality, as well as making use of it as introductory material to understanding what it might take to pursue efforts that require a higher level of data quality maturity such as master data management (MDM), in which case this reviewer recommends "Enterprise Master Data Management: An SOA Approach to Managing Core Information" by Allen Dreibelbis, Eberhard Hechler, Ivan Milman, Martin Oberhofer, Paul van Run, and Dan Wolfson (see my review). In the opinion of this reviewer, what Loshin provides here is best suited for managers looking to piece together all of the steps associated with data quality pursuits as well as get a better handle on how each of the steps are interrelated and whether each is a requirement or just an option, possibly looking to solve some aspects of data quality in an evolutionary, piecemeal fashion rather than revolutionary endeavor.

David Loshin's new book, The Practitioner's Guide to Data Quality Improvement, is well-organized, helpful, and on topic. One of my pet peeves is the poor state of data quality rampant just about everywhere these days... and Loshin's text offers expert guidance on how organizations can remedy that situation.

The book provides a comprehensive look at data quality from both a business and IT perspective. It does not just cover technology issues, but discusses people, process, and technology. And that is important, because this is the mix that is needed in order to initiate any type of quality improvement regimen.

In the book, Loshin shows how to institute and run a data quality program, from start to finish. And this is all helpful information. But I think my favorite chapter of the book is the one on Data Quality Service Level Agreements. This is so because data quality is not a project that can be started and completed. It needs to become an on-going component of our everyday procedures. And only through adopting a service level agreement mentality when it comes to data quality can we ever hope to make data quality monitoring and improvement an accepted, regular component of what we do.

Wow, is this book detailed. The first several chapter are hard to get through because he's laying the foundation for the details later in the book. As I read it, I had a hard time relating to much of the information and ideas presented. I think this is due to my limited exposure and viewpoint as compared to the author's seemingly total understanding of Data Quality. He's talking in very broad and high level terms of databases, master data sets, etc while I'm just thinking of specific types of data such as service levels, outage reports, etc. Overall, a good book if you can muster through it.