research-article

Towards a content agnostic computable knowledge repository for data quality assessment

Authors:

Julio C. FacelliAuthors Info & Claims

Volume 177, Issue C

Pages 193 - 201

https://doi.org/10.1016/j.cmpb.2019.05.017

Published: 01 August 2019 Publication History

Hightlights

•

We identified research gaps in data quality literature towards automating DQA methods.

•

In this process, we designed, developed and implemented a computable data quality knowledge repository for assessing quality and characterizing data in health data repositories.

•

In this process, we leveraged service-oriented architecture towards a scalable, reproducible framework in disparate biomedical data sources.

Abstract

Background and objective

In recent years, several data quality conceptual frameworks have been proposed across the Data Quality and Information Quality domains towards assessment of quality of data. These frameworks are diverse, varying from simple lists of concepts to complex ontological and taxonomical representations of data quality concepts. The goal of this study is to design, develop and implement a platform agnostic computable data quality knowledge repository for data quality assessments.

Methods

We identified computable data quality concepts by performing a comprehensive literature review of articles indexed in three major bibliographic data sources. From this corpus, we extracted data quality concepts, their definitions, applicable measures, their computability and identified conceptual relationships. We used these relationships to design and develop a data quality meta-model and implemented it in a quality knowledge repository.

Results

We identified three primitives for programmatically performing data quality assessments: data quality concept, its definition, its measure or rule for data quality assessment, and their associations. We modeled a computable data quality meta-data repository and extended this framework to adapt, store, retrieve and automate assessment of other existing data quality assessment models.

Conclusion

We identified research gaps in data quality literature towards automating data quality assessments methods. In this process, we designed, developed and implemented a computable data quality knowledge repository for assessing quality and characterizing data in health data repositories. We leverage this knowledge repository in a service-oriented architecture to perform scalable and reproducible framework for data quality assessments in disparate biomedical data sources.

References

[1]

I.-G. Todoran, L. Lecornu, A. Khenchaf, J.-M. Le Caillec, A methodology to evaluate important dimensions of information quality in systems, J. Data Inf. Qual. 6 (2015) 11.

Hightlights

Abstract

Background and objective

Methods

Results

Conclusion

References

Cited By

Index Terms

Recommendations

A Model for Data Quality Assessment

Towards measuring test data quality

Data Quality Assessment and Improvement

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations