research-article

Free access

The Principles of Data-Centric AI

Authors:

Mohammad Hossein Jarrahi,

Ali Memariani,

Shion GuhaAuthors Info & Claims

Communications of the ACM, Volume 66, Issue 8

Pages 84 - 92

https://doi.org/10.1145/3571724

Published: 25 July 2023 Publication History

All formats PDF

Abstract

Uniting data-centric perspectives and concepts to trace the foundations of DCAI.

References

[1]

Ahmad, S., Lavin, A., Purdy, S., and Agha, Z. Unsupervised real-time anomaly detection for streaming data. Neurocomputing 262, (Nov. 2017), 134--147.

Crossref

Google Scholar

[2]

Amershi, S. et al. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conf. Human Factors in Computing Systems. ACM, New York, NY, USA, 1--13.

Google Scholar

[3]

Anandkumar, A. Data Augmentation. Data-centric AI Resource Hub, 2021; https://datacentricai.org/data-augmentation/

Google Scholar

[4]

Aragon, C., Guha, S., Kogan, M., Muller, M., and Neff, G. Human-Centered Data Science: An Introduction. MIT Press. Cambridge, MA, USA, 2022.

Google Scholar

[5]

Aroyo, L., Lease, M., Paritosh, P., and Schaekermann, M. Data excellence for AI: why should you care? Interactions 29, 2 (Feb. 2022), 66--69.

Digital Library

Google Scholar

[6]

Becht, E. et al. Dimensionality reduction for visualizing single-cell data using UMAP. Nat. Biotechnol. (Dec. 2018)

Crossref

Google Scholar

[7]

Bernstein, M. Labeling and crowdsourcing. Data-centric AI Resource Hub, 2022; https://datacentricai.org/

Google Scholar

[8]

Boehm, M., Kumar, A., and Yang, J. Data management in machine learning systems. Synthesis Lectures on Data Management 14, 1 (Feb. 2019), 1--173.

Crossref

Google Scholar

[9]

Buneman, P., Khanna, S., and Tan, W.C. Data provenance: Some basic issues. In Proceedings of Foundations of Software Technology and Theoretical Computer Science. Springer Berlin Heidelberg, 2000, 87--93.

Google Scholar

[10]

Chancellor, S., Baumer, E.P.S., and De Choudhury. M. Who is the "human" in human-centered machine learning? In Proceedings of the ACM Hum. Comput. Interact. 3, (Nov. 2019), 1--32.

Digital Library

Google Scholar

[11]

Chen, A. et al. Developments in MLflow: A system to accelerate the machine learning lifecycle. In Proceedings of the 4^th Intern. Workshop on Data Management for End-to-End Machine Learning, 2020. ACM, New York, NY, USA, 1--4.

Digital Library

Google Scholar

[12]

DVC. Open-source version control system for machine learning projects. iterative.ai., 2022; https://dvc.org/

Google Scholar

[13]

Ehsan, U. and Riedl, M.O Human-centered explainable AI: Towards a reflective sociotechnical approach. HCI International 2020---Late Breaking Papers: Muttimodatity and Intelligence. Springer International Publishing, 449--466.

Google Scholar

[14]

Feinberg, M. A design perspective on data. In Proceedings of the 2017 Conf. Human Factors in Computing Systems. ACM, New York, NY, USA, 2952--2963.

Google Scholar

[15]

Frid-Adar, M., Klang, E., Amitai, M., Goldberger, J., and Greenspan, H. Synthetic data augmentation using GAN for improved liver lesion classification. In Proceedings of the 15^th IEEE Intern. Symp. Biomedical Imaging. 2018, 289--293.

Crossref

Google Scholar

[16]

Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J.W., Wallach, H., Daumé III, H., and Crawford, K. Datasheets for datasets. Commun. ACM 64, 11 (Nov. 2021), 86--92.

Digital Library

Google Scholar

[17]

Gordon, M.L., Zhou, K., Patel, K., Hashimoto, T., and Bernstein, M.S. The disagreement deconvolution: Bringing machine learning performance metrics in line with reality. In Proceedings of the 2021 Conf. Human Factors in Computing Systems. ACM, New York, NY, USA, 1--14.

Google Scholar

[18]

Gray, M.L. and Suri, S. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Houghton Mifflin Harcourt, 2019.

Google Scholar

[19]

Jarrahi, M.H., Savage, S., and Lease, M. Driving fairness in digital labor platforms. In Proceedings Against Platform Determinism Workshop. Data & Society, 2021.

Google Scholar

[20]

Kurban, H., Sharma, P., and Dalkilic, M. Data expressiveness and its use in data-centric AI. In Proceedings of NeurIPS Data-Centric AI Workshop. 2021.

Google Scholar

[21]

Lavitas, L., Redfield, O., Lee, A., Fletcher, D., Eck, M., and Janardhanan, S. Annotation quality framework-accuracy, credibility, and consistency. In Proceedings of NeurIPS Data-Centric AI Workshop. 2021; https://bit.ly/3H9vtuT

Google Scholar

[22]

Lee, N.T., Resnick, P., and Barton, G. Algorithmic bias detection and mitigation: Best practices and policies to reduce consumer harms. Center for Technology Innovation, Brookings. Tillgänglig online, 2019; https://bit.ly/3LoyJ7l.

Google Scholar

[23]

Lee, Y., Kwon, O.J., Lee, H., Kim, J., Lee, K., and Kim, K.E. Augment & valuate: A data enhancement pipeline for data-centric AI. NeurIPS Data-Centric AI Workshop. 2021; http://arxiv.org/abs/2112.03837

Google Scholar

[24]

Liu, A., Soderland, S., Bragg, J., Lin, C.H., Ling, X., and Weld, D.S. Effective crowd annotation for relation extraction. In Proceedings of the 2016 Conf. North American Chapter of the ACL: Human Language Technologies. Assoc. Comput. Linguistics (San Diego, CA, USA, 2016), 897--906.

Crossref

Google Scholar

[25]

Lombard, M., Snyder-Duch, J., and Bracken, C.C. Content analysis in mass communication: Assessment and reporting of intercoder reliability. Hum. Commun. Res. 28, 4 (Oct. 2002), 587--604.

Crossref

Google Scholar

[26]

Mattson, P. and Paritosh, P. DataPerf: Benchmarking data for better ML. In Proceedings of the 35^th Conf. Neural Information Processing Systems. 2021; https://bit.ly/3Lx1Mqx

Google Scholar

[27]

Miranda, L. Towards data-centric machine learning: a short review. Lj Miranda's Blog. 2021; https://bit.ly/41EwAuT

Google Scholar

[28]

Motamedi, M., Sakharnykh, N., and Kaldewey, T. A data-centric approach for training deep neural networks with less data. In Proceedings of the 35^th Conf. Neural Information Processing Systems. 2021; http://arxiv.org/abs/2110.03613

Google Scholar

[29]

Ng, A. A chat with Andrew on MLOps: From model-centric to data-centric AI. 2021; https://www.youtube.com/watch?v=06-AZXmwHjo&t=2109s

Google Scholar

[30]

Ng, A., Laird, D., and He, L. Data-centric AI competition. Data-centric AI Resource Hub, 2021; https://https-deeplearning-ai.github.io/data-centric-comp/

Google Scholar

[31]

Passi, S. and Jackson, S. Data vision: Learning to see through algorithmic abstraction. In Proceedings of the 2017 ACM Conf. Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 2436--2447.

Google Scholar

[32]

Pine, K.H. and Liboiron, M. The politics of measurement and action. In Proceedings of the 33^rd Annual ACM Conf. Human Factors in Computing System. ACM, New York, NY, USA, 2015, 3147--3156.

Digital Library

Google Scholar

[33]

Polyzotis, N. and Zaharia, M. What can data-centric AI learn from data and ML engineering? 2021, arXi; http://arxiv.org/abs/2112.06439

Google Scholar

[34]

Rother, C., Kolmogorov, V., and Blake, A. GrabCut. ACM Trans. Graph. 23, 3 (Aug. 2004), 309--314.

Digital Library

Google Scholar

[35]

Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., and Aroyo, L.M. 'Everyone wants to do the model work, not the data work:' Data cascades in high-stakes AI. In Proceedings of the ACM Conf. Human Factors in Computing Systems. ACM, New York, NY, USA, 2021, 11--15.

Digital Library

Google Scholar

[36]

Sambasivan, N. and Veeraraghavan, R. The deskilling of domain expertise in AI development. In Proceedings of the 2022 ACM Conf. Human Factors in Computing Systems. ACM, New York, NY, USA

Digital Library

Google Scholar

[37]

Sculley, D. A data-centric view of technical debt in AI. Data-centric AI Resource Hub. 2022; https://datacentricai.org/data-in-deployment/

Google Scholar

[38]

Shneiderman, B. Human-Centered AI. Oxford University Press, 2022.

Google Scholar

[39]

Subramonyam, H., Seifert, C., and Adar, M.I.E. How can human-centered design shape data-centric AI? In Proceedings of NeurIPS Data-Centric AI Workshop. 2021; https://haridecoded.com/resources/AIX_NeurIPS_2021.pdf

Google Scholar

Cited By

View all

Jung SJeon JPark JKim J(2024)A Data-Centric AI Approach to Extend ODD of Autonomous DrivingTransaction of the Korean Society of Automotive Engineers10.7467/KSAE.2024.32.3.28932:3(289-294)Online publication date: 1-Mar-2024
https://doi.org/10.7467/KSAE.2024.32.3.289
Brayner ACarvalho ARuiz DOgasawara E(2024)Um Farol para Criação e Avaliação de Cursos de Ciência de Dados: Os Referenciais Curriculares da SBCAnais do IV Simpósio Brasileiro de Educação em Computação (EDUCOMP 2024)10.5753/educomp.2024.237484(266-272)Online publication date: 22-Apr-2024
https://doi.org/10.5753/educomp.2024.237484
Majeed AHwang S(2024)A Data-Centric AI Paradigm for Socio-Industrial and Global ChallengesElectronics10.3390/electronics1311215613:11(2156)Online publication date: 1-Jun-2024
https://doi.org/10.3390/electronics13112156
Show More Cited By

Index Terms

The Principles of Data-Centric AI

Recommendations

Towards Design Principles for User-Centric Explainable AI in Fraud Detection
Artificial Intelligence in HCI
Abstract
Experts rely on fraud detection and decision support systems to analyze fraud cases, a growing problem in digital retailing and banking. With the advent of Artificial Intelligence (AI) for decision support, those experts face the black-box problem ...
Principles of Noology: Toward a Theory and Science of Intelligence
AI ethics: from principles to practice
Abstract
Much of the current work on AI ethics has lost its connection to the real-world impact by making AI ethics operable. There exist significant limitations of hyper-focusing on the identification of abstract ethical principles, lacking effective ...

Comments

Information & Contributors

Information

Published In

Communications of the ACM Volume 66, Issue 8

August 2023

106 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/3610954

Editor:
James Larus
Association for Computing Machinery, New York, NY

Issue’s Table of Contents

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2023

Published in CACM Volume 66, Issue 8

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
1,977
Total Downloads

Downloads (Last 12 months)1,416
Downloads (Last 6 weeks)158

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Jung SJeon JPark JKim J(2024)A Data-Centric AI Approach to Extend ODD of Autonomous DrivingTransaction of the Korean Society of Automotive Engineers10.7467/KSAE.2024.32.3.28932:3(289-294)Online publication date: 1-Mar-2024
https://doi.org/10.7467/KSAE.2024.32.3.289
Brayner ACarvalho ARuiz DOgasawara E(2024)Um Farol para Criação e Avaliação de Cursos de Ciência de Dados: Os Referenciais Curriculares da SBCAnais do IV Simpósio Brasileiro de Educação em Computação (EDUCOMP 2024)10.5753/educomp.2024.237484(266-272)Online publication date: 22-Apr-2024
https://doi.org/10.5753/educomp.2024.237484
Majeed AHwang S(2024)A Data-Centric AI Paradigm for Socio-Industrial and Global ChallengesElectronics10.3390/electronics1311215613:11(2156)Online publication date: 1-Jun-2024
https://doi.org/10.3390/electronics13112156
Ciardi TNihar AChawla RAkanbi OTripathi PWu YChaudhary VFrench R(2024)Materials data science using CRADLE: A distributed, data-centric approachMRS Communications10.1557/s43579-024-00616-6Online publication date: 29-Jul-2024
https://doi.org/10.1557/s43579-024-00616-6
Olari VRomeike R(2024)Data-related practices for creating Artificial Intelligence systems in K-12Proceedings of the 19th WiPSCE Conference on Primary and Secondary Computing Education Research10.1145/3677619.3678115(1-10)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3677619.3678115
Pina DChapman AKunstmann Lde Oliveira DMattoso M(2024)DLProv: A Data-Centric Support for Deep Learning Workflow AnalysesProceedings of the Eighth Workshop on Data Management for End-to-End Machine Learning10.1145/3650203.3663337(77-85)Online publication date: 9-Jun-2024
https://dl.acm.org/doi/10.1145/3650203.3663337
Heck PBosch JLewis GCleland-Huang JMuccini H(2024)What About the Data? A Mapping Study on Data Engineering for AI SystemsProceedings of the IEEE/ACM 3rd International Conference on AI Engineering - Software Engineering for AI10.1145/3644815.3644954(43-52)Online publication date: 14-Apr-2024
https://dl.acm.org/doi/10.1145/3644815.3644954
Haque MSaxena DWeathington KChudzik JGuha S(2024)Are We Asking the Right Questions?: Designing for Community Stakeholders’ Interactions with AI in PolicingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642738(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642738
McConvey KGuha S(2024)"This is not a data problem": Algorithms and Power in Public Higher Education in CanadaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642451(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642451
Moon EGuha S(2024)A Human-Centered Review of Algorithms in Homelessness ResearchProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642392(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642392
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Towards Design Principles for User-Centric Explainable AI in Fraud Detection

Principles of Noology: Toward a Theory and Science of Intelligence

AI ethics: from principles to practice

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations