Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3617694.3623228acmconferencesArticle/Chapter ViewAbstractPublication PageseaamoConference Proceedingsconference-collections
research-article
Open access

Power and Public Participation in AI

Published: 30 October 2023 Publication History

Abstract

The rapid growth of AI in contemporary life has outpaced the public participation necessary for society to determine how these technologies should be used. As scholars respond to this challenge by exploring new modes of public participation in AI, we help advance these efforts by introducing influential work from public planning scholarship, the Ladder of Citizen Participation, as an analytical lens to help compare and contrast power in this work. We used the ladder to analyze participatory approaches to AI development in recent scholarship, finding that most of this work informs or consults rather than partners with or delegates control to participants. We also found that papers frequently reflect a writing style that makes it difficult to ascertain the degree of power afforded. We discuss implications from our work for powerholders (developers, researchers, practitioners) offering participatory approaches to AI and for people (specific communities, stakeholders, general public) participating in those processes.

References

[1]
2021. Stop LAPD Spying Coalition. https://stoplapdspying.org/ [Online; accessed 2021-09-07].
[2]
2022. About | #MoreThanCode. https://morethancode.cc/about/ [Online; accessed 2021-09-07].
[3]
2022. Data 4 Black Lives | About Us. https://d4bl.org/about.html [Online; accessed 2022-09-07].
[4]
2022. Design Justice Network. https://designjustice.org/ [Online; accessed 2022-09-07].
[5]
2022. Minderoo Initiative – UCLA Center for Critical Internet Inquiry. https://www.c2i2.ucla.edu/minderoo-initiative/ [Online; accessed 2022-09-07].
[6]
Sherry Arnstein. 2007. A Ladder of Citizen Participation. Journal of the American Institute of Planners 35, 4 (2007), 216–224. https://doi.org/10.1007/s13398-014-0173-7.2
[7]
Sherry R Arnstein. 1969. A ladder of citizen participation. Journal of the American Institute of planners 35, 4 (1969), 216–224.
[8]
Mariam Asad, Christopher A. Le Dantec, Becky Nielsen, and Kate Diedrick. 2017. Creating a Sociotechnical API: Designing City-Scale Community Engagement. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 2295–2306. https://doi.org/10.1145/3025453.3025963
[9]
Edmond Awad, Sohan Dsouza, Richard Kim, Jonathan Schulz, Joseph Henrich, Azim Shariff, Jean-François Bonnefon, and Iyad Rahwan. 2018. The moral machine experiment. Nature 563, 7729 (2018), 59–64.
[10]
Ruha Benjamin. 2019. Race after technology: Abolitionist tools for the new jim code. John Wiley & Sons.
[11]
Kathryn Blair, Jean-Rene Leblanc, and Lora Oehlberg. 2019. Exploring Public Engagement with the Social Impact of Algorithms. Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion, 129–133.
[12]
Brian Bourke. 2014. Positionality: Reflecting on the research process. The qualitative report 19, 33 (2014), 1–9.
[13]
Tone Bratteteig and Guri Verne. 2018. Does AI Make PD Obsolete? Exploring Challenges from Artificial Intelligence to Participatory Design. In Proceedings of the 15th Participatory Design Conference: Short Papers, Situated Actions, Workshops and Tutorial - Volume 2 (Hasselt and Genk, Belgium) (PDC ’18). Association for Computing Machinery, New York, NY, USA, Article 8, 5 pages. https://doi.org/10.1145/3210604.3210646
[14]
Tone Bratteteig and Ina Wagner. 2016. What is a participatory design result?Proceedings of the 14th Participatory Design Conference on Full papers - PDC ’16 (2016), 141–150. https://doi.org/10.1145/2940299.2940316
[15]
Anna Brown, Alexandra Chouldechova, Emily Putnam-Hornstein, Andrew Tobin, and Rhema Vaithianathan. 2019. Toward Algorithmic Accountability in Public Services: A Qualitative Study of Affected Community Perspectives on Algorithmic Decision-making in Child Welfare Services. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 41.
[16]
Hao-Fei Cheng, Logan Stapleton, Ruiqi Wang, Paige Bullock, Alexandra Chouldechova, Zhiwei Steven Steven Wu, and Haiyi Zhu. 2021. Soliciting Stakeholders’ Fairness Notions in Child Maltreatment Predictive Systems. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–17.
[17]
James Clifford. 2008. On Ethnographic Authority *. 2 (2008), 118–146.
[18]
Patricia Hill Collins. 2002. Black feminist thought: Knowledge, consciousness, and the politics of empowerment. routledge.
[19]
Ned Cooper, Tiffanie Horne, Gillian Hayes, Courtney Heldreth, Michal Lahav, Jess Scon Holbrook, and Lauren Wilcox. 2022. A Systematic Review and Thematic Analysis of Community-Collaborative Approaches to Computing Research. https://dl.acm.org/doi/abs/10.1145/3491102.3517716
[20]
Eric Corbett and Christopher A. Le Dantec. 2018. Going the Distance: Trust Work for Citizen Participation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173886
[21]
Sasha Costanza-Chock. 2020. Design justice: Community-led practices to build the worlds we need. The MIT Press.
[22]
Robert A Dahl. 2005. Who governs?: Democracy and power in an American city. Yale University Press.
[23]
Brian d’Alessandro, Cathy O’Neil, and Tom LaGatta. 2017. Conscientious classification: A data scientist’s guide to discrimination-aware classification. Big data 5, 2 (2017), 120–134.
[24]
Alexander D’Amour, Hansa Srinivasan, James Atwood, Pallavi Baljekar, D. Sculley, and Yoni Halpern. 2020. Fairness is Not Static: Deeper Understanding of Long Term Fairness via Simulation Studies. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* ’20). Association for Computing Machinery, New York, NY, USA, 525–534. https://doi.org/10.1145/3351095.3372878
[25]
Fernando Delgado, Stephen Yang, Michael Madaio, and Qian Yang. 2021. Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir". https://doi.org/10.48550/ARXIV.2111.01122
[26]
Jessa Dickinson, Mark Díaz, Christopher A. Le Dantec, and Sheena Erete. 2019. "The Cavalry Ain’t Coming in to Save Us": Supporting Capacities and Relationships through Civic Tech. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 123 (nov 2019), 21 pages. https://doi.org/10.1145/3359225
[27]
Catherine D’Ignazio and Lauren F. Klein. 2020. Data Feminism. The MIT Press. https://doi.org/10.7551/mitpress/11805.001.0001
[28]
Danielle Ensign, Sorelle A. Friedler, Scott Neville, Carlos Scheidegger, and Suresh Venkatasubramanian. 2018. Runaway Feedback Loops in Predictive Policing. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, 160–171. https://proceedings.mlr.press/v81/ensign18a.html
[29]
Rankin Y.R Thomas J.O. Erete, S.2022. A Method to the Madness: Applying an Intersectional Analysis of Structural Oppression and Power in HCI and Design. ACM Transactions on Computer-Human Interaction 0, 0 (2022), 1–20.
[30]
Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin’s Press.
[31]
John Gaber. 2019. Building “A Ladder of Citizen Participation” Sherry Arnstein, Citizen Participation, and Model Cities. Journal of the American planning association 85, 3 (2019), 188–201.
[32]
Sandra Harding. 1992. Rethinking standpoint epistemology: What is" strong objectivity?". The Centennial Review 36, 3 (1992), 437–470.
[33]
Christina Harrington, Sheena Erete, and Anne Marie Piper. 2019. Deconstructing community-based collaborative design: Towards more equitable participatory design engagements. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–25.
[34]
Gillian R. Hayes. 2011. The relationship of action research to human-computer interaction. ACM Transactions on Computer-Human Interaction 18, 3 (2011), 1–20. https://doi.org/10.1145/1993060.1993065
[35]
Naja Holten Møller, Irina Shklovski, and Thomas T Hildebrandt. 2020. Shifting concepts of value: Designing algorithmic decision-support systems for public services. Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, 1–12.
[36]
Abigail Z. Jacobs and Hanna Wallach. 2021. Measurement and Fairness. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT ’21). Association for Computing Machinery, New York, NY, USA, 375–385. https://doi.org/10.1145/3442188.3445901
[37]
Anna Jobin, Marcello Ienca, and Effy Vayena. 2019. The global landscape of AI ethics guidelines. Nature Machine Intelligence 1, 9 (2019), 389–399.
[38]
Tomo Kihara, Roy Bendor, and Derek Lomas. 2019. Designing an escape room in the city for public engagement with AI-enhanced surveillance. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 1–6.
[39]
Sandjar Kozubaev, Fernando Rochaix, Carl DiSalvo, and Christopher A Le Dantec. 2019. Spaces and Traces: Implications of Smart Technology in Public Housing. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 439.
[40]
P M Krafft, Meg Young, Michael Katell, Jennifer E Lee, Shankar Narayan, Micah Epstein, Dharma Dailey, Bernease Herman, Aaron Tam, Vivian Guetler, 2021. An Action-Oriented AI Policy Toolkit for Technology Audits by Community Advocates and Activists. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 772–781.
[41]
Christopher A Le Dantec and Sarah Fox. 2015. Strangers at the gate: Gaining access, building rapport, and co-constructing community-based research. Proceedings of the 18th ACM conference on computer supported cooperative work & social computing, 1348–1358.
[42]
Min Hun Lee, Daniel P Siewiorek, Asim Smailagic, Alexandre Bernardino, and Sergi i Badia. 2020. Co-Design and Evaluation of an Intelligent Decision Support System for Stroke Rehabilitation Assessment. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1–27.
[43]
Min Kyung Lee, Daniel Kusbit, Anson Kahng, Ji Tae Kim, Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, 2019. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–35.
[44]
Donald Martin, Vinodkumar Prabhakaran, Jill Kuhlberg, Andrew Smart, and William S. Isaac. 2020. Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamics.
[45]
Wilhelmina Nekoto, Vukosi Marivate, Tshinondiwa Matsila, Timi Fasubaa, Tajudeen Kolawole, Taiwo Fagbohungbe, Solomon Oluwole Akinola, Shamsuddeen Hassan Muhammad, Salomon Kabongo, Salomey Osei, Sackey Freshia, Rubungo Andre Niyongabo, Ricky Macharm, Perez Ogayo, Orevaoghene Ahia, Musie Meressa, Mofe Adeyemi, Masabata Mokgesi-Selinga, Lawrence Okegbemi, Laura Jane Martinus, Kolawole Tajudeen, Kevin Degila, Kelechi Ogueji, Kathleen Siminyu, Julia Kreutzer, Jason Webster, Jamiil Toure Ali, Jade Abbott, Iroro Orife, Ignatius Ezeani, Idris Abdulkabir Dangana, Herman Kamper, Hady Elsahar, Goodness Duru, Ghollah Kioko, Espoir Murhabazi, Elan van Biljon, Daniel Whitenack, Christopher Onyefuluchi, Chris Emezue, Bonaventure Dossou, Blessing Sibanda, Blessing Itoro Bassey, Ayodele Olabiyi, Arshath Ramkilowan, Alp Öktem, Adewale Akinfaderin, and Abdallah Bashir. 2020. Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages. arxiv:2010.02353 [cs.CL]
[46]
Safiya Umoja Noble. 2018. Algorithms of oppression: How search engines reinforce racism. nyu Press.
[47]
A I Now. 2018. Algorithmic Accountability Policy Toolkit. (2018).
[48]
Cathy O’neil. 2016. Weapons of math destruction: How big data increases inequality and threatens democracy. Broadway Books.
[49]
Samir Passi and Solon Barocas. 2019. Problem Formulation and Fairness. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* ’19). Association for Computing Machinery, New York, NY, USA, 39–48. https://doi.org/10.1145/3287560.3287567
[50]
Amandalynne Paullada, Inioluwa Deborah Raji, Emily M. Bender, Emily Denton, and Alex Hanna. 2021. Data and its (dis)contents: A survey of dataset development and use in machine learning research. Patterns 2, 11 (2021), 100336. https://doi.org/10.1016/j.patter.2021.100336
[51]
Jennifer Pierre, Roderic Crooks, Morgan Currie, Britt Paris, and Irene Pasquetto. 2021. Getting Ourselves Together: Data-Centered Participatory Design Research & Epistemic Burden. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 406, 11 pages. https://doi.org/10.1145/3411764.3445103
[52]
Carina E. A. Prunkl, Carolyn Ashurst, Markus Anderljung, Helena Webb, Jan Leike, and Allan Dafoe. 2021. Institutionalizing ethics in AI through broader impact requirements. Nature Machine Intelligence 3, 2 (01 Feb 2021), 104–110. https://doi.org/10.1038/s42256-021-00298-y
[53]
Yim Register and Amy J Ko. 2020. Learning machine learning with personal data helps stakeholders ground advocacy arguments in model mechanics. Proceedings of the 2020 ACM Conference on International Computing Education Research, 67–78.
[54]
Rashida Richardson, Jason Schultz, and Kate Crawford. 2019. Dirty Data, Bad Predictions: How Civil Rights Violations Impact Police Data, Predictive Policing Systems, and Justice. New York University Law Review Online, Forthcoming (2019).
[55]
Rashida Richardson, J. Schultz, and K. Crawford. 2019. Dirty Data, Bad Predictions: How Civil Rights Violations Impact Police Data, Predictive Policing Systems, and Justice.
[56]
David A Robb, Muneeb I Ahmad, Carlo Tiseo, Simona Aracri, Alistair C McConnell, Vincent Page, Christian Dondrup, Francisco J Chiyah Garcia, Hai-Nguyen Nguyen, Èric Pairet, 2020. Robots in the danger zone: exploring public perception through engagement. Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 93–102.
[57]
Jennifer A. Rode. 2011. Reflexivity in digital anthropology. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11 (2011), 123. https://doi.org/10.1145/1978942.1978961
[58]
Mark Sendak, Madeleine Clare Elish, Michael Gao, Joseph Futoma, William Ratliff, Marshall Nichols, Armando Bedoya, Suresh Balu, and Cara O’Brien. 2020. "The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learning. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* ’20). Association for Computing Machinery, New York, NY, USA, 99–109. https://doi.org/10.1145/3351095.3372827
[59]
Hong Shen, Alicia DeVos, Motahhare Eslami, and Kenneth Holstein. 2021. Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors. arXiv preprint arXiv:2105.02980 (2021).
[60]
Zoe Skinner, Stacey Brown, and Greg Walsh. 2020. Children of Color’s Perceptions of Fairness in AI: An Exploration of Equitable and Inclusive Co-Design. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 1–8.
[61]
Mona Sloane. 2019. Inequality Is the Name of the Game: Thoughts on the Emerging Field of Technology, Ethics and Social Justice. In Proceedings of the Weizenbaum Conference 2019 "Challenges of Digital Inequality - Digital Education, Digital Work, Digital Life". Berlin, 9. https://doi.org/10.34669/wi.cp/2.9
[62]
Mona Sloane, Emanuel Moss, Olaitan Awomolo, and Laura Forlano. 2020. Participation is not a Design Fix for Machine Learning. https://doi.org/10.48550/ARXIV.2007.02423
[63]
C Estelle Smith, Bowen Yu, Anjali Srivastava, Aaron Halfaker, Loren Terveen, and Haiyi Zhu. 2020. Keeping community in the loop: Understanding wikipedia stakeholder values for machine learning-based systems. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–14.
[64]
Susan Leigh Star and James R. Griesemer. 1989. Institutional Ecology and Boundary Objects. Social Studies of Science 19, 3 (1989), 387–420.
[65]
Harini Suresh, Rajiv Movva, Amelia Lee Dogan, Rahul Bhargava, Isadora Cruxen, Angeles Martinez Cuba, Guilia Taurino, Wonyoung So, and Catherine D’Ignazio. 2022. Towards Intersectional Feminist and Participatory ML: A Case Study in Supporting Feminicide Counterdata Collection. In 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT ’22). Association for Computing Machinery, New York, NY, USA, 667–678. https://doi.org/10.1145/3531146.3533132
[66]
Niels Van Berkel, Jorge Goncalves, Danula Hettiachchi, Senuri Wijenayake, Ryan M Kelly, and Vassilis Kostakos. 2019. Crowdsourcing perceptions of fair predictors for machine learning: a recidivism case study. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–21.
[67]
Helena Webb, Ansgar Koene, Menisha Patel, and Elvira Perez Vallejos. 2018. Multi-stakeholder dialogue for policy recommendations on algorithmic fairness. Proceedings of the 9th international conference on social media and society, 395–399.
[68]
Haiyi Zhu, Bowen Yu, Aaron Halfaker, and Loren Terveen. 2018. Value-sensitive algorithm design: Method, case study, and lessons. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1–23.

Cited By

View all
  • (2025)Intentions and PremisesAI Driven Tools for Sustainable Public Administration10.4018/979-8-3693-8372-8.ch012(321-360)Online publication date: 24-Jan-2025
  • (2025)Understanding Human-Centred AI: a review of its defining elements and a research agendaBehaviour & Information Technology10.1080/0144929X.2024.2448719(1-40)Online publication date: 16-Feb-2025
  • (2025)Mapping AI ethics narratives: evidence from Twitter discourse between 2015 and 2022Humanities and Social Sciences Communications10.1057/s41599-025-04469-912:1Online publication date: 15-Feb-2025
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
EAAMO '23: Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization
October 2023
498 pages
ISBN:9798400703812
DOI:10.1145/3617694
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 2023

Check for updates

Author Tags

  1. AI
  2. algorithmic decision making
  3. algorithms
  4. democracy
  5. human-centered AI
  6. machine learning
  7. participatory AI
  8. participatory design
  9. power
  10. public participation

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

EAAMO '23
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,512
  • Downloads (Last 6 weeks)209
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Intentions and PremisesAI Driven Tools for Sustainable Public Administration10.4018/979-8-3693-8372-8.ch012(321-360)Online publication date: 24-Jan-2025
  • (2025)Understanding Human-Centred AI: a review of its defining elements and a research agendaBehaviour & Information Technology10.1080/0144929X.2024.2448719(1-40)Online publication date: 16-Feb-2025
  • (2025)Mapping AI ethics narratives: evidence from Twitter discourse between 2015 and 2022Humanities and Social Sciences Communications10.1057/s41599-025-04469-912:1Online publication date: 15-Feb-2025
  • (2024)Stakeholder Involvement for Responsible AI Development: A Process FrameworkProceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization10.1145/3689904.3694698(1-14)Online publication date: 29-Oct-2024
  • (2024)"I Want to Publicize My Stutter": Community-led Collection and Curation of Chinese Stuttered Speech DataProceedings of the ACM on Human-Computer Interaction10.1145/36870148:CSCW2(1-27)Online publication date: 8-Nov-2024
  • (2024)The Denizen Designer Project: Practices, Relationships, and Principles of Activist-Led DesignProceedings of the ACM on Human-Computer Interaction10.1145/36868978:CSCW2(1-32)Online publication date: 8-Nov-2024
  • (2024)Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent CircumventionProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659002(1733-1744)Online publication date: 3-Jun-2024
  • (2024)Participation in the age of foundation modelsProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658992(1609-1621)Online publication date: 3-Jun-2024
  • (2024)Algorithmic Transparency and Participation through the Handoff Lens: Lessons Learned from the U.S. Census Bureau’s Adoption of Differential PrivacyProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658962(1150-1162)Online publication date: 3-Jun-2024
  • (2024)Building, Shifting, & Employing Power: A Taxonomy of Responses From Below to Algorithmic HarmProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658958(1093-1106)Online publication date: 3-Jun-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media