The Power of Absence: Thinking with Archival Theory in Algorithmic Design
Pages 214 - 223
Abstract
This paper explores the value of archival theory as a means of grappling with bias in algorithmic design. Rather than seek to mitigate biases perpetuated by datasets and algorithmic systems, archival theory offers a reframing of bias itself. Drawing on a range of archival theory from the fields of history, literary and cultural studies, Black studies, and feminist STS, we propose absence—as power, presence, and productive—as a concept that might more securely anchor investigations into the causes of algorithmic bias, and that can prompt more capacious, creative, and joyful future work. This essay, in turn, can intervene into the technical as well as the social, historical, and political structures that serve as sources of bias.
References
[1]
2023. "FACT SHEET: Biden-Harris Administration Takes Sweeeping Action to Address Racial Bias in Home Valuations". https://www.whitehouse.gov/briefing-room/statements-releases/2023/06/01/fact-sheet-biden-harris-administration-takes-sweeping-action-to-address-racial-bias-in-home-valuations/
[2]
2024. BIAS Project. https://www.biasproject.eu/project-overview/#: :text=Welcome%20to%20BIAS,addressing%20and%20mitigating%20algorithmic%20biases
[3]
2024. Colored Conventions Corpus. https://coloredconventions.org/about-records/ccp-corpus/
[4]
2024. The IEEE Global Initiative. https://standards.ieee.org/industry-connections/ec/autonomous-systems/
[5]
Julia Angwin and Jeff Larson. 2016. Bias in Criminal Risk Scores Is Mathematically Inevitable, Researchers Say. ProPublica (Dec. 2016). https://www.propublica.org/article/bias-in-criminal-risk-scores-is-mathematically-inevitable-researchers-say
[6]
Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. ProPublica (May 2016). https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
[7]
William Arnett. 2006. Gee’s Bend: The architecture of the quilt. Tinwood Books.
[8]
Gabrielle Benabdallah, Ashten Alexander, Sourojit Ghosh, Chariell Glogovac-Smith, Lacey Jacoby, Caitlin Lustig, Anh Nguyen, Anna Parkhurst, Kathryn Reyes, Neilly H Tan, 2022. Slanted Speculations: Material Encounters with Algorithmic Bias. In Designing Interactive Systems Conference. 85–99.
[9]
Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the dangers of stochastic parrots: Can language models be too big?. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency. 610–623.
[10]
Jesse Josua Benjamin, Arne Berger, Nick Merrill, and James Pierce. 2021. Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3411764.3445481
[11]
Ruha Benjamin. 2019. Race After Technology: Abolitionist Tools for the New Jim Code. John Wiley & Sons.
[12]
Julian Bleecker. 2022. Design fiction: A short essay on design, science, fact, and fiction. Machine Learning and the City: Applications in Architecture and Urban Design (2022), 561–578.
[13]
Meredith Broussard. 2018. Artificial unintelligence: How computers misunderstand the world. mit Press.
[14]
Joy Buolamwini. 2024. Algorithmic Justice League.
[15]
Kriston Capps. 2023. An Architect Uses AI to Explore Surreal Black Worlds. https://www.bloomberg.com/news/features/2023-09-23/with-ai-an-architect-imagines-a-world-that-centers-blackness
[16]
Giovanni Colavizza, Tobias Blanke, Charles Jeurgens, and Julia Noordegraaf. 2021. Archives and AI: An overview of current debates and future perspectives. ACM Journal on Computing and Cultural Heritage (JOCCH) 15, 1 (2021), 1–15.
[17]
Jay Cunningham, Gabrielle Benabdallah, Daniela Rosner, and Alex Taylor. 2023. On the grounds of solutionism: Ontologies of blackness and HCI. ACM Transactions on Computer-Human Interaction 30, 2 (2023), 1–17.
[18]
Emily Denton, Alex Hanna, Razvan Amironesei, Andrew Smart, and Hilary Nicole. 2021. On the genealogy of machine learning datasets: A critical history of ImageNet. Big Data & Society 8, 2 (2021), 20539517211035955.
[19]
Emily Denton, Alex Hanna, Razvan Amironesei, Andrew Smart, Hilary Nicole, and Morgan Klaus Scheuerman. 2020. Bringing the People Back In: Contesting Benchmark Machine Learning Datasets. arXiv:2007.07399 [cs] (July 2020). http://arxiv.org/abs/2007.07399 arXiv:2007.07399.
[20]
Catherine D’ignazio and Lauren F Klein. 2023. Data feminism. MIT press.
[21]
Jesse Dodge, Maarten Sap, Ana Marasović, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Margaret Mitchell, and Matt Gardner. 2021. Documenting large webtext corpora: A case study on the colossal clean crawled corpus. arXiv preprint arXiv:2104.08758 (2021).
[22]
Anthony Dunne and Fiona Raby. 2013. Speculative everything: design, fiction, and social dreaming. MIT press.
[23]
Jacob Eisenstein, Daniel Andor, Bernd Bohnet, Michael Collins, and David Mimno. 2022. Honest students from untrusted teachers: Learning an interpretable question-answering pipeline from a pretrained language model. arXiv preprint arXiv:2210.02498 (2022).
[24]
Yanai Elazar, Akshita Bhagia, Ian Magnusson, Abhilasha Ravichander, Dustin Schwenk, Alane Suhr, Pete Walsh, Dirk Groeneveld, Luca Soldaini, Sameer Singh, 2023. What’s In My Big Data?arXiv preprint arXiv:2310.20707 (2023).
[25]
Avriel Epps-Darling. 2020. How the Racism Baked Into Technology Hurts Teens. https://www.theatlantic.com/family/archive/2020/10/algorithmic-bias-especially-dangerous-teens/616793/
[26]
Virginia Eubanks. 2018. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. St. Martin’s Publishing Group. Google-Books-ID: pn4pDwAAQBAJ.
[27]
M Beatrice Fazi. 2018. Contingent computation: abstraction, experience, and indeterminacy in computational aesthetics. Rowman & Littlefield.
[28]
Michel Foucault. 2012. From Archaeology to Genealogy. Post-Marxist Theory (2012), 37.
[29]
Jacob Gaboury. 2018. Becoming NULL: Queer relations in the excluded middle. Women & Performance: a journal of feminist theory 28, 2 (2018), 143–158.
[30]
Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé, and Kate Crawford. 2022. Excerpt from datasheets for datasets. Auerbach Publications.
[31]
Andrew Goffey. 2008. Algorithm. In Software Studies: A Lexicon, Matthew Fuller (Ed.). MIT Press.
[32]
Alexis Pauline Gumbs. 2020. M archive: After the end of the world. Duke University Press.
[33]
Suchin Gururangan, Dallas Card, Sarah K Dreier, Emily K Gade, Leroy Z Wang, Zeyu Wang, Luke Zettlemoyer, and Noah A Smith. 2022. Whose language counts as high quality? measuring language ideologies in text data selection. arXiv preprint arXiv:2201.10474 (2022).
[34]
Saidiya Hartman. 2008. Lose your mother: A journey along the Atlantic slave route. Macmillan.
[35]
Saidiya Hartman. 2008. Venus in two acts. Small Axe: A Caribbean Journal of Criticism 12, 2 (2008), 1–14.
[36]
Saidiya Hartman. 2022. Scenes of subjection: Terror, slavery, and self-making in nineteenth-century America. WW Norton & Company.
[37]
Deborah Hellman. 2021. Big Data and Compounding Injustice., 18 pages. Forthcoming. Technical Report. SSRN preprint.
[38]
Eun Seo Jo and Timnit Gebru. 2020. Lessons from archives: Strategies for collecting sociocultural data in machine learning. In Proceedings of the 2020 conference on fairness, accountability, and transparency. 306–316.
[39]
Josh A Johnson, Brandon Moore, Eun Kyeong Hwang, Andy Hickner Msi, and Heather Yeo. 2023. The accuracy of race & ethnicity data in US based healthcare databases: A systematic review. The American Journal of Surgery (2023).
[40]
Jessica Marie Johnson. 2018. Markup bodies: black [life] studies and slavery [death] studies at the digital crossroads. Social Text 36, 4 (2018), 57–79.
[41]
Bettina Judd. 2019. Lucille Clifton’s Creative Technologies of Becoming. Black Bodies and Transhuman Realities: Scientifically Modifying the Black Body in Posthuman Literature and Culture 133 (2019).
[42]
Amruta Kale, Tin Nguyen, Frederick C Harris Jr, Chenhao Li, Jiyin Zhang, and Xiaogang Ma. 2023. Provenance documentation to enable explainable and trustworthy AI: A literature review. Data Intelligence 5, 1 (2023), 139–162.
[43]
Sayash Kapoor and Arvind Narayanan. 2023. Leakage and the reproducibility crisis in machine-learning-based science. Patterns 4, 9 (2023).
[44]
Lauren Kirchner. 2-15. When Discrimination Is Baked Into Algorithms. https://www.theatlantic.com/business/archive/2015/09/discrimination-algorithms-disparate-impact/403969/
[45]
Lauren F Klein. 2013. The image of absence: archival silence, data visualization, and James Hemings. American Literature 85, 4 (2013), 661–688.
[46]
Airi Lampinen, Naja Holten Møller, Riyaz Sheikh, Asbjørn Ammitzbøll Flügge, Kristin Kaltenhäuser, and Baki Cakici. 2022. CSCW and Algorithmic Systems. (2022). https://doi.org/10.48340/ecscw2022_ws03 Accepted: 2022-06-22T04:34:50Z Publisher: European Society for Socially Embedded Technologies (EUSSET).
[47]
Victoria L Lemieux. 2019. Blockchain and public record keeping: of temples, prisons, and the (re) configuration of power. Frontiers in Blockchain 2 (2019), 5.
[48]
Yanni Alexander Loukissas. 2019. All data are local: Thinking critically in a data-driven society. MIT press.
[49]
Caitlin Lustig and Hong-An Wu. 2022. Tarot as a Technology of Care: A Conversation with Hong-An (Ann) Wu. ACM Interactions (2022).
[50]
Richard Marciano, Victoria Lemieux, Mark Hedges, Maria Esteva, William Underwood, Michael Kurtz, and Mark Conrad. 2018. Archival records and training in the age of big data. In Re-Envisioning the MLS: Perspectives on the future of library and information science education. Vol. 44. Emerald Publishing Limited, 179–199.
[51]
Katelyn Mei, Sonia Fereidooni, and Aylin Caliskan. 2023. Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Tasks. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 1699–1710.
[52]
Zion Mengesha, Courtney Heldreth, Michal Lahav, Juliana Sublewski, and Elyse Tuennerman. 2021. “I don’t Think These Devices are Very Culturally Sensitive.”—Impact of Automated Speech Recognition Errors on African Americans. Frontiers in Artificial Intelligence 4 (2021), 169.
[53]
Tiya Miles. 2022. All that she carried: The journey of Ashley’s sack, a Black family keepsake. Random House Trade Paperbacks.
[54]
Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019. Model cards for model reporting. In Proceedings of the conference on fairness, accountability, and transparency. 220–229.
[55]
Romi Ron Morrison. 2019. Gaps between the digits: On the fleshy unknowns of the HUMAN. Information Design Journal (IDJ) 25, 1 (Jan. 2019), 56–70. https://doi.org/10.1075/idj.25.1.05mor Publisher: John Benjamins Publishing Co.
[56]
Romi Ron Morrison. 2022. Voluptuous Disintegration: A Future History of Black Computational Thought.DHQ: Digital Humanities Quarterly 16, 3 (2022).
[57]
José Esteban Muñoz. 2019. Cruising utopia. In Cruising Utopia, 10th Anniversary Edition. New York University Press.
[58]
Mikel K Ngueajio and Gloria Washington. 2022. Hey ASR system! Why aren’t you more inclusive? Automatic speech recognition systems’ bias and proposed bias mitigation techniques. A literature review. In International Conference on Human-Computer Interaction. Springer, 421–440.
[59]
Mutale Nkonde. 2019. Automated anti-blackness: facial recognition in Brooklyn, New York. Harvard Journal of African American Public Policy 20 (2019), 30–36.
[60]
Safiya Umoja Noble. 2018. Algorithms of Oppression How Search Engines Reinforce Racism. NYU Press.
[61]
Ngozi Okidegbe. 2021. Discredited Data. Cornell L. Rev. 107 (2021), 2007.
[62]
Mimi Onuoha. 2016. Library of Missing Datasets. (2016). https://mimionuoha.com/the-library-of-missing-datasets
[63]
Luciana Parisi. 2022. Recursive Philosophy and Negative Machines. Critical Inquiry 48, 2 (2022), 313–333.
[64]
Luiza Prado de Oliveira Martins. 2018. Technoecologies of Birth Control: Biopolitics by Design. Ph. D. Dissertation. Universität der Künste Berlin.
[65]
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research 21, 1 (2020), 5485–5551.
[66]
Al Rahrooh, Anders O Garlid, Kelly Bartlett, Warren Coons, Panayiotis Petousis, William Hsu, and Alex AT Bui. 2024. Towards a framework for interoperability and reproducibility of predictive models. Journal of Biomedical Informatics 149 (2024), 104551.
[67]
Sonia Ranade. 2018. Access technologies for the disruptive digital archive., 79–98 pages.
[68]
Caitlin Rosenthal. 2019. Accounting for slavery: Masters and management. Harvard University Press.
[69]
Daniela Rosner. 2022. The Bias Cut: Toward a Technopoetics of Algorithmic Systems. Catalyst: Feminism, Theory, Technoscience 8, 2 (2022).
[70]
Daniela Rosner. 2023. Bias Cuts and Data Dumps: Weaving a Relational Ethics into Performances and Practices of Trust. M/C Journal 26, 6 (2023).
[71]
Daniela K Rosner. 2018. Critical fabulations: Reworking the methods and margins of design. MIT Press.
[72]
Jihan Sherman. 2023. Black Feminist Technoscience: Sojourner Truth, Storytelling, and a Framework for Design. In Proceedings of the 2023 ACM Designing Interactive Systems Conference(DIS ’23). Association for Computing Machinery, New York, NY, USA, 978–986. https://doi.org/10.1145/3563657.3596105
[73]
Hortense J Spillers. 2022. Mama’s baby, papa’s maybe: An American grammar book. In The transgender studies reader remix. Routledge, 93–104.
[74]
Nanna Bonde Thylstrup, Daniela Agostinho, Annie Ring, Catherine D’Ignazio, and Kristin Veel. 2021. Uncertain archives: Critical keywords for big data. MIT Press.
[75]
Jacqueline L Tobin and Raymond G Dobard. 2000. Hidden in plain view: A secret story of quilts and the Underground Railroad. Anchor.
[76]
Michel-Rolph Trouillot. 1995. The Silences of the Past: The Power and the Production of History. Beacon Press.
[77]
Michel-Rolph Trouillot. 2015. Silencing the past: Power and the production of history. Beacon Press.
[78]
Ana Valdivia and Martina Tazzioli. 2023. Datafication Genealogies beyond Algorithmic Fairness: Making Up Racialised Subjects. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. 840–850.
[79]
Ari Ezra Waldman. 2019. Power, process, and automated decision-making. Fordham L. Rev. 88 (2019), 613.
[80]
Alexander Ghedi Weheliye. 2014. Habeas viscus: Racializing assemblages, biopolitics, and black feminist theories of the human. Duke University Press.
[81]
Sylvia Wynter. 1992. Rethinking Aesthetics: Notes to a Deciphering Practice. Ex-iles: Essays on Caribbean (1992), 238–279.
[82]
Sylvia Wynter. 1995. ’No humans involved’: An open letter to my colleagues. Havens Center Visiting Scholar’s Program (1995).
[83]
Hua Zhou and Kenneth Lange. 2009. Rating Movies and Rating the Raters Who Rate Them. The American Statistician 63, 4 (Nov. 2009), 297–307. https://doi.org/10.1198/tast.2009.08278 Publisher: Taylor & Francis _eprint: https://doi.org/10.1198/tast.2009.08278.
Index Terms
- The Power of Absence: Thinking with Archival Theory in Algorithmic Design
Recommendations
Harms from Increasingly Agentic Algorithmic Systems
FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and TransparencyResearch in Fairness, Accountability, Transparency, and Ethics (FATE)1 has established many sources and forms of algorithmic harm, in domains as diverse as health care, finance, policing, and recommendations. Much work remains to be done to mitigate the ...
Disambiguating Algorithmic Bias: From Neutrality to Justice
AIES '23: Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and SocietyAs algorithms have become ubiquitous in consequential domains, societal concerns about the potential for discriminatory outcomes have prompted urgent calls to address algorithmic bias. In response, a rich literature across computer science, law, and ...
Bureaucracy as a Lens for Analyzing and Designing Algorithmic Systems
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsScholarship on algorithms has drawn on the analogy between algorithmic systems and bureaucracies to diagnose shortcomings in algorithmic decision-making. We extend the analogy further by drawing on Michel Crozier's theory of bureaucratic organizations to ...
Comments
Information & Contributors
Information
Published In
July 2024
3616 pages
ISBN:9798400705830
DOI:10.1145/3643834
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- NSF
Conference
DIS '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 186Total Downloads
- Downloads (Last 12 months)186
- Downloads (Last 6 weeks)57
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in