Law and the Emerging Political Economy of Algorithmic Audits
Pages 1255 - 1267
Abstract
For almost a decade now, scholarship in and beyond the ACM FAccT community has been focusing on novel and innovative ways and methodologies to audit the functioning of algorithmic systems. Over the years, this research idea and technical project has matured enough to become a regulatory mandate. Today, the Digital Services Act (DSA) and the Online Safety Act (OSA) have established the framework within which technology corporations and (traditional) auditors will develop the ‘practice’ of algorithmic auditing thereby presaging how this ‘ecosystem’ will develop. In this paper, we systematically review the auditing provisions in the DSA and the OSA in light of observations from the emerging industry of algorithmic auditing. Who is likely to occupy this space? What are some political and ethical tensions that are likely to arise? How are the mandates of ‘independent auditing’ or ‘the evaluation of the societal context of an algorithmic function’ likely to play out in practice? By shaping the picture of the emerging political economy of algorithmic auditing, we draw attention to strategies and cultures of traditional auditors that risk eroding important regulatory pillars of the DSA and the OSA. Importantly, we warn that ambitious research ideas and technical projects of/for algorithmic auditing may end up crashed by the standardising grip of traditional auditors and/or diluted within a complex web of (sub-)contractual arrangements, diverse portfolios, and tight timelines.
References
[1]
[n. d.]. Apollo Research. https://www.apolloresearch.ai/
[2]
[n. d.]. ARC Evals - METR. https://metr.org/
[3]
2020. R (Bridges) v. Chief Constable of South Wales Police [2020] EWCA Civ 1058. https://caselaw.nationalarchives.gov.uk/ewca/civ/2020/1058
[4]
2022. Algorithmic Accountability Act 2022.
[5]
2022. Standard Operating Procedure (SOP) for the Overt Deployment of Live Facial Recognition Technology (LFR). Technical Report. https://www.met.police.uk/SysSiteAssets/media/downloads/force-content/met/advice/lfr/policy-documents/lfr-sop.pdf
[6]
2023. Algorithmic Accountability Act of 2023. U.S.C. 5, H.R. 5628 (21 Sep 2023), 553. https://www.govinfo.gov/app/details/BILLS-118hr5628ih
[7]
2023. Local Law Int. No. 1894-A (Automated Employment Decision Tools Law (”AEDT”)), New York City.
[8]
2023. Online Safety Bill, Hansard (HL Vol 831, Col 385). https://hansard.parliament.uk/lords/2023-06-22/debates/C956350F-D70E-4409-8A4D-4ED05488C6DE/OnlineSafetyBill
[9]
2023. Responsible AI. https://kpmg.com/nl/en/home/services/advisory/trusted-enterprise/responsible-ai.html
[10]
Kenneth W. Abbott, David Levi-Faur, and Duncan Snidal. 2017. Theorizing Regulatory Intermediaries: The RIT Model. The ANNALS of the American Academy of Political and Social Science 670, 1 (01 Mar 2017), 14–35. https://doi.org/10/f953b4
[11]
Hal Abelson, Ross Anderson, Steven M. Bellovin, Josh Benaloh, Matt Blaze, Jon Callas, Whitfield Diffie, Susan Landau, Peter G. Neumann, Ronald L. Rivest, Jeffrey I. Schiller, Bruce Schneier, Vanessa Teague, and Carmela Troncoso. 2021. Bugs in Our Pockets: The Risks of Client-Side Scanning. arxiv:2110.07450v1https://arxiv.org/abs/2110.07450v1
[12]
BABL AI. n.d. AI Audits. https://babl.ai/ai-audits/
[13]
Fiddler AI. n.d. AI Observability, ML Model Monitoring, and Explainable AI. https://www.fiddler.ai/
[14]
Holistic AI. [n. d.]. Digital Services Act Audit - Solution. https://www.holisticai.com/digital-services-act-audit
[15]
Holistic AI. n.d. EU AI Act Readiness - Solutions. https://www.holisticai.com/eu-ai-act-readiness
[16]
Naomi Appelman and Paddy Leerssen. 2022. On ”Trusted” Flaggers. Yale J.L. & Tech. 24, 1 (2022), 452–475. https://yjolt.org/trusted-flaggers
[17]
Jef Ausloos and Siddharth de Souza (Eds.). forthcoming. Researcher Access to Digital Infrastructures. Cambridge University Press, Cambridge.
[18]
Jef Ausloos and Michael Veale. 2020. Researching with Data Rights. Technology and Regulation1 (2020), 136–157. https://doi.org/10.26116/techreg.2020.010
[19]
C. Richard Baker, Jean B´edard, and Christian Prat dit Hauret. 2014. The Regulation of Statutory Auditing: An Institutional Theory Approach. Managerial Auditing Journal 29, 5 (01 Jan 2014), 371–394. https://doi.org/10.1108/MAJ-09-2013-0931
[20]
Agathe Balayn and Seda Gürses. 2021. Beyond Debiasing: Regulating AI and Its Inequalities. https://perma.cc/4UAV-3UFB
[21]
Agathe Balayn, Mireia Yurrita, Jie Yang, and Ujwal Gadiraju. 2023. "Fairness Toolkits, A Checkbox Culture?” On the Factors That Fragment Developer Practices in Handling Algorithmic Harms. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. Association for Computing Machinery, New York, NY, USA, 482–495. https://doi.org/10.1145/3600211.3604674
[22]
Jack Bandy. 2021. Problematic Machine Behavior: A Systematic Literature Review of Algorithm Audits. Proc. ACM Hum.-Comput. Interact. 5, CSCW1 (22 Apr 2021), 74:1–74:34. https://doi.org/10.1145/3449148
[23]
Nathan Bartley, Andres Abeliuk, Emilio Ferrara, and Kristina Lerman. 2021. Auditing Algorithmic Bias on Twitter. 65–73.
[24]
Silke Beck, Sheila Jasanoff, Andy Stirling, and Christine Polzin. 2021. The Governance of Sociotechnical Transformations to Sustainability. Current Opinion in Environmental Sustainability 49 (Apr 2021), 143–152. https://doi.org/10.1016/j.cosust.2021.04.010
[25]
Abeba Birhane, Vinay Uday Prabhu, and John Whaley. 2022. Auditing Saliency Cropping Algorithms. 4051–4059. https://openaccess.thecvf.com/content/WACV2022/html/Birhane_Auditing_Saliency_Cropping_Algorithms_WACV_2022_paper.html
[26]
Su Lin Blodgett, Solon Barocas, Hal Daum´e III, and Hanna Wallach. 2020. Language (Technology) Is Power: A Critical Survey of “Bias” in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 5454–5476. https://doi.org/10.18653/v1/2020.acl-main.485
[27]
Booking.com. 2023. Submissions by Booking.Com in Response to the European Commission’s Request for Feedback on the Draft DRPA. Technical Report. https://ec.europa.eu/info/law/better-regulation/have-your-say/initiatives/13626-Digital-Services-Act-conducting-independent-audits/F3424053_en
[28]
Sebastian Botzem. 2012. The Politics of Accounting Regulation: Organizing Transnational Standard Setting in Financial Reporting. Edward Elgar Publishing.
[29]
Ian Brown and Christopher T. Marsden. 2013. Regulating Code: Good Governance and Better Regulation in the Information Age. MIT Press, Cambridge, MA.
[30]
Shea Brown, Jovana Davidovic, and Ali Hasan. 2021. The Algorithm Audit: Scoring the Algorithms That Score Us. Big Data & Society 8, 1 (2021), 2053951720983865.
[31]
Miriam C. Buiten. 2022. The Digital Services Act: From Intermediary Liability to Platform Regulation. JIPITEC 12, 5 (2022). https://www.jipitec.eu/issues/jipitec-12-5-2021/5491
[32]
Sarmad Chandio, Daniyal Pirwani Dar, and Rishab Nithyanand. 2023. How Auditing Methodologies Can Impact Our Understanding of YouTube’s Recommendation Systems. arXiv:2303.03445 (2023). https://doi.org/10.48550/arXiv.2303.03445
[33]
Rumman Chowdhury. 2023. What’s an Audit?https://www.get-parity.com/raiblog/whats-an-audit
[34]
Athena Christofi, Jonas Breuer, Ellen Wauters, Peggy Valcke, and Jo Pierson. 2022. Data Protection, Control and Participation beyond Consent - Seeking the Views of Data Subjects in Data Protection Impact Assessments. In Research Handbook on EU Data Protection Law. Edward Elgar Publishing, 503–529. https://doi.org/10.4337/9781800371682.00029
[35]
Jennifer Cobbe and Jatinder Singh. 2021. Artificial Intelligence as a Service: Legal Responsibilities, Liabilities, and Policy Challenges. Computer Law & Security Review 42 (2021), 105573. https://doi.org/10/gmq8jm
[36]
Jennifer Cobbe, Michael Veale, and Jatinder Singh. 2023. Understanding Accountability in Algorithmic Supply Chains. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, NY, USA, 1186–1197. https://doi.org/gsb98p
[37]
European Commission. [n. d.]. The EU’s Digital Services Act. https://commission.europa.eu/strategy-and-policy/priorities-2019-2024/europe-fit-digital-age/digital-services-act_en
[38]
Federal Trade Commission. 2022. Combatting Online Harms Through Innovation. https://perma.cc/2S5Y-WQKX
[39]
Sasha Costanza-Chock, Inioluwa Deborah Raji, and Joy Buolamwini. 2022. Who Audits the Auditors? Recommendations from a Field Scan of the Algorithmic Auditing Ecosystem. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, 1571–1583. https://doi.org/10.1145/3531146.3533213
[40]
Alexander D’Amour, Hansa Srinivasan, James Atwood, Pallavi Baljekar, D. Sculley, and Yoni Halpern. 2020. Fairness Is Not Static: Deeper Understanding of Long Term Fairness via Simulation Studies. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, NY, USA, 525–534. https://doi.org/10.1145/3351095.3372878
[41]
Mark Dangelo. 2023. Auditing AI: The emerging battlefield of transparency and assessment. https://www.thomsonreuters.com/en-us/posts/technology/auditing-ai-transparency/
[42]
Philipp Darius, Daniela Stockmann, Joanna Bryson, Luciana Cingolani, Rachel Griffin, Gerhard Hammerschmid, Maximilian Kupi, Haytham Mones, Simon Munzert, and Rónán Riordan. 2023. Implementing Data Access of the Digital Services Act: Collaboration of European Digital Service Coordinators and Researchers in Building Strong Oversight over Social Media Platforms. https://perma.cc/P2MM-QWUP
[43]
Katarina Demetzou. 2022. Introduction to the Conformity Assessment under the Draft EU AI Act, and How It Compares to DPIAs. https://fpf.org/blog/introduction-to-the-conformity-assessment-under-the-draft-eu-ai-act-and-how-it-compares-to-dpias/
[44]
Daria Dergacheva, Christian Katzenbach, Sebastian Felix Schwemer, and João Pedro Quintais. 2023. Improving Data Access for Researchers in the Digital Services Act. SSRN Scholarly Paper (01 Jun 2023). https://doi.org/10.2139/ssrn.4465846
[45]
Paul J. DiMaggio and Walter W. Powell. 1983. The Iron Cage Revisited: Institutional Isomorphism and Collective Rationality in Organizational Fields. American Sociological Review 48, 2 (1983), 147. https://doi.org/10.2307/2095101
[46]
Denise Hanes Downey and Kimberly D. Westermann. 2021. Challenging Global Group Audits: The Perspective of US Group Audit Leads. Contemporary Accounting Research 38, 2 (2021), 1395–1433. https://doi.org/10.1111/1911-3846.12648
[47]
Lilian Edwards. 2019. ‘With Great Power Comes Great Responsibility?’: The Rise of Platform Liability. In Law, Policy, and the Internet, Lilian Edwards (Ed.). Hart Publishing, 253–289.
[48]
Randal J. Elder, Mark S. Beasley, Chris E. Hogan, and Alvin A. Arens. 2020. Auditing and Assurance Services: International Perspectives (17 ed.). Pearson.
[49]
Ernst and Young. [n. d.]. EY Trusted AI Platform. https://www.ey.com/en_gl/consulting/trusted-ai-platform
[50]
Ilana Golbin. 2021. Algorithmic Impact Assessments: What Are They and Why Do You Need Them?https://perma.cc/6CFY-MYNZ
[51]
Ellen P. Goodman and Julia Tr´ehu. 2022. AI Audit-Washing and Accountability. https://www.gmfus.org/news/ai-audit-washing-and-accountability
[52]
Ellen P. Goodman and Julia Tr´ehu. 2023. Algorithmic Auditing: Chasing AI Accountability. Santa Clara High Technology Law Journal 39, 3 (2023), 289.
[53]
Charles Goodwin. 1994. Professional Vision. American Anthropologist 96, 3 (1994), 606–633. https://www.jstor.org/stable/682303
[54]
Google. 2023. Submissions by Google in Response to the European Commission’s Request for Feedback on the Draft DRPA. https://ec.europa.eu/info/law/better-regulation/have-your-say/initiatives/13626-Digital-Services-Act-conducting-independent-audits/F3424072_en
[55]
Robert Gorwa. 2024. The Politics of Platform Regulation: How Governments Shape Online Content Moderation. Oxford University Press, Oxford, UK.
[56]
Robert Gorwa, Reuben Binns, and Christian Katzenbach. 2020. Algorithmic Content Moderation: Technical and Political Challenges in the Automation of Platform Governance. Big Data & Society 7, 1 (2020), 2053951719897945. https://doi.org/10/ggsfrk
[57]
Robert Gorwa and Michael Veale. 2024. Moderating Model Marketplaces: Platform Governance Puzzles for AI Intermediaries. Law, Innovation and Technology 16, 2 (2024). https://doi.org/10.31235/osf.io/6dfk3
[58]
Australian Government. 2023. Royal Commission into the Robodebt Scheme. https://www.pmc.gov.au/sites/default/files/resource/download/gov-response-royal-commission-robodebt-scheme.pdf
[59]
HM Government. 2017. The Futures Toolkit: Tools for Futures Thinking and Foresight across UK Government. https://assets.publishing.service.gov.uk/media/5a821fdee5274a2e8ab579ef/futures-toolkit-edition-1.pdf
[60]
HM Government. 2017. Internet Safety Strategy – Green paper. https://www.gov.uk/government/consultations/internet-safety-strategy-green-paper
[61]
HM Government. 2022. Impact Assessment: The Online Safety Bill. https://publications.parliament.uk/pa/bills/cbill/58-02/0285/210285en.pdf
[62]
Ian D. Gow and Stuart Kells. 2018. The Big Four: The Curious Past and Perilous Future of the Global Accounting Monopoly. Berrett-Koehler Publishers, a BK Business book, Oakland.
[63]
Lara Groves, Jacob Metcalf, Alayna Kennedy, Briana Vecchione, and Andrew Strait. 2024. Auditing Work: Exploring the New York City Algorithmic Bias Audit Regime. In Proceedings of the 2024 Conference on Fairness, Accountability, and Transparency in Algorithmic Systems (FAccT’24). ACM, Rio de Janeiro, Brazil. https://doi.org/10.48550/arXiv.2402.08101
[64]
Eva Hartmann and Poul F. Kjaer (Eds.). 2015. The Evolution of Intermediary Institutions in Europe. Palgrave Macmillan UK, London. https://doi.org/10.1057/9781137484529
[65]
Marius Hobbhahn. 2021. Announcing Apollo Research. https://forum.effectivealtruism.org/posts/ysC6crBKhDBGZfob3/announcing-apollo-research
[66]
Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daum´e, Miro Dudik, and Hanna Wallach. 2019. Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3290605.3300830
[67]
Christopher Humphrey, Anne Loft, and Margaret Woods. 2009. The Global Audit Profession and the International Financial Architecture: Understanding Regulatory Relationships at a Time of Financial Crisis. Accounting, Organizations and Society 34, 6-7 (2009), 810–825. https://doi.org/10.1016/j.aos.2009.06.003
[68]
Basileal Imana, Aleksandra Korolova, and John Heidemann. 2023. Having Your Privacy Cake and Eating It Too: Platform-supported Auditing of Social Media Algorithms for Public Interest. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1–33.
[69]
Petros Iosifidis. 2011. The Public Sphere, Social Networks and Public Service Media. Information, Communication & Society 14, 5 (2011), 619–637.
[70]
Sheila Jasanoff and Sang-Hyun Kim. 2015. Dreamscapes of Modernity: Sociotechnical Imaginaries and the Fabrication of Power. University of Chicago Press, Chicago, IL. https://doi.org/10.7208/chicago/9780226276663.001.0001
[71]
Kate Kaye. 2022. A new wave of AI auditing startups wants to prove responsibility can be profitable. Protocol (03 Jan 2022). https://web.archive.org/web/20230416215440/https://www.protocol.com/enterprise/ai-audit-2022
[72]
Poul F. Kjaer (Ed.). 2020. The Law of Political Economy: Transformation in the Function of Law. Cambridge University Press, Cambridge. https://doi.org/10.1017/9781108675635
[73]
Allison Koenecke, Andrew Nam, Emily Lake, Joe Nudell, Minnie Quartey, Zion Mengesha, Connor Toups, John R. Rickford, Dan Jurafsky, and Sharad Goel. 2020. Racial Disparities in Automated Speech Recognition. Proceedings of the National Academy of Sciences 117, 14 (07 Apr 2020), 7684–7689. https://doi.org/10.1073/pnas.1915768117
[74]
Johann Laux, Sandra Wachter, and Brent Mittelstadt. 2021. Taming the Few: Platform Regulation, Independent Audits, and the Risks of Capture Created by the DMA and DSA. Computer Law & Security Review 43 (2021), 105613.
[75]
Paddy Leerssen. 2023. Seeing What Others Are Seeing: Studies in the Regulation of Transparency for Social Media Recommender Systems. Ph. D. Dissertation. University of Amsterdam.
[76]
Paddy Leerssen, Amélie P. Heldt, and Matthias C. Kettemann. 2023. Scraping By? Europe’s Law and Policy on Social Media Research Access. In Challenges and Perspectives of Hate Speech Research, Christian Strippel, Sünje Paasch-Colberg, Martin Emmer, and Joachim Trebbe (Eds.). Vol. 12. Berlin, 405–425. https://doi.org/10.48541/dcr.v12.24
[77]
Deloitte Consulting LLP. 2020. Deloitte Introduces Trustworthy AI Framework to Guide Organizations in Ethical Application of Technology in the Age of With. https://perma.cc/RZ3Q-UD47
[78]
Deloitte Consulting LLP. 2021. Deloitte AI Institute Teams With Chatterbox Labs to Ensure Ethical Application of AI. https://perma.cc/DC8D-QAS5
[79]
Natasha Lomas. 2023. Security Researchers Latest to Blast UK’s Online Safety Bill as Encryption Risk. https://techcrunch.com/2023/07/05/uk-online-safety-bill-risks-e2ee/
[80]
Daithí Mac Síthigh. 2020. The Road to Responsibilities: New Attitudes Towards Internet Intermediaries. Information & Communications Technology Law 29, 1 (2020), 1–21. https://doi.org/10/ggkhjn
[81]
Michael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, and Hanna Wallach. 2020. Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376445
[82]
Katherine R. Maffey, Kyle Dotterrer, Jennifer Niemann, Iain Cruickshank, Grace A. Lewis, and Christian Kästner. 2023. MLTEing Models: Negotiating, Evaluating, and Documenting Model and System Qualities. In 2023 IEEE/ACM 45th International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER). 31–36. https://doi.org/10.1109/ICSE-NIER58687.2023.00012
[83]
Chris Marsden, Trisha Meyer, and Ian Brown. 2020. Platform Values and Democratic Elections: How Can the Law Regulate Digital Disinformation?Computer Law & Security Review 36 (01 Apr 2020), 105373. https://doi.org/10.1016/j.clsr.2019.105373
[84]
Christopher T. Marsden. 2011. Internet Co-Regulation: European Law, Regulatory Governance and Legitimacy in Cyberspace. Cambridge University Press.
[85]
Kira J. M. Matus and Michael Veale. 2022. Certification Systems for Machine Learning: Lessons from Sustainability. Regulation & Governance 16, 1 (2022), 177–196. https://doi.org/10.1111/rego.12417
[86]
Anna-Katharina Meßmer and Martin Degeling. 2023. Auditing Recommender Systems–Putting the DSA into Practice with a Risk-Scenario-Based Approach. Stiftung Neue Verantwortung (2023). https://doi.org/10.48550/arXiv.2302.04556
[87]
Jacob Metcalf, Emanuel Moss, and Danah Boyd. 2019. Owning Ethics: Corporate Logics, Silicon Valley, and the Institutionalization of Ethics. Social Research: An International Quarterly 86, 2 (2019), 449–476. https://doi.org/10.1353/sor.2019.0022
[88]
Shira Mitchell, Eric Potash, Solon Barocas, Alexander D’Amour, and Kristian Lum. 2021. Algorithmic Fairness: Choices, Assumptions, and Definitions. Annu. Rev. Stat. Appl. 8, 1 (07 Mar 2021), 141–163. https://doi.org/10.1146/annurev-statistics-042720-125902
[89]
Nadia Nahar, Shurui Zhou, Grace Lewis, and Christian Kästner. 2022. Collaboration Challenges in Building ML-enabled Systems: Communication, Documentation, Engineering, and Process. In Proceedings of the 44th International Conference on Software Engineering. Association for Computing Machinery, New York, NY, USA, 413–425. https://doi.org/10.1145/3510003.3510209
[90]
Luca Nannini, Agathe Balayn, and Adam Leon Smith. 2023. Explainability in AI Policies: A Critical Review of Communications, Reports, Regulations, and Standards in the EU, US, and UK. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, NY, USA, 1198–1212. https://doi.org/10.1145/3593013.3594074
[91]
Chris Norval, Richard Cloete, and Jatinder Singh. 2023. Navigating the Audit Landscape: A Framework for Developing Transparent and Auditable XR. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, NY, USA, 1418–1431. https://doi.org/10.1145/3593013.3594090
[92]
Government of Canada. 2022. Summary: Regulatory Powers. https://www.canada.ca/en/canadian-heritage/campaigns/harmful-online-content/summary-session-four.html
[93]
Ofcom. 2023. Protecting People from Illegal Harms Online - Summary of Each Chapter. https://www.ofcom.org.uk/__data/assets/pdf_file/0030/270948/chapter-summaries-illegal-harms-consultation.pdf
[94]
Ofqual. 2020. Awarding GCSE, AS, A Level, Advanced Extension Awards and Extended Project Qualifications in Summer 2020: Interim Report. Technical Report. https://perma.cc/8QY4-VW4G
[95]
Victor Ojewale, Ryan Steed, Briana Vecchione, Abeba Birhane, and Inioluwa Deborah Raji. 2024. Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling. https://doi.org/10.48550/arXiv.2402.17861 arxiv:2402.17861
[96]
Chinasa T. Okolo, Nicola Dell, and Aditya Vashistha. 2022. Making AI Explainable in the Global South: A Systematic Review. In Proceedings of the 5th ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies. Association for Computing Machinery, New York, NY, USA, 439–452. https://doi.org/10.1145/3530190.3534802
[97]
Rock Yuren Pang, Jack Cenatempo, Franklyn Graham, Bridgette Kuehn, Maddy Whisenant, Portia Botchway, Katie Stone Perez, and Allison Koenecke. 2023. Auditing Cross-Cultural Consistency of Human-Annotated Labels for Recommendation Systems. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, NY, USA, 1531–1552. https://doi.org/10.1145/3593013.3594098
[98]
European Parliament. 2023. European Health Data Space Regulation (Amendments Adopted by the European Parliament). https://www.europarl.europa.eu/doceo/document/TA-9-2023-0462_EN.html
[99]
Claudia Peersman, Jos´e Tomas Llanos, Corinne May-Chahal, Ryan McConville, Partha Das Chowdhury, and Emiliano De Cristofaro. 2023. Towards a Framework for Evaluating CSAM Prevention and Detection Tools in the Context of End-to-end Encryption Environments: A Case Study. https://www.rephrain.ac.uk/safety-tech-challenge-fund/
[100]
Authoriteit Persoonsgegevens. 2024. AI & Algorithmic Risks Report Netherlands - Winter 2023 2024. https://perma.cc/M2JU-GCVU
[101]
Arthur C. Petersen, P. H. M. Janssen, JP van der Sluijs, J. S. Risbet, J. R. Ravetz, J. Arjan Wardekker, and H. Martison Hughes. 2013. Guidance for Uncertainty Assessment and Communication. PBL Netherlands Environmental Assessment Bureau, The Hague, NL. https://perma.cc/N9FJ-RGXU
[102]
Joseph Phiri and Pinar Guven-Uslu. 2019. Social Networks, Corruption and Institutions of Accounting, Auditing and Accountability. Accounting, Auditing & Accountability Journal 32, 2 (2019), 508–530.
[103]
Metropolitan Police. 2022. Understanding Accuracy and Bias. Technical Report. https://www.met.police.uk/SysSiteAssets/media/downloads/force-content/met/advice/lfr/other-lfr-documents/lfr-accuracy-and-demographic-differential.pdf
[104]
South Wales Police. 2021. Equality Impact Assessment: A Practical Tool to Identify Discrimination. https://perma.cc/E7AU-VFNJ
[105]
South Wales Police. 2023. Policy Document for the Overt Deployment of Live Facial Recognition (LFR) Technology. Technical Report. https://perma.cc/H5NF-D9QT
[106]
Martha Poon. 2007. Scorecards as Devices for Consumer Credit: The Case of Fair, Isaac & Company Incorporated. The Sociological Review 55, 2_suppl (2007), 284–306. https://doi.org/10/bbzb34
[107]
Martha Poon. 2009. From New Deal Institutions to Capital Markets: Commercial Consumer Risk Scores and the Making of Subprime Mortgage Finance. Accounting, Organizations and Society 34, 5 (2009), 654–674. https://doi.org/10/cm8g3x
[108]
Inioluwa Deborah Raji. 2022. From Algorithmic Audits to Actual Accountability: Overcoming Practical Roadblocks on the Path to Meaningful Audit Interventions for AI Governance. In Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society. Association for Computing Machinery, New York, NY, USA, 5. https://doi.org/10.1145/3514094.3539566
[109]
Inioluwa Deborah Raji. 2022. It’s Time to Develop the Tools We Need to Hold Algorithms Accountable. https://foundation.mozilla.org/en/blog/its-time-to-develop-the-tools-we-need-to-hold-algorithms-accountable/
[110]
Inioluwa Deborah Raji, Timnit Gebru, Margaret Mitchell, Joy Buolamwini, Joonseok Lee, and Emily Denton. 2020. Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing. https://doi.org/10.48550/arXiv.2001.00964 arxiv:2001.00964preprint.
[111]
Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes. 2020. Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, NY, USA, 33–44. https://doi.org/10.1145/3351095.3372873
[112]
Bogdana Rakova, Jingying Yang, Henriette Cramer, and Rumman Chowdhury. 2021. Where Responsible AI Meets Reality: Practitioner Perspectives on Enablers for Shifting Organizational Practices. Proc. ACM Hum.-Comput. Interact. 5, CSCW1 (22 Apr 2021), 7:1–7:23. https://doi.org/10.1145/3449081
[113]
Varun Ramdas. 2022. Identifying an Actionable Algorithmic Transparency Framework: A Comparative Analysis of Initiatives to Enhance Accountability of Social Media Platforms. Nat’l LU Delhi Stud. LJ 4 (2022), 74.
[114]
Howard Rosenbaum and Pnina Fichman. 2019. Algorithmic Accountability and Digital Justice: A Critical Assessment of Technical and Sociotechnical Approaches. Proceedings of the Association for Information Science and Technology 56, 1 (2019), 237–244.
[115]
Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms. In Data and Discrimination: Converting Critical Concerns into Productive: A Preconference at the 64th Annual Meeting of the International Communication Association. Seattle, Vol. 22. 4349–4357.
[116]
D. Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean-Francois Crespo, and Dan Dennison. 2015. Hidden Technical Debt in Machine Learning Systems. In Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 2. MIT Press, Cambridge, MA, USA, 2503–2511. https://proceedings.neurips.cc/paper_files/paper/2015/file/86df7dcfd896fcaf2674f757a2463eba-Paper.pdf
[117]
Nick Seaver. 2017. Algorithms as Culture: Some Tactics for the Ethnography of Algorithmic Systems. Big Data & Society 4, 2 (2017), 205395171773810. https://doi.org/10/gd8fdx
[118]
Hong Shen, Alicia DeVos, Motahhare Eslami, and Kenneth Holstein. 2021. Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–29.
[119]
Jessie J. Smith, Anas Buhayh, Anushka Kathait, Pradeep Ragothaman, Nicholas Mattei, Robin Burke, and Amy Voida. 2023. The Many Faces of Fairness: Exploring the Institutional Logics of Multistakeholder Microlending Recommendation. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, NY, USA, 1652–1663. https://doi.org/10.1145/3593013.3594106
[120]
Kevin B. Sobel-Read. 2020. Reimagining the Unimaginable: Law and the Ongoing Transformation of Global Value Chains into Integrated Legal Entities. European Review of Contract Law 16, 1 (07 Apr 2020), 160–185. https://doi.org/10.1515/ercl-2020-0009
[121]
Dan Sunderland and Gregory M. Trompeter. 2017. Multinational Group Audits: Problems Faced in Practice and Opportunities for Research. Auditing: A Journal of Practice & Theory 36, 3 (2017), 159–183. https://doi.org/10.2308/ajpt-51667
[122]
Petros Terzis and (Enrique) OE Santamaria Echeverria. 2023. Interoperability and Governance in the European Health Data Space Regulation. Medical Law International 23, 4 (2023), 368–376. https://doi.org/10.1177/09685332231165692
[123]
HM Treasury. 2015. The Aqua Book: Guidance on Producing Quality Analysis for Government. HM Government, London.
[124]
Roberto Ulloa, Mykola Makhortykh, and Aleksandra Urman. 2022. Scaling up Search Engine Audits: Practical Insights for Algorithm Auditing. Journal of Information Science (02 May 2022), 01655515221093029. https://doi.org/10.1177/01655515221093029
[125]
Michael Veale. forthcoming. Denied by Design? Data Access Rights in Encrypted Infrastructures. In Researcher Access to Digital Infrastructures, Jef Ausloos and Siddharth de Souza (Eds.). Cambridge University Press, Cambridge. https://doi.org/k5mk
[126]
Michael Veale and Irina Brass. 2019. Administration by Algorithm? Public Management Meets Public Sector Machine Learning. In Algorithmic Regulation, Karen Yeung and Martin Lodge (Eds.). Oxford University Press, Oxford, 121–149. https://doi.org/10/gfzvz8
[127]
Michael Veale and Frederik Zuiderveen Borgesius. 2021. Demystifying the Draft EU Artificial Intelligence Act. Computer Law Review International 22, 4 (2021), 97–112. https://doi.org/10/gns2s9
[128]
Kaiser Wolfram and Johan Schot. 2014. Writing the Rules for Europe. Palgrave Macmillan.
[129]
Richmond Y. Wong, Michael A. Madaio, and Nick Merrill. 2023. Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics. Proc. ACM Hum.-Comput. Interact. 7, CSCW1 (16 Apr 2023), 145:1–145:27. https://doi.org/10.1145/3579621
[130]
Lorna Woods and Will Perrin. 2021. Obliging Platforms to Accept a Duty of Care. In Regulating Big Tech, Martin Moore and Damian Tambini (Eds.). Oxford University Press, Oxford, 93–109. https://doi.org/10.1093/oso/9780197616093.003.0006
[131]
Lorna Woods, Will Perrin, and Maeve Walsh. 2019. Draft Online Harm Reduction Bill. https://carnegieuktrust.org.uk/publications/draft-online-harm-bill/
[132]
Meg Young, Michael Katell, and P. M. Krafft. 2022. Confronting Power and Corporate Capture at the FAccT Conference. In 2022 ACM Conference on Fairness, Accountability, and Transparency. ACM, Seoul, 1375–1386. https://doi.org/10.1145/3531146.3533194
[133]
Skye Zhu and Soon-Yeow Phang. 2024. How Do Lead Auditor Instructions Influence Component Auditors’ Evidence Collection Decisions? The Joint Influence of Construal Interpretations and Responsibility. Contemporary Accounting Research 41, 1 (2024), 591–619. https://doi.org/10.1111/1911-3846.12911
Index Terms
- Law and the Emerging Political Economy of Algorithmic Audits
Recommendations
The emerging law of international electronic commerce: recent work by UNCITRAL
ICEC '03: Proceedings of the 5th international conference on Electronic commerceThis paper describes the minimal aspects of any law intended to govern electronic commerce, and discusses the recent attempts by the United Nations Commission on International Trade Law to create a legal framework for electronic commerce. Electronic ...
A Sociotechnical Audit: Assessing Police Use of Facial Recognition
FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and TransparencyAlgorithmic audits are increasingly used to hold people accountable for the algorithms they implement. However, much work remains to integrate ethical and legal evaluations of how algorithms are used into audits. In this paper, we present a ...
Comments
Information & Contributors
Information
Published In
June 2024
2580 pages
ISBN:9798400704505
DOI:10.1145/3630106
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- UK Research and Innovation
Conference
FAccT '24
FAccT '24: The 2024 ACM Conference on Fairness, Accountability, and Transparency
June 3 - 6, 2024
Rio de Janeiro, Brazil
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 153Total Downloads
- Downloads (Last 12 months)153
- Downloads (Last 6 weeks)62
Reflects downloads up to 30 Aug 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in