Auditing for Racial Discrimination in the Delivery of Education Ads
Pages 2348 - 2361
Abstract
Digital ads on social-media platforms play an important role in shaping access to economic opportunities. Our work proposes and implements a new third-party auditing method that can evaluate racial bias in the delivery of ads for education opportunities. Third-party auditing is important because it allows external parties to demonstrate presence or absence of bias in social-media algorithms. Education is a domain with legal protections against discrimination and concerns of racial-targeting, but bias induced by ad delivery algorithms has not been previously explored in this domain. Prior audits demonstrated discrimination in platforms’ delivery of ads to users for housing and employment ads. These audit findings supported legal action that prompted Meta to change their ad-delivery algorithms to reduce bias, but only in the domains of housing, employment, and credit. In this work, we propose a new methodology that allows us to measure racial discrimination in a platform’s ad delivery algorithms for education ads. We apply our method to Meta using ads for real schools and observe the results of delivery. We find evidence of racial discrimination in Meta’s algorithmic delivery of ads for education opportunities, posing legal and ethical concerns. Our results extend evidence of algorithmic discrimination to the education domain, showing that current bias mitigation mechanisms are narrow in scope, and suggesting a broader role for third-party auditing of social media in areas where ensuring non-discrimination is important.
References
[1]
Muhammad Ali, Angelica Goetzen, Alan Mislove, Elissa M. Redmiles, and Piotr Sapiezynski. 2023. Problematic Advertising and its Disparate Exposure on Facebook. In 32nd USENIX Security Symposium (USENIX Security 23). USENIX Association, Anaheim, CA, 5665–5682. https://dl.acm.org/doi/abs/10.5555/3620237.3620554
[2]
Muhammad Ali, Piotr Sapiezynski, Miranda Bogen, Aleksandra Korolova, Alan Mislove, and Aaron Rieke. 2019. Discrimination through Optimization: How Facebook’s Ad Delivery Can Lead to Biased Outcomes. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work and Social Computing, Vol. 3. ACM, 1–30. https://dl.acm.org/doi/10.1145/3359301
[3]
Muhammad Ali, Piotr Sapiezynski, Aleksandra Korolova, Alan Mislove, and Aaron Rieke. 2021. Ad Delivery Algorithms: The Hidden Arbiters of Political Messaging. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining (Virtual Event, Israel) (WSDM ’21). Association for Computing Machinery, New York, NY, USA, 13–21. https://doi.org/10.1145/3437963.3441801
[4]
Julia Angwin and Terry Paris Jr.2016. Facebook Lets Advertisers Exclude Users by Race – ProPublica. Retrieved February 18, 2021 from https://www.propublica.org/article/facebook-lets-advertisers-exclude-users-by-race
[5]
Peter Arcidiacono, Josh Kinsler, and Tyler Ransom. 2022. What the Students for Fair Admissions Cases Reveal About Racial Preferences. Working Paper 29964. National Bureau of Economic Research, Cambridge, MA. https://doi.org/10.3386/w29964
[6]
Roy L. Austin. 2023. An Update on Our Ads Fairness Efforts. https://about.fb.com/news/2023/01/an-update-on-our-ads-fairness-efforts/.
[7]
Solon Barocas and Andrew D Selbst. 2016. Big data’s disparate impact. California law review (2016), 671–732.
[8]
Joseph R Biden. 2023. Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence. Retrieved November 30, 2023 from https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/
[9]
Raj Chetty, John N Friedman, Emmanuel Saez, Nicholas Turner, and Danny Yagan. 2017. Mobility Report Cards: The Role of Colleges in Intergenerational Mobility. Working Paper 23618. National Bureau of Economic Research, Cambridge, MA. https://doi.org/10.3386/w23618
[10]
Chris Coons, Rob Portman, Amy Klobuchar, and Bill Cassidy. 2022. Platform Accountability and Transparency Act. Retrieved December 21, 2021 from https://www.coons.senate.gov/news/press-releases/senator-coons-colleagues-introduce-legislation-to-provide-public-with-transparency-of-social-media-platforms
[11]
Amit Datta, Anupam Datta, Jael Makagon, Deirdre K Mulligan, and Michael Carl Tschantz. 2018. Discrimination in Online Personalization: A Multidisciplinary Inquiry.Proceedings of the 2018 ACM Conference on Fairness, Accountability, and Transparency 81 (2018), 20–34.
[12]
David Deming, Claudia Goldin, and Lawrence Katz. 2013. For-Profit Colleges. The Future of Children 23, 1 (2013), 137–163. http://www.jstor.org/stable/23409492
[13]
Cynthia Dwork and Christina Ilvento. 2019. Fairness Under Composition. In 10th Innovations in Theoretical Computer Science Conference (ITCS 2019), Vol. 124. 33:1–33:20. https://doi.org/10.4230/LIPIcs.ITCS.2019.33
[14]
European Commission. 2022. Digital Services Act: Commission welcomes political agreement on rules ensuring a safe and accountable online environment. Retrieved April 27, 2022 from https://ec.europa.eu/commission/presscorner/detail/en/ip_22_2545
[15]
Executive Office of the President. 2023. Advancing Governance, Innovation, and Risk Management for Agency Use of Artificial Intelligence. Retrieved December 27, 2023 from https://ai.gov/wp-content/uploads/2023/11/AI-in-Government-Memo-Public-Comment.pdf
[16]
Federal Reserve. 2023. Report on the Economic Well-Being of U.S. Households in 2022. Retrieved November 1, 2023 from https://www.federalreserve.gov/publications/files/2022-report-economic-well-being-us-households-202305.pdf
[17]
Florida Division of Elections. 2022. Voter Extract Disk Request. https://dos.fl.gov/elections/data-statistics/voter-registration-statistics/voter-extract-disk-request/
[18]
Carolin Gerlitz and Anne Helmond. 2013. The Like Economy: Social buttons and the data-intensive web. New Media & Society 15, 8 (2013), 1348–1365. https://doi.org/10.1177/1461444812472322
[19]
Howard R. Gold. 2019. Who’s at Fault for Student-Loan Defaults?Retrieved January 29, 2023 from https://www.chicagobooth.edu/review/whos-fault-student-loan-defaults
[20]
Sandra González-Bailón, David Lazer, Pablo Barberá, Meiqing Zhang, Hunt Allcott, Taylor Brown, Adriana Crespo-Tenorio, Deen Freelon, Matthew Gentzkow, Andrew M. Guess, Shanto Iyengar, Young Mie Kim, Neil Malhotra, Devra Moehler, Brendan Nyhan, Jennifer Pan, Carlos Velasco Rivera, Jaime Settle, Emily Thorson, Rebekah Tromble, Arjun Wilkins, Magdalena Wojcieszak, Chad Kiewiet de Jonge, Annie Franco, Winter Mason, Natalie Jomini Stroud, and Joshua A. Tucker. 2023. Asymmetric ideological segregation in exposure to political news on Facebook. Science 381, 6656 (2023), 392–398. https://www.science.org/doi/abs/10.1126/science.ade7138
[21]
Andrew M. Guess, Neil Malhotra, Jennifer Pan, Pablo Barberá, Hunt Allcott, Taylor Brown, Adriana Crespo-Tenorio, Drew Dimmery, Deen Freelon, Matthew Gentzkow, Sandra González-Bailón, Edward Kennedy, Young Mie Kim, David Lazer, Devra Moehler, Brendan Nyhan, Carlos Velasco Rivera, Jaime Settle, Daniel Robert Thomas, Emily Thorson, Rebekah Tromble, Arjun Wilkins, Magdalena Wojcieszak, Beixian Xiong, Chad Kiewiet de Jonge, Annie Franco, Winter Mason, Natalie Jomini Stroud, and Joshua A. Tucker. 2023. How do social media feed algorithms affect attitudes and behavior in an election campaign?Science 381, 6656 (2023), 398–404. https://www.science.org/doi/abs/10.1126/science.abp9364
[22]
Andrew M. Guess, Neil Malhotra, Jennifer Pan, Pablo Barberá, Hunt Allcott, Taylor Brown, Adriana Crespo-Tenorio, Drew Dimmery, Deen Freelon, Matthew Gentzkow, Sandra González-Bailón, Edward Kennedy, Young Mie Kim, David Lazer, Devra Moehler, Brendan Nyhan, Carlos Velasco Rivera, Jaime Settle, Daniel Robert Thomas, Emily Thorson, Rebekah Tromble, Arjun Wilkins, Magdalena Wojcieszak, Beixian Xiong, Chad Kiewiet de Jonge, Annie Franco, Winter Mason, Natalie Jomini Stroud, and Joshua A. Tucker. 2023. Reshares on social media amplify political news but do not detectably affect beliefs or opinions. Science 381, 6656 (2023), 404–408. https://www.science.org/doi/pdf/10.1126/science.add8424
[23]
John Hegeman and Jared Morgenstern. 2009. User feedback-based selection and prioritizing of online advertisements. https://patents.google.com/patent/US20110106630A1/en. United States Patent Application (2009).
[24]
Paul Hitlin and Lee Rainie. 2019. Facebook algorithms and personal data. Pew Research Center 16 (2019).
[25]
Sture Holm. 1979. A Simple Sequentially Rejective Multiple Test Procedure. Scandinavian Journal of Statistics 6, 2 (1979), 65–70. http://www.jstor.org/stable/4615733
[26]
Michael Hurwitz. 2011. The impact of legacy status on undergraduate admissions at elite colleges and universities. Economics of Education Review 30, 3 (2011), 480–492. https://doi.org/10.1016/j.econedurev.2010.12.002
[27]
Basileal Imana, Aleksandra Korolova, and John Heidemann. 2021. Auditing for Discrimination in Algorithms Delivering Job Ads. In Proceedings of the Web Conference 2021. Association for Computing Machinery, New York, NY, USA, 3767–3778. https://doi.org/10.1145/3442381.3450077
[28]
Basileal Imana, Aleksandra Korolova, and John Heidemann. 2023. Having Your Privacy Cake and Eating It Too: Platform-Supported Auditing of Social Media Algorithms for Public Interest. Proceedings of the ACM Human Computer Interaction 7, CSCW1, Article 134 (04 2023), 33 pages. https://doi.org/10.1145/3579610
[29]
Basileal Imana, Aleksandra Korolova, and John Heidemann. 2024. Dataset of ad content and delivery statistics used in “Auditing for Racial Discrimination in the Delivery of Education Ads”. https://ant.isi.edu/datasets/addelivery-education/.
[30]
Mathew Joseph, Eileen Wall Mullen, and Deborah F. Spake. 2012. University branding: Understanding students’ choice of an educational institution. Journal of Brand Management 20 (2012), 1 – 12. https://api.semanticscholar.org/CorpusID:168107438
[31]
Suzanne Kahn, Mark Huelsman, and Jen Mishory. 2019. Bridging Progressive Policy Debates: How Student Debt and the Racial Wealth Gap Reinforce Each Other. Retrieved January 18, 2023 from https://rooseveltinstitute.org/wp-content/uploads/2020/07/RI_Student-Debt-and-RWG-201909.pdf
[32]
Levi Kaplan, Nicole Gerzon, Alan Mislove, and Piotr Sapiezynski. 2022. Measurement and Analysis of Implied Identity in Ad Delivery Optimization. In Proceedings of the 22nd ACM Internet Measurement Conference (Nice, France) (IMC ’22). Association for Computing Machinery, New York, NY, USA, 195–209. https://doi.org/10.1145/3517745.3561450
[33]
Michelle S. Lam, Ayush Pandit, Colin H. Kalicki, Rachit Gupta, Poonam Sahoo, and Danaë Metaxa. 2023. Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 360 (oct 2023), 37 pages. https://doi.org/10.1145/3610209
[34]
Anja Lambrecht and Catherine Tucker. 2019. Algorithmic bias? An empirical study of apparent gender-based discrimination in the display of STEM career ads. Management Science 65, 7 (2019), 2966–2981. http://dx.doi.org/10.2139/ssrn.2852260
[35]
Laura Murphy and Associates. 2020. Facebook’s Civil Rights Audit – Final Report. Retrieved October 19, 2020 from https://about.fb.com/wp-content/uploads/2020/07/Civil-Rights-Audit-Final-Report.pdf
[36]
Lisa Gabrielle Lerman and Annette K. Sanderson. 1978. Discrimination in Access to Public Places: A Survey of State and Federal Public Accommodations Laws Project. New York University Review of Law and Social Change 7 (1978), 215.
[37]
LinkedIn. 2021. How the LinkedIn Ads Auction Works — and How You Can Benefit. Retrieved November 9, 2021 from https://www.linkedin.com/business/marketing/blog/linkedin-ads/how-the-linkedin-ads-auction-works-and-how-you-can-benefit
[38]
Adam Looney and Constantine Yannelis. 2015. A Crisis in Student Loans? How Changes in the Characteristics of Borrowers and in the Institutions They Attended Contributed to Rising Loan Defaults. Brookings Papers on Economic Activity (2015), 1–68. http://www.jstor.org/stable/43752167
[39]
Meta. 2024. About Ad Auctions. Retrieved May 2, 2024 from https://www.facebook.com/business/help/430291176997542?id=561906377587030
[40]
Meta. 2024. Ad Library. Retrieved May 2, 2024 from https://www.facebook.com/ads/library
[41]
Meta. 2024. Create a customer list custom audience. Retrieved May 2, 2024 from https://www.facebook.com/business/help/170456843145568?id=2469097953376494
[42]
Meta. 2024. Facebook Open Research & Transparency. Retrieved May 2, 2024 from https://fort.fb.com/
[43]
Meta. 2024. How to choose the right ad objective in Meta Ads Manager. Retrieved May 2, 2024 from https://www.facebook.com/business/help/1438417719786914
[44]
Meta Technical Report. 2023. Towards Fairness in Personalized Ads. Retrieved November 24, 2023 from https://about.fb.com/wp-content/uploads/2023/01/Toward_fairness_in_personalized_ads.pdf
[45]
Meta’s Civil Rights Team. 2021. Meta’s Progress on Civil Rights Audit Commitments. Retrieved November 22, 2021 from https://about.fb.com/wp-content/uploads/2021/11/Metas-Progress-on-Civil-Rights-Audit-Commitments.pdf
[46]
Varun Nagaraj Rao and Aleksandra Korolova. 2023. Discrimination through Image Selection by Job Advertisers on Facebook. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency(FAccT ’23). Association for Computing Machinery, 1772–1788. https://doi.org/10.1145/3593013.3594115
[47]
Brandie Nonnecke and Camille Carlton. 2022. EU and US legislation seek to open up digital platform data. Science 375, 6581 (2022), 610–612. https://doi.org/10.1126/science.abl8537 arXiv:https://www.science.org/doi/pdf/10.1126/science.abl8537
[48]
North Carolina State Board of Elections. 2020. Voter History Data. https://dl.ncsbe.gov/index.html.
[49]
Brendan Nyhan, Jaime Settle, Emily Thorson, Magdalena Wojcieszak, Pablo Barberá, Annie Y Chen, Hunt Allcott, Taylor Brown, Adriana Crespo-Tenorio, Drew Dimmery, 2023. Like-minded sources on Facebook are prevalent but not polarizing. Nature 620, 7972 (2023), 137–144. https://www.nature.com/articles/s41586-023-06297-w
[50]
U.S. Department of Education. 2018. Law Enforcement Actions Against Predatory Colleges. Retrieved December 25, 2023 from https://sites.ed.gov/naciqi/files/2018/05/NACIQI-Enclosure-1-law-enforcement.pdf
[51]
U.S. Department of Housing and Urban Development. 2024. Guidance on Application of the Fair Housing Act to the Advertising of Housing, Credit, and Other Real Estate-Related Transactions through Digital Platforms. Retrieved May 2nd, 2024 from https://www.hud.gov/sites/dfiles/FHEO/documents/FHEO_Guidance_on_Advertising_through_Digital_Platforms.pdf
[52]
Victor Ojewale, Ryan Steed, Briana Vecchione, Abeba Birhane, and Inioluwa Deborah Raji. 2024. Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling. https://doi.org/10.48550/arXiv.2402.17861
[53]
Sheryl Sandberg. 2019. Doing More to Protect Against Discrimination in Housing, Employment and Credit Advertising. Retrieved October 19, 2020 from https://about.fb.com/news/2019/03/protecting-against-discrimination-in-ads/
[54]
Aruna Sankaranarayanan, Erik Hemberg, and Una-May O’Reilly. 2023. The Facebook Algorithm’s Active Role in Climate Advertisement Delivery. https://arxiv.org/abs/2308.03191
[55]
Michael D. Shear and Anemona Hartocollis. 2023. Education Dept. Opens Civil Rights Inquiry Into Harvard’s Legacy Admissions. Retrieved January 9, 2024 from https://www.nytimes.com/2023/07/25/us/politics/harvard-admissions-civil-rights-inquiry.html
[56]
Till Speicher, Muhammad Ali, Giridhari Venkatadri, Filipe Nunes Ribeiro, George Arvanitakis, Fabrício Benevenuto, Krishna P. Gummadi, Patrick Loiseau, and Alan Mislove. 2018. Potential for Discrimination in Online Targeted Advertising. In Proceedings of Machine Learning Research, Vol. 81. PMLR, New York, NY, USA, 5–19. http://proceedings.mlr.press/v81/speicher18a.html
[57]
Scott Spencer. 2020. Upcoming Update To Housing, Employment, And Credit Advertising Policies. Retrieved October 19, 2020 from https://www.blog.google/technology/ads/upcoming-update-housing-employment-and-credit-advertising-policies/
[58]
The US Department of Justice. 2022. Justice Department Secures Groundbreaking Settlement Agreement with Meta Platforms, Formerly Known as Facebook, to Resolve Allegations of Discriminatory Advertising. Retrieved June 29, 2022 from https://www.justice.gov/opa/pr/justice-department-secures-groundbreaking-settlement-agreement-meta-platforms-formerly-known
[59]
Ariana Tobin and Jeremy B. Merrill. 2018. Facebook Is Letting Job Advertisers Target Only Men – ProPublica. Retrieved February 18, 2021 from https://www.propublica.org/article/facebook-is-letting-job-advertisers-target-only-men
[60]
U.S. Department of Education. 2022. College Scorecard. https://collegescorecard.ed.gov/.
[61]
USC. 1964. 42 USC Section 2000d. https://www.law.cornell.edu/uscode/text/42/2000d.
[62]
USC. 1974. 20 USC Chapter 39 — Equal educational opportunities and transportation of students. https://www.law.cornell.edu/uscode/text/20/chapter-39.
[63]
USC. 1977. DC Human Rights Act – D.C. Code § 2-14. http://dccode.elaws.us/code?no=2-14.
[64]
Nils Wernerfelt, Anna Tuchman, Bradley Shapiro, and Robert Moakler. 2022. Estimating the Value of Offsite Data to Advertisers on Meta. University of Chicago, Becker Friedman Institute for Economics Working Paper114 (2022).
[65]
X. 2024. Bidding and auctions FAQs. Retrieved May 2, 2024 from https://business.twitter.com/en/help/troubleshooting/bidding-and-auctions-faqs.html
[66]
YouTube. 2022. YouTube Researcher Program. Retrieved July 14, 2022 from https://research.youtube/
Index Terms
- Auditing for Racial Discrimination in the Delivery of Education Ads
Recommendations
Auditing for Discrimination in Algorithms Delivering Job Ads
WWW '21: Proceedings of the Web Conference 2021Ad platforms such as Facebook, Google and LinkedIn promise value for advertisers through their targeted advertising. However, multiple studies have shown that ad delivery on such platforms can be skewed by gender or race due to hidden algorithmic ...
Discrimination through Optimization: How Facebook's Ad Delivery Can Lead to Biased Outcomes
The enormous financial success of online advertising platforms is partially due to the precise targeting features they offer. Although researchers and journalists have found many ways that advertisers can target---or exclude---particular groups of users ...
An fmri investigation of attributing negative social treatment to racial discrimination
We used fMRI to examine the neural responses that occur during experiences of perceived racial discrimination. Previous neuroimaging studies have focused exclusively on the processes underlying racial bias from the perpetrator's perspective and have yet ...
Comments
Information & Contributors
Information
Published In
June 2024
2580 pages
ISBN:9798400704505
DOI:10.1145/3630106
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
FAccT '24
FAccT '24: The 2024 ACM Conference on Fairness, Accountability, and Transparency
June 3 - 6, 2024
Rio de Janeiro, Brazil
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 127Total Downloads
- Downloads (Last 12 months)127
- Downloads (Last 6 weeks)40
Reflects downloads up to 03 Oct 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in