Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3593013.3594115acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfacctConference Proceedingsconference-collections
research-article
Open access

Discrimination through Image Selection by Job Advertisers on Facebook

Published: 12 June 2023 Publication History

Abstract

Targeted advertising platforms are widely used by job advertisers to reach potential employees; thus issues of discrimination due to targeting that have surfaced have received widespread attention. Advertisers could misuse targeting tools to exclude people based on gender, race, location and other protected attributes from seeing their job ads. In response to legal actions, Facebook disabled the ability for explicit targeting based on many attributes for some ad categories, including employment. Although this is a step in the right direction, prior work has shown that discrimination can take place not just due to the explicit targeting tools of the platforms, but also due to the impact of the biased ad delivery algorithm. Thus, one must look at the potential for discrimination more broadly, and not merely through the lens of the explicit targeting tools.
In this work, we propose and investigate the prevalence of a new means for discrimination in job advertising, that combines both targeting and delivery – through the disproportionate representation or exclusion of people of certain demographics in job ad images. We use the Facebook Ad Library to demonstrate the prevalence of this practice through: (1) evidence of advertisers running many campaigns using ad images of people of only one perceived gender, (2) systematic analysis for gender representation in all current ad campaigns for truck drivers and nurses, (3) longitudinal analysis of ad campaign image use by gender and race for select advertisers. After establishing that the discrimination resulting from a selective choice of people in job ad images, combined with algorithmic amplification of skews by the ad delivery algorithm, is of immediate concern, we discuss approaches and challenges for addressing it.

References

[1]
ACLU. 2018. ACLU and Workers Take On Facebook for Gender Discrimination in Job Ads. https://www.aclu.org/press-releases/aclu-and-workers-take-facebook-gender-discrimination-job-ads
[2]
ACLU. 2018. How Facebook Is Giving Sex Discrimination in Employment Ads a New Life. https://www.aclu.org/news/womens-rights/how-facebook-giving-sex-discrimination-employment-ads-new
[3]
Muhammad Ali, Piotr Sapiezynski, Miranda Bogen, Aleksandra Korolova, Alan Mislove, and Aaron Rieke. 2019. Discrimination through optimization: How Facebook’s Ad delivery can lead to biased outcomes. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work and Social Computing.
[4]
Muhammad Ali, Piotr Sapiezynski, Aleksandra Korolova, Alan Mislove, and Aaron Rieke. 2021. Ad Delivery Algorithms: The Hidden Arbiters of Political Messaging. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining.
[5]
Julia Angwin and Terry Parris Jr.2016. Facebook Lets Advertisers Exclude Users by Race. https://www.propublica.org/article/facebook-lets-advertisers-exclude-users-by-race
[6]
Julia Angwin, Noam Scheiber, and Ariana Tobin. 2017. Dozens of companies are using Facebook to exclude older workers from job ads, ProPublica. https://www.propublica.org/article/facebook-ads-age-discrimination-targeting
[7]
Roy L. Austin Jr. 2023. An Update on Our Ads Fairness Efforts. https://about.fb.com/news/2023/01/an-update-on-our-ads-fairness-efforts/
[8]
Derek R Avery and Patrick F McKay. 2006. Target practice: An organizational impression management approach to attracting minority and female job applicants. Personnel Psychology (2006).
[9]
Sabyasachee Baruah, Digbalay Bose, Meredith Conroy, Shrikanth S. Narayanan, Susanna Ricco, Komal Singh, and Krishna Somandepalli. 2022. #SeeItBeIt: What families are seeing on TV, The Geena Davis Institute on Gender in Media. https://seejane.org/wp-content/uploads/GDI-What-Families-Are-Watching-TV-2022-Report.pdf
[10]
Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency.
[11]
Bureau of Labor Statistics. 2018. Electronically mediated work: New questions in the contingent worker supplement. https://www.bls.gov/opub/mlr/2018/article/electronically-mediated-work-new-questions-in-the-contingent-worker-supplement.htm
[12]
Bureau of Labor Statistics. 2021. Labor Force Statistics from the Current Population Survey. https://www.bls.gov/cps/cpsaat11.htm
[13]
Capaci v. Katz & Besthoff, Inc. 1983. Capaci v. Katz & Besthoff, Inc., 647 pages.
[14]
Elisa Celis, Anay Mehrotra, and Nisheeth Vishnoi. 2019. Toward controlling discrimination in online ad auctions. In International Conference on Machine Learning.
[15]
Esmita Charani, Sameed Shariq, Alexandra M Cardoso Pinto, Raabia Farooqi, Winnie Nambatya, Oluchi Mbamalu, Seye Abimbola, and Marc Mendelson. 2023. The use of imagery in global health: An analysis of infectious disease documents and a framework to guide practice. The Lancet Global Health 11, 1 (2023), e155–e164.
[16]
Chris Coons, Rob Portman, and Amy Klobuchar. 2021. Coons, Portman, Klobuchar announce legislation to ensure transparency at social media platforms. https://www.coons.senate.gov/news/press-releases/coons-portman-klobuchar-announce-legislation-to-ensure-transparency-at-social-media-platforms
[17]
Amit Datta, Anupam Datta, Jael Makagon, Deirdre K Mulligan, and Michael Carl Tschantz. 2018. Discrimination in online advertising: A multidisciplinary inquiry. In Conference on Fairness, Accountability and Transparency.
[18]
Amit Datta, Michael Carl Tschantz, and Anupam Datta. 2015. Automated Experiments on Ad Privacy Settings. Proceedings on Privacy Enhancing Technologies (2015).
[19]
Duren v. Missouri (U.S. Supreme Court) 1979. Duren v. Missouri (U.S. Supreme Court)., 357 pages. https://www.law.cornell.edu/supremecourt/text/439/357
[20]
Cynthia Dwork and Christina Ilvento. 2018. Fairness Under Composition. In 10th Innovations in Theoretical Computer Science Conference (ITCS 2019).
[21]
Laura Edelson, Jason Chuang, Erika Franklin Fowler, Michael Franz, and Travis N Ridout. 2021. Universal Digital Ad Transparency. In TPRC49: The 49th Research Conference on Communication, Information and Internet Policy.
[22]
Laura Edelson, Tobias Lauinger, and Damon McCoy. 2020. A security analysis of the Facebook Ad Library. In IEEE Symposium on Security and Privacy (SP). IEEE.
[23]
Facebook. 2018. Reviewing Targeting to Ensure Advertising is Safe and Civil. https://www.facebook.com/business/news/reviewing-targeting-to-ensure-advertising-is-safe-and-civil
[24]
Facebook. 2019. Updates To Housing, Employment and Credit Ads in Ads Manager. Retrieved January 14, 2022 from https://www.facebook.com/business/news/updates-to-housing-employment-and-credit-ads-in-ads-manager
[25]
Facebook. 2020. Facebook’s Civil Rights Audit – Final Report. Retrieved February 28, 2022 from https://about.fb.com/wp-content/uploads/2020/07/Civil-Rights-Audit-Final-Report.pdf
[26]
Facebook. 2020. Good Questions, Real Answers: How Does Facebook Use Machine Learning to Deliver Ads?Retrieved February 1, 2022 from https://www.facebook.com/business/news/good-questions-real-answers-how-does-facebook-use-machine-learning-to-deliver-ads/#
[27]
Facebook. 2022. About Bid and Budget Pacing. Retrieved February 24, 2022 from https://www.facebook.com/business/help/571961726580148?id=2196356200683573
[28]
Facebook. 2022. Removing Certain Ad Targeting Options and Expanding Our Ad Controls. https://www.facebook.com/business/news/removing-certain-ad-targeting-options-and-expanding-our-ad-controls
[29]
Facebook. 2023. About ad auctions. Retrieved May 10, 2023 from https://www.facebook.com/business/help/430291176997542
[30]
Facebook. 2023. Discriminatory Practices. https://transparency.fb.com/policies/ad-standards/unacceptable-content/discriminatory-practices
[31]
Facebook. 2023. Personal Attributes (Advertising Standards). Retrieved February 11, 2023 from https://transparency.fb.com/policies/ad-standards/objectionable-content/personal-attributes
[32]
Irfan Faizullabhoy and Aleksandra Korolova. 2018. Facebook’s Advertising Platform: New Attack Vectors and the Need for Interventions. In IEEE Workshop on Technology and Consumer Protection (ConPro ’18).
[33]
George Farkas, Paul L Morgan, Marianne M Hillemeier, Cynthia Mitchell, and Adrienne D Woods. 2020. District-level achievement gaps explain Black and Hispanic overrepresentation in special education. Exceptional Children 86, 4 (2020), 374–392.
[34]
Joseph L Gastwirth, Wenjing Xu, and Qing Pan. 2015. Statistical measures for evaluating protected group under-representation: Analysis of the conflicting inferences drawn from the same data in People v. Bryant and Ambrose v. Booker. Law, Probability and Risk 14, 4 (2015), 279–304.
[35]
Danielle Gaucher, Justin Friesen, and Aaron C Kay. 2011. Evidence that gendered wording in job advertisements exists and sustains gender inequality.Journal of personality and social psychology 101, 1 (2011), 109.
[36]
James J Gibson. 2002. A theory of direct visual perception. Vision and Mind: selected readings in the philosophy of perception (2002), 77–90.
[37]
Google. 2020. Update to Personalized advertising policies: Housing, employment, and credit. https://support.google.com/adspolicy/answer/9917652?hl=en
[38]
Mary L Gray, Siddharth Suri, Syed Shoaib Ali, and Deepti Kulkarni. 2016. The crowd is a collaborative network. In Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing.
[39]
Steven Greenshouse. 2004. Abercrombie to Alter Its Marketing to Settle Bias Suit, The New York Times. https://www.nytimes.com/2004/11/16/business/abercrombie-to-alter-its-marketing-to-settle-bias-suit.html
[40]
Alex Himel. 2018. Helping People Find Jobs and Local Businesses Hire. https://about.fb.com/news/2018/02/jobs/
[41]
Susan Illston. 2004. Gonzalez, et al., v. Abercrombie & Fitch Stores, Inc., et al.https://ecommons.cornell.edu/bitstream/handle/1813/80139/Gonzalez__et_al_v__Abercrombie_and_Fitch_Stores.pdf
[42]
Basileal Imana, Aleksandra Korolova, and John Heidemann. 2021. Auditing for Discrimination in Algorithms Delivering Job Ads. In Proceedings of the Web Conference.
[43]
Basileal Imana, Aleksandra Korolova, and John Heidemann. 2023. Having your Privacy Cake and Eating it Too: Platform-supported Auditing of Social Media Algorithms for Public Interest. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1–33.
[44]
Tanuj Jain, Christopher Lennan, Zubin John, and Dat Tran. 2019. Imagededup. https://github.com/idealo/imagededup.
[45]
Valerie Walsh Johnson. 1991. Fair Housing Act-Ragin v. New York Times: Is it time to end the use of models in housing advertisements?Mem. St. UL Rev. 22 (1991), 401.
[46]
Levi Kaplan, Nicole Gerzon, Alan Mislove, and Piotr Sapiezynski. 2022. Measurement and analysis of implied identity in ad delivery optimization. In Proceedings of the 22nd ACM Internet Measurement Conference. 195–209.
[47]
Matthew Kay, Cynthia Matuszek, and Sean A Munson. 2015. Unequal representation and gender stereotypes in image search results for occupations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems.
[48]
Jon Keegan. 2021. Facebook Got Rid of Racial Ad Categories. Or Did It?https://themarkup.org/citizen-browser/2021/07/09/facebook-got-rid-of-racial-ad-categories-or-did-it
[49]
Peter W Kerman. 1974. Sex discrimination in help wanted advertising. Santa Clara Lawyer (1974).
[50]
Sara Kingsley, Clara Wang, Alex Mikhalenko, Proteeti Sinha, and Chinmay Kulkarni. 2020. Auditing digital platforms for discrimination in economic opportunity advertising. arXiv preprint arXiv:2008.09656 (2020).
[51]
Anja Lambrecht and Catherine Tucker. 2019. Algorithmic bias? An empirical study of apparent gender-based discrimination in the display of STEM career ads. Management science 65, 7 (2019), 2966–2981.
[52]
Victor Le Pochat, Laura Edelson, Tom Van Goethem, Wouter Joosen, Damon McCoy, and Tobias Lauinger. 2022. An Audit of Facebook’s Political Ad Policy Enforcement. In Proceedings of the 31st USENIX Security Symposium. USENIX Association.
[53]
LinkedIn. 2021. Ad Targeting Discrimination. https://www.linkedin.com/help/linkedin/answer/a416948
[54]
LinkedIn Corporate Communications. 2019. Language Matters - How words impact men and women in the workplace. https://business.linkedin.com/content/dam/me/business/en-us/talent-solutions-lodestone/body/pdf/Linkedin-Language-Matters-Report-FINAL2.pdf
[55]
Alexandra Sasha Luccioni, Christopher Akiki, Margaret Mitchell, and Yacine Jernite. 2023. Stable Bias: Analyzing Societal Representations in Diffusion Models. arXiv preprint arXiv:2303.11408 (2023).
[56]
Paul Messaris. 1997. Visual persuasion: The role of images in advertising. Sage.
[57]
Meta. 2023. Introducing the AI Sandbox for advertisers and expanding our Meta Advantage suite. https://www.facebook.com/business/news/introducing-ai-sandbox-and-expanding-meta-advantage-suite
[58]
Meta. 2023. Toward fairness in personalized ads. https://about.fb.com/wp-content/uploads/2023/01/Toward_fairness_in_personalized_ads.pdf
[59]
Danaë Metaxa, Michelle A Gan, Su Goh, Jeff Hancock, and James A Landay. 2021. An Image of Society: Gender and Racial Representation and Impact in Image Search Results for Occupations. Proceedings of the ACM on Human-Computer Interaction (2021).
[60]
Perry L Moriearty. 2009. Framing justice: Media, bias, and legal decisionmaking. Md. L. Rev. (2009).
[61]
National Center for State Courts. 2010. Jury Managers’ Toolbox. https://www.ncsc-jurystudies.org/__data/assets/pdf_file/0026/7478/a-primer-on-fair-cross-section.pdf
[62]
National Organization For Women (NOW). 2014. Highlights. https://now.org/wp-content/uploads/2014/02/Highlights.pdf
[63]
New York Times 1973. Law on Sex‐Labeled Job Ads Is Upheld. https://www.nytimes.com/1973/06/22/archives/law-on-sexlabeled-job-ads-is-upheld.html
[64]
Kazuyuki Okudaira. 2023. Meta to debut ad-creating generative AI this year, CTO says. https://asia.nikkei.com/Business/Technology/Meta-to-debut-ad-creating-generative-AI-this-year-CTO-says
[65]
Barbara Ortutay. 2022. Facebook parent Meta’s revenue, profit decline amid ad slump. https://apnews.com/article/technology-business-earnings-reports-8d24203456813802a4239e54d1b444d4
[66]
Orestis Papakyriakopoulos and Arwa M Mboya. 2021. Beyond algorithmic bias: a socio-computational interrogation of the google search by image algorithm. Social Science Computer Review (2021).
[67]
Timothy D Pippert, Laura J Essenburg, and Edward J Matchett. 2013. We’ve got minorities, yes we do: Visual representations of racial and ethnic diversity in college recruitment materials. Journal of Marketing for Higher Education (2013).
[68]
Peter Romer-Friedman and Mitra Ebadolahi. 2022. Real Women in Trucking. http://guptawessler.com/real-women-in-trucking/
[69]
Sheryl Sandberg. 2019. Doing More to Protect Against Discrimination in Housing, Employment and Credit Advertising. Retrieved January 13, 2022 from https://about.fb.com/news/2019/03/protecting-against-discrimination-in-ads/
[70]
Piotr Sapiezynski, Avijit Ghosh, Levi Kaplan, Alan Mislove, and Aaron Rieke. 2022. Algorithms that “Don’t See Color”: Measuring Biases in Lookalike and Special Ad Audiences. In Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society.
[71]
Richard Seltzer, John M Copacino, and Diana Roberto Donahoe. 1995. Fair Cross-Section Challenges in Maryland: An Analysis and Proposal. U. Balt. L. Rev. 25 (1995), 127.
[72]
Márcio Silva, Lucas Santos de Oliveira, Athanasios Andreou, Pedro Olmo Vaz de Melo, Oana Goga, and Fabrício Benevenuto. 2020. Facebook ads monitor: An independent auditing system for political ads on Facebook. In Proceedings of The Web Conference.
[73]
Veronica Smith. 2008. Visual Persuasion: Issues in the translation of the visual in advertising. Meta: Journal des Traducteurs/Meta: Translators’ Journal (2008).
[74]
Vera Sosnovik and Oana Goga. 2021. Understanding the Complexity of Detecting Political Ads. In Proceedings of the Web Conference.
[75]
Till Speicher, Muhammad Ali, Giridhari Venkatadri, Filipe Nunes Ribeiro, George Arvanitakis, Fabrício Benevenuto, Krishna P Gummadi, Patrick Loiseau, and Alan Mislove. 2018. Potential for discrimination in online targeted advertising. In Conference on Fairness, Accountability and Transparency.
[76]
Michael Spence. 1973. Job Market Signaling. The Quarterly Journal of Economics (1973).
[77]
Anne Sraders. 2019. Goldman Sachs Removed This One Word From Some Recruiting Materials—and Saw Female Hires Soar. https://fortune.com/2019/12/10/goldman-sachs-removed-this-one-word-from-some-recruiting-materials-and-saw-female-hires-soar/
[78]
Latanya Sweeney. 2013. Discrimination in online ad delivery. Commun. ACM (2013).
[79]
Henri Tajfel and John C. Turner. 1974. Social identity and intergroup behaviour. Social science information (1974).
[80]
Ruth E. Thaler-Carter. 2001. Diversify Your Recruitment Advertising. More companies are adding a diversity element to their recruitment ads. HR MAGAZINE 46, 6 (2001), 92–101.
[81]
The United States Department of Justice. 2022. Justice Department Secures Groundbreaking Settlement Agreement with Meta Platforms, Formerly Known as Facebook, to Resolve Allegations of Discriminatory Advertising. https://www.justice.gov/opa/pr/justice-department-secures-groundbreaking-settlement-agreement-meta-platforms-formerly-known
[82]
Ariana Tobin. 2019. HUD sues Facebook over housing discrimination and says the company’s algorithms have made the problem worse. https://propublica.org/article/hud-sues-facebook-housing-discrimination-advertising-algorithms
[83]
Ariana Tobin and Jeremy B. Merrill. 2018. Facebook Is Letting Job Advertisers Target Only Men, ProPublica. https://www.propublica.org/article/facebook-is-letting-job-advertisers-target-only-men
[84]
U.S. Department of Education. 2016. Racial and Ethnic Disparities in Special Education. https://www2.ed.gov/programs/osepidea/618-data/LEA-racial-ethnic-disparities-tables/disproportionality-analysis-by-state-analysis-category.pdf
[85]
U.S. Equal Employment Opportunity Commission. 1981. CM-607 Affirmative Action. https://www.eeoc.gov/laws/guidance/cm-607-affirmative-action
[86]
U.S.C.1964. Title VII of the Civil Rights Act of 1964. https://www.eeoc.gov/statutes/title-vii-civil-rights-act-1964
[87]
U.S.C.1968. Fair Housing Act. https://www.justice.gov/crt/fair-housing-act-1
[88]
H Jack Walker, Hubert S Feild, Jeremy B Bernerth, and J Bret Becton. 2012. Diversity cues on recruitment websites: Investigating the effects on job seekers’ information processing.Journal of Applied Psychology 97, 1 (2012), 214.
[89]
Kenneth White, Megan McCoy, Kim Love, Eun Jin Kwak, Erin Bruce, and John Grable. 2019. The role of signaling when promoting diversity and inclusion at the firm level: A financial advisory professional case study. Advances in Business Research 9, 1 (2019), 1–16.
[90]
Kyra Yee, Uthaipon Tantipongpipat, and Shubhanshu Mishra. 2021. Image cropping on Twitter: Fairness metrics, their limitations, and the importance of representation, design, and agency. Proceedings of the ACM on Human-Computer Interaction (2021).
[91]
Lara Zarum. 2018. Some Viewers Think Netflix Is Targeting Them by Race. Here’s What to Know.https://www.nytimes.com/2018/10/23/arts/television/netflix-race-targeting-personalization.html

Cited By

View all
  • (2024)Auditing for Racial Discrimination in the Delivery of Education AdsProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659041(2348-2361)Online publication date: 3-Jun-2024
  • (2023)Normalization of Vaping on TikTok: A Mixed-Methods Approach Using Computer Vision, Natural Language Processing, and Qualitative Thematic Analysis (Preprint)Journal of Medical Internet Research10.2196/55591Online publication date: 18-Dec-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency
June 2023
1929 pages
ISBN:9798400701924
DOI:10.1145/3593013
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2023

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

FAccT '23

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)818
  • Downloads (Last 6 weeks)85
Reflects downloads up to 14 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Auditing for Racial Discrimination in the Delivery of Education AdsProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659041(2348-2361)Online publication date: 3-Jun-2024
  • (2023)Normalization of Vaping on TikTok: A Mixed-Methods Approach Using Computer Vision, Natural Language Processing, and Qualitative Thematic Analysis (Preprint)Journal of Medical Internet Research10.2196/55591Online publication date: 18-Dec-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media