Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3555041.3589725acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
short-paper
Open access

Dexer: Detecting and Explaining Biased Representation in Ranking

Published: 05 June 2023 Publication History

Abstract

With the growing use of ranking algorithms in real-life decision-making purposes, fairness in ranking has been recognized as an important issue. Recent works have studied different fairness measures in ranking, and many of them consider the representation of different "protected groups", in the top-k ranked items, for any reasonable k. Given the protected groups, confirming algorithmic fairness is a simple task. However, the groups' definitions may be unknown in advance. To this end, we present Dexer, a system for the detection of groups with biased representation in the top-k. Dexer utilizes the notion of Shapley values to provide the users with visual explanations for the cause of bias. We will demonstrate the usefulness of Dexer using real-life data.

Supplemental Material

MP4 File
Demo presentation video

References

[1]
Abolfazl Asudeh, HV Jagadish, Julia Stoyanovich, and Gautam Das. 2019a. Designing fair ranking schemes. In Proceedings of the 2019 International Conference on Management of Data.
[2]
Abolfazl Asudeh, Zhongjun Jin, and H. V. Jagadish. 2019b. Assessing and Remedying Coverage for a Given Dataset. In ICDE.
[3]
Tobias Berg, Valentin Burg, Ana Gombović, and Manju Puri. 2020. On the rise of fintechs: Credit scoring using digital footprints. The Review of Financial Studies, Vol. 33, 7 (2020).
[4]
Ángel Alexander Cabrera, Will Epperson, Fred Hohman, Minsuk Kahng, Jamie Morgenstern, and Duen Horng Chau. 2019. Fairvis: Visual analytics for discovering intersectional bias in machine learning. In VAST.
[5]
Yeounoh Chung, Tim Kraska, Neoklis Polyzotis, Ki Hyun Tae, and Steven Euijong Whang. 2020. Automated Data Slicing for Model Validation: A Big Data - AI Integration Approach. IEEE Trans. Knowl. Data Eng., Vol. 32, 12 (2020).
[6]
Paulo Cortez and Alice Maria Goncc alves Silva. 2008. Using data mining to predict secondary school student performance. (2008).
[7]
Sahin Cem Geyik, Stuart Ambler, and Krishnaram Kenthapadi. 2019. Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search. In SIGKDD. ACM.
[8]
Zhongjun Jin, Mengjing Xu, Chenkai Sun, Abolfazl Asudeh, and HV Jagadish. 2020. Mithracoverage: a system for investigating population bias for intersectional fairness. In SIGMOD.
[9]
Shira Mitchell, Eric Potash, Solon Barocas, Alexander D'Amour, and Kristian Lum. 2021. Algorithmic fairness: Choices, assumptions, and definitions. Annual Review of Statistics and Its Application, Vol. 8 (2021).
[10]
Yuval Moskovitch, Jinyang Li, and H. V. Jagadish. 2023. Detection of Groups with Biased Representation in Ranking. CoRR, Vol. abs/2301.00719 (2023). https://arxiv.org/abs/2301.00719
[11]
Eliana Pastor, Luca de Alfaro, and Elena Baralis. 2021a. Identifying Biased Subgroups in Ranking and Classification. CoRR, Vol. abs/2108.07450 (2021). https://arxiv.org/abs/2108.07450
[12]
Eliana Pastor, Luca de Alfaro, and Elena Baralis. 2021b. Looking for Trouble: Analyzing Classifier Behavior via Pattern Divergence. In SIGMOD.
[13]
Christopher Peskun, Allan Detsky, and Maureen Shandling. 2007. Effectiveness of medical school admissions criteria in predicting residency ranking four years later. Medical education, Vol. 41, 1 (2007).
[14]
Evaggelia Pitoura, Kostas Stefanidis, and Georgia Koutrika. 2022. Fairness in rankings and recommendations: an overview. VLDB J., Vol. 31, 3 (2022).
[15]
L Shapley. 2020. 7. A Value for n-Person Games. Contributions to the Theory of Games II (1953) 307--317. In Classics in Game Theory. Princeton University Press.
[16]
Ke Yang and Julia Stoyanovich. 2017. Measuring Fairness in Ranked Outputs. In SSDBM. ACM.
[17]
Tobias Berg, Valentin Burg, Ana Gombović, and Manju Puri. 2020. On the rise of fintechs: Credit scoring using digital footprints. The Review of Financial Studies, Vol. 33, 7 (2020).
[18]
Ángel Alexander Cabrera, Will Epperson, Fred Hohman, Minsuk Kahng, Jamie Morgenstern, and Duen Horng Chau. 2019. Fairvis: Visual analytics for discovering intersectional bias in machine learning. In VAST.
[19]
Yeounoh Chung, Tim Kraska, Neoklis Polyzotis, Ki Hyun Tae, and Steven Euijong Whang. 2020. Automated Data Slicing for Model Validation: A Big Data - AI Integration Approach. IEEE Trans. Knowl. Data Eng., Vol. 32, 12 (2020).
[20]
Paulo Cortez and Alice Maria Goncc alves Silva. 2008. Using data mining to predict secondary school student performance. (2008).
[21]
Sahin Cem Geyik, Stuart Ambler, and Krishnaram Kenthapadi. 2019. Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search. In SIGKDD. ACM.
[22]
Zhongjun Jin, Mengjing Xu, Chenkai Sun, Abolfazl Asudeh, and HV Jagadish. 2020. Mithracoverage: a system for investigating population bias for intersectional fairness. In SIGMOD.
[23]
Shira Mitchell, Eric Potash, Solon Barocas, Alexander D'Amour, and Kristian Lum. 2021. Algorithmic fairness: Choices, assumptions, and definitions. Annual Review of Statistics and Its Application, Vol. 8 (2021).
[24]
Yuval Moskovitch, Jinyang Li, and H. V. Jagadish. 2023. Detection of Groups with Biased Representation in Ranking. CoRR, Vol. abs/2301.00719 (2023). https://arxiv.org/abs/2301.00719
[25]
Eliana Pastor, Luca de Alfaro, and Elena Baralis. 2021a. Identifying Biased Subgroups in Ranking and Classification. CoRR, Vol. abs/2108.07450 (2021). https://arxiv.org/abs/2108.07450
[26]
Eliana Pastor, Luca de Alfaro, and Elena Baralis. 2021b. Looking for Trouble: Analyzing Classifier Behavior via Pattern Divergence. In SIGMOD.
[27]
Christopher Peskun, Allan Detsky, and Maureen Shandling. 2007. Effectiveness of medical school admissions criteria in predicting residency ranking four years later. Medical education, Vol. 41, 1 (2007).
[28]
Evaggelia Pitoura, Kostas Stefanidis, and Georgia Koutrika. 2022. Fairness in rankings and recommendations: an overview. VLDB J., Vol. 31, 3 (2022).
[29]
L Shapley. 2020. 7. A Value for n-Person Games. Contributions to the Theory of Games II (1953) 307--317. In Classics in Game Theory. Princeton University Press.
[30]
Ke Yang and Julia Stoyanovich. 2017. Measuring Fairness in Ranked Outputs. In SSDBM. ACM.

Cited By

View all
  • (2024)On Explaining Unfairness: An Overview2024 IEEE 40th International Conference on Data Engineering Workshops (ICDEW)10.1109/ICDEW61823.2024.00035(226-236)Online publication date: 13-May-2024

Index Terms

  1. Dexer: Detecting and Explaining Biased Representation in Ranking

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGMOD '23: Companion of the 2023 International Conference on Management of Data
    June 2023
    330 pages
    ISBN:9781450395076
    DOI:10.1145/3555041
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 June 2023

    Check for updates

    Author Tags

    1. explanations
    2. ranking fairness
    3. representation bias

    Qualifiers

    • Short-paper

    Data Availability

    Funding Sources

    Conference

    SIGMOD/PODS '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 785 of 4,003 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)204
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 06 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)On Explaining Unfairness: An Overview2024 IEEE 40th International Conference on Data Engineering Workshops (ICDEW)10.1109/ICDEW61823.2024.00035(226-236)Online publication date: 13-May-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media