Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3689904.3694706acmconferencesArticle/Chapter ViewAbstractPublication PageseaamoConference Proceedingsconference-collections
research-article

Ending Affirmative Action Harms Diversity Without Improving Academic Merit

Published: 29 October 2024 Publication History

Abstract

Each year, selective American colleges sort through tens of thousands of applications to identify a first-year class that displays both academic merit and diversity. In the 2023-2024 admissions cycle, these colleges faced unprecedented challenges to doing so. First, the number of applications has been steadily growing year-over-year. Second, test-optional policies that have remained in place since the COVID-19 pandemic limit access to key information that has historically been predictive of academic success. Most recently, longstanding debates over affirmative action culminated in the Supreme Court banning race-conscious admissions. Colleges have explored machine learning (ML) models to address the issues of scale and missing test scores, often via ranking algorithms intended to allow human reviewers to focus attention on ‘top’ applicants. However, the Court’s ruling will force changes to these models, which were previously able to consider race as a factor in ranking. There is currently a poor understanding of how these mandated changes will shape applicant ranking algorithms, and, by extension, admitted classes. We seek to address this by quantifying the impact of different admission policies on the applications prioritized for review. We show that removing race data from a previously developed applicant ranking algorithm reduces the diversity of the top-ranked pool of applicants without meaningfully increasing the academic merit of that pool. We further measure the impact of policy change on individuals by quantifying arbitrariness in applicant rank. We find that any given policy has a high degree of arbitrariness (i.e. at most 9% of applicants are consistently ranked in the top 20%), and that removing race data from the ranking algorithm increases arbitrariness in outcomes for most applicants.

References

[1]
1978. University of California Regents v. Bakke. 438 U.S. 265.
[2]
2003. Gratz v. Bollinger. 539 U. S. 244.
[3]
2003. Grutter v. Bollinger. 539 U. S. 306.
[4]
2023. Students for Fair Admissions, Inc. v. President and Fellows of Harvard College. 600 U. S. ___.
[5]
2024. Report From Working Group on the Role of Standardized Test Scores in Undergraduate Admissions. Dartmouth College. https://home.dartmouth.edu/sites/home/files/2024-02/sat-undergrad-admissions.pdf
[6]
Rediet Abebe, Solon Barocas, Jon Kleinberg, Karen Levy, Manish Raghavan, and David G. Robinson. 2020. Roles for computing in social change. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency(FAT*). Association for Computing Machinery, New York, NY, USA, 252–260. https://doi.org/10.1145/3351095.3372871
[7]
Columbia Undergraduate Admissions. [n. d.]. Testing Policy. https://undergrad.admissions.columbia.edu/apply/process/testing
[8]
MIT Admissions. 2024. MIT Admissions. https://mitadmissions.org/
[9]
Stanford Undergraduate Admissions. 2023. Admission Overview. https://admission.stanford.edu/apply/overview/index.html
[10]
A.J. Alvero, Noah Arthurs, anthony lising antonio, Benjamin W. Domingue, Ben Gebre-Medhin, Sonia Giebel, and Mitchell L. Stevens. 2020. AI and Holistic Review: Informing Human Reading in College Admissions. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society(AIES). Association for Computing Machinery, New York, NY, USA, 200–206. https://doi.org/10.1145/3375627.3375871
[11]
McKane Andrus and Sarah Villeneuve. 2022. Demographic-Reliant Algorithmic Fairness: Characterizing the Risks of Demographic Data Collection in the Pursuit of Fairness. In 2022 ACM Conference on Fairness, Accountability, and Transparency(FAccT). ACM, Seoul Republic of Korea, 1709–1721. https://doi.org/10.1145/3531146.3533226
[12]
Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich. 2022. Towards Substantive Conceptions of Algorithmic Fairness: Normative Guidance from Equal Opportunity Doctrines. In Equity and Access in Algorithms, Mechanisms, and Optimization(EAAMO). ACM, Arlington VA USA, 1–10. https://doi.org/10.1145/3551624.3555303
[13]
Richard Arum and Mitchell L. Stevens. 2023. For Most College Students, Affirmative Action Was Never Enough. The New York Times. https://www.nytimes.com/interactive/2023/07/03/opinion/for-most-college-students-affirmative-action-was-not-enough.html
[14]
Carolyn Ashurst and Adrian Weller. 2023. Fairness Without Demographic Data: A Survey of Approaches. In Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization(EAAMO). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3617694.3623234
[15]
Abolfazl Asudeh, H. V. Jagadish, Julia Stoyanovich, and Gautam Das. 2019. Designing Fair Ranking Schemes. In Proceedings of the 2019 International Conference on Management of Data (Amsterdam, Netherlands) (SIGMOD ’19). Association for Computing Machinery, New York, NY, USA, 1259–1276. https://doi.org/10.1145/3299869.3300079
[16]
Emily Black, Manish Raghavan, and Solon Barocas. 2022. Model Multiplicity: Opportunities, Concerns, and Solutions. In 2022 ACM Conference on Fairness, Accountability, and Transparency(FAccT). ACM, Seoul Republic of Korea, 850–863. https://doi.org/10.1145/3531146.3533149
[17]
Christian Borgs, Jennifer Chayes, Nika Haghtalab, Adam Tauman Kalai, and Ellen Vitercik. 2019. Algorithmic Greenlining: An Approach to Increase Diversity. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society(AIES). Association for Computing Machinery, New York, NY, USA, 69–76. https://doi.org/10.1145/3306618.3314246
[18]
William G. Bowen. 1977. Admissions and the Relevance of Race: Addressing the issues of principle, policy, and practice raised by the Bakke case. Princeton Alumni Weekly. https://www.princeton.edu/ paw/web_exclusives/more/article_archives_bowen.html
[19]
Lilah Burke. 2020. The Death and Life of an Admissions Algorithm. Inside Higher Ed. https://www.insidehighered.com/admissions/article/2020/12/14/u-texas-will-stop-using-controversial-algorithm-evaluate-phd
[20]
L. Elisa Celis, Damian Straszak, and Nisheeth K. Vishnoi. 2018. Ranking with Fairness Constraints. arxiv:1704.06840 [cs.DS]
[21]
Raj Chetty, David Deming, and John Friedman. 2023. Diversifying Society’s Leaders? The Determinants and Causal Effects of Admission to Highly Selective Private Colleges. Technical Report w31492. National Bureau of Economic Research, Cambridge, MA. w31492 pages. https://doi.org/10.3386/w31492
[22]
Art Coleman and Jamie Lewis Keith. 2018. Understanding Holistic Review in Higher Education Admissions: Guiding Principles and Model Illustrations. College Board and EducationCounsel. https://highered.collegeboard.org/media/pdf/understanding-holistic-review-he-admissions.pdf
[23]
A. Feder Cooper, Katherine Lee, Madiha Zahrah Choksi, Solon Barocas, Christopher De Sa, James Grimmelmann, Jon Kleinberg, Siddhartha Sen, and Baobao Zhang. 2024. Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification. arXiv:2301.11562
[24]
Kuheli Dutt, Danielle L. Pfaff, Ariel F. Bernstein, Joseph S. Dillard, and Caryn J. Block. 2016. Gender differences in recommendation letters for postdoctoral fellowships in geoscience. Nature Geoscience 9, 11 (Nov. 2016), 805–808. https://doi.org/10.1038/ngeo2819
[25]
John Friedman, Bruce Sacerdote, and Michele Tine. 2024. Standardized Test Scores and Academic Performance at Ivy-Plus Colleges. Opportunity Insights. https://opportunityinsights.org/wp-content/uploads/2024/01/SAT_ACT_on_Grades.pdf
[26]
Nikhil Garg, Hannah Li, and Faidra Monachou. 2021. Standardized Tests and Affirmative Action: The Role of Bias and Variance. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency(FAccT). Association for Computing Machinery, New York, NY, USA, 261. https://doi.org/10.1145/3442188.3445889
[27]
Ben Green. 2022. Escaping the Impossibility of Fairness: From Formal to Substantive Algorithmic Fairness. Philosophy & Technology 35, 4 (Dec. 2022), 90. https://doi.org/10.1007/s13347-022-00584-6
[28]
Joshua Grossman, Sabina Tomkins, Lindsay Page, and Sharad Goel. 2023. The Disparate Impacts of College Admissions Policies on Asian American Applicants. Technical Report w31527. National Bureau of Economic Research, Cambridge, MA. w31527 pages. https://doi.org/10.3386/w31527
[29]
Moritz Hardt, Nimrod Megiddo, Christos Papadimitriou, and Mary Wootters. 2016. Strategic classification. In Proceedings of the 2016 ACM conference on innovations in theoretical computer science. 111–122.
[30]
Anemona Hartocollis and Amy Harmon. 2023. Affirmative Action Ruling Shakes Universities Over More Than Race. The New York Times. https://www.nytimes.com/2023/07/26/us/affirmative-action-college-admissions-harvard.html
[31]
Benjamin Q. Huynh, Elizabeth T. Chin, Allison Koenecke, Derek Ouyang, Daniel E. Ho, Mathew V. Kiang, and David H. Rehkopf. 2024. Mitigating allocative tradeoffs and harms in an environmental justice data tool. Nature Machine Intelligence 6, 2 (01 Feb 2024), 187–194. https://doi.org/10.1038/s42256-024-00793-y
[32]
Common Data Set Initiative. 2023. Common Data Set 2023-2024. https://commondataset.org/wp-content/uploads/2024/01/CDS_2023-2024-with-auto-sum.pdf
[33]
Abigail Z. Jacobs and Hanna Wallach. 2021. Measurement and Fairness. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency(FAccT). Association for Computing Machinery, New York, NY, USA, 375–385. https://doi.org/10.1145/3442188.3445901
[34]
Brian Heseung Kim, Elyse Armstrong, Laurel Eckhouse, Mark Freeman, Rodney Hughes, Trent Kajikawa, and Michelle Sinofsky. 2024. Deadline updates, 2023–2024: First-year application trends through Feb 1. https://www.commonapp.org/files/Common-App-Deadline-Updates-2024.02.14.pdf
[35]
Benjamin Laufer, Jon Kleinberg, Karen Levy, and Helen Nissenbaum. 2023. Strategic Evaluation. In Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization(EAAMO). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3617694.3623237
[36]
Hansol Lee, René F. Kizilcec, and Thorsten Joachims. 2023. Evaluating a Learned Admission-Prediction Model as a Replacement for Standardized Tests in College Admissions. In Proceedings of the Tenth ACM Conference on Learning @ Scale (Copenhagen, Denmark) (L@S ’23). Association for Computing Machinery, New York, NY, USA, 195–203. https://doi.org/10.1145/3573051.3593382
[37]
Jinsook Lee, Bradon Thymes, Joyce Zhou, Thorsten Joachims, and Rene F. Kizilcec. 2023. Augmenting Holistic Review in University Admission using Natural Language Processing for Essays and Recommendation Letters. In Equity, Diversity, & Inclusion in Educational Technology Research & Development Workshop(AIED). arXiv, Tokyo, Japan. http://arxiv.org/abs/2306.17575
[38]
David Leonhardt. 2023. Why Does Duke Have So Few Low-Income Students?The New York Times Magazine. https://www.nytimes.com/interactive/2023/09/07/magazine/duke-economic-diversity.html
[39]
David Leonhardt. 2024. The Misguided War on the SAT. The New York Times. https://www.nytimes.com/2024/01/07/briefing/the-misguided-war-on-the-sat.html
[40]
Lydia T Liu, Nikhil Garg, and Christian Borgs. 2022. Strategic ranking. In International Conference on Artificial Intelligence and Statistics. PMLR, 2489–2518.
[41]
Zhi Liu and Nikhil Garg. 2021. Test-optional policies: Overcoming strategic behavior and informational gaps. In Proceedings of the 1st ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization. 1–13.
[42]
Amelie Marian. 2023. Algorithmic Transparency and Accountability through Crowdsourcing: A Study of the NYC School Admission Lottery. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency(FAccT). Association for Computing Machinery, New York, NY, USA, 434–443. https://doi.org/10.1145/3593013.3594009
[43]
Kelly McConvey, Shion Guha, and Anastasia Kuzminykh. 2023. A Human-Centered Review of Algorithms in Decision-Making in Higher Education. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI). ACM, Hamburg Germany, 1–15. https://doi.org/10.1145/3544548.3580658
[44]
Katharine Meyer. 2023. The end of race-conscious admissions. The Brookings Institution. https://www.brookings.edu/articles/the-end-of-race-conscious-admissions/
[45]
Kristen M. Glasener Michael N. Bastedo, Nicholas A. Bowman and Jandi L. Kelly. 2018. What are We Talking About When We Talk About Holistic Review? Selective College Admissions and its Effects on Low-SES Students. The Journal of Higher Education 89, 5 (2018), 782–805. https://doi.org/10.1080/00221546.2018.1442633
[46]
James Murphy. 2024. Tracking the Impact of the SFFA Decision on College Admissions. Education Reform Now. https://edreformnow.org/2024/09/09/tracking-the-impact-of-the-sffa-decision-on-college-admissions/
[47]
University of California Standardized Testing Task Force. 2020. Report of the UC Academic Council Standardized Testing Task Force. https://senate.universityofcalifornia.edu/_files/ underreview/sttf-report.pdf
[48]
U.S. Department of Education National Center for Education Statistics. [n. d.]. Integrated Postsecondary Education Data System (IPEDS), Admissions component final data (fall 2014 - 2021) and provisional data (fall 2022). https://nces.ed.gov/ipeds/TrendGenerator/app/answer/10/101
[49]
U.S. Department of Education Office for Civil Rights. 2018. DATA HIGHLIGHTS ON SCIENCE, TECHNOLOGY, ENGINEERING, AND MATHEMATICS COURSE TAKING IN OUR NATION’S PUBLIC SCHOOLS. https://www2.ed.gov/about/offices/list/ocr/docs/stem-course-taking.pdf 2015–16 CIVIL RIGHTS DATA COLLECTION STEM COURSE TAKING.
[50]
General Assembly of the State of Indiana. 1843. The revised statutes of the state of Indiana, passed at the twenty-seventh session of the General assembly. J. Dowling and R. Cole, state printers, Indianapolis. 1154 pages. https://babel.hathitrust.org/cgi/pt?id=nyp.33433009073879&seq=352By an act of the General assembly Samuel Bigger was ’authorized to prepare a compilation and revision of the general statute laws’. George H. Dunn was associated with the reviser.
[51]
General Assembly of the State of North Carolina. 1830. Acts passed by the General Assembly of the State of North Carolina (1830-1831). https://digital.ncdcr.gov/Documents/Detail/acts-passed-by-the-general-assembly-of-the-state-of-north-carolina-1830-1831/1955764?item=2080405 Chapter VI: A Bill to Prevent All Persons from Teaching Slaves to Read or Write, the Use of Figures Excepted (page 15).
[52]
Presidential Committee on Harvard & the Legacy of Slavery, Tomiko Brown-Nagin, Sven Beckert, Annette Gordon-Reed, Stephen Gray, Evelynn M. Hammonds, Nancy F. Koehn, Meira Levinson, Tiya Miles, Martha Minow, Maya Sen, Daniel Albert Smith, David R. Williams, and William Julius Wilson. 2022. Harvard & the Legacy of Slavery. https://legacyofslavery.harvard.edu/
[53]
Samir Passi and Solon Barocas. 2019. Problem Formulation and Fairness. In Proceedings of the Conference on Fairness, Accountability, and Transparency(FAT*). Association for Computing Machinery, New York, NY, USA, 39–48. https://doi.org/10.1145/3287560.3287567
[54]
Gourab K Patro, Lorenzo Porcaro, Laura Mitchell, Qiuyue Zhang, Meike Zehlike, and Nikhil Garg. 2022. Fair ranking: a critical review, challenges, and future directions. In Proceedings of the 2022 ACM conference on fairness, accountability, and transparency. 1929–1942.
[55]
Juan Perdomo, Tijana Zrnic, Celestine Mendler-Dünner, and Moritz Hardt. 2020. Performative Prediction. In Proceedings of the 37th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 119), Hal Daumé III and Aarti Singh (Eds.). PMLR, 7599–7609. https://proceedings.mlr.press/v119/perdomo20a.html
[56]
Abdul Hamid M Ragab, Abdul Fatah S Mashat, and Ahmed M Khedra. 2012. HRSPCA: Hybrid recommender system for predicting college admission. In 2012 12th International conference on intelligent systems design and applications (ISDA). IEEE, 107–113.
[57]
S.F. Reardon. 2011. The widening academic achievement gap between the rich and the poor: New evidence and possible explanations. https://cepa.stanford.edu/sites/default/files/reardon%20whither%20opportunity%20-%20chapter%205.pdf In R. Murnane & G. Duncan (Eds.), Whither Opportunity? Rising Inequality and the Uncertain Life Chances of Low-Income Children. New York: Russell Sage Foundation Press.
[58]
Sarah Reber, Gabriela Goodman, and Rina Nagashima. 2023. Admissions at most colleges will be unaffected by Supreme Court ruling on affirmative action. The Brookings Institution. https://www.brookings.edu/articles/admissions-at-most-colleges-will-be-unaffected-by-supreme-court-ruling-on-affirmative-action/
[59]
Samantha Robertson, Tonya Nguyen, and Niloufar Salehi. 2021. Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithms. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI). ACM, Yokohama Japan, 1–14. https://doi.org/10.1145/3411764.3445748
[60]
Lucy Shao, Richard A. Levine, Stefan Hyman, Jeanne Stronach, and Juanjuan Fan. 2022. A Combinatorial Optimization Framework for Scoring Students in University Admissions. Evaluation Review 46, 3 (2022), 296–335. https://doi.org/10.1177/0193841X221082887
[61]
Ashudeep Singh and Thorsten Joachims. 2018. Fairness of Exposure in Rankings. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (London, United Kingdom) (KDD ’18). Association for Computing Machinery, New York, NY, USA, 2219–2228. https://doi.org/10.1145/3219819.3220088
[62]
Ashudeep Singh and Thorsten Joachims. 2019. Policy Learning for Fairness in Ranking. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.). Vol. 32. Curran Associates, Inc.https://proceedings.neurips.cc/paper_files/paper/2019/file/9e82757e9a1c12cb710ad680db11f6f1-Paper.pdf
[63]
Sashank Sridhar, Siddartha Mootha, and Santosh Kolagati. 2020. A university admission prediction system using stacked ensemble learning. In 2020 Advanced Computing and Communication Technologies for High Performance Applications (ACCTHPA). IEEE, 162–167.
[64]
Shawn Staudaher, Jeonghyun Lee, and Farahnaz Soleimani. 2020. Predicting Applicant Admission Status for Georgia Tech’s Online Master’s in Analytics Program. In Proceedings of the Seventh ACM Conference on Learning @ Scale (Virtual Event, USA) (L@S ’20). Association for Computing Machinery, New York, NY, USA, 309–312. https://doi.org/10.1145/3386527.3406735
[65]
Mitchell L. Stevens. 2007. Creating a Class: College Admissions and the Education of Elites. Harvard University Press. http://www.jstor.org/stable/j.ctv1m46g11
[66]
Lisa M. Stulberg and Anthony S. Chen. 2014. The Origins of Race-conscious Affirmative Action in Undergraduate Admissions: A Comparative Analysis of Institutional Change in Higher Education. Sociology of Education 87, 1 (2014), 36–52. https://doi.org/10.1177/0038040713514063
[67]
Oliver Thomas, Miri Zilka, Adrian Weller, and Novi Quadrianto. 2021. An Algorithmic Framework for Positive Action. In Equity and Access in Algorithms, Mechanisms, and Optimization(EAAMO). ACM, – NY USA, 1–13. https://doi.org/10.1145/3465416.3483303
[68]
Carnegie Mellon University. 2024. Admissions Consideration. https://www.cmu.edu/admission/admission/admission-consideration
[69]
Dineshkumar B Vaghela and Priyanka Sharma. 2015. Students’ Admission Prediction using GRBST with Distributed Data Mining. Communications on Applied Electronics 2, 1 (2015), 15–19.
[70]
Austin Waters and Risto Miikkulainen. 2014. GRADE: Machine‐Learning Support for Graduate Admissions. AI Magazine 35, 1 (March 2014), 64–75. https://doi.org/10.1609/aimag.v35i1.2504
[71]
Jamelle Watson-Daniels, Solon Barocas, Jake M. Hofman, and Alexandra Chouldechova. 2023. Multi-Target Multiplicity: Flexibility and Fairness in Target Specification under Resource Constraints. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency(FAccT). Association for Computing Machinery, New York, NY, USA, 297–311. https://doi.org/10.1145/3593013.3593998
[72]
Meike Zehlike, Francesco Bonchi, Carlos Castillo, Sara Hajian, Mohamed Megahed, and Ricardo Baeza-Yates. 2017. FA*IR: A Fair Top-k Ranking Algorithm. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (Singapore, Singapore) (CIKM ’17). Association for Computing Machinery, New York, NY, USA, 1569–1578. https://doi.org/10.1145/3132847.3132938
[73]
Meike Zehlike, Ke Yang, and Julia Stoyanovich. 2022. Fairness in Ranking, Part I: Score-Based Ranking. ACM Comput. Surv. 55, 6, Article 118 (dec 2022), 36 pages. https://doi.org/10.1145/3533379
[74]
Meike Zehlike, Ke Yang, and Julia Stoyanovich. 2022. Fairness in Ranking, Part II: Learning-to-Rank and Recommender Systems. ACM Comput. Surv. 55, 6, Article 117 (dec 2022), 41 pages. https://doi.org/10.1145/3533380
[75]
Anna Zimdars. 2010. Fairness and undergraduate admission: a qualitative exploration of admissions choices at the University of Oxford. Oxford Review of Education 36, 3 (June 2010), 307–323. https://doi.org/10.1080/03054981003732286

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
EAAMO '24: Proceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization
October 2024
221 pages
ISBN:9798400712227
DOI:10.1145/3689904
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. affirmative action
  2. arbitrariness
  3. college admissions
  4. fairness
  5. machine learning
  6. ranking system

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

EAAMO '24
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 977
    Total Downloads
  • Downloads (Last 12 months)977
  • Downloads (Last 6 weeks)903
Reflects downloads up to 01 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media