research-article

Open access

Decoding design agendas: an ethical design activity for middle school students

Authors:

Daniella DiPaola,

Blakeley H. Payne,

Cynthia BreazealAuthors Info & Claims

IDC '20: Proceedings of the Interaction Design and Children Conference

Pages 1 - 10

https://doi.org/10.1145/3392063.3394396

Published: 21 June 2020 Publication History

Abstract

If we expect our children to be driving technology design agendas in the future, we must first help them recognize that opinions and beliefs are baked into the technologies that we create and that these opinions may serve some groups of people more than others. In this paper, we discuss an ethical design activity completed by 19 middle school-aged children. The activity encourages students to see technical systems as socio-technical systems, to engage them in stakeholder analysis, and to apply ethical design tools in order to redesign YouTube. Results indicate students are capable of transforming into critical users and ethical designers of technology. They are able to recognize the underlying design agendas for popular technologies such as YouTube, identify stakeholders who shape those design agendas, and apply an array of tools to reimagine technologies in a more inclusive manner.

References

[1]

2019. 2019 State of Computer Science Education. Technical Report.

[2]

ACLU. 2020. Coalition Letter Calling for a Federal Moratorium on Face Recognition. (2020). Retrieved January 24, 2020 from https://www.aclu.org/letter/coalition-letter-calling-federal-moratorium-face-recognition

[3]

Monica Anderson and Jingjing Jiang. 2018. Teens, Social Media Technology 2018. Technical Report.

[4]

Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency. 77--91.

[5]

Emanuelle Burton, Judy Goldsmith, Sven Koenig, Benjamin Kuipers, Nicholas Mattei, and Toby Walsh. 2017. Ethical Considerations in Artificial Intelligence Courses. AI Magazine 38, 2 (Jul. 2017), 22--34.

Digital Library

[6]

Rob Copeland. 2019. YouTube Weighs Major Changes to Kids' Content Amid FTC Probe. The Wall Street Journal (June 2019).

[7]

Sasha Costanza-Chock. 2018a. Design Justice, A.I., and Escape from the Matrix of Domination. Journal of Design and Science (16 7 2018). https://jods.mitpress.mit.edu/pub/costanza-chock.

[8]

Jeffery Dastin. 2018. Amazon scraps secret AI recruiting tool that showed bias against women. Reuters (October 2018).

[9]

Design Research Society 2018b. Design Justice: towards an intersectional feminist framework for design theory and practice. Design Research Society.

[10]

Stefania Druga, Randi Williams, Cynthia Breazeal, and Mitchel Resnick. 2017. "Hey Google is It OK If I Eat You?": Initial Explorations in Child-Agent Interaction. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC '17). Association for Computing Machinery, New York, NY, USA, 595--600.

Digital Library

[11]

Allison Druin, Elizabeth Foss, Leshell Hatley, Evan Golub, Mona Leigh Guha, Jerry Fails, and Hilary Hutchinson. 2009. How Children Search the Internet with Keyword Interfaces. In Proceedings of the 8th International Conference on Interaction Design and Children (IDC '09). Association for Computing Machinery, New York, NY, USA, 89--96.

Digital Library

[12]

Informatics Europe. 2020. Informatics Education. (2020). Retrieved January 24, 2020 from https://www.informatics-europe.org/working-groups/informatics-education.html

[13]

Lauren Feiner. 2018. Salesforce hires its first chief ethical and humane use officer following Benioff's criticism of Facebook. CNBC (December 2018).

[14]

Max Fisher and Amanda Taub. 2019. How YouTube Radicalized Brazil. The New York Times (August 2019).

[15]

Hanna Gun and Cathy O'Neil. in press. Near Term AI. (in press).

[16]

Saber Khan. 2020. EthicalCS. (2020). Retrieved January 24, 2020 from https://ethicalcs.org/

[17]

Will Knight. 2020. White House Favors a Light Touch in Regulating AI. (2020). Retrieved January 24, 2020 from https://www.wired.com/story/white-house-favors-light-touch-regulating-ai/

[18]

Paris Martineau. 2020. Cities Examine Proper---and Improper---Uses of Facial Recognition. (2020). Retrieved January 24, 2020 from https://www.wired.com/story/cities-examine-proper-improper-facial-recognition/

[19]

S Mattu, L Kirchner, and J Angwin. 2016. How we analyzed the COMPAS recidivism algorithm. ProPublica (2016).

[20]

Jack Nicas. 2018. How YouTube Drives People to the Internet's Darkest Corners. The Wall Street Journal (February 2018).

[21]

Rachel O'Dwyer. 2018. Algorithms are making the same mistakes assessing credit scores that humans did a century ago. Quartz (May 2018).

[22]

U.S. Bureau of Labor Statistics. 2019. Employment Projections --- 2018-2028. Technical Report. Washington, D.C., USA.

[23]

Michael B. Robb. 2017. News and America's Kids: How Young People Perceive and Are Impacted by the News. Technical Report.

[24]

Kevin Roose. 2019. The Making of a YouTube Radical. The New York Times (June 2019).

[25]

Jeffrey Saltz, Michael Skirpan, Casey Fiesler, Micha Gorelick, Tom Yeh, Robert Heckman, Neil Dewar, and Nathan Beard. 2019. Integrating Ethics within Machine-learning Courses. ACM Trans. Comput. Educ. 19 4, 22 (July 2019), 1--26.

[26]

Katie Shilton. 2018. Values and Ethics in Human-Computer Interaction. Found. Trends Hum.-Comput. Interact. 12, 2 (July 2018), 107--171.

Digital Library

[27]

Natasha Singer. 2018. Tech's Ethical 'Dark Side': Harvard, Stanford and Others Want to Address It. The New York Times (February 2018).

[28]

Joan E. Solsman. 2018. YouTube's AI is the puppet master over most of what you watch. CNET (January 2018).

[29]

Latanya Sweeney. 2013. Discrimination in online ad delivery. Queue 11, 3 (2013), 10.

Digital Library

[30]

Saadia Zahidi Till Alexander Leopold, Vesselina Stefanova Ratcheva. 2018. The Future of Jobs Report. Technical Report. World Economic Forum.

[31]

Zeynup Tufecki. 2018. YouTube, the Great Radicalizer. The New York Times (March 2018).

[32]

Langdon Winner. 1999. The Social Shaping of Technology (2nd ed.). Open University Press, UK, Chapter Do artifacts have politics?, 28--40.

[33]

YouTube. 2019. About YouTube. (2019). Retrieved January 24, 2020 from https://www.youtube.com/about/

[34]

Ethan Zuckerman. 2014. New Media, New Civics? Policy & Internet 6, 2 (2014), 151--168.

[35]

Ethan Zuckerman. 2017. Who Filters Your News? Why we built gobo.social. (November 2017). Retrieved January 24, 2020 from https://medium.com/mit-media-lab/who-filters-your-news-why-we-built-gobo-social-bfa6748b5944

Cited By

Schulte CSentance SSparmann SAltin RFriebroon-Yesharim MLandman MRücker MSatavlekar SSiegel ATedre MTubino LVartiainen HVelÁzquez-Iturbide JWaite JWu ZMonga MLonati VBarendsen ESheard JPaterson J(2025)What We Talk About When We Talk About K-12 Computing Education2024 Working Group Reports on Innovation and Technology in Computer Science Education10.1145/3689187.3709612(226-257)Online publication date: 22-Jan-2025
https://dl.acm.org/doi/10.1145/3689187.3709612
Iivari NVentä-Olkkonen LLehto EHolappa JHartikainen H(2024)How to combine criticality with reflection? Scaffolding children's critical reflection in the case of anti-bullying interventionsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685354(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685354
Sharma SHowell NVentä-Olkkonen LIivari NEden GHartikainen HKinnula MDurall ENitsche MOkkonen JPait SRubegni ESluis-Thiescheffer Wvan der Velden LVaranasi U(2024)Promoting Criticality with Design Futuring with Young ChildrenProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685335(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685335
Show More Cited By

Index Terms

Decoding design agendas: an ethical design activity for middle school students
1. Applied computing
  1. Education
    1. Interactive learning environments
2. Human-centered computing
  1. Interaction design
    1. Empirical studies in interaction design

Recommendations

Design ethics education in Taiwan: a study of syllabi of ethics-related courses
IDGD'11: Proceedings of the 4th international conference on Internationalization, design and global development

This paper aims to identify the scope and content of ethics components in the curricula of regular 4-year undergraduate design programs in Taiwan by investigating the syllabi of ethics-related courses. Of the 148 universities and colleges in Taiwan, ...
Sometimes it's hard to be a robot: A call for action on the ethics of abusing artificial agents

This is a call for informed debate on the ethical issues raised by the forthcoming widespread use of robots, particularly in domestic settings. Research shows that humans can sometimes become very abusive towards computers and robots particularly when ...
Getting IT Together: A Longitudinal Look at Linking Girls' Interest in IT Careers to Lessons Taught in Middle School Camps

The dearth of women choosing information technology (IT) careers has been identified as a national problem in the United States. Efforts have been made to combat this by educating girls at a young age about technology. Recent research demonstrates that ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IDC '20: Proceedings of the Interaction Design and Children Conference

June 2020

642 pages

ISBN:9781450379816

DOI:10.1145/3392063

General Chairs:
Elisa Rubegni
University of Lancaster, UK
,
Asimina Vasalou
University College London, UK
,
Program Chairs:
Narcís Parés
Universitat Pompeu Fabra, Spain
,
Nitin Sawhney
Aalto University, Finland

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

MIT Media Lab Consortia

Conference

IDC '20

Sponsor:

SIGCHI

IDC '20: Interaction Design and Children

June 21 - 24, 2020

London, United Kingdom

Acceptance Rates

Overall Acceptance Rate 172 of 578 submissions, 30%

Upcoming Conference

IDC '25

Sponsor:
sigchi

Interaction Design and Children

June 23 - 26, 2025

Reykjavik , Iceland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
1,650
Total Downloads

Downloads (Last 12 months)381
Downloads (Last 6 weeks)40

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Schulte CSentance SSparmann SAltin RFriebroon-Yesharim MLandman MRücker MSatavlekar SSiegel ATedre MTubino LVartiainen HVelÁzquez-Iturbide JWaite JWu ZMonga MLonati VBarendsen ESheard JPaterson J(2025)What We Talk About When We Talk About K-12 Computing Education2024 Working Group Reports on Innovation and Technology in Computer Science Education10.1145/3689187.3709612(226-257)Online publication date: 22-Jan-2025
https://dl.acm.org/doi/10.1145/3689187.3709612
Iivari NVentä-Olkkonen LLehto EHolappa JHartikainen H(2024)How to combine criticality with reflection? Scaffolding children's critical reflection in the case of anti-bullying interventionsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685354(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685354
Sharma SHowell NVentä-Olkkonen LIivari NEden GHartikainen HKinnula MDurall ENitsche MOkkonen JPait SRubegni ESluis-Thiescheffer Wvan der Velden LVaranasi U(2024)Promoting Criticality with Design Futuring with Young ChildrenProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685335(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685335
Sebastian PSharma SIivari NKinnula MMonga CVerma DAbbas M(2024)Emerging Technologies in Global South Classrooms: Teachers Imagining Future of EducationProceedings of the Participatory Design Conference 2024: Full Papers - Volume 110.1145/3666094.3666109(234-247)Online publication date: 11-Aug-2024
https://dl.acm.org/doi/10.1145/3666094.3666109
Hollands FDiPaola DBreazeal CAli SDorodchi MZhange MCooper S(2024)AI Mastery May Not Be For Everyone, But AI Literacy Should BeProceedings of the 2024 on ACM Virtual Global Computing Education Conference V. 110.1145/3649165.3690117(60-66)Online publication date: 5-Dec-2024
https://dl.acm.org/doi/10.1145/3649165.3690117
Amspoker EHammer JOgan ASolyst J(2024)Augmenting Youths' Critical Consciousness Through Redesign of Algorithmic SystemsProceedings of the 2024 ACM Conference on International Computing Education Research - Volume 210.1145/3632621.3671425(535-536)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3632621.3671425
Zhou XZhou YGong YCai ZQiu AXiao QAntle ABai Z(2024)"Bee and I need diversity!" Break Filter Bubbles in Recommendation Systems through Embodied AI LearningProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655802(44-61)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655802
Durall Gazulla EHirvonen NSharma SHartikainen HJylhä VIivari NKinnula MBaizhanova A(2024)Youth perspectives on technology ethics: analysis of teens’ ethical reflections on AI in learning activitiesBehaviour & Information Technology10.1080/0144929X.2024.2350666(1-24)Online publication date: 14-May-2024
https://doi.org/10.1080/0144929X.2024.2350666
Hollands FBreazeal C(2024)Establishing AI Literacy before Adopting AIThe Science Teacher10.1080/00368555.2024.230831691:2(35-42)Online publication date: 19-Mar-2024
https://doi.org/10.1080/00368555.2024.2308316
Schaper M(2024)Gender literacy through the making processInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2024.10064840:COnline publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2024.100648
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten