AFFORCE: Actionable Framework for Designing Crowdsourcing Experiences for Older Adults
Pages 469 - 475
Abstract
In this article we propose a unique framework for designing attractive and engaging crowdsourcing systems for older adults, which is called AFFORCE (Actionable Framework For Crowdsourcing Experiences). We first categorize and map mitigating factors and barriers to crowdsourcing for older adults to finally discuss, present and combine system elements addressing them into an actionable reference framework. This innovative framework is based on our experience with the design of crowdsourcing systems for older adults in exploratory cases and studies, related work, as well as our and related research at the intersection of older adults’ use of ICT, crowdsourcing and citizen science.
References
[1]
Ana Maria Amorim and Vaninha Vieira. 2019. Exploratory Study on the Motivation of Brazilian Elderly People in Crowdsourcing Systems. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (Vitória, Espírito Santo, Brazil) (IHC ’19). Association for Computing Machinery, New York, NY, USA, Article 65, 4 pages. https://doi.org/10.1145/3357155.3360478
[2]
Bartłomiej Balcerzak, Wiesław Kopeć, Radosław Nielek, Sebastian Kruk, Kamil Warpechowski, Mateusz Wasik, and Marek Węgrzyn. 2017. Press F1 for help: participatory design for dealing with on-line and real life security of older adults. In Computer Sciences and Information Technologies (CSIT), 2017 12th International Scientific and Technical Conference on, Vol. 1. IEEE, IEEE, Lviv, Ukraine, 240–243.
[3]
Robin Brewer, Meredith Ringel Morris, and Anne Marie Piper. 2016. ”Why Would Anybody Do This?”: Understanding Older Adults’ Motivations and Challenges in Crowd Work. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2246–2257. https://doi.org/10.1145/2858036.2858198
[4]
Jennifer L. Davidson, Umme Ayda Mannan, Rithika Naik, Ishneet Dua, and Carlos Jensen. 2014. Older Adults and Free/Open Source Software: A Diary Study of First-Time Contributors. In Proceedings of The International Symposium on Open Collaboration (Berlin, Germany) (OpenSym ’14). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/2641580.2641589
[5]
Amy Franklin and Sahiti Myneni. 2018. Engagement and Design Barriers of MHealth Applications for Older Adults. In Proceedings of the Technology, Mind, and Society (Washington, DC, USA) (TechMindSociety ’18). Association for Computing Machinery, New York, NY, USA, Article 9, 5 pages. https://doi.org/10.1145/3183654.3183695
[6]
Aaron Halfaker, R. Stuart Geiger, Jonathan T. Morgan, and John Riedl. 2013. The Rise and Decline of an Open Collaboration System: How Wikipedia’s Reaction to Popularity Is Causing Its Decline. American Behavioral Scientist 57, 5 (2013), 664–688. https://doi.org/10.1177/0002764212469365 arXiv:https://doi.org/10.1177/0002764212469365
[7]
Lei Han, Kevin Roitero, Ujwal Gadiraju, Cristina Sarasua, Alessandro Checco, Eddy Maddalena, and Gianluca Demartini. 2021. The Impact of Task Abandonment in Crowdsourcing. IEEE Transactions on Knowledge and Data Engineering 33, 5(2021), 2266–2279. https://doi.org/10.1109/TKDE.2019.2948168
[8]
Dave Harley, Kate Howland, Eric Harris, and Cara Redlich. 2014. Online Communities for Older Users: What Can We Learn from Local Community Interactions to Create Social Sites That Work for Older People. In Proceedings of the 28th International BCS Human Computer Interaction Conference on HCI 2014 - Sand, Sea and Sky - Holiday HCI (Southport, UK) (BCS-HCI ’14). BCS, Swindon, GBR, 42–51.
[9]
B.W. Hesse. 1995. Curb cuts in the virtual community: telework and persons with disabilities. In Proceedings of the Twenty-Eighth Annual Hawaii International Conference on System Sciences, Vol. 4. IEEE, Wailea, HI, USA, 418–425 vol.4. https://doi.org/10.1109/HICSS.1995.375707
[10]
Danula Hettiachchi, Zhanna Sarsenbayeva, Fraser Allison, Niels van Berkel, Tilman Dingler, Gabriele Marini, Vassilis Kostakos, and Jorge Goncalves. 2020. ”Hi! I Am the Crowd Tasker” Crowdsourcing through Digital Voice Assistants. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376320
[11]
Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The Future of Crowd Work. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (San Antonio, Texas, USA) (CSCW ’13). Association for Computing Machinery, New York, NY, USA, 1301–1318. https://doi.org/10.1145/2441776.2441923
[12]
Tiffany Knearem, Xiying Wang, and John M. Carroll. 2020. Sustaining Engagement in Volunteer Activities for Older Adults. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing(Virtual Event, USA) (CSCW ’20 Companion). Association for Computing Machinery, New York, NY, USA, 299–303. https://doi.org/10.1145/3406865.3418337
[13]
Bran Knowles, Vicki L. Hanson, Yvonne Rogers, Anne Marie Piper, Jenny Waycott, Nigel Davies, Aloha Hufana Ambe, Robin N. Brewer, Debaleena Chattopadhyay, Marianne Dee, David Frohlich, Marisela Gutierrez-Lopez, Ben Jelen, Amanda Lazar, Radoslaw Nielek, Belén Barros Pena, Abi Roper, Mark Schlager, Britta Schulte, and Irene Ye Yuan. 2021. The Harm in Conflating Aging with Accessibility. Commun. ACM 64, 7 (June 2021), 66–71. https://doi.org/10.1145/3431280
[14]
Masatomo Kobayashi, Shoma Arita, Toshinari Itoko, Shin Saito, and Hironobu Takagi. 2015. Motivating Multi-Generational Crowd Workers in Social-Purpose Work. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work and Social Computing(Vancouver, BC, Canada) (CSCW ’15). Association for Computing Machinery, New York, NY, USA, 1813–1824. https://doi.org/10.1145/2675133.2675255
[15]
Masatomo Kobayashi, Tatsuya Ishihara, Toshinari Itoko, Hironobu Takagi, and Chieko Asakawa. 2013. Age-Based Task Specialization for Crowdsourced Proofreading. In Universal Access in Human-Computer Interaction. User and Context Diversity, Constantine Stephanidis and Margherita Antona (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 104–112.
[16]
Wiesław Kopeć, Radoslaw Nielek, and Adam Wierzbicki. 2018. Guidelines towards Better Participation of Older Adults in Software Development Processes Using a New SPIRAL Method and Participatory Approach. In Proceedings of the 11th International Workshop on Cooperative and Human Aspects of Software Engineering (Gothenburg, Sweden) (CHASE ’18). Association for Computing Machinery, New York, NY, USA, 49–56. https://doi.org/10.1145/3195836.3195840
[17]
Wiesław Kopeć, Kinga Skorupska, Anna Jaskulska, Katarzyna Abramczuk, Radoslaw Nielek, and Adam Wierzbicki. 2017. LivingLab PJAIT: Towards Better Urban Participation of Seniors. In Proceedings of the International Conference on Web Intelligence (Leipzig, Germany) (WI ’17). ACM, New York, NY, USA, 1085–1092. https://doi.org/10.1145/3106426.3109040
[18]
Jarosław Kowalski, Anna Jaskulska, Kinga Skorupska, Katarzyna Abramczuk, Cezary Biele, Wiesław Kopeć, and Krzysztof Marasek. 2019. Older Adults and Voice Interaction: A Pilot Study with Google Home. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312973
[19]
Qisheng Li, Krzysztof Z. Gajos, and Katharina Reinecke. 2018. Volunteer-Based Online Studies With Older Adults and People with Disabilities. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 229–241. https://doi.org/10.1145/3234695.3236360
[20]
Ryan Moore and Jeffrey Hancock. 2020. Older Adults, Social Technologies, and the Coronavirus Pandemic: Challenges, Strengths, and Strategies for Support. Social Media + Society 6 (07 2020), 205630512094816. https://doi.org/10.1177/2056305120948162
[21]
Daniel L Murman. 2015. The Impact of Age on Cognition. Seminars in hearing 36, 3 (Aug. 2015), 111–121. https://doi.org/10.1055/s-0035-1555115 Publisher: Thieme Medical Publishers.
[22]
Radoslaw Nielek, Filip Georgiew, and Adam Wierzbicki. 2016. Crowd Teaches the Machine: Reducing Cost of Crowd-Based Training of Machine Classifiers. In Artificial Intelligence and Soft Computing, Leszek Rutkowski, Marcin Korytkowski, Rafał Scherer, Ryszard Tadeusiewicz, Lotfi A. Zadeh, and Jacek M. Zurada (Eds.). Springer International Publishing, Cham, 502–511.
[23]
Radoslaw Nielek, Marta Lutostańska, Wiesław Kopeć, and Adam Wierzbicki. 2017. Turned 70? It is Time to Start Editing Wikipedia. In Proceedings of the International Conference on Web Intelligence (Leipzig, Germany) (WI ’17). Association for Computing Machinery, New York, NY, USA, 899–906. https://doi.org/10.1145/3106426.3106539
[24]
Radoslaw Nielek, Marta Lutostańska, Wiesław Kopeć, and Adam Wierzbicki. 2017. Turned 70?: It is Time to Start Editing Wikipedia. In Proceedings of the International Conference on Web Intelligence (Leipzig, Germany) (WI ’17). ACM, New York, NY, USA, 899–906. https://doi.org/10.1145/3106426.3106539
[25]
D. Orzeszek, W. Kopec, M. Wichrowski, R. Nielek, B. Balcerzak, G. Kowalik, and M. Puchalska-Kaminska. 2017. Beyond Participatory Design: Towards a Model for Teaching Seniors Application Design.
[26]
Zhengxiang Pan. 2016. The Roles of Familiarity Design in Active Ageing. arxiv:1601.06869 [cs.HC]
[27]
Pninit Russo-Netzer and Hadassah Littman-Ovadia. 2019. “Something to Live for”: Experiences, Resources, and Personal Strengths in Late Adulthood. Frontiers in Psychology 10 (2019), 2452. https://doi.org/10.3389/fpsyg.2019.02452
[28]
Shin Saito, Toshihiro Watanabe, Masatomo Kobayashi, and Hironobu Takagi. 2014. Skill Development Framework for Micro-Tasking. In Universal Access in Human-Computer Interaction. Universal Access to Information and Knowledge, Constantine Stephanidis and Margherita Antona (Eds.). Springer International Publishing, Cham, 400–409.
[29]
Eunjin Seong and Seungjun Kim. 2020. Designing a Crowdsourcing System for the Elderly: A Gamified Approach to Speech Collection. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3334480.3382999
[30]
Kinga Skorupska, Anna Jaskulska, Rafał Masłyk, Julia Paluch, Radosław Nielek, and Wiesław Kopeć. 2021. Older Adults’ Motivation and Engagement with Diverse Crowdsourcing Citizen Science Tasks. In Human-Computer Interaction – INTERACT 2021, Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, and Kori Inkpen (Eds.). Springer International Publishing, Cham, 93–103.
[31]
Kinga Skorupska, Kamil, Warpechowski, Radosław Nielek, and Wiesław Kopeć. 2020. Conversational Crowdsourcing for Older Adults: a Wikipedia Chatbot Concept.
[32]
Kinga Skorupska, Manuel Núñez, Wiesław Kopeć, and Radoslaw Nielek. 2018. Older Adults and Crowdsourcing: Android TV App for Evaluating TEDx Subtitle Quality. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 159 (Nov. 2018), 23 pages. https://doi.org/10.1145/3274428
[33]
Kinga Skorupska, Manuel Núñez, Wiesław Kopeć, and Radosław Nielek. 2019. A Comparative Study of Younger and Older Adults’ Interaction with a Crowdsourcing Android TV App for Detecting Errors in TEDx Video Subtitles. In Human-Computer Interaction – INTERACT 2019, David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Springer International Publishing, Cham, 455–464.
[34]
Nitin Verma, Kristina Shiroma, Kate Rich, Kenneth R. Fleischmann, Bo Xie, and Min Kyung Lee. 2021. Conducting Quantitative Research with Hard-To-Reach-Online Populations: Using Prime Panels to Rapidly Survey Older Adults During a Pandemic., 384–393 pages.
[35]
Xiying Wang, Tiffany Knearem, and John M. Carroll. 2018. Ordinary Innovations of Older Adults: An Interview Study to Understand Interest Development in Aging. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing (Jersey City, NJ, USA) (CSCW ’18). Association for Computing Machinery, New York, NY, USA, 253–256. https://doi.org/10.1145/3272973.3274068
[36]
Han Yu, Chunyan Miao, Siyuan Liu, Zhengxiang Pan, N. Syahidah B. Khalid, Zhiqi Shen, and Cyril Leung. 2016. Productive Aging through Intelligent Personalized Crowdsourcing. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (Phoenix, Arizona) (AAAI’16). AAAI Press, Phoenix, Arizona, 4405–4406.
[37]
Han Yu, Zhiqi Shen, Simon Fauvel, and Lizhen Cui. 2017. Efficient scheduling in crowdsourcing based on workers’ mood. In 2017 IEEE International Conference on Agents (ICA). IEEE, Beijing, China, 121–126. https://doi.org/10.1109/AGENTS.2017.8015317
[38]
Kathryn Zyskowski, Meredith Ringel Morris, Jeffrey P. Bigham, Mary L. Gray, and Shaun K. Kane. 2015. Accessible Crowdwork? Understanding the Value in and Challenge of Microtask Employment for People with Disabilities. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work and Social Computing (Vancouver, BC, Canada) (CSCW ’15). Association for Computing Machinery, New York, NY, USA, 1682–1693. https://doi.org/10.1145/2675133.2675158
Recommendations
Older Adults and Crowdsourcing: Android TV App for Evaluating TEDx Subtitle Quality
In this paper we describe the insights from an exploratory qualitative pilot study testing the feasibility of a solution that would encourage older adults to participate in online crowdsourcing tasks in a non-computer scenario. Therefore, we developed an ...
Ordinary Innovations of Older Adults: An Interview Study to Understand Interest Development in Aging
CSCW '18 Companion: Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social ComputingBuilding and maintaining personal interests are important for older adults to promote an active and healthy lifestyle. In this paper, we discuss older adults' innovative ways of developing their interests and the related influence on their health and ...
Sustaining Engagement in Volunteer Activities for Older Adults
CSCW '20 Companion: Companion Publication of the 2020 Conference on Computer Supported Cooperative Work and Social ComputingSustaining engagement in volunteering opportunities is important for older adults to maintain an active lifestyle. We conducted an observation and interview study with older adults who volunteer in a water monitoring group to investigate the role of ...
Comments
Information & Contributors
Information
Published In
December 2021
698 pages
ISBN:9781450391153
DOI:10.1145/3486622
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 April 2022
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Funding Sources
- National Science Centre of Poland
Conference
WI-IAT '21
Sponsor:
WI-IAT '21: IEEE/WIC/ACM International Conference on Web Intelligence
December 14 - 17, 2021
VIC, Melbourne, Australia
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 57Total Downloads
- Downloads (Last 12 months)7
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format