research-article

Open access

Exploring Rulebook Accessibility and Companionship in Board Games via Voiced-based Conversational Agent Alexa

Authors:

Audrey GirouardAuthors Info & Claims

DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference

Pages 2221 - 2232

https://doi.org/10.1145/3563657.3595970

Published: 10 July 2023 Publication History

All formats PDF

Abstract

The inaccessibility of rulebooks hinders the rule learning experience of board game players who are blind or have low vision (BLV). We conducted two qualitative studies to explore the design of conversational agents (CAs) that can support BLV players’ learning and provide companionship. In Study 1, we recruited 14 BLV participants and identified their rule learning challenges, with emphasis on cognitive load, and co-designed functional and social characteristics in Amazon Alexa that can support rule learning and offer companionship. We then developed a new Alexa skill and had 9 BLV participants evaluate our skill against the Alexa skill for the game Ticket to Ride (Study 2). We generated four design principles for CAs to support board game rule learning for BLV people: conciseness, pausing capacity, customization, and companionship.

References

[1]

2020. How to Build Alexa Companion Skills for Board Games. https://m.media-amazon.com/images/G/01/mobile-apps/dex/alexa/resources/How_to_Build_Alexa_Companion_Skills_for_Board_Games._CB1583784193_.pdf Accessed: 2022-10-05.

[2]

n.d. MAXQDA. Retrieved 2022-11-04 from https://www.maxqda.com/

[3]

Ali Abdolrahmani, Ravi Kuber, and Stacy M. Branham. 2018. Siri Talks at You: An Empirical Investigation of Voice-Activated Personal Assistant (VAPA) Usage by Individuals Who Are Blind. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS ’18). ACM, New York, NY, 249–258. https://doi.org/10.1145/3234695.3236344

Digital Library

[4]

Mahdieh Allameh and Loutfouz Zaman. 2021. Jessy: A Conversational Assistant for Tutoring Digital Board Games. ACM, New York, NY, 168–173.

[5]

Amazon. 2022. Speech Synthesis Markup Language (SSML) Reference. Retrieved 2022-09-10 from https://developer.amazon.com/en-US/docs/alexa/custom-skills/speech-synthesis-markup-language-ssml-reference.html#audio

[6]

Frank Biocca. 1999. The cyborg’s dilemma: Progressive embodiment in virtual environments. Human Factors in Information Technology 13 (1999), 113–144.

[7]

Jeff Blankenburg. 2018. Blogs. https://developer.amazon.com/blogs/alexa/post/531ffdd7-acf3-43ca-9831-9c375b08afe0/things-every-alexa-skill-should-do-pass-the-one-breath-test

[8]

Adrian Bolesnikov, Jin Kang, and Audrey Girouard. 2022. Understanding Tabletop Games Accessibility: Exploring Board and Card Gaming Experiences of People Who Are Blind and Low Vision. ACM, New York, NY.

[9]

Olimar Borges, Juliana Oliveira, Marcia de Borba Campos, and Sabrina Marczak. 2018. Fair Play: A Guidelines Proposal for the Development of Accessible Audiogames for Visually Impaired Users. 401–419. https://doi.org/10.1007/978-3-319-92049-8_29

Digital Library

[10]

Stacy M. Branham and Antony Rishin Mukkath Roy. 2019. Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users. In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, PA) (ASSETS ’19). ACM, New York, NY, 446–458. https://doi.org/10.1145/3308561.3353797

Digital Library

[11]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706qp063oa

[12]

Philip Sheridan Buffum, Kristy Elizabeth Boyer, Eric N Wiebe, Bradford W Mott, and James C Lester. 2015. Mind the gap: improving gender equity in game-based learning environments with learning companions. In Artificial Intelligence in Education: 17th International Conference, AIED 2015, Madrid, Spain, June 22-26, 2015. Proceedings 17. Springer, 64–73.

[13]

Gwo-Dong Chen, Jih-Hsien Lee, Chin-Yeh Wang, Po-Yao Chao, Liang-Yi Li, and Tzung-Yi Lee. 2012. An empathic avatar in a computer-aided learning program to encourage and persuade learners. Journal of Educational Technology & Society 15, 2 (2012), 62–72.

[14]

Frederico da Rocha Tomé Filho, Pejman Mirza-Babaei, Bill Kapralos, and Glaudiney Moreira Mendonça Junior. 2019. Let’s Play Together: Adaptation Guidelines of Board Games for Players with Visual Impairment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Glasgow, Scotland, UK) (CHI ’19). ACM, New York, NY, 1–15. https://doi.org/10.1145/3290605.3300861

Digital Library

[15]

[15] Frederico Da Rocha Tomé Filho. 2018. Board game accessibility for persons with visual impairment. Thesis. http://ir.library.dc-uoit.ca/handle/10155/1014

[16]

Kathleen Kara Fitzpatrick, Alison Darcy, and Molly Vierhile. 2017. Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial. JMIR Mental Health (Jun 2017). https://doi.org/10.2196/mental.7785

[17]

David Gonçalves, André Rodrigues, and Tiago Guerreiro. 2020. Playing With Others: Depicting Multiplayer Gaming Experiences of People With Visual Impairments. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, Greece) (ASSETS ’20). ACM, New York, NY, 12 pages. https://doi.org/10.1145/3373625.3418304

Digital Library

[18]

Michael Heron. 2018. The Universal Inaccessibility in Board Games. Retrieved 2022-06-08 from https://www.meeplelikeus.co.uk/the-universal-inaccessibility-of-board-games/

[19]

Michael Heron, Pauline Belford, Hayley Reid, and Michael Crabb. 2018. Meeple Centred Design: A Heuristic Toolkit for Evaluating the Accessibility of Tabletop Games. The Computer Games Journal 7 (06 2018). https://doi.org/10.1007/s40869-018-0057-8

[20]

Jaylin Herskovitz, Andi Xu, Rahaf Alharbi, and Anhong Guo. 2023. Hacking, Switching, Combining: Understanding and Supporting DIY Assistive Technology Design by Blind People. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.

Digital Library

[21]

Sheng-Hui Hsu, Chih-Yueh Chou, Fei-Ching Chen, Yuan-Kai Wang, and Tak-Wai Chan. 2007. An investigation of the differences between robot and virtual learning companions’ influences on students’ engagement. In 2007 First IEEE International Workshop on Digital Game and Intelligent Toy Enhanced Learning (DIGITEL’07). IEEE, 41–48.

Digital Library

[22]

Melissa J. Rogerson, Lucy A. Sparrow, and Martin R. Gibbs. 2021. Unpacking “Boardgames with Apps”: The Hybrid Digital Boardgame Model. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). ACM, New York, NY, 17 pages. https://doi.org/10.1145/3411764.3445077

Digital Library

[23]

Gabriella M. Johnson and Shaun K. Kane. 2020. Game Changer: Accessible Audio and Tactile Guidance for Board and Card Games. In Proceedings of the 17th International Web for All Conference (Taipei, Taiwan) (W4A ’20). ACM, New York, NY. https://doi.org/10.1145/3371300.3383347

Digital Library

[24]

Yanghee Kim, Amy L Baylor, and Entong Shen. 2007. Pedagogical agents as learning companions: the impact of agent emotion and gender. Journal of Computer Assisted Learning 23, 3 (2007), 220–234.

[25]

Liliana Laranjo, Adam G Dunn, Huong Ly Tong, Ahmet Baki Kocaballi, Jessica Chen, Rabia Bashir, Didi Surian, Blanca Gallego, Farah Magrabi, Annie YS Lau, 2018. Conversational agents in healthcare: a systematic review. Journal of the American Medical Informatics Association 25, 9 (2018), 1248–1258.

[26]

Meng-Yun Liao, Ching-Ying Sung, Hao-Chuan Wang, and Wen-Chieh Lin. 2019. Virtual classmates: Embodying historical learners’ messages as learning companions in a VR classroom through comment mapping. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 163–171.

[27]

Henry Lieberman, Fabio Paternò, and Volker Wulf. 2006. End user development. Vol. 9. Springer.

[28]

Tze Wei Liew, Nor Azan Mat Zin, and Noraidah Sahari. 2017. Exploring the affective, motivational and cognitive effects of pedagogical agent enthusiasm in a multimedia learning environment. Human-centric Computing and Information Sciences 7, 1 (2017), 1–21.

Digital Library

[29]

Richard E Mayer and Roxana Moreno. 2003. Nine ways to reduce cognitive load in multimedia learning. Educational psychologist 38, 1 (2003), 43–52.

[30]

Punya Mishra. 2006. Affective feedback from computers and its effect on perceived ability and affect: A test of the computers as social actor hypothesis. Journal of Educational Multimedia and Hypermedia 15, 1 (2006), 107–131.

[31]

Christopher P Niemiec and Richard M Ryan. 2009. Autonomy, competence, and relatedness in the classroom: Applying self-determination theory to educational practice. Theory and research in Education 7, 2 (2009), 133–144.

[32]

Betsy Phillips and Hongxin Zhao. 1993. Predictors of assistive technology abandonment. Assistive technology 5, 1 (1993), 36–45.

[33]

Zahy Ramadan, Maya F. Farah, and Lea El Essrawi. 2021. From Amazon.com to Amazon.love: How Alexa is redefining companionship and interdependence for people with special needs. Psychology & Marketing (2021), 596–609. https://doi.org/10.1002/mar.21441

[34]

Aiko Sato. 2016. Applying an Experiential Learning Model to the Teaching of Gateway Strategy Board Games. International Journal of Instruction 9 (01 2016), 4–16. https://doi.org/10.12973/iji.2016.912a

[35]

Chun Shao and K Hazel Kwon. 2021. Hello Alexa! Exploring effects of motivational factors and social presence on satisfaction with artificial intelligence-enabled gadgets. Human Behavior and Emerging Technologies 3, 5 (2021), 978–988.

[36]

E Shashko. 2019. Analyzing The Accessibility Of Digital Manuals For Board Games. Retrieved 2022-04-10 from https://sightless.fun/boardgames/analyzing-the-accessibility-of-digital-manuals-for-board-games/

[37]

Dafna Sinai and Rinat B Rosenberg-Kima. 2022. Perceptions of Social Robots as Motivating Learning Companions for Online Learning. In 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 1045–1048.

[38]

Marita Skjuve, Asbjørn Følstad, Knut Inge Fostervold, and Petter Bae Brandtzaeg. 2021. My Chatbot Companion - a Study of Human-Chatbot Relationships. International Journal of Human-Computer Studies (2021). https://doi.org/10.1016/j.ijhcs.2021.102601

[39]

Timo Strohmann, Dominik Siemon, Bijan Khosrawi-Rad, and Susanne Robra-Bissantz. 2023. Toward a design theory for virtual companionship. Human–Computer Interaction 38, 3-4 (2023), 194–234.

[40]

Vivian Ta, Caroline Griffith, Carolynn Boatfield, Xinyu Wang, Maria Civitello, Haley Bader, Esther DeCero, and Alexia Loggarakis. 2020. User Experiences of Social Support From Companion Chatbots in Everyday Contexts: Thematic Analysis. Journal of Medical Internet Research (03 2020). https://doi.org/10.2196/16235

[41]

Lauren Thevin, Nicolas Rodier, Bernard Oriola, Martin Hachet, Christophe Jouffrais, and Anke M. Brock. 2021. Inclusive Adaptation of Existing Board Games for Gamers with and without Visual Impairments Using a Spatial Augmented Reality Framework for Touch Detection and Audio Feedback. Proc. ACM Hum.-Comput. Interact. 5, ISS, Article 505 (nov 2021), 33 pages. https://doi.org/10.1145/3488550

Digital Library

[42]

Xiaoyi Tian, Zak Risha, Ishrat Ahmed, Arun Balajiee Lekshmi Narayanan, and Jacob Biehl. 2021. Let’s Talk It Out: A Chatbot for Effective Study Habit Behavioral Change. Proc. ACM Hum.-Comput. Interact., Article 97 (apr 2021), 32 pages. https://doi.org/10.1145/3449171

Digital Library

[43]

Qiaosi Wang, Shan Jing, and Ashok K. Goel. 2022. Co-Designing AI Agents to Support Social Connectedness Among Online Learners: Functionalities, Social Characteristics, and Ethical Challenges. In Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). ACM, New York, NY, 541–556. https://doi.org/10.1145/3532106.3533534

Digital Library

[44]

Yanqing Wang, Xiaowei Feng, Jiangnan Guo, Shaoying Gong, Yanan Wu, and Jing Wang. 2022. Benefits of affective pedagogical agents in multimedia instruction. Frontiers in Psychology 12 (2022), 6639.

[45]

Philip Weber, Kevin Krings, Julia Nießner, Sabrina Brodesser, and Thomas Ludwig. 2021. FoodChattAR: Exploring the Design Space of Edible Virtual Agents for Human-Food Interaction. In Designing Interactive Systems Conference 2021. 638–650.

[46]

Ying Xu and Mark Warschauer. 2019. Young Children’s Reading and Learning with Conversational Agents. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Glasgow, Scotland, UK) (CHI EA ’19). ACM, New York, NY, 1–8. https://doi.org/10.1145/3290607.3299035

Digital Library

[47]

Bei Yuan, Eelke Folmer, and Frederick C. Harris. 2011. Game Accessibility: A Survey. Univers. Access Inf. Soc. 10, 1 (mar 2011), 81–100. https://doi.org/10.1007/s10209-010-0189-5

Digital Library

Cited By

Chen QGu ZLu LXu XBa ZLin FLiu ZRen K(2024)Conan's Bow Tie: A Streaming Voice Conversion for Real-Time VTuber LivestreamingProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645146(35-50)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645146
Behl AJayawardena N(2024)Internationalisation of Board GamesReference Module in Social Sciences10.1016/B978-0-443-13701-3.00372-8Online publication date: 2024
https://doi.org/10.1016/B978-0-443-13701-3.00372-8

Index Terms

Exploring Rulebook Accessibility and Companionship in Board Games via Voiced-based Conversational Agent Alexa
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Understanding Tabletop Games Accessibility: Exploring Board and Card Gaming Experiences of People who are Blind and Low Vision
TEI '22: Proceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction

Gaming accessibility research for blind or low vision (BLV) communities largely focuses on digital games. There is a need for designers to understand BLV's experience with tabletop games that involve the player's physical interaction. In this study, we ...
Gamifying Serious Games: Modding Modern Board Games to Teach Game Potentials
Gaming, Simulation and Innovations: Challenges and Opportunities
Abstract
The growing interest in game-based approaches is evident. But establishing Gamification and Serious Game processes are challenging, especially when there are few available resources and game design knowledge. Low-tech and low-budget games can be ...
What we have here is a failure of companionship: communication in goal-oriented team-mate games
OzCHI '11: Proceedings of the 23rd Australian Computer-Human Interaction Conference

There is a fairly common assumption about real-time, goal oriented, multiplayer games: communication is primarily appreciated (and used) for more effectively attaining goals. But an interesting question that does not seem to have been explored in the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference

July 2023

2717 pages

ISBN:9781450398930

DOI:10.1145/3563657

Editors:
Daragh Byrne
Carnegie Mellon University
,
Nikolas Martelaro
Carnegie Mellon University
,
Andy Boucher
Northumbria University
,
David Chatting
Goldsmiths, University of London
,
Sarah Fdili Alaoui
LISN-Université Paris Saclay
,
Sarah Fox
Carnegie Mellon University
,
Iohanna Nicenboim
Delft University of Technology
,
Cayley MacArthur
University of Waterloo

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 July 2023

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Sciences and Engineering Research Council of Canada

Conference

DIS '23

Sponsor:

SIGCHI

DIS '23: Designing Interactive Systems Conference

July 10 - 14, 2023

PA, Pittsburgh, USA

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
391
Total Downloads

Downloads (Last 12 months)374
Downloads (Last 6 weeks)56

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen QGu ZLu LXu XBa ZLin FLiu ZRen K(2024)Conan's Bow Tie: A Streaming Voice Conversion for Real-Time VTuber LivestreamingProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645146(35-50)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645146
Behl AJayawardena N(2024)Internationalisation of Board GamesReference Module in Social Sciences10.1016/B978-0-443-13701-3.00372-8Online publication date: 2024
https://doi.org/10.1016/B978-0-443-13701-3.00372-8

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents