research-article

Help Supporters: Exploring the Design Space of Assistive Technologies to Support Face-to-Face Help Between Blind and Sighted Strangers

Authors:

Connor Courtien,

David Angel Rios,

Jacqueline Gibson,

Brian A. SmithAuthors Info & Claims

CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Article No.: 40, Pages 1 - 24

https://doi.org/10.1145/3613904.3642816

Published: 11 May 2024 Publication History

Abstract

Blind and low-vision (BLV) people face many challenges when venturing into public environments, often wishing it were easier to get help from people nearby. Ironically, while many sighted individuals are willing to help, such interactions are infrequent. Asking for help is socially awkward for BLV people, and sighted people lack experience in helping BLV people. Through a mixed-ability research-through-design process, we explore four diverse approaches toward how assistive technology can serve as help supporters that collaborate with both BLV and sighted parties throughout the help process. These approaches span two phases: the connection phase (finding someone to help) and the collaboration phase (facilitating help after finding someone). Our findings from a 20-participant mixed-ability study reveal how help supporters can best facilitate connection, which types of information they should present during both phases, and more. We discuss design implications for future approaches to support face-to-face help.

Supplemental Material

MP4 File - Video Preview

Video Preview

Transcript for: Video Preview

MP4 File - Video Presentation

Video Presentation

Transcript for: Video Presentation

References

[1]

Aira Tech Corp. 2017. AIRA. https://aira.io/.

[2]

Elizabeth Susan Anderson, Jenny Ford, and Lucy Thorpe. 2011. Learning to listen: improving students’ communication with disabled people. Medical Teacher 33, 1 (2011), 44–52.

[3]

Be My Eyes. 2015. Be My Eyes - See the world together. https://www.bemyeyes.com/

[4]

Victoria M.E. Bellotti, Sara Cambridge, Karen Hoy, Patrick C. Shih, Lisa Renery Handalian, Kyungsik Han, and John M. Carroll. 2014. Towards community-centered support for peer-to-peer service exchange: rethinking the timebanking metaphor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2014-04-26) (CHI ’14). Association for Computing Machinery, 2975–2984. https://doi.org/10.1145/2556288.2557061

Digital Library

[5]

Cynthia L. Bennett, Erin Brady, and Stacy M. Branham. 2018. Interdependence as a Frame for Assistive Technology Research and Design. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Galway Ireland, 161–173. https://doi.org/10.1145/3234695.3236348

Digital Library

[6]

Cynthia L. Bennett and Daniela K. Rosner. 2019. The Promise of Empathy: Design, Disability, and Knowing the "Other". In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300528

Digital Library

[7]

Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, and Tom Yeh. 2010. VizWiz: nearly real-time answers to visual questions. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). Association for Computing Machinery, New York, NY, USA, 333–342. https://doi.org/10.1145/1866029.1866080

Digital Library

[8]

Perkins School for the Blind. 2023. Blind etiquette: Six ways to be considerate when interacting with people with visual impairments. https://www.perkins.org/blind-etiquette-six-ways-to-be-considerate-when-interacting-with-people-with-visual-impairments/

[9]

Stacy M. Branham, Ali Abdolrahmani, William Easley, Morgan Scheuerman, Erick Ronquillo, and Amy Hurst. 2017. "Is Someone There? Do They Have a Gun": How Visual Information about Others Can Improve Personal Safety Management for Blind Individuals. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (Baltimore, Maryland, USA) (ASSETS ’17). Association for Computing Machinery, New York, NY, USA, 260–269. https://doi.org/10.1145/3132525.3132534

Digital Library

[10]

Stacy M. Branham and Shaun K. Kane. 2015. Collaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (New York, NY, USA, 2015-04-18) (CHI ’15). Association for Computing Machinery, 2373–2382. https://doi.org/10.1145/2702123.2702511

Digital Library

[11]

Stacy M. Branham and Shaun K. Kane. 2015. The Invisible Work of Accessibility: How Blind Employees Manage Accessibility in Mixed-Ability Workplaces. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (New York, NY, USA, 2015-10-26) (ASSETS ’15). Association for Computing Machinery, 163–171. https://doi.org/10.1145/2700648.2809864

Digital Library

[12]

Kathy Charmaz. 2006. Constructing grounded theory. Sage Publications, London ; Thousand Oaks, Calif.

[13]

William Easley, Michele A. Williams, Ali Abdolrahmani, Caroline Galbraith, Stacy M. Branham, Amy Hurst, and Shaun K. Kane. 2016. Let’s Get Lost: Exploring Social Norms In Predominately Blind Environments. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, San Jose California USA, 2034–2040. https://doi.org/10.1145/2851581.2892470

Digital Library

[14]

Edona Elshan and Philipp Ebel. 2020. Let’s Team Up: Designing Conversational Agents as Teammates. (2020).

[15]

Envision. 2023. How to interact with the blind.https://www.letsenvision.com/blog/how-to-interact-with-the-blind

[16]

David R Flatla and Carl Gutwin. 2012. " So that’s what you see" building understanding with personalized simulations of colour vision deficiency. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility. 167–174.

Digital Library

[17]

William Gaver. 2012. What Should We Expect from Research through Design?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 937–946. https://doi.org/10.1145/2207676.2208538

Digital Library

[18]

Leo A. Goodman. 1961. Snowball Sampling. The Annals of Mathematical Statistics 32, 1 (1961), 148–170. https://www.jstor.org/stable/2237615 Publisher: Institute of Mathematical Statistics.

[19]

Martin Grayson, Anja Thieme, Rita Marques, Daniela Massiceti, Ed Cutrell, and Cecily Morrison. 2020. A Dynamic AI System for Extending the Capabilities of Blind People. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3334480.3383142

Digital Library

[20]

João Guerreiro, Dragan Ahmetovic, Daisuke Sato, Kris Kitani, and Chieko Asakawa. 2019. Airport Accessibility and Navigation Assistance for People with Visual Impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, Glasgow, Scotland Uk, 1–14. https://doi.org/10.1145/3290605.3300246

Digital Library

[21]

John AC Hattie and Gregory M Donoghue. 2016. Learning strategies: A synthesis and conceptual model. npj Science of Learning 1, 1 (2016), 1–13.

[22]

Steven Henderson and Steven Feiner. 2011. Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair. IEEE Transactions on Visualization and Computer Graphics 17, 10 (2011), 1355–1368. https://doi.org/10.1109/TVCG.2010.245

Digital Library

[23]

Karen Holtzblatt and Hugh Beyer. 2017. The affinity diagram. Contextual design (2017), 127–146.

[24]

Joey Chiao-Yin Hsiao and Tawanna R. Dillahunt. 2017. People-Nearby Applications: How Newcomers Move Their Relationships Offline and Develop Social and Cultural Capital. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (Portland Oregon USA, 2017-02-25). ACM, 26–40. https://doi.org/10.1145/2998181.2998280

Digital Library

[25]

Gaurav Jain, Yuanyang Teng, Dong Heon Cho, Yunhao Xing, Maryam Aziz, and Brian A. Smith. 2023. "I Want to Figure Things Out": Supporting Exploration in Navigation for People with Visual Impairments. Proc. ACM Hum.-Comput. Interact. 7, CSCW1, Article 63 (apr 2023), 28 pages. https://doi.org/10.1145/3579496

Digital Library

[26]

Yongsik Jin, Jonghong Kim, Bumhwi Kim, Rammohan Mallipeddi, and Minho Lee. 2015. Smart Cane: Face Recognition System for Blind. In Proceedings of the 3rd International Conference on Human-Agent Interaction (New York, NY, USA, 2015-10-21) (HAI ’15). Association for Computing Machinery, 145–148. https://doi.org/10.1145/2814940.2814952

Digital Library

[27]

Rie Kamikubo, Naoya Kato, Keita Higuchi, Ryo Yonetani, and Yoichi Sato. 2020. Support Strategies for Remote Guides in Assisting People with Visual Impairments for Effective Indoor Navigation. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2020-04-23) (CHI ’20). Association for Computing Machinery, 1–12. https://doi.org/10.1145/3313831.3376823

Digital Library

[28]

Devva Kasnitz. 2019. The Politics of Disability Performativity: An Autoethnography. 61 (2019), S16–S25. Issue S21. https://doi.org/10.1086/705782 Publisher: The University of Chicago Press.

[29]

Gerard Kim and Hyeong Cheol Kim. 2011. Designing of multimodal feedback for enhanced multitasking performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3113–3122.

Digital Library

[30]

Kyungjun Lee, Daisuke Sato, Saki Asakawa, Hernisa Kacorri, and Chieko Asakawa. 2020. Pedestrian Detection with Wearable Cameras for the Blind: A Two-way Perspective. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2020-04-23) (CHI ’20). Association for Computing Machinery, 1–12. https://doi.org/10.1145/3313831.3376398

Digital Library

[31]

Sooyeon Lee, Madison Reddie, Chun-Hua Tsai, Jordan Beck, Mary Beth Rosson, and John M. Carroll. 2020. The Emerging Professional Practice of Remote Sighted Assistance for People with Visual Impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376591

Digital Library

[32]

Sharan B Merriam and Elizabeth J Tisdell. 2015. Qualitative research: A guide to design and implementation. John Wiley & Sons.

[33]

Oussama Metatla, Nick Bryan-Kinns, Tony Stockman, and Fiore Martin. 2012. Cross-modal collaborative interaction between visually-impaired and sighted users in the workplace. In Proceedings of the International Conference of Auditory Display (ICAD’2012), Georgia Institute of Technology, Atlanta, GA, USA.

[34]

Missouri School for the Blind. 2023. How to Interact with A Person Who is Visually Impaired. https://msb.dese.mo.gov/resources/interacting-with-visually-impaired.html

[35]

Inge Molenaar. 2021. Personalisation of learning: Towards hybrid human-AI learning technologies. (2021). https://doi.org/10.1787/2cc25e37-en

[36]

Cecily Morrison, Ed Cutrell, Martin Grayson, Geert Roumen, Rita Marques, Anja Thieme, Alex Taylor, and Abigail Sellen. 2021. PeopleLens. 28, 3 (2021), 10–13. https://www.microsoft.com/en-us/research/publication/peoplelens/

[37]

Mala D Naraine and Peter H Lindsay. 2011. Social inclusion of employees who are blind or low vision. Disability & Society 26, 4 (2011), 389–403.

[38]

Isabel Neto, Hugo Nicolau, and Ana Paiva. 2021. Community Based Robot Design for Classrooms with Mixed Visual Abilities Children. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 31, 12 pages. https://doi.org/10.1145/3411764.3445135

Digital Library

[39]

ngrok, Inc.2023. ngrok | Unified Ingress Platform for Developers. https://ngrok.com/

[40]

Hugo Nicolau, Joaquim Jorge, and Tiago Guerreiro. 2009. Blobby: how to guide a blind person. In CHI ’09 Extended Abstracts on Human Factors in Computing Systems (Boston MA USA, 2009-04-04). ACM, 3601–3606. https://doi.org/10.1145/1520340.1520541

Digital Library

[41]

Michael Oliver. 1990. The individual and social models of disability. Oliver.

[42]

J. Eduardo Pérez, Myriam Arrue, Masatomo Kobayashi, Hironobu Takagi, and Chieko Asakawa. 2017. Assessment of Semantic Taxonomies for Blind Indoor Navigation Based on a Shopping Center Use Case. In Proceedings of the 14th International Web for All Conference (Perth Western Australia Australia, 2017-04-02). ACM, 1–4. https://doi.org/10.1145/3058555.3058575

Digital Library

[43]

Morgan Klaus Scheuerman, William Easley, Ali Abdolrahmani, Amy Hurst, and Stacy Branham. 2017. Learning the Language: The Importance of Studying Written Directions in Designing Navigational Technologies for the Blind. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver Colorado USA, 2017-05-06). ACM, 2922–2928. https://doi.org/10.1145/3027063.3053260

Digital Library

[44]

Kristen Shinohara and Jacob O. Wobbrock. 2016. Self-Conscious or Self-Confident? A Diary Study Conceptualizing the Social Accessibility of Assistive Technology. ACM Trans. Access. Comput. 8, 2, Article 5 (jan 2016), 31 pages. https://doi.org/10.1145/2827857

Digital Library

[45]

Lee Stearns and Anja Thieme. 2018. Automated Person Detection in Dynamic Scenes to Assist People with Vision Impairments: An Initial Investigation. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway Ireland, 2018-10-08). ACM, 391–394. https://doi.org/10.1145/3234695.3241017

Digital Library

[46]

Anja Thieme, Cynthia L. Bennett, Cecily Morrison, Edward Cutrell, and Alex S. Taylor. 2018. I can do everything but see! – How People with Vision Impairments Negotiate their Abilities in Social Contexts. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–14. https://doi.org/10.1145/3173574.3173777

Digital Library

[47]

Bitstrips ULC. 2022. Bitmoji - your own personal emoji. https://www.bitmoji.com/

[48]

United States: National Archives and Records Administration: Office of the Federal Register. 1998. Assistive Technology Act of 1998 – An act to support programs of grants to States to address the assistive technology needs of individuals with disabilities, and for other purposes.https://www.govinfo.gov/app/details/PLAW-105publ394 Accession Number: PLAW-105publ394, PLAW-105publ394 Call Number: AE 2.110:, AE 2.110/3:, AE 2.110:105-394, AE 2.110:, AE 2.110/3:, AE 2.110:105-394 Source: DGPO, DGPO.

[49]

Beatrice Vincenzi, Alex S. Taylor, and Simone Stumpf. 2021. Interdependence in Action: People with Visual Impairments and Their Guides Co-Constituting Common Spaces. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 69 (apr 2021), 33 pages. https://doi.org/10.1145/3449143

Digital Library

[50]

VSC-Service-Account. 2023. Holographic face tracking. https://learn.microsoft.com/en-us/samples/microsoft/windows-universal-samples/holographicfacetracking/

[51]

Michele A. Williams, Caroline Galbraith, Shaun K. Kane, and Amy Hurst. 2014. "just let the cane hit it": how the blind and sighted see navigation differently. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS ’14. ACM Press, Rochester, New York, USA, 217–224. https://doi.org/10.1145/2661334.2661380

Digital Library

[52]

Michele A. Williams, Amy Hurst, and Shaun K. Kane. 2013. "Pray before you step out": describing personal and situational blind navigation behaviors. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (Bellevue Washington, 2013-10-21). ACM, 1–8. https://doi.org/10.1145/2513383.2513449

Digital Library

[53]

Rainer Winkler, Matthias Söllner, Maya Lisa Neuweiler, Flavia Conti Rossini, and Jan Marco Leimeister. 2019. Alexa, Can You Help Us Solve This Problem?: How Conversations With Smart Personal Assistant Tutors Increase Task Group Outcomes. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow Scotland Uk, 2019-05-02). ACM, 1–6. https://doi.org/10.1145/3290607.3313090

Digital Library

[54]

Wisconsin Department of Health. 2023. Do’s and Don’ts When Interacting with a Person who is Blind. https://www.dhs.wisconsin.gov/obvi/adjustment/dos-donts.htm

[55]

Jingyi Xie, Rui Yu, Sooyeon Lee, Yao Lyu, Syed Masum Billah, and John M. Carroll. 2022. Helping Helpers: Supporting Volunteers in Remote Sighted Assistance with Augmented Reality Maps. In Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY, USA, 881–897. https://doi.org/10.1145/3532106.3533560

Digital Library

[56]

Chien Wen Yuan, Benjamin V. Hanrahan, Sooyeon Lee, Mary Beth Rosson, and John M. Carroll. 2017. I Didn’t Know that You Knew I Knew: Collaborative Shopping Practices between People with Visual Impairment and People with Vision. 1 (2017), 118:1–118:18. Issue CSCW. https://doi.org/10.1145/3134753

Digital Library

[57]

John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through Design as a Method for Interaction Design Research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 493–502. https://doi.org/10.1145/1240624.1240704

Digital Library

Cited By

Kubota MKuribayashi MKayukawa STakagi HAsakawa CMorishima S(2024)Snap&Nav: Smartphone-based Indoor Navigation System For Blind People via Floor Map Analysis and Intersection DetectionProceedings of the ACM on Human-Computer Interaction10.1145/36765228:MHCI(1-22)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676522

Index Terms

Help Supporters: Exploring the Design Space of Assistive Technologies to Support Face-to-Face Help Between Blind and Sighted Strangers
1. Human-centered computing
2. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Assistive technologies
  2. User characteristics
    1. People with disabilities

Index terms have been assigned to the content through auto-classification.

Recommendations

“I Choose Assistive Devices That Save My Face”: A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Despite the potential benefits of assistive technologies (ATs) for people with various disabilities, only around 7% of Chinese with disabilities have had an opportunity to use ATs. Even for those who have used ATs, the abandonment rate was high. ...
Blind Leading the Sighted: Drawing Design Insights from Blind Users towards More Productivity-oriented Voice Interfaces
Regular Papers and Special Issue on ASSETS 2018

Voice-activated personal assistants (VAPAs) are becoming smaller, cheaper, and more accurate, such that they are now prevalent in homes (e.g., Amazon Echo, Sonos One) and on mobile devices (e.g., Google Assistant, Apple Siri) around the world. VAPAs ...
Using Sound Feedback to Help Blind People Navigate
ECCE '18: Proceedings of the 36th European Conference on Cognitive Ergonomics

People can generate mental representations of one physical magnitude (e.g., distance) in terms of another (e.g., pitch). Capitalizing on this ability, we developed a system that could help visually impaired people navigate by presenting them with sounds ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

May 2024

18961 pages

ISBN:9798400703300

DOI:10.1145/3613904

Editors:
Florian Floyd Mueller
Monash University
,
Penny Kyburz
The Australian National University
,
Julie R. Williamson
University of Glasgow
,
Corina Sas
Lancaster University
,
Max L. Wilson
University of Nottingham
,
Phoebe Toups Dugas
Monash University/New Mexico State University
,
Irina Shklovski
University of Copenhagen

Copyright © 2024 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '24

Sponsor:

CHI '24: CHI Conference on Human Factors in Computing Systems

May 11 - 16, 2024

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
2,029
Total Downloads

Downloads (Last 12 months)2,029
Downloads (Last 6 weeks)69

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kubota MKuribayashi MKayukawa STakagi HAsakawa CMorishima S(2024)Snap&Nav: Smartphone-based Indoor Navigation System For Blind People via Floor Map Analysis and Intersection DetectionProceedings of the ACM on Human-Computer Interaction10.1145/36765228:MHCI(1-22)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676522

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents