research-article

The Autonomous Vehicle Assistant (AVA): : Emerging technology design supporting blind and visually impaired travelers in autonomous transportation

Authors:

Paul D.S. Fink,

Stacy A. Doore,

Matthew Maring,

Aubree Nygaard,

Richard R. Corey,

Raymond J. Perry,

Katherine Freund,

Velin Dimitrov,

Nicholas A. GiudiceAuthors Info & Claims

Volume 179, Issue C

https://doi.org/10.1016/j.ijhcs.2023.103125

Published: 01 November 2023 Publication History

Highlights

•

Details the design process of a winning project in the inclusive design challenge.

•

Explores safe blind and visually impaired localization of automated vehicles.

•

Presents a novel computer vision, ultrawideband, and GPS based approach.

•

Evaluates approach with two user studies demonstrating positive results.

•

Presents future directions involving user training and implementation.

Abstract

The U.S. Department of Transportation's Inclusive Design Challenge spurred innovative research promoting accessible technology for people with disabilities in the future of autonomous transportation. This paper presents the user-driven design of the Autonomous Vehicle Assistant (AVA), a winning project of the challenge focused on solutions for people who are blind and visually impaired. Results from an initial survey (n = 90) and series of user interviews (n = 12) informed AVA's novel feature set, which was evaluated through a formal navigation study (n = 10) and participatory design evaluations (n = 6). Aggregate findings suggest that AVA's sensor fusion approach combining computer vision, last-meter assistance, and multisensory alerts provide critical solutions for users poised to benefit most from this emerging transportation technology.

References

[1]

N. Aziz, T. Stockman, R. Stewart, Planning your journey in audio: design and evaluation of auditory route overviews, ACM Trans Access Comput 15 (4) (2022) 28,. 1-28:48.

Digital Library

[2]

A. Bayne, A. Siegfried, L.F. Beck, K. Freund, Barriers and facilitators of older adults’ use of ride share services, J Transp Health 21 (2021),.

[3]

R. Bennett, R. Vijaygopal, R. Kottasz, Willingness of people who are blind to accept autonomous vehicles: an empirical investigation, Transportation Research Part F: Traffic Psychology and Behaviour 69 (2020) 13–27,.

[4]

Bochkovskiy, A., Wang, C.Y., & Liao, H.Y.M. (2020). YOLOv4: optimal speed and accuracy of object detection (arXiv:2004.10934). arXiv. https://doi.org/10.48550/arXiv.2004.10934.

[5]

R.N. Brewer, A.M. Austin, N.B. Ellison, Stories from the front seat: supporting accessible transportation in the sharing economy, Proceedings of the ACM on Human-Computer Interaction 95 (1–95) (2019) 17,. 3(CSCW).

Digital Library

[6]

R.N. Brewer, N. Ellison, Supporting People with Vision Impairments in Automated Vehicles: Challenge and Opportunities, University of Michigan, Ann Arbor, Transportation Research Institute, 2020, 2020 https://deepblue.lib.umich.edu/handle/2027.42/156054?show=full.

[7]

R.N. Brewer, V. Kameswaran, Understanding the power of control in autonomous vehicles for people with vision impairment, in: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, 2018, pp. 185–197,.

Digital Library

[8]

R.N. Brewer, V. Kameswaran, Understanding trust, transportation, and accessibility through ridesharing, in: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, 2019, pp. 1–11,.

Digital Library

[9]

J. Brinkley, S.B. Daily, J.E. Gilbert, A policy proposal to support self-driving vehicle accessibility, The Journal on Technology and Persons with Disabilities 7 (16) (2019) http://dspace.calstate.edu/handle/10211.3/210388.

[10]

J. Brinkley, E.W.H. Jr, B. Posadas, J. Woodward, S.B. Daily, J.E. Gilbert, Exploring the needs, preferences, and concerns of persons with visual impairments regarding autonomous vehicles, ACM Trans Access Comput 13 (1) (2020) 34.

[11]

J. Brinkley, B. Posadas, I. Sherman, S.B. Daily, J.E. Gilbert, An open road evaluation of a self-driving vehicle human–machine interface designed for visually impaired users, International Journal of Human–Computer Interaction 35 (11) (2019) 1018–1032,.

[12]

Bureau of Transportation Statistics, Travel Patterns of American Adults with Disabilities |, January 12 Bureau of Transportation Statistics, 2021, https://www.bts.gov/travel-patterns-with-disabilities.

[13]

CDC, Vision Loss and Age |, CDC, 2020, https://www.cdc.gov/visionhealth/risk/age.htm.

[14]

CDC, Vision Loss: A Public Health Problem |, CDC, 2022, https://www.cdc.gov/visionhealth/basic_information/vision_loss.htm.

[15]

D.D. Clark-carter, A.D. Heyes, C.I. Howarth, The efficiency and walking speed of visually impaired people, Ergonomics 29 (6) (1986) 779–789,.

[16]

H. Claypool, A. Bin-Nun, J. Gerlach, Self-Driving Cars: The Impact on People with Disabilities, Ruderman Foundation, 2017, p. 35.

[17]

A. Curl, H. Fitt, M. Tomintz, Experiences of the built environment, falls and fear of falling outdoors among older adults: an exploratory study and future directions, Int J Environ Res Public Health 17 (4) (2020) 1224,.

[18]

H. Detjen, S. Schneegass, S. Geisler, A. Kun, V. Sundar, An emergent design framework for accessible and inclusive future mobility, in: Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2022, pp. 1–12,.

Digital Library

[19]

B.E. Dicianno, S. Sivakanthan, S.A. Sundaram, S. Satpute, H. Kulich, E. Powers, N. Deepak, R. Russell, R. Cooper, R.A. Cooper, Systematic review: automated vehicles and services for people with disabilities, Neurosci. Lett. 761 (2021),.

[20]

DOT, DOT Inclusive Design Challenge | US Department of Transportation |, Inclusive Design Challenge Competitors, 2020, https://www.transportation.gov/inclusive-design-challenge/inclusive-design-challenge-competitors#maine.

[21]

DOT. (2020b). Intelligent transportation systems—complete trip – ITS4US. https://its.dot.gov/its4us/.

[22]

I. Dotlic, A. Connell, H. Ma, J. Clancy, M. McLaughlin, Angle of arrival estimation using decawave DW1000 integrated circuits, in: 2017 14th Workshop on Positioning, Navigation and Communications (WPNC), 2017, pp. 1–6,.

[23]

P.D.S. Fink, A. Abou Allaban, O.E. Atekha, R.J. Perry, E.S. Sumner, R.R. Corey, V. Dimitrov, N.A. Giudice, Expanded situational awareness without vision: a novel haptic interface for use in fully autonomous vehicles, in: Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, 2023, pp. 54–62,.

Digital Library

[24]

P.D.S. Fink, V. Dimitrov, H. Yasuda, T.L. Chen, R.R. Corey, N.A. Giudice, E.S. Sumner, Autonomous is not enough: designing multisensory mid-air gestures for vehicle interactions among people with visual impairments, in: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23, 2023,.

Digital Library

[25]

P.D.S. Fink, J.A. Holz, N.A. Giudice, Fully Autonomous Vehicles for People with Visual Impairment: policy, Accessibility, and Future Directions, ACM Trans Access Comput 14 (3) (2021) 15,. 1-15:17.

Digital Library

[26]

N.A. Giudice, Navigating without vision: principles of blind spatial cognition, D. Montello, Handbook of Behavioral and Cognitive Geography , Edward Elgar Publishing, 2018, pp. 260–288,.

[27]

Giudice, N.A., & Long, R.G. (In Press). Establishing and maintaining orientation for mobility: tools, techniques, and technologies. In Foundations of Orientation and Mobility (4th ed., Vol. 1, p. Chapter 2). American Foundation for the Blind. 2023.

[28]

Giudice, N.A., & Tietz, J.D. (2008). Learning with Virtual Verbal Displays: effects of Interface Fidelity on Cognitive Map Development. In C. Freksa, N. S. Newcombe, P. Gärdenfors, & S. Wölfl (Eds.), Spatial Cognition VI. Learning, Reasoning, and Talking about Space (Vol. 5248, pp. 121–137). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-87601-4_11.

[29]

R.G. Golledge, Geography and the disabled: a survey with special reference to vision impaired and blind populations, Transactions of the Institute of British Geographers 18 (1) (1993) 63–85,.

[30]

M.W.M. Jaspers, T. Steen, C.van den Bos, M Geenen, The think aloud method: a guide to user interface design, Int J Med Inform 73 (11) (2004) 781–795,.

[31]

NanoCode012imyhxy曾逸夫 G. Jocher, A. Chaurasia, A. Stoken, J. Borovec, Y. Kwon, K. Michael, TaoXie, J. Fang, Yifu Lorna, Zeng, C., V, A. Wong, D. Montes, Z. Wang, C. Fati, J. Nadar, Laughing, M. Jain, ultralytics/yolov5: V7.0 - YOLOv5 SOTA Realtime Instance Segmentation, Zenodo (2022),.

[32]

V. Kameswaran, J. Gupta, J. Pal, S. O'Modhrain, T.C. Veinot, R. Brewer, A. Parameshwar, V. Y, J O'Neill, We can go anywhere”: understanding independence through a case study of ride-hailing use by people with visual impairments in metropolitan India, in: Proceedings of the ACM on Human-Computer Interaction, 2, 2018, pp. 1–24,. CSCW.

Digital Library

[33]

R.L. Klatzky, J.R. Marston, N.A. Giudice, R.G. Golledge, J.M. Loomis, Cognitive load of navigating without vision when guided by virtual sound versus spatial language, J Exp Psychol Appl 12 (4) (2006) 223–232,.

[34]

J.M. Loomis, R.G. Golledge, R.L. Klatzky, Navigation system for the blind: auditory display modes and guidance, Presence: Teleoperators and Virtual Environments 7 (2) (1998) 193–203,.

Digital Library

[35]

R. Manduchi, J.M. Coughlan, The last meter: blind visual guidance to a target, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2014, pp. 3113–3122,.

Digital Library

[36]

Mapbox, Maps, geocoding, and Navigation APIs & SDKs |, Mapbox, 2023, https://www.mapbox.com/.

[37]

N. Martelaro, P. Carrington, S. Fox, J. Forlizzi, Designing an inclusive mobile app for people with disabilities to independently use autonomous vehicles, in: Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2022, pp. 45–55,.

Digital Library

[38]

I. Massad, S. Dalyot, Towards the crowdsourcing of massive smartphone assisted-GPS sensor ground observations for the production of digital terrain models, Sensors 18 (3) (2018) 3,. Article.

[39]

M.C. McDonnall, Predictors of employment for youths with visual impairments: findings from the second national longitudinal transition study, J Vis Impair Blind 105 (8) (2011) 453–467.

[40]

K. Merry, P. Bettinger, Smartphone GPS accuracy study in an urban environment, PLoS ONE 14 (7) (2019),.

[41]

Mooney, J. (2003). Driving status and out-of-home social activity levels: the case of older male veterans. https://www.semanticscholar.org/paper/Driving-status-and-out-of-home-social-activity-:-of-Mooney/11a42c479f83811eb03d2099e8cae17931c0ecca.

[42]

S. Narayanan, E. Chaniotakis, C. Antoniou, Shared autonomous vehicle services: a comprehensive review, Transportation Research Part C: Emerging Technologies 111 (2020) 255–293,.

[43]

NIA, Falls and Fractures in Older Adults: Causes and Prevention, National Institute on Aging, 2023, https://www.nia.nih.gov/health/falls-and-fractures-older-adults-causes-and-prevention.

[44]

OpenStreetMap, OpenStreetMap, OpenStreetMap, 2023, https://www.openstreetmap.org.

[45]

H.P. Palani, P.D.S. Fink, N.A. Giudice, Comparing map learning between touchscreen-based visual and haptic displays: a behavioral evaluation with blind and sighted users, Multimodal Technologies and Interaction 6 (1) (2022) 1,. Article.

[46]

J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: unified, real-time object detection, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 779–788,.

[47]

R.J. Reed-Jones, G.R. Solis, K.A. Lawson, A.M. Loya, D. Cude-Islas, C.S. Berger, Vision and falls: a multidisciplinary review of the contributions of visual impairment to falls among older adults, Maturitas 75 (1) (2013) 22–28,.

[48]

R.E. Roberts, G.A. Kaplan, S.J. Shema, W.J. Strawbridge, Prevalence and correlates of depression in an aging cohort: the Alameda County Study, J Gerontol B Psychol Sci Soc Sci 52 (5) (1997) S252–S258,.

[49]

S. Shen, W. Koech, J. Feng, T.M. Rice, M. Zhu, A cross-sectional study of travel patterns of older adults in the USA during 2015: implications for mobility and traffic safety, BMJ Open 7 (8) (2017),.

[50]

United States Department of Labor. (2019). Autonomous Vehicles: Driving Employment For People With Disabilities. https://www.dol.gov/odep/topics/AV-Info-Guide-Revised.doc.

[51]

WebAIM. (2021). WebAIM: screen reader user survey #9 results. https://webaim.org/projects/screenreadersurvey9/.

[52]

P.A. Zandbergen, S.J. Barbeau, Positional accuracy of assisted GPS data from high-sensitivity GPS-enabled mobile phones, The Journal of Navigation 64 (3) (2011) 381–399,.

[53]

Y. Zhao, E. Kupferstein, H. Rojnirun, L. Findlater, S. Azenkot, The effectiveness of visual and audio wayfinding guidance on smartglasses for people with low vision, in: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, pp. 1–14,.

Digital Library

Cited By

Yong JWei JLei XWang YDang JLu W(2025)Intervention and regulatory mechanism of multimodal fusion natural interactions on AR embodied cognitionInformation Fusion10.1016/j.inffus.2024.102910117:COnline publication date: 1-May-2025
https://dl.acm.org/doi/10.1016/j.inffus.2024.102910
Fink PMilne HCaccese AAlsamsam MLoranger JColley MGiudice N(2024)Accessible Maps for the Future of Inclusive RidesharingProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675736(106-115)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675736

Index Terms

The Autonomous Vehicle Assistant (AVA): Emerging technology design supporting blind and visually impaired travelers in autonomous transportation
1. Human-centered computing
2. Social and professional topics

Index terms have been assigned to the content through auto-classification.

Recommendations

Autonomous is Not Enough: Designing Multisensory Mid-Air Gestures for Vehicle Interactions Among People with Visual Impairments
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Should fully autonomous vehicles (FAVs) be designed inclusively and accessibly, independence will be transformed for millions of people experiencing transportation-limiting disabilities worldwide. Although FAVs hold promise to improve efficient ...
Understanding the Power of Control in Autonomous Vehicles for People with Vision Impairment
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Autonomy and control are important themes in design for people with disabilities. With the rise in research in autonomous vehicle design, we investigate perceived differences in control for people with vision impairments in the use of semi- and fully ...
Fully Autonomous Vehicles for People with Visual Impairment: Policy, Accessibility, and Future Directions

A significant number of individuals in the United States report a disability that limits their ability to travel, including many people who are blind or visually impaired (BVI). The implications of restricted transportation result in negative impacts ...

Comments

Information & Contributors

Information

Published In

cover image International Journal of Human-Computer Studies

International Journal of Human-Computer Studies Volume 179, Issue C

Nov 2023

235 pages

ISSN:1071-5819

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 November 2023

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yong JWei JLei XWang YDang JLu W(2025)Intervention and regulatory mechanism of multimodal fusion natural interactions on AR embodied cognitionInformation Fusion10.1016/j.inffus.2024.102910117:COnline publication date: 1-May-2025
https://dl.acm.org/doi/10.1016/j.inffus.2024.102910
Fink PMilne HCaccese AAlsamsam MLoranger JColley MGiudice N(2024)Accessible Maps for the Future of Inclusive RidesharingProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675736(106-115)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675736

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents