abstract

HeliCoach: An Adaptive Orientation and Mobility Training System in a Drone-based 3D Audio Space

Authors:

Qianying WangAuthors Info & Claims

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 8

https://doi.org/10.1145/3334480.3382880

Published: 25 April 2020 Publication History

Abstract

We present HeliCoach, an adaptive O&M (orientation and mobility) training system to help visually impaired people to gain audio-orientation ability efficiently. HeliCoach is a mastery-based adaptive learning system consists of three components: A drone-based physically simulated 3D audio space, a UWB (Ultra-Wide Band)-supported assessment system, an intelligent belt with haptic feedback as training scaffolds. We evaluated the acceptability and efficiency of HeliCoach on both blindfolded sighted participants and visually impaired participants in an audio-orientation task. The results showed that HeliCoach was efficient and interesting. Thus, We believe HeliCoach can be applied to many simulated 3D audio space related task to train people more efficiently.

References

[1]

Axel Ahrens, Kasper Duemose Lund, Marton Marschall, and Torsten Dau. 2019. Sound source localization with varying amount of visual information in virtual reality. PloS one 14, 3 (2019), e0214603.

[2]

Vincent Aleven, Ido Roll, Bruce M McLaren, and Kenneth R Koedinger. 2016. Help helps, but only so much: Research on help seeking with intelligent tutoring systems. International Journal of Artificial Intelligence in Education 26, 1 (2016), 205--223.

[3]

Kevin Allain, Bas Dado, Mick Van Gelderen, Olivier Hokke, Miguel Oliveira, Rafael Bidarra, Nikolay D Gaubitch, Richard C Hendriks, and Ben Kybartas. 2015. An audio game for training navigation skills of blind children. In 2015 IEEE 2nd VR Workshop on Sonic Interactions for Virtual Environments (SIVE). IEEE, 1--4.

Digital Library

[4]

Benjamin S Bloom. 1984. The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational researcher 13, 6 (1984), 4--16.

[5]

J. Briggs and British Columbia. Ministry of Education. Special Programs Branch. 1999. Framework for Independent Travel: A Resource for Orientation and Mobility Instruction. Government of British Columbia. https://books.google.com/books?id=dW13PQAACAAJ

[6]

Erin C Connors, Elizabeth R Chrastil, Jaime Sánchez, and Lotfi B Merabet. 2014. Virtual environments for the transfer of navigation skills in the blind: A comparison of directed instruction vs. video game based learning approaches. Frontiers in human neuroscience 8 (2014), 223.

[7]

Akansel Cosgun, E Akin Sisbot, and Henrik I Christensen. 2014. Evaluation of rotational and directional vibration patterns on a tactile belt for guiding visually impaired people. In 2014 IEEE Haptics Symposium (HAPTICS). IEEE, 367--370.

[8]

Qicheng Ding, Jiangtao Gong, Jingwei Sun, Penghui Xu, Liuxin Zhang, Qianying Wang, and Yu Zhang. 2019. HeliCoach: A Drone-based System Supporting Orientation and Mobility Training for the Visually Impaired. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, LBW1720.

[9]

Tomá Effenberger, Jaroslav Cechák, and Radek Pelánek. 2019. Measuring Difficulty of Introductory Programming Tasks. In Proceedings of the Sixth (2019) ACM Conference on Learning@ Scale. ACM, 28.

Digital Library

[10]

Yiyuan Han and Fei Chen. 2019. Minimum Audible Movement Angle in Virtual Auditory Environment: Effect of Stimulus Frequency. In 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR). IEEE, 175--178.

[11]

Akio Honda, Sayaka Tsunokake, Yôiti Suzuki, and Shuichi Sakamoto. 2018. Effects of listener's whole-body rotation and sound duration on horizontal sound localization accuracy. Acoustical Science and Technology 39, 4 (2018), 305--307.

[12]

Dae Kim, C Scott Smith, Elyse Connors, and others. 2016. Travel Behavior of Blind Individuals before and after Receiving Orientation and Mobility Training. Technical Report. Western Michigan University. Transportation Research Center for Livable....

[13]

Nicola Kloet, Simon Watkins, Xu Wang, Sam Prudden, Reece Clothier, and J Palmer. 2017. Drone on: A preliminary investigation of the acoustic impact of unmanned aircraft systems (UAS). In 24th international congress on sound and vibration.

[14]

Ryusuke Noda, Toshiyuki Nakata, Teruaki Ikeda, Di Chen, Yuma Yoshinaga, Kenta Ishibashi, Chen Rao, and Hao Liu. 2018. Development of Bio-Inspired Low-Noise Propeller for a Drone. Journal of Robotics and Mechatronics 30, 3 (2018), 337--343.

[15]

Annishka Oksa, Slava Kalyuga, and Paul Chandler. 2010. Expertise reversal effect in using explanatory notes for readers of Shakespearean text. Instructional Science 38, 3 (2010), 217--236.

[16]

Parvaneh Rabiee, Gillian Mary Parker, Sylvia Margaret Bernard, and Kate Baxter. 2015. Vision rehabilitation services: what is the evidence? Final report. (2015).

[17]

Steve Ritter, Michael Yudelson, Stephen E Fancsali, and Susan R Berman. 2016. How mastery learning works at scale. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale. ACM, 71--79.

Digital Library

[18]

Yigal Rosen, Ilia Rushkin, Rob Rubin, Liberty Munson, Andrew Ang, Gregory Weber, Glenn Lopez, and Dustin Tingley. 2018. The effects of adaptive learning in a massive open online course on learners' skill development. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale. ACM, 6.

Digital Library

[19]

Diogo Simões and Sofia Cavaco. 2014. An orientation game with 3D spatialized audio for visually impaired children. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology. ACM, 37.

Digital Library

[20]

Robert A Sottilare, Rodney A Long, and Benjamin S Goldberg. 2017. Enhancing the Experience Application Program Interface (xAPI) to improve domain competency modeling for adaptive instruction. In Proceedings of the Fourth (2017) ACM Conference on Learning@ Scale. ACM, 265--268.

Digital Library

[21]

Jan BF Van Erp, Liselotte Kroon, Tina Mioch, and Katja I Paul. 2017. Obstacle detection display for visually impaired: Coding of direction, distance, and height on a vibrotactile waist band. Frontiers in ICT 4 (2017), 23.

[22]

Herbert J Walberg. 1984. Improving the productivity of America's schools. Educational leadership 41, 8 (1984), 19--27.

[23]

Ryan Wedoff, Lindsay Ball, Amelia Wang, Yi Xuan Khoo, Lauren Lieberman, and Kyle Rector. 2019. Virtual Showdown: An Accessible Virtual Reality Game with Scaffolds for Youth with Visual Impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 141.

Digital Library

[24]

F Wendt and M Frank. 2018. On the localization of auditory objects created by directional sound sources in a virtual room. VDT Tonmeistertagung (2018).

[25]

Yuhang Zhao, Cynthia L Bennett, Hrvoje Benko, Edward Cutrell, Christian Holz, Meredith Ringel Morris, and Mike Sinclair. 2018. Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 116.

Digital Library

Cited By

Yang KWu JXin HGong J(2024)"I see it as a wellspring for my positive and upward journey in life.": Understanding Current Practices of Assistive Technology's Customized Modification in ChinaProceedings of the ACM on Human-Computer Interaction10.1145/36870128:CSCW2(1-42)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687012
Zhang YLi ZGuo HWang LChen QJiang WFan MZhou GGong J(2023)"I am the follower, also the boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually ImpairedProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580884(1-22)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580884
Garcia JBrock A(2022)CandyFly: Bringing fun to drone pilots with disabilities through adapted and adaptable interactionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517568(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517568

Index Terms

HeliCoach: An Adaptive Orientation and Mobility Training System in a Drone-based 3D Audio Space
1. Human-centered computing
  1. Accessibility
    1. Accessibility systems and tools
    2. Empirical studies in accessibility

Recommendations

HeliCoach: A Drone-based System Supporting Orientation and Mobility Training for the Visually Impaired
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Orientation and mobility (O&M) training is essential for improving the independence and wellbeing of the visually impaired. However, the shortage of qualified trainers and the unengaging training contents limit the number of O&M training recipients. In ...
Opportunities for Supporting Self-efficacy Through Orientation & Mobility Training Technologies for Blind and Partially Sighted People
ASSETS '21: Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility

Orientation and mobility (O&M) training provides essential skills and techniques for safe and independent mobility for blind and partially sighted (BPS) people. The demand for O&M training is increasing as the number of people living with vision ...
Mobile location-based games to support orientation & mobility training for visually impaired students
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

Orientation and Mobility (O&M) training is an important aspect in the education of visually impaired students. In this work we present a scavenger hunt-like location-based game to support O&M training. In two comparative studies with blind and partially ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

4474 pages

ISBN:9781450368193

DOI:10.1145/3334480

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2020

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

the National Key Research and Development Plan

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
225
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)2

Reflects downloads up to 30 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yang KWu JXin HGong J(2024)"I see it as a wellspring for my positive and upward journey in life.": Understanding Current Practices of Assistive Technology's Customized Modification in ChinaProceedings of the ACM on Human-Computer Interaction10.1145/36870128:CSCW2(1-42)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687012
Zhang YLi ZGuo HWang LChen QJiang WFan MZhou GGong J(2023)"I am the follower, also the boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually ImpairedProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580884(1-22)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580884
Garcia JBrock A(2022)CandyFly: Bringing fun to drone pilots with disabilities through adapted and adaptable interactionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517568(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517568

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten