Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3281505.3281516acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
short-paper

Investigating different modalities of directional cues for multi-task visual-searching scenario in virtual reality

Published: 28 November 2018 Publication History

Abstract

In this study, we investigated and compared the effectiveness of visual, auditory, and vibrotactile directional cues on multiple simultaneous visual-searching tasks in an immersive virtual environment. Effectiveness was determined by the task-completion time, the range of head movement, the accuracy of the identification task, and the perceived workload. Our experiment showed that the on-head vibrotactile display can effectively guide users towards virtual visual targets, without affecting their performance on the other simultaneous tasks, in the immersive VR environment. These results can be applied to numerous applications (e.g. gaming, driving, and piloting) in which there are usually multiple simultaneous tasks, and the user experience and performance could be vulnerable.

Supplementary Material

MP4 File (a41-chen.mp4)

References

[1]
Beattie, D., Baillie, L., Halvey, M., & McCall, R. (2014, October). What's around the corner?: enhancing driver awareness in autonomous vehicles via in-vehicle spatial auditory displays. In Proceedings of the 8th nordic conference on human-computer interaction: fun, fast, foundational (pp. 189--198). ACM.
[2]
Burke, J. L., Prewett, M. S., Gray, A. A., Yang, L., Stilson, F. R., Coovert, M. D., ... & Redden, E. (2006, November). Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. In Proceedings of the 8th international conference on Multimodal interfaces (pp. 108--117). ACM.
[3]
Bustamante, E. A., & Spain, R. D. (2008, September). Measurement invariance of the Nasa TLX. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 52, No. 19, pp. 1522--1526). Sage CA: Los Angeles, CA: SAGE Publications.
[4]
Cassinelli, A., Reynolds, C., & Ishikawa, M. (2006, October). Augmenting spatial awareness with haptic radar. In Wearable Computers, 2006 10th IEEE International Symposium on (pp. 61--64). IEEE.
[5]
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981). A method for assessing the quality of a randomized control trial. Controlled clinical trials, 2(1), 31--49.
[6]
Danna, J., Fontaine, M., Paz-Villagrán, V., Gondre, C., Thoret, E., Aramaki, M., ... & Velay, J. L. (2015). The effect of real-time auditory feedback on learning new characters. Human movement science, 43, 216--228.
[7]
Gilliland, K., & Schlegel, R. E. (1994). Tactile stimulation of the human head for information display. Human Factors, 36(4), 700--717.
[8]
Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology, 52, 139--183.
[9]
Hayward, V., & MacLean, K. E. (2007). Do it yourself haptics: part I. IEEE Robotics & Automation Magazine, 14(4).
[10]
Hopkins, K., Kass, S. J., Blalock, L. D., & Brill, J. C. (2017). Effectiveness of auditory and tactile crossmodal cues in a dual-task visual and auditory scenario. Ergonomics, 60(5), 692--700.
[11]
Kaul, O. B., & Rohs, M. (2016, May). Haptichead: 3d guidance and target acquisition through a vibrotactile grid. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (pp. 2533--2539). ACM.
[12]
Kaul, O. B., & Rohs, M. (2017, May). HapticHead: A Spherical Vibrotactile Grid around the Head for 3D Guidance in Virtual and Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 3729--3740). ACM.
[13]
Kaul, O. B., Meier, K., & Rohs, M. (2017, September). Increasing Presence in Virtual Reality with a Vibrotactile Grid Around the Head. In IFIP Conference on Human-Computer Interaction (pp. 289--298). Springer, Cham.
[14]
Kerdegari, H., Kim, Y., & Prescott, T. J. (2016, July). Head-Mounted Sensory Augmentation Device: Comparing Haptic and Audio Modality. In Conference on Biomimetic and Biohybrid Systems (pp. 107--118). Springer International Publishing.
[15]
Marsalia, A. (2013). Evaluation of vibrotactile alert systems for supporting hazard awareness and safety of distracted pedestrians (Doctoral dissertation).
[16]
Rash, C. E., Russo, M. B., Letowski, T. R., & Schmeisser, E. T. (2009). Helmet-mounted displays: Sensation, perception and cognition issues. ARMY AEROMEDICAL RESEARCH LAB FORT RUCKER AL.
[17]
ępakov, O., Rantala, J., & Isokoski, P. (2015, June). Sequential and simultaneous tactile stimulation with multiple actuators on head, neck and back for gaze cuing. In World Haptics Conference (WHC), 2015 IEEE (pp. 333--338). IEEE.
[18]
Turchet, L., Burelli, P., & Serafin, S. (2013). Haptic feedback for enhancing realism of walking simulations. IEEE transactions on haptics, 6(1), 35--45.
[19]
van Erp, J. (2001). Tactile navigation display. Haptic human-computer interaction, 165--173.
[20]
Ward, M., Barde, A., Russell, P. N., Billinghurst, M., & Helton, W. S. (2016, September). Visual cues to reorient attention from head mounted displays. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 60, No. 1, pp. 1574--1578). Sage CA: Los Angeles, CA: SAGE Publications.
[21]
Way, T. P., & Barner, K. E. (1997). Automatic visual to tactile translation. i. human factors, access methods and image manipulation. IEEE Transactions on rehabilitation engineering, 5(1), 81--94.
[22]
Wickens, C. D. (1991). Processing resources and attention. Multiple-task performance, 1991, 3--34
[23]
Wuertz, J., Alharthi, S. A., Hamilton, W. A., Bateman, S., Gutwin, C., Tang, A., ... & Hammer, J. (2018, April). A Design Framework for Awareness Cues in Distributed Multiplayer Games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (p. 243). ACM.

Cited By

View all
  • (2024)Visual and Haptic Guidance for Enhancing Target Search Performance in Dual-Task SettingsApplied Sciences10.3390/app1411465014:11(4650)Online publication date: 28-May-2024
  • (2024)Understanding the Impact of the Reality-Virtuality Continuum on Visual Search Using Fixation-Related Potentials and Eye Tracking FeaturesProceedings of the ACM on Human-Computer Interaction10.1145/36765288:MHCI(1-33)Online publication date: 24-Sep-2024
  • (2024)SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675639(1-17)Online publication date: 27-Oct-2024
  • Show More Cited By

Index Terms

  1. Investigating different modalities of directional cues for multi-task visual-searching scenario in virtual reality

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology
      November 2018
      570 pages
      ISBN:9781450360869
      DOI:10.1145/3281505
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 November 2018

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. auditory
      2. directional cue
      3. multi-task
      4. vibration
      5. virtual reality
      6. visual

      Qualifiers

      • Short-paper

      Funding Sources

      Conference

      VRST '18

      Acceptance Rates

      Overall Acceptance Rate 66 of 254 submissions, 26%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)86
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 20 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Visual and Haptic Guidance for Enhancing Target Search Performance in Dual-Task SettingsApplied Sciences10.3390/app1411465014:11(4650)Online publication date: 28-May-2024
      • (2024)Understanding the Impact of the Reality-Virtuality Continuum on Visual Search Using Fixation-Related Potentials and Eye Tracking FeaturesProceedings of the ACM on Human-Computer Interaction10.1145/36765288:MHCI(1-33)Online publication date: 24-Sep-2024
      • (2024)SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675639(1-17)Online publication date: 27-Oct-2024
      • (2024)Toward Facilitating Search in VR With the Assistance of Vision Large Language ModelsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687742(1-14)Online publication date: 9-Oct-2024
      • (2024)Exploring Bimanual Haptic Feedback for Spatial Search in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337204530:5(2422-2433)Online publication date: 4-Mar-2024
      • (2024)Interacting with virtual characters, objects and environments: investigating immersive virtual reality in rehabilitationDisability and Rehabilitation: Assistive Technology10.1080/17483107.2024.235328420:1(107-117)Online publication date: 23-May-2024
      • (2024)Individualized foveated rendering with eye-tracking head-mounted displayVirtual Reality10.1007/s10055-023-00931-828:1Online publication date: 19-Jan-2024
      • (2024)Analyzing the Interplay of Visual and Auditory Stimuli on Human Physiology and Stress Levels in Virtual EnvironmentHCI International 2024 – Late Breaking Papers10.1007/978-3-031-76809-5_8(103-117)Online publication date: 4-Dec-2024
      • (2023)DrivingVibe: Enhancing VR Driving Experience using Inertia-based Vibrotactile Feedback around the HeadProceedings of the ACM on Human-Computer Interaction10.1145/36042537:MHCI(1-22)Online publication date: 13-Sep-2023
      • (2023)HaptiX: Vibrotactile Haptic Feedback for Communication of 3D Directional CuesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585601(1-7)Online publication date: 19-Apr-2023
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media