Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Designing a Vibrotactile Head-Mounted Display for Spatial Awareness in 3D Spaces

Published: 01 April 2017 Publication History

Abstract

Due to the perceptual characteristics of the head, vibrotactile Head-mounted Displays are built with low actuator density. Therefore, vibrotactile guidance is mostly assessed by pointing towards objects in the azimuthal plane. When it comes to multisensory interaction in 3D environments, it is also important to convey information about objects in the elevation plane. In this paper, we design and assess a haptic guidance technique for 3D environments. First, we explore the modulation of vibration frequency to indicate the position of objects in the elevation plane. Then, we assessed a vibrotactile HMD made to render the position of objects in a 3D space around the subject by varying both stimulus loci and vibration frequency. Results have shown that frequencies modulated with a quadratic growth function allowed a more accurate, precise, and faster target localization in an active head pointing task. The technique presented high usability and a strong learning effect for a haptic search across different scenarios in an immersive VR setup.

References

[1]
F. Alary, M. Duquette, R. Goldstein, C. E. Chapman, P. Voss, V. La Buis-sonnière-Ariza, and F. Lepore. Tactile acuity in the blind: a closer look reveals superiority over the sighted in some but not all cutaneous tasks. Neuropsychologia, Volume 47 (Issue 10 pp. 2037–2043, 2009.
[2]
A. Bangor, P. Kortum, and J. Miller. Determining what individual sus scores mean: Adding an adjective rating scale. Journal of usability studies, Volume 4 (Issue 3 pp. 114–123, 2009.
[3]
M. Berning, F. Braun, T. Riedel, and M. Beigl. Proximityhat: a head-worn system for subtle sensory augmentation with tactile stimulation. In Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 31–38. <conf-sponsor>ACM</conf-sponsor>, 2015.
[4]
L. Brayda, C. Campus, R. Chellali, G. Rodriguez, and C. Martinoli. An investigation of search behaviour in a tactile exploration task for sighted and non-sighted adults. In CHI' 11 Extended Abstracts on Human Factors in Computing Systems, pp. 2317–2322. <conf-sponsor>ACM</conf-sponsor>, 2011.
[5]
S. Brewster and L. M. Brown. Tactons: structured tactile messages for non-visual information display. In Proceedings of the fifth conference on Australasian user interface -Volume Volume 28, pp. 15–23. <conf-sponsor>Australian Computer Society, Inc.</conf-sponsor>, 2004.
[6]
J. Brooke. Sus: a retrospective. Journal of usability studies, Volume 8 (Issue 2 pp. 29–40, 2013.
[7]
S. Cardin, D. Thalmann, and F. Vexo. A wearable system for mobility improvement of visually impaired people. The Visual Computer, Volume 23 (Issue 2 pp. 109–118, 2006.
[8]
A. Chan, K. MacLean, and J. McGrenere. Designing haptic icons to support collaborative turn-taking. International Journal of Human-Computer Studies, Volume 66 (Issue 5 pp. 333–355, 2008.
[9]
R. Cholewiak, J. Brill, and A. Schwab. Vibrotactile localization on the abdomen: Effects of place and space. Perception & Psychophysics, Volume 66 (Issue 6 pp. 970–987, 2004.
[10]
D. Dakopoulos and N.G. Bourbakis. Wearable obstacle avoidance electronic travel aids for blind: a survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), Volume 40 (Issue 1 pp. 25–35, 2010.
[11]
V. A. de Jesus Oliveira, L. Nedel, A. Maciel, and L. Brayda. <chapter-title>Localized magnification in vibrotactile HMDs for accurate spatial awareness</chapter-title>. In Haptics: Perception, Devices, Control, and Applications, pp. 55–64. Springer Nature, 2016.
[12]
V. A. de Jesus Oliveira, L. Nedel, A. Maciel, and L. Brayda. Spatial discrimination of vibrotactile stimuli around the head. In IEEE Haptics Symposium (HAPTICS), pp. 1–6, 2016.
[13]
D. Dobbelstein, P. Henzler, and E. Rukzio. Unconstrained pedestrian navigation based on vibro-tactile feedback around the wristband of a smartwatch. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2439–2445. <conf-sponsor>ACM</conf-sponsor>, 2016.
[14]
M. K. Dobrzynski, S. Mejri, S. Wischmann, and D. Floreano. Quantifying information transfer through a head-attached vibrotactile display: principles for design and control. IEEE Transactions on Biomedical Engineering, Volume 59 (Issue 7 pp. 2011–2018, 2012.
[15]
J. Fröhlich and I. Wachsmuth. The visual, the auditory and the haptic-a user study on combining modalities in virtual worlds. In International Conference on Virtual, Augmented and Mixed Reality, pp. 159–168. <conf-sponsor>Springer</conf-sponsor>, 2013.
[16]
K. Gilliland and R.E. Schlegel. Tactile stimulation of the human head for information display. Human Factors: The Journal of the Human Factors and Ergonomics Society, Volume 36 Issue 4, 1994.
[17]
R. Gray, H. Z. Tan, and J. J. Young. Do multimodal signals need to come from the same place? crossmodal attentional links between proximal and distal surfaces. In Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p. pp.437. <conf-sponsor>IEEE Computer Society</conf-sponsor>, 2002.
[18]
S. G. Hart. Nasa-task load index (nasa-tlx); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, vol. Volume 50, pp. 904–908. <conf-sponsor>Sage Publications</conf-sponsor>, 2006.
[19]
V. L. Hawes, J. K. Kumagai, D. W. Tack, and L. L. Bossi. Examination of head and chest located tactile information for infantry wayfinding, 2005.
[20]
V. Hayward and K.E. MacLean. Do it yourself haptics: part i. IEEE Robotics & Automation Magazine, Volume 14 Issue 4, 2007.
[21]
L. A. Jones and N.B. Sarter. Tactile displays: Guidance for their design and application. Human Factors: The Journal of the Human Factors and Ergonomics Society, Volume 50 (Issue 1 pp. 90–111, 2008.
[22]
O. B. Kaul and M. Rohs. Haptichead: 3d guidance and target acquisition through a vibrotactile grid. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2533–2539. <conf-sponsor>ACM</conf-sponsor>, 2016.
[23]
O. B. Kaul and M. Rohs. Wearable head-mounted 3d tactile display application scenarios. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pp. 1163–1167. <conf-sponsor>ACM</conf-sponsor>, 2016.
[24]
H. Kerdegari, Y. Kim, and T. Prescott. Tactile language for a head-mounted sensory augmentation device. In Biomimetic and Biohybrid Systems, pp. 359–365. <conf-sponsor>Springer</conf-sponsor>, 2015.
[25]
H. Kerdegari, Y. Kim, T. Stafford, and T. J. Prescott. Centralizing bias and the vibrotactile funneling illusion on the forehead. In Haptics: Neuroscience, Devices, Modeling, and Applications, pp. 55–62. <conf-sponsor>Springer</conf-sponsor>, 2014.
[26]
K. E. MacLean and V. Hayward. Do it yourself haptics: Part ii {tutorial}. IEEE robotics & automation magazine, Volume 15 (Issue 1 pp. 104–119, 2008.
[27]
K. Myles and J.T. Kalb. Guidelines for head tactile communication. Technical report, DTIC Document, 2010.
[28]
T. Nukarinen, J. Rantala, A. Farooq, and R. Raisamo. Delivering directional haptic cues through eyeglasses and a seat. In IEEE World Haptics Conference (WHC), pp. 345–350. <conf-sponsor>IEEE</conf-sponsor>, 2015.
[29]
F. Pinto, A. Buaes, D. Francio, A. P. D. Binotto, and P. Santos. Bratrack: a low-cost marker-based optical stereo tracking system. In SIGGRAPH Posters, p. pp.131, 2008.
[30]
C. E. Rash, M. B. Russo, T. R. Letowski, and E. T. Schmeisser. Helmet-mounted displays: Sensation, perception and cognition issues. Technical report, DTIC Document, 2009.
[31]
J. C. Roberts and K. Franklin. Haptic glyphs (hlyphs)-structured haptic objects for haptic visualization. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference, pp. 369–374. <conf-sponsor>IEEE</conf-sponsor>, 2005.
[32]
J. Sauro and J.S. Dumas. Comparison of three one-question, post-task usability questionnaires. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. <conf-sponsor>ACM</conf-sponsor>, 2009.
[33]
M. J. Smith, R. J. Koubek, G. Salvendy, and D. Harris. Usability Evaluation and Interface Design: Cognitive Engineering, Intelligent Agents, and Virtual Reality, vol. Volume 1 . CRC press, 2001.
[34]
O. Spakov, J. Rantala, and P. Isokoski. Sequential and simultaneous tactile stimulation with multiple actuators on head, neck and back for gaze cuing. In IEEE World Haptics Conference (WHC), 2015.
[35]
L. Turchet. Designing presence for real locomotion in immersive virtual environments: an affordance-based experiential approach. Virtual Reality, Volume 19 (Issue 3–4: pp. 277–290, 2015.
[36]
L. Turchet, P. Burelli, and S. Serafin. Haptic feedback for enhancing realism of walking simulations. IEEE Transactions on Haptics, Volume 6 (Issue 1 pp. 35–45, 2013.
[37]
J. B. van Erp. Tactile navigation display. In Haptic human-computer Interaction, pp. 165–173. <conf-sponsor>Springer</conf-sponsor>, 2001.
[38]
J. B. Van Erp, H. A. Van Veen, C. Jansen, and T. Dobbins. Waypoint navigation with a vibrotactile waist belt. ACM Transactions on Applied Perception (TAP), Volume 2 (Issue 2 pp. 106–117, 2005.
[39]
M. Ward, A. Barde, P. N. Russell, M. Billinghurst, and W. S. Helton. Visual cues to reorient attention from head mounted displays. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Volume 60 (Issue 1 pp. 1574–1578, sep 2016.

Cited By

View all
  • (2024)ShoulderTapper: Providing Directional Cues through Electrotactile Feedback for Target Acquisition in Pick-by-Light SystemsProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701597(228-234)Online publication date: 1-Dec-2024
  • (2024)How Vibrotactile and Auditory Feedback Can Affect Performance in Search for Invisible Objects in Virtual RealityProceedings of the European Conference on Cognitive Ergonomics 202410.1145/3673805.3673808(1-6)Online publication date: 8-Oct-2024
  • (2024)SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675639(1-17)Online publication date: 27-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Visualization and Computer Graphics
IEEE Transactions on Visualization and Computer Graphics  Volume 23, Issue 4
April 2017
152 pages

Publisher

IEEE Educational Activities Department

United States

Publication History

Published: 01 April 2017

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 25 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)ShoulderTapper: Providing Directional Cues through Electrotactile Feedback for Target Acquisition in Pick-by-Light SystemsProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701597(228-234)Online publication date: 1-Dec-2024
  • (2024)How Vibrotactile and Auditory Feedback Can Affect Performance in Search for Invisible Objects in Virtual RealityProceedings of the European Conference on Cognitive Ergonomics 202410.1145/3673805.3673808(1-6)Online publication date: 8-Oct-2024
  • (2024)SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675639(1-17)Online publication date: 27-Oct-2024
  • (2024)Toward Facilitating Search in VR With the Assistance of Vision Large Language ModelsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687742(1-14)Online publication date: 9-Oct-2024
  • (2024)Ultrasonic Mid-Air Haptics on the Face: Effects of Lateral Modulation Frequency and Amplitude on Users’ ResponsesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642417(1-12)Online publication date: 11-May-2024
  • (2024)Exploring Bimanual Haptic Feedback for Spatial Search in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337204530:5(2422-2433)Online publication date: 4-Mar-2024
  • (2024)Exploring Audio Interfaces for Vertical Guidance in Augmented Reality via Hand-Based FeedbackIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337204030:5(2818-2828)Online publication date: 4-Mar-2024
  • (2024)A Stereohaptics Accessory for Spatial Computing PlatformsHCI International 2024 – Late Breaking Papers10.1007/978-3-031-76803-3_19(325-340)Online publication date: 29-Jun-2024
  • (2024)Human Identification Performance of Vibrotactile Stimuli Applied on the Torso Along Azimuth or ElevationHaptics: Understanding Touch; Technology and Systems; Applications and Interaction10.1007/978-3-031-70058-3_1(3-15)Online publication date: 30-Jun-2024
  • (2022)Interactive Cultural Communication Effect in VR Space of Intelligent Mobile Communication NetworkWireless Communications & Mobile Computing10.1155/2022/96892722022Online publication date: 1-Jan-2022
  • Show More Cited By

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media