Article

Using a vibro-tactile display for enhanced collision perception and presence

Authors:

Jonghyun Ryu and

Gerard Jounghyun KimAuthors Info & Claims

VRST '04: Proceedings of the ACM symposium on Virtual reality software and technology

November 2004

Pages 89 - 96

https://doi.org/10.1145/1077534.1077551

Published: 10 November 2004 Publication History

Abstract

One of the goals and means of realizing virtual reality is through multimodal interfaces, leveraging on the many sensory organs that humans possess. Among them, the tactile sense is important and useful for close range interaction and manipulation tasks. In this paper, we explore this possibility using a vibro-tactile device on the whole body for simulating collision between the user and virtual environment. We first experimentally verify the effect of enhanced user felt presence by employing localized vibration feedback alone on collision, and further investigate how to effectively provide the sense of collision using the vibro-tactile display in different ways. In particular, we test the effects of using a vibration feedback model (for simulating collision with different object materials), saltation, and simultaneous use of 3D sound toward spatial presence and perceptual realism. The results have shown that employing the proposed vibro-tactile interface did enhance the sense of presence, especially when combined with 3D sound. Furthermore, the use of saltation also helped the user detect and localize the point of contact more correctly. The use of the vibration feedback model was not found to be significantly effective, and sometimes even hindered the correct sense of collision primarily due to the limitation of the vibrotactile display device.

References

[1]

Berthoz, A. (Translated by Weiss, G.), The Brain's Sense of Movement. Harvard University Press, 2000.]]

[2]

Bolt, R. A, Put-That-There, Voice and Gesture at the Graphics Interface. Computer Graphics, Vol. 14, pp. 262--270, 1980.]]

Digital Library

[3]

Chen, L. M., Friedman, R. M., and Roe, A. W., Optical Imaging of a Tactile Illusion in Area 3b of the Primary Somatosensory Cortex. Science, Vol. 302, pp. 881--885, 2003.]]

[4]

Corradini, A., Wesson, R. M., and Cohen, P. R., A map-based system using speech and 3D gestures for pervasive computing. Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, pp. 191--196, 2002.]]

Digital Library

[5]

DiFranco, D. E., Beauregard, G. L., and Srinivasan, M. A., The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments. In G. Rizzoni (Ed.) Proc. of the ASME Dynamic Systems and Control Division, DSC Vol. 61, pp 17--22, 1997.]]

[6]

Dinh, H. Q., Walker, N., Hodges, L. F., Chang Song, and Kobayashi, A., Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. Proceedings of the IEEE Virtual Reality, pp. 222--228, 1999.]]

Digital Library

[7]

Geldard, F. A., Sensory Saltation: Metastability in the Perceptual World. New Jersey: Lawrence Erlbaum Associates, 1975.]]

[8]

Grasso, M. A., Ebert, D. S., and Finin, T. W., The integrality of speech in multimodal interfaces ACM Transactions on Computer-Human Interaction (TOCHI), 5(4), 1998.]]

Digital Library

[9]

Gunther, E., and Davenport, G., Cutaneous Grooves: Composing for the Sense of Touch, Proceedings of NIME'02, 2002.]]

Digital Library

[10]

i-Visor, {On-line} avaliable: http://www.personaldisplay.com/.]]

[11]

Kammermeier, P., Buss, M., and Schmidt, G., A Systems Theoretical for Human Perception in Multimodal Presence Systems. Transactions on IEEE/ASME Mechatronics, 6(3), pp. 234--244, 2001.]]

[12]

Lin, M., and Gottschalk, S., Collision Detection between Geometric Models: A Survey, Proceedings of IMA Conference on mathematics of Surface, 1998.]]

[13]

Logitech, "Logitech Force 3D" (Product Description), {Online} available: http://www.logitech.com/index.cfm/products/details/US/EN.]]

[14]

Mine, M. R., Brooks, F. P. Jr., and Sequin, C. H., Moving Objects in Space: Exploiting Proprioception in Virtual-Environment Interaction. Proceedings of ACM SIGGRAPH. CD-ROM, 1997.]]

Digital Library

[15]

Miner, N., and Caudel, T., Computational Requirements and Synchronization Issues for Virtual Acoustic Displays, Presence: Teleoperators and Virtual Environments, MIT, 7(4), pp. 396--409, 1998.]]

Digital Library

[16]

Mitsutake, N., Hoshiai, K., Igarashi, H., Sugioka, Y., Yamamoto, Y., Yamazaki, K., Yoshida, A., and Yamaguchi, T., Open sesame from top of your head-an event related potential based interface for the control of the virtual reality system, Proceedings of 2nd IEEE International Workshop on Robot and Human Communication, pp. 292--295, 1993.]]

[17]

Nara, T., Takasaki, M., Maeda, T., Higuchi, T., Ando, S., and Tachi, S., Surface Acoustic Wave Tactile Display. IEEE Computer Graphics and Applications, Vol 21, No. 6, pp 56--63, 2001.]]

Digital Library

[18]

Okamura, A. M., Dennerlein, J. T., and Howe, R. D., Vibration Feedback Models for Virtual Environments. IEEE Computer Graphics and Application, Vol. 21, No. 6, pp 56--63, 2001.]]

[19]

PHANTOM, {On-line} available: http://www.sensable.com/products/phantom_ghost/phantom. asp.]]

[20]

Play Station, {On-line} available: http://www.playstation.com.]]

[21]

Richard, P., Burdea, G., Gomez, D., and Coiffet, P. A. Comparison of Haptic, Visual and Auditive Force Feedback for Deformable Virtual Objects. Proceedings of ICAT'94 Conference, pp. 49--62, 1994.]]

[22]

Sallnas, E., Grohn, K., and Sjostrom, C., Supporting Presence in Collaborative Environment by Haptic Force Feedback. ACM Transactions on CHI 7(4), pp. 461--476, 2000.]]

Digital Library

[23]

Sallnas, E. L., Kirsten, R. G., and Calle, S. Supporting Presence in Collaborative Environments by Haptic Force Feedback. ACM Transactions on Computer-Human Interaction, 7(4), pp. 461--476, 2001.]]

Digital Library

[24]

Sensorama. Invented by Morton Heilig, a filmmaker, a totally mechanical VR device (one person theater), 1961.]]

[25]

Slater, M., Usoh, M., and Steed, A., Taking Steps: The Influence of a Walking Technique on Presence in virtual Reality. ACM Transactions on Computer-Human Interaction(TOCHI), 2(3), pp. 201--219, 1995.]]

Digital Library

[26]

Slater, M., and Wilbur, S., A Framework for Immersive Virtual Environments(FIVE): Speculations on the Role of Presence in virtual Environments. Presence: Teleoperators and Virtual Environments, MIT, 6(6), pp. 603--616, 1997.]]

[27]

Sound Power, {On-line} Availale: http://www.newcoms.co.kr/kor_newcom/kor_main.htm.]]

[28]

Tan, H. Z., and Pentland, A., Tactual Display for Wearable Computing, Proceedings of the ISWC 97, 1997.]]

Digital Library

[29]

TSAS, Tactile Situation Awareness System (TSAS), Information Through the Sense of Touch, {On-line} available: http://www.namrl.navy.mil/accel/TSAS, 2000.]]

[30]

Van Erp, Jan. B. F., Tactile Navigation Display, TNO Human Factors, Haptic HCI 2000, LNCS2058, pp. 165--173, 2000.]]

Digital Library

[31]

Van Erp, Jan B. F., Veltman, J. A., van Veen, H. A. H. C., and Oving, A. B., Tactile Torso Display as Countermeasure to Reduce Night Vision Goggles Induced Drift, NATO RTO Conference on Spatial Disorientation 15--17, 2002.]]

[32]

Watanabe, T., and Fujui, S., A Method for Controlling Tactile Sensation of Surface Roughness Using Ultrasonic Vibration. Proc. 1995 IEEE Int. Conf, Robotics and Automation, Vol. 1, pp. 1134--1139, 1995.]]

[33]

Wellman, P., and Howe, R. D.: "Towards realistic vibrotactile display in virtual environments", proceedings of ASME Dynamic Systems and Control Division, Vol. 57, No. 2, pp. 713--718, 1995.]]

[34]

Witmer, B. G., and Singer, M. J., Measuring Presence in Virtual Environments: A Presence Questionnaire, Presence, Vol. 7, No. 3, pp. 225--240, 1998.]]

Digital Library

[35]

Yang, U., Jang Y., and Kim G. J., POS. T. Wear: Vibro-tactile Interface Design for Near-body Space Interaction in VR-based Motion Training System, Intenational Conference on Artificial Reality and Telexistence, 12th ICAT pp. 4--9, 2002.]]

Cited By

Hedges JSazdov RJohnston A(2023)Measuring the influence of audio on immersive experience in extended reality and digital games: a systematic review2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA)10.1109/I3DA57090.2023.10289267(1-13)Online publication date: 5-Sep-2023
https://doi.org/10.1109/I3DA57090.2023.10289267
Egeberg MLind SNilsson NSerafin S(2021)Exploring the Effects of Actuator Configuration and Visual Stimuli on Cutaneous Rabbit Illusions in Virtual RealityACM Symposium on Applied Perception 202110.1145/3474451.3476230(1-9)Online publication date: 16-Sep-2021
https://dl.acm.org/doi/10.1145/3474451.3476230
Souza VMaciel ANedel LKopper R(2021)Measuring Presence in Virtual Environments: A SurveyACM Computing Surveys10.1145/346681754:8(1-37)Online publication date: 4-Oct-2021
https://dl.acm.org/doi/10.1145/3466817
Show More Cited By

Index Terms

Using a vibro-tactile display for enhanced collision perception and presence
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess
VRST '96: Proceedings of the ACM Symposium on Virtual Reality Software and Technology

This paper describes an experiment to assess the influence of immersion on performance in immersive virtual environments. The task involved Tri-Dimensional Chess, and required subjects to reproduce on a real chess board the state of board learned from a ...
Read More
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Read More
Enhancing Presence in Head-Mounted Display Environments by Visual Body Feedback Using Head-Mounted Cameras
CW '09: Proceedings of the 2009 International Conference on CyberWorlds

A fully-articulated visual representation of a user in an immersive virtual environment (IVE) can enhance the user's subjective sense of feeling present in the virtual world. Usually this requires the user to wear a full-body motion capture suit to ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '04: Proceedings of the ACM symposium on Virtual reality software and technology

November 2004

226 pages

ISBN:1581139071

DOI:10.1145/1077534

Program Chairs:
Rynson W. H. Lau
City University of Hong Kong, Hong Kong
,
George Baciu
The Hong Kong Polytechnic University, Hong Kong

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

VRST04

Sponsor:

VRST04: The ACM Symposium on Virtual Reality Software and Technology 2004

November 10 - 12, 2004

Hong Kong

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Upcoming Conference

VRST '24

Sponsor:
sigchi
sigchi

30th ACM Symposium on Virtual Reality Software and Technology

October 9 - 11, 2024

Trier , Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
906
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Hedges JSazdov RJohnston A(2023)Measuring the influence of audio on immersive experience in extended reality and digital games: a systematic review2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA)10.1109/I3DA57090.2023.10289267(1-13)Online publication date: 5-Sep-2023
https://doi.org/10.1109/I3DA57090.2023.10289267
Egeberg MLind SNilsson NSerafin S(2021)Exploring the Effects of Actuator Configuration and Visual Stimuli on Cutaneous Rabbit Illusions in Virtual RealityACM Symposium on Applied Perception 202110.1145/3474451.3476230(1-9)Online publication date: 16-Sep-2021
https://dl.acm.org/doi/10.1145/3474451.3476230
Souza VMaciel ANedel LKopper R(2021)Measuring Presence in Virtual Environments: A SurveyACM Computing Surveys10.1145/346681754:8(1-37)Online publication date: 4-Oct-2021
https://dl.acm.org/doi/10.1145/3466817
Cui DMousas C(2021)Evaluating Wearable Tactile Feedback Patterns During a Virtual Reality Fighting Game2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct54149.2021.00075(328-333)Online publication date: Oct-2021
https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00075
Cmentowski SKruger J(2021)Effects of Task Type and Wall Appearance on Collision Behavior in Virtual Environments2021 IEEE Conference on Games (CoG)10.1109/CoG52621.2021.9619039(1-8)Online publication date: 17-Aug-2021
https://doi.org/10.1109/CoG52621.2021.9619039
Moussaïd MSchinazi VKapadia MThrash T(2018)Virtual Sensing and Virtual Reality: How New Technologies Can Boost Research on Crowd DynamicsFrontiers in Robotics and AI10.3389/frobt.2018.000825Online publication date: 13-Jul-2018
https://doi.org/10.3389/frobt.2018.00082
Louison CFerlay FMestre D(2017)Spatialized vibrotactile feedback contributes to goal-directed movements in cluttered virtual environments2017 IEEE Symposium on 3D User Interfaces (3DUI)10.1109/3DUI.2017.7893324(99-102)Online publication date: 2017
https://doi.org/10.1109/3DUI.2017.7893324
Kaul OMeier KRohs M(2017)Increasing Presence in Virtual Reality with a Vibrotactile Grid Around the Head16th IFIP TC 13 International Conference on Human-Computer Interaction --- INTERACT 2017 - Volume 1051610.1007/978-3-319-68059-0_19(289-298)Online publication date: 25-Sep-2017
https://dl.acm.org/doi/10.1007/978-3-319-68059-0_19
Zhenhui Yuan Ghinea GMuntean G(2015)Beyond Multimedia Adaptation: Quality of Experience-Aware Multi-Sensorial Media DeliveryIEEE Transactions on Multimedia10.1109/TMM.2014.237124017:1(104-117)Online publication date: Jan-2015
https://doi.org/10.1109/TMM.2014.2371240
Yoon KKim SHan JHan SPreda M(2015)Introduction to MPEG-V StandardsMPEG-V10.1016/B978-0-12-420140-8.00001-9(1-19)Online publication date: 2015
https://doi.org/10.1016/B978-0-12-420140-8.00001-9
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents