research-article

Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality

Authors:

Ping-Hsuan Han,

Yang-Sheng Chen,

Kong-Chang Lee,

Hao-Cheng Wang,

Chiao-En Hsieh,

Jui-Chun Hsiao,

Chien-Hsing Chou,

Yi-Ping HungAuthors Info & Claims

VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

Article No.: 35, Pages 1 - 10

https://doi.org/10.1145/3281505.3281507

Published: 28 November 2018 Publication History

Abstract

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. This system consists of a steerable haptic device rigged on the top of the user head and a handheld device also with haptics feedbacks to simultaneously provide tactile sensations to the users in a 2m x 2m space. The steerable haptic device can enhance the immersive environment for providing full body experience, such as heat in the desert or cold in the snow mountain. Additionally, the handheld device can enhance the immersive interaction for providing partial body experience, such as heating the iron or quenching the hot iron. With our system, the users can perceive visual, auditory and haptic when they are moving around in virtual space and interacting with virtual object. In our study, the result has shown the potential of the hybrid-haptic feedback system, which the participants rated the enjoyment, realism, quality, immersion higher than the other.

Supplementary Material

MP4 File (a35-han.mp4)

Download
14.01 MB

References

[1]

Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper and Patrick Baudisch (2015). TurkDeck: Physical virtual reality based on people. In ACM UIST, 417--426.

Digital Library

[2]

Ali Israr, Siyan Zhao, Kyna McInosh, Jaekyun Kang, Zachary Schwemler, Eric Brockmeyer, Mark Baskinger and Moshe Mahler (2015). Po2: augmented haptics for interactive gameplay. In ACM SIGGRAPH 2015 Emerging Technologies, 21.

Digital Library

[3]

Roshan Lalintha Peiris, Wei Peng, Zikun Chen, Liwei Chan and Kouta Minamizawa. (2017). Thermovr: Exploring integrated thermal haptic feedback with head mounted displays. In ACM SIGCHI, 5452--5456.

Digital Library

[4]

Anatole Lécuyer (2009). Simulating haptic feedback using vision: A survey of research and applications of pseudo-haptic feedback. Presence: Teleoperators and Virtual Environments, 18(1), 39--53.

Digital Library

[5]

Hrvoje Benko, Christian Holz, Mike Sinclair and Eyal Ofek (2016). Normaltouch and texturetouch: High-fidelity 3d haptic shape rendering on handheld virtual reality controllers. In ACM UIST, 717--728.

Digital Library

[6]

Sylvain Cardin, Daniel Thalmann and Frederic Vexo (2007). Head mounted wind. In CASA, No. VRLAB-CONF-2007-136, 101--108.

[7]

Yuichiro Kojima, Yuki Hashimoto and Hiroyuki Kajimoto (2009). A novel wearable device to present localized sensation of wind. In Proceedings of the International Conference on Advances in Computer Enterntainment Technology, 61--65.

Digital Library

[8]

Nimesha Ranasinghe, Pravar Jain, Shienny Karwita, David Tolley and Ellen Yi-Luen Do (2017). Ambiotherm: enhancing sense of presence in virtual reality by simulating real-world environmental conditions. In ACM SIGCHI, 1731--1742.

Digital Library

[9]

Nimesha Ranasinghe, Pravar Jain, Nguyen Thi Ngoc Tram, Koon Chuan Raymond Koh, David Tolley, Shienny Karwita, Lin Lien-Ya, Yan Liangkun, Kala Shamaiah, Chow Eason Wai Tung, Ching Chiuan Yen and Ellen Yi-Luen Do (2018). Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience. In ACM SIGCHI 577.

Digital Library

[10]

Dhruv Jain, Misha Sra, Jingru Guo, Rodrigo Marques, Raymond Wu, Justin Chiu and Chris Schmandt (2016). Immersive Scuba Diving Simulator Using Virtual Reality. In UIST, 729--739.

Digital Library

[11]

Taeyong Moon and Gerard J. KIM (2004). Design and evaluation of a wind display for virtual reality. In VRST, 122--128.

Digital Library

[12]

L. Deligiannidis and R.J.K. Jacob (2006). The vr scooter: Wind and tactile feedback improve user performance. In IEEE 3DUI, 143--150.

Digital Library

[13]

Max Rheiner (2014). Birdly an attempt to fly. In ACM SIGGRAPH Emerging Technologies, 3.

Digital Library

[14]

Ping-Hsuan Han, Da-Yuan Huang, Hsin-Ruey Tsai, Po-Chang Chen, Chen-Hsin Hsieh, Kuan-Ying Lu, De-Nian Yang and Yi-Ping Hung (2015). Moving around in virtual space with spider silk. In ACM SIGGRAPH Emerging Technologies, 19.

Digital Library

[15]

Felix Hülsmann, Julia Fröhlich, Nikita Mattar and Ipke Wachsmuth (2014). Wind and warmth in virtual reality: implementation and evaluation. In VRIC 24.

[16]

Ping-Hsuan Han, Chiao-En Hsieh, Yang-Sheng Chen, Jui-Chun Hsiao, Kong-Chang Lee, Sheng-Fu Ko, Kuan-Wen Chen, Chien-Hsing Chou and Yi-Ping Hung. (2017). AoEs: enhancing teleportation experience in immersive environment with mid-air haptics. In ACM SIGGRAPH Emerging Technologies, 3.

Digital Library

[17]

Adalberto L. Simeone, Eduardo Velloso and Hans Gellersen (2015). Substitutional reality: Using the physical environment to design virtual reality experiences. In ACM SIGCHI, 3307--3316.

Digital Library

[18]

Masashi Konyo, Satoshi Tadokoro, Akinori Yoshida and Naoki Saiwaki (2005). A tactile synthesis method using multiple frequency vibrations for representing virtual touch. In IEEE IROS 2005, 3965--3971.

[19]

Takaki murakami, Tanner Person, Charith Lasantha Fernando and Kouta Minamizawa (2017). Altered touch: miniature haptic display with force, thermal and tactile feedback for augmented haptics. In ACM SIGGRAPH Posters, 53.

Digital Library

[20]

Pedro Lopes, Alexandra Ion and Patrick Baudisch. (2015). Impacto: Simulating physical impact by combining tactile stimulation with electrical muscle stimulation. In UIST, 11--19.

Digital Library

[21]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki and Patrick Baudisch (2017). Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In ACM SIGCHI, 1471--1482.

Digital Library

[22]

Yukari Konishi, Nobuhisa Hanamitsu, Benjamin Outram, Kouta Minamizawa and Tetsuya Mizuquchi and Ayahiko Sato (2016). Synesthesia suit: the full body immersive experience. In ACM SIGGRAPH VR Village, 20.

Digital Library

[23]

Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek and Andrew D. Wilson (2016). Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences. In ACM SIGCHI, 1968--1979.

Digital Library

[24]

Lung-Pan Cheng, Sebastian Marwecki and Patrick Baudisch. (2017). Mutual Human Actuation. In UIST, 797--805.

Digital Library

[25]

Eisuke Fujinawa, Shigeo Yoshida, Yuki Koyama, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose (2017). Computational design of hand-held VR controllers using haptic shape illusion. In UIST, 28.

[26]

Ping-Hsuan Han, Yang-Sheng Chen, Chiao-En Hsieh, Yu-Jie Huang, Hung-Chih Lin, Peng-Wen Tong, Kuan-Yin Lu and Yi-Ping Hung (2016). OoEs: playing in the immersive game with augmented haptics. In ACM SIGGRAPH VR Village, 15.

Digital Library

[27]

Ping-Hsuan Han, Yang-Sheng Chen, Kai-Ti Yang, Wei-Shu Chuan, Yu-Tong Chang, Tin-Ming Yang, Jia-Yan Lin, Kong-Chang Lee, Chien-Hsing Chou and Yi-Ping Hung (2017). BoEs: attachable haptics bits on gaming controller for designing interactive gameplay. In SIGGRAPH Asia VR Showcase, 3.

Digital Library

[28]

Yang-Sheng Chen, Ping-Hsuan Han, Jui-Chun Hsiao, Kong-Chang Lee, Chiao-En Hsieh, Kuan-Yin Lu and Yi-Ping Hung (2016). SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction. In UIST, 71--72.

Digital Library

[29]

Unity. The Blacksmith. http://unity3d.com/cn/pages/the-blacksmith.

[30]

Natan Linder and Pattie Maes (2010). LuminAR: portable robotic augmented reality interface design and prototype. In UIST, 395--396.

Digital Library

[31]

Alexis Zerroug, Alvaro Cassinelli and Masatoshi Ishikawa (2011). Invoked computing: Spatial audio and video AR invoked through miming. In VRIC, 31--32.

[32]

Andrew Wilson, Hrvoje Benko, Shahram Izadi and Otmar Hilliges (2012). Steerable augmented reality with the beamatron. In UIST, 413--422.

Digital Library

[33]

Rajinder Sodhi, Matthew Glisson and Ivan Poupyrev (2013). AIRREAL: tactile interactive experiences in free air. In UIST, 25--26.

Digital Library

[34]

Barry G. Green (1977). Localization of thermal sensation: An illusion and synthetic heat. Perception & Psychophysics, 22, 4: 331--337.

[35]

Davide Fillingeri and George Havenith (2015). Human skin wetness perception: psychophysical and neurophysiological bases. Temperature, 2(1), 86--104.

[36]

Oliver Schneider, Karon MacLean, Colin Swindells, and Kellogg Booth (2017). Haptic experience design: What hapticians do and where they need help. International Journal of Human-Computer Studies.

Digital Library

Cited By

Borah NMungi PSneha RSachdeva PBorah P(2025)Exploring the Impact of Foot-Based Haptic Feedback on User Experience in Virtual Reality NavigationHuman-Computer Interaction. Design and Research10.1007/978-3-031-80829-6_7(146-160)Online publication date: 14-Feb-2025
https://doi.org/10.1007/978-3-031-80829-6_7
Spence CGao Y(2024)Augmenting home entertainment with digitally delivered touchi-Perception10.1177/2041669524128147415:5Online publication date: 17-Oct-2024
https://doi.org/10.1177/20416695241281474
Hoffmann PWehbe RMühlhäuser MBarrera Machuca M(2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656191
Show More Cited By

Index Terms

Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Perception
    2. Shape modeling
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present Haptic Revolver, a handheld virtual reality controller that renders fingertip haptics when interacting with virtual surfaces. Haptic Revolver's core haptic element is an actuated wheel that raises and lowers underneath the finger to render ...
Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Manipulating a virtual object with appropriate passive haptic cues provides a satisfying sense of presence in virtual reality. However, scaling such experiences to support multiple virtual objects is a challenge as each one needs to be accompanied with ...
BoEs: attachable haptics bits on gaming controller for designing interactive gameplay
SA '17: SIGGRAPH Asia 2017 VR Showcase

Gaming controller is a general way for playing in the immersive virtual reality (VR) game. With haptics technology and head-mounted display (HMD), user can have an enhanced immersive experience when they manipulate in the virtual environment. Currently, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

November 2018

570 pages

ISBN:9781450360869

DOI:10.1145/3281505

Editor:
Stephen N. Spencer
University of Washington
,
General Chair:
Shigeo Morishima
Waseda University
,
Program Chairs:
Yuichi Itoh
Osaka University
,
Takaaki Shiratori
Facebook Reality Labs
,
Yonghao Yue
The University of Tokyo
,
Rob Lindeman
University of Canterbury

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRST '18

Sponsor:

VRST '18: 24th ACM Symposium on Virtual Reality Software and Technology

November 28 - December 1, 2018

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
1,625
Total Downloads

Downloads (Last 12 months)304
Downloads (Last 6 weeks)30

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Borah NMungi PSneha RSachdeva PBorah P(2025)Exploring the Impact of Foot-Based Haptic Feedback on User Experience in Virtual Reality NavigationHuman-Computer Interaction. Design and Research10.1007/978-3-031-80829-6_7(146-160)Online publication date: 14-Feb-2025
https://doi.org/10.1007/978-3-031-80829-6_7
Spence CGao Y(2024)Augmenting home entertainment with digitally delivered touchi-Perception10.1177/2041669524128147415:5Online publication date: 17-Oct-2024
https://doi.org/10.1177/20416695241281474
Hoffmann PWehbe RMühlhäuser MBarrera Machuca M(2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656191
Günther SSkogseide ABuhlmann RMühlhäuser M(2024)Assessing the Influence of Visual Cues in Virtual Reality on the Spatial Perception of Physical Thermal StimuliProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642154(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642154
Min XSun SQi Y(2024)XR CUBE: Multi-Sensory Intelligent Interaction Device for Extended Reality ApplicationIEEE Access10.1109/ACCESS.2024.340117612(78058-78073)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3401176
Tyree ABhatia AHong MHanna JKasper KGood BPerez DGovalla DHunt ASathishkumaraselvam VHoffman JRozenblit JGutruf P(2024)Biosymbiotic Haptic Feedback - Sustained Long Term Human Machine InterfacesBiosensors and Bioelectronics10.1016/j.bios.2024.116432(116432)Online publication date: Jun-2024
https://doi.org/10.1016/j.bios.2024.116432
Kuhail MBerengueres JTaher FAl Kuwaiti MKuhail MBerengueres JTaher FAl Kuwaiti M(2024)Exploring Haptic Technology’s Role in Gaming and EntertainmentAdvances, Applications and the Future of Haptic Technology10.1007/978-3-031-70588-5_3(29-42)Online publication date: 17-Oct-2024
https://doi.org/10.1007/978-3-031-70588-5_3
Moesgen THo HXiao Y(2024)Apparent Thermal Motion on the ForearmHaptics: Understanding Touch; Technology and Systems; Applications and Interaction10.1007/978-3-031-70058-3_5(56-68)Online publication date: 30-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-70058-3_5
Wang ZGuo MFang YNie KWang HShi XLi YGao Z(2024)Wings of Imagination: Strengthening Avian Embodiment and Flight Immersion in Virtual Reality Through Multisensory Haptic FeedbackDistributed, Ambient and Pervasive Interactions10.1007/978-3-031-60012-8_26(411-432)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60012-8_26
Wang YChen Y(2023)Non-Contact Thermal Haptics for VRAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3610724(386-390)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594739.3610724
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten