article

Extending "out of the body" tactile phantom sensations to 2D and applying it to mobile interaction

Authors:

Youngsun Kim,

Jaedong Lee,

Gerard J. KimAuthors Info & Claims

Personal and Ubiquitous Computing, Volume 19, Issue 8

Pages 1295 - 1311

https://doi.org/10.1007/s00779-015-0894-4

Published: 01 December 2015 Publication History

Abstract

Funneling and saltation are the two major perceptual illusion techniques for vibro-tactile feedback. They can be used to minimize the number of vibrators on the interaction device in contact with the user body and thereby build a less cumbersome and less expensive feedback device. Recently, these techniques have been found to elicit an "out of the body" experience, i.e., phantom tactile sensations indirectly felt from the handheld object (external to the body). This paper explores the practical applicability of this theoretical result to mobile tactile interaction. Two psychophysical experiments were first conducted to validate the effects of "out of the body" funneling and saltation on an actual handheld smart phone along (1) 1D and (2) when extended, for the first time, to 2D. A third experiment was run to evaluate user experience, applying phantom sensation based on vibro-tactile feedback, using funneling, to a real-world application. Experimental results have confirmed the same "out of the body" 1D illusory effects on an actual mobile device. In addition, a 2D modulated phantom sensation with a resolution of 5 3 on a 3.5-inch display space was achieved through saltation and funneling. Finally, we showed that the phantom sensation does significantly improve the user experience for a real-world application with a small additional cost of a few more vibrators, compared to a conventional single vibrator-based device.

References

[1]

Alles DS (1970) Information transmission by phantom sensations. IEEE Trans Man Mach Syst 11(1):85---91

Google Scholar

[2]

Arduino (2013) http://www.arduino.cc/

Google Scholar

[3]

Barghout A, Kammerl J, Cha J, Steinbach E, El Saddik A (2009) Spatial resolution of vibrotactile perception on the human forearm when exploiting funneling illusion. In: Proceedings of the IEEE international workshop on haptic audio visual environments and games, pp 19---23

Google Scholar

[4]

Bekesy GV (1958) Funneling in the nervous system and its role in loudness and sensation intensity on the skin. J Acoust Soc Am 30(5):399---412

Google Scholar

[5]

Burdea G, Coiffet P (2003) Virtual reality technology, 2nd edn. Wiley, London

Crossref

Google Scholar

[6]

Burke J, Prewett M, Gray A, Yang L, Stilson F, Coovert M, Elliot L, Redden E (2006) Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a mental analysis. In: Proceedings of international conference on multimodal interfaces, pp 108---117

Crossref

Google Scholar

[7]

Cholewiak RW, Collins AA (2000) The generation of vibrotactile patterns on a linear array: influences of body site, time, and presentation mode. Atten Percept Psychophys 62(6):1220---1235

Google Scholar

[8]

Eimer M, Forster B, Vibell J (2005) Cutaneous saltation within and across arms: a new measure of the saltation illusion in somatosensation. Percept Psychophys 67(3):458---468

Google Scholar

[9]

Flach R, Haggard P (2006) The cutaneous rabbit revisited. J Exp Psychol Hum Percept Perform 32(3):717---732

Google Scholar

[10]

Geldard FA, Sherrick CE (1978) The cutaneous rabbit: a perceptual illusion. Science 178(4507):178---179

Google Scholar

[11]

Geshelder G (1997) Psychophysics: the fundamentals. Lawrence Erlbaum Associates, London

Google Scholar

[12]

Gunther E, Davenport G, O'Modhrain S (2002) Cutaneous grooves: composing for the sense of touch. In: Proceedings of the new interfaces for musical expression, pp 57---82

Crossref

Google Scholar

[13]

Hoggan E, Brewster S, Anwer S (2007) Mobile multi-actuator tactile displays. In: Proceedings of the haptic and audio interaction design, pp 22---33

Crossref

Google Scholar

[14]

Israr A, Poupyrev I (2011) Control space of apparent haptic motion. In: IEEE world haptics conference, pp 457---462

Google Scholar

[15]

Lee J, Kim Y, Kim GJ (2011) Funneling and saltation effects for tactile interaction with virtual objects. In: Proceedings of ACM SIGCHI, pp 3141---3148

Crossref

Google Scholar

[16]

Jung J, Choi S (2007) Perceived magnitude and power consumption of vibration feedback in mobile devices. Proc HCI Int 4551:354---363

Crossref

Google Scholar

[17]

Kingdom F, Prins N (2010) Psychophysics: a practical introduction. Elsevier, Amsterdam

Google Scholar

[18]

McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264(5588):746---748

Google Scholar

[19]

Miyazaki M, Hirashima M, Nozaki D (2010) The "cutaneous rabbit" hopping out of the body. J Neurosci 30(5):1856---1860

Google Scholar

[20]

Mizukami Y, Sawada H (2006) Tactile information transmission by apparent movement phenomenon using shape-memory alloy device. Int J Disabil Hum Dev 5(3):277---284

Google Scholar

[21]

Nokia (2013) Bouncing ball on Nokia N900. http://bit.ly/x2-bouncingball

Google Scholar

[22]

Ooka T, Fujita K (2010) Virtual object manipulation system with substitutive display of tangential force and slip by control of vibrotactile phantom sensation. In: Proceedings of IEEE haptics symposium, pp 215---218

Crossref

Google Scholar

[23]

Rahal L, Cha J, Kammerl J, El Saddik A, Steinbach E (2009) Investigating the influence of temporal intensity changes on the apparent movement phenomenon. In: Proceedings of the international conference on virtual environments, human-computer interfaces and measurements systems, pp 310---313

Crossref

Google Scholar

[24]

Raisamo J, Raisamo R, Surakka V (2009) Evaluating the effect of temporal parameters for vibrotactile saltatory patterns. In: Proceedings of the international conference on multimodal interfaces, pp 317---326

Crossref

Google Scholar

[25]

Richter H, Hang A, Blaha B (2011) The PhantomStation: Towards funneling remote tactile feedback on Interactive Surfaces. In: Proceedings of augmented human international conference. Article No. 5

Crossref

Google Scholar

[26]

Seo J, Choi S (2010) Initial study for creating linearly moving vibrotactile sensation on mobile device. In: Proceedings of the IEEE haptics symposium, pp 67---70

Crossref

Google Scholar

[27]

Sherrick CE (1985) A scale for rate of tactual vibration. J Acoust Soc Am 78(1):78---83

Google Scholar

[28]

Sherrick CE, Cholewiak RW, Collins AA (1990) The localization of low and high frequency vibrotactile stimuli. J Acoust Soc Am 88(1):169---179

Google Scholar

[29]

Tan HZ, Pentland A (1997) Tactual displays for wearable computing. In: Proceedings of IEEE international symposium on wearable computing, pp 84---89

Crossref

Google Scholar

[30]

Verrillo RT, Gescheilder GG (1992) Perception via the sense of touch. In: Summers IR (ed) Tactile aids for the hearing impaired, Whurr Publishers Ltd, pp 1---36

Google Scholar

[31]

Wikipedia (2013) Arkanoid. http://en.wikipedia.org/wiki/Arkanoid

Google Scholar

[32]

Yatani K, Truong K (2009) SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices. In: Proceedings of user interface software and technology, pp 111---120

Crossref

Google Scholar

[33]

Yu W, Kuber R, Murphy E, Strain P, McAllister G (2006) A novel multimodal interface for improving visually impaired people's web accessibility. Int Virtual Real 9:133---148

Crossref

Google Scholar

Cited By

View all

Kurzweg MWeiss YErnst MSchmidt AWolf K(2024)Survey on Haptic Feedback through Sensory Illusions in Interactive SystemsACM Computing Surveys10.1145/364835356:8(1-39)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1145/3648353
Chen QSpapé MJacucci G(2024)Understanding Phantom Tactile Sensation on Commercially Available Social Virtual Reality PlatformsProceedings of the ACM on Human-Computer Interaction10.1145/36374188:CSCW1(1-22)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637418
Luo HWang ZWang ZZhang YWang D(2023)Perceptual Localization Performance of the Whole Hand Vibrotactile Funneling IllusionIEEE Transactions on Haptics10.1109/TOH.2023.326643216:2(240-250)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TOH.2023.3266432
Show More Cited By

Index Terms

Extending "out of the body" tactile phantom sensations to 2D and applying it to mobile interaction
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Virtual worlds software

Recommendations

Body-Penetrating Tactile Phantom Sensations
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

In tactile interaction, a phantom sensation refers to an illusion felt on the skin between two distant points at which vibrations are applied. It can improve the perceptual spatial resolution of tactile stimulation with a few tactors. All phantom ...
Tactile Information Transmission by 2D Stationary Phantom Sensations
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

A phantom sensation refers to an illusory tactile sensation perceived midway between multiple distant stimulations on the skin. Phantom sensations have been used intensively in tactile interfaces owing to their simplicity and effectiveness. Despite that,...
Funneling and saltation effects for tactile interaction with virtual objects
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Funneling and saltation are two major illusory feedback techniques for vibration-based tactile feedback. They are often put into practice e.g. to reduce the number of vibrators to be worn on the body and thereby build a less cumbersome feedback device. ...

Reviews

Reviewer: Brad D. Reid

The quest for an all-senses virtual reality is not only of abstract research interest, but has numerous marketplace applications. Researchers have known for decades that the brain map of sensation does not necessarily correspond to physical reality. The authors report on their studies of how vibrators in contact with the skin might be used to generate the desired sensation. Individuals interested in full sensory interfaces will want to read the paper. The researchers focus on the well-known phenomena of funneling and saltation. Funneling occurs when one experiences a number of touches as a single touch to the center of the area. Saltation refers to a sensation of moving touches produced by rapidly tapping two sections of the skin. The so-called cutaneous rabbit illusion has been the subject of much research. The current researchers note that phantom out-of-body sensations, seemingly occurring in empty space, may be generated in some circumstances. The paper's introduction reviews this research with appropriate illustrations. The current researchers' experimental design and devices, utilized with five male and five female paid subjects, are discussed in detail. The researchers state: "The main purpose of our work was to validate whether there was no significant perceptual difference between saltation and funneling-driven phantom sensations and actual sensations." The researchers conclude that their experiments demonstrate that one may upgrade the tactile experience with no more than four vibrators in a handheld device. As they note, this is cost-effective. However, they plan for additional research and testing. With ample illustrations, graphs of responses, and a detailed list of references, the researchers have produced an important and readable report. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image Personal and Ubiquitous Computing

Personal and Ubiquitous Computing Volume 19, Issue 8

December 2015

78 pages

ISSN:1617-4909

Issue’s Table of Contents

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 December 2015

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
90
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kurzweg MWeiss YErnst MSchmidt AWolf K(2024)Survey on Haptic Feedback through Sensory Illusions in Interactive SystemsACM Computing Surveys10.1145/364835356:8(1-39)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1145/3648353
Chen QSpapé MJacucci G(2024)Understanding Phantom Tactile Sensation on Commercially Available Social Virtual Reality PlatformsProceedings of the ACM on Human-Computer Interaction10.1145/36374188:CSCW1(1-22)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637418
Luo HWang ZWang ZZhang YWang D(2023)Perceptual Localization Performance of the Whole Hand Vibrotactile Funneling IllusionIEEE Transactions on Haptics10.1109/TOH.2023.326643216:2(240-250)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TOH.2023.3266432
Kurzweg MLinke SWeiss YLetter MSchmidt AWolf K(2023)Assignment of a Vibration to a Graphical Object Induced by Resonant FrequencyHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_33(523-545)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-42280-5_33
Lee JLee HEizad AYoon J(2022)A Pilot Study on Perception of Direction Cues Delivered Using A Portable Electro-Tactile Biofeedback Device2022 9th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob)10.1109/BioRob52689.2022.9925502(01-05)Online publication date: 21-Aug-2022
https://dl.acm.org/doi/10.1109/BioRob52689.2022.9925502
Kaul ORohs MSimon BDemir KFerry KBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Vibrotactile Funneling Illusion and Localization Performance on the HeadProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376335(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376335
Pantera LHudin CPanëels S(2020)Two-Point Haptic Pattern Recognition with the Inverse Filter MethodHaptics: Science, Technology, Applications10.1007/978-3-030-58147-3_60(545-553)Online publication date: 6-Sep-2020
https://dl.acm.org/doi/10.1007/978-3-030-58147-3_60
Patel PRay RManivannan M(2019)Power Law Based “Out of Body” Tactile Funneling for Mobile HapticsIEEE Transactions on Haptics10.1109/TOH.2019.293382212:3(307-318)Online publication date: 16-Sep-2019
https://dl.acm.org/doi/10.1109/TOH.2019.2933822
Israr AZhao SSchwemler ZFritz A(2019)Stereohaptics Toolkit for Dynamic Tactile ExperiencesHCI International 2019 – Late Breaking Papers10.1007/978-3-030-30033-3_17(217-232)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1007/978-3-030-30033-3_17
Park GChoi SMandryk RHancock MPerry MCox A(2018)Tactile Information Transmission by 2D Stationary Phantom SensationsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173832(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173832

Abstract

References

Cited By

Index Terms

Recommendations

Body-Penetrating Tactile Phantom Sensations

Tactile Information Transmission by 2D Stationary Phantom Sensations

Funneling and saltation effects for tactile interaction with virtual objects

Reviews

Access critical reviews of Computing literature here

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Share

Share this Publication link

Share on social media

Affiliations