research-article

HapThimble: A Wearable Haptic Device towards Usable Virtual Touch Screen

Authors:

Woohun LeeAuthors Info & Claims

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Pages 3694 - 3705

https://doi.org/10.1145/2858036.2858196

Published: 07 May 2016 Publication History

Abstract

A virtual touch screen concept using an optical see-through head-mounted display has been suggested. With a virtual touch screen, the user's direct-touch interactions are allowed in much the same way as a conventional touch screen, but the absence of haptic feedback and physical constraint leads to poor user performance. To overcome this issue, we developed a wearable haptic device, called HapThimble. It provides various types of haptic feedback (tactile, pseudo-force, and vibrotactile) to the user's fingertip and mimics physical buttons based on force-penetration depth curves. We conducted three experiments with HapThimble. The first experiment confirmed that HapThimble could increase a users' performance when conducting clicking and dragging tasks. The second experiment revealed that users could differentiate between six types of haptic feedback, rendered based on different force-penetration depth curves obtained using HapThimble. Last, we conducted a test to investigate the similarity between the physical buttons and the mimicked haptic buttons and obtained a 90.3% success rate.

Supplementary Material

suppl.mov (pn0910-file3.mp4)

Supplemental video

Download
73.49 MB

References

[1]

Jake Abbott, Marayong Panadda, and Okanura Allison. 2007. Haptic Virtual Fixtures for Robot-Assisted Manipulation. Robotics Research: 49--64. http://doi.org/10.1007/978--3--540--48113--3_5

[2]

T. Amemiya and H. Gomi. 2014. Distinct pseudoattraction force sensation by a thumb-sized vibrator that oscillates asymmetrically. In Haptics: Neuroscience, Devices, Modeling, and Applications. Springer Berlin Heidelberg, 88--95. http://doi.org/10.1007/978--3--66244196--1

[3]

Takafumi Aoki, Hironori Mitake, Danial Keoki, Shoichi Hasegawa, and Makoto Sato. 2009. Wearable haptic device to present contact sensation based on cutaneous sensation using thin wire. In Proc. of the International Conference on Advances in Computer Entertainment Technology, 115--122. http://doi.org/10.1145/1690388.1690408

Digital Library

[4]

Wouter M. Bergmann Tiest and Astrid M L Kappers. 2009. Cues for haptic perception of compliance. IEEE Transactions on Haptics 2, 4: 189--199. http://doi.org/10.1109/TOH.2009.16

Digital Library

[5]

Conrad Bullion and Hakan Gurocak. 2010. Haptic Glove with MR Brakes for Distributed Finger Force. Presence 18, 6: 421--433. http://doi.org/10.1162/pres.18.6.421

Digital Library

[6]

William A S Buxton. 1990. A three-state model of graphical input. Human-computer interaction-INTERACT 90: 449--456.

Digital Library

[7]

Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: Multi-Point Mid-Air Hpatic Feedback for Touch Surfaces. In Proc. of the 26th annual ACM symposium on User interface software and technology, ACM Press, 505--514. http://doi.org/10.1145/2501988.2502018

Digital Library

[8]

Li-Wei Chan, Hui-Shan Kao, Mike Y Chen, Ming-Sui Lee, Jane Hsu, and Yi-ping Hung. 2010. Touching the Void : Direct-Touch Interaction for Intangible Displays. In Proc. of the 28th international conference on Human factors in computing systems, 2625--2634. http://doi.org/10.1145/1753326.1753725

Digital Library

[9]

David Drascic and Paul Milgram. 1996. Perceptual Issues in Augmented Reality. In Proc. of SPIE 2653, Stereoscopic Displays and Virtual Reality Systems III, 123--134. http://doi.org/10.1117/12.237425

[10]

Paulo Gallotti, Alberto Raposo, and Luciano Soares. 2011. V-glove: A 3D virtual touch interface. In Proc. of 13th Symposium on Virtual Reality, SVR 2011, 242--251. http://doi.org/10.1109/SVR.2011.21

Digital Library

[11]

Sidhant Gupta, Dan Morris, Shwetak N. Patel, and Desney Tan. 2013. AirWave: non-contact haptic feedback using air vortex rings. In Proc. of the 2013 ACM international joint conference on Pervasive and ubiquitous computing, 419--428. http://doi.org/10.1145/2493432.2493463

Digital Library

[12]

H.G. Hoffman. 1998. Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. In Proc. of IEEE 1998 Virtual Reality Annual International Symposium, 59--63. http://doi.org/10.1109/VRAIS.1998.658423

Digital Library

[13]

Samantha Horvath, John Galeotti, Bing Wu, Roberta Klatzky, Mel Siegel, and George Stetten. 2014. FingerSight: Fingertip Haptic Sensing of the Visual Environment. IEEE Journal of Translational Engineering in Health and Medicine, February: 1--9. http://doi.org/10.1109/JTEHM.2014.2309343

[14]

Takayuki Hoshi, Masafumi Takahashi, Takayuki Iwamoto, and Hiroyuki Shinoda. 2010. Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound. IEEE Transactions on Haptics 3, 3: 155--165. http://doi.org/10.1109/TOH.2010.4

Digital Library

[15]

Go Inaba and Kinya Fujita. 2006. A pseudo-forcefeedback device by fingertip tightening for multi-finger object manipulation. In Proc. of EuroHaptics, 475--478. Retrieved from http://reality.ei.tuat.ac.jp/papers/EH06.pdf

[16]

Exos Inc. 1991. Product Literature on Dexterous Hand Master and Grip Master.

[17]

Seki Inoue, Yasutoshi Makino, and Hiroyuki Shinoda. 2015. Active touch perception produced by airborne ultrasonic haptic hologram. 2015 IEEE World Haptics Conference (WHC), IEEE, 362--367. http://doi.org/10.1109/WHC.2015.7177739

[18]

Johan Kildal. 2010. 3D-press: Haptic Illusion of Compliance when Pressing on a Rigid Surface. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI '10), 8. http://doi.org/10.1145/1891903.1891931

Digital Library

[19]

Sunjun Kim and Geehyuk Lee. 2013. Haptic Feedback Design for a Virtual Button Along Force-Displacement Curves. In Proc. of UIST '13, 91--96. http://doi.org/10.1145/2501988.2502041

Digital Library

[20]

Eunjin Koh, Jongho Won, and Changseok Bae. 2008. Vision-based virtual touch screen interface. Digest of Technical Papers IEEE International Conference on Consumer Electronics: 4--5. http://doi.org/10.1109/ICCE.2008.4587900

[21]

R. Komerska and C. Ware. 2003. Haptic task constraints for 3D interaction. In Proc. of 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003, 270--277. http://doi.org/10.1109/HAPTIC.2003.1191295

Digital Library

[22]

Katherine J. Kuchenbecker, Jonathan Fiene, and Günter Niemeyer. 2006. Improving contact realism through event-based haptic feedback. IEEE Transactions on Visualization and Computer Graphics, 219--229. http://doi.org/10.1109/TVCG.2006.32

Digital Library

[23]

Jinha Lee, Alex Olwal, Hiroshi Ishii, Microsoft Way, and Redmond Wa. 2013. SpaceTop : Integrating 2D and Spatial 3D Interactions in a See-through Desktop Environment. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, 189--192. http://dx.doi.org/10.1145/2470654.2470680

Digital Library

[24]

Rw Lindeman, Jl Sibert, and Jk Hahn. 1999. Towards usable VR: an empirical study of user interfaces for immersive virtual environments. In Proc. of the SIGCHI conference on Human Factors in Computing Systems, 64--71. http://doi.org/10.1145/302979.302995

Digital Library

[25]

Pedro Lopes and Patrick Baudisch. 2013. Musclepropelled force feedback. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, 2577--2580. http://doi.org/10.1145/2470654.2481355

Digital Library

[26]

Kouta Minamizawa and S Fukamachi. 2007. Gravity grabber: wearable haptic display to present virtual mass sensation. ACM SIGGRAPH 2007 emerging technologies, 8. http://doi.org/10.1145/1278280.1278289

Digital Library

[27]

Georgios Nikolakis and Dimitrios Tzovaras. 2004. CyberGrasp and PHANTOM Integration: Enhanced Haptic Access for Visually Impaired Users. In Proc. of Conference Speech and Computer, 507--513. Retrieved from http://www.iscaspeech.org/archive_open/specom_04/spc4_507.html

[28]

Domenico Prattichizzo, Claudio Pacchierotti, Stefano Cenci, Kouta Minamizawa, and Giulio Rosati. 2010. Using a fingertip tactile device to substitute kinesthetic feedback in haptic interaction. In Haptics: Generating and Perceiving Tangible Sensations. 125--130. http://doi.org/10.1007/978--3--642--14064--8_19

Digital Library

[29]

Jun Rekimoto. 2013. Traxion: a tactile interaction device with virtual force sensation. In Proc. of 26th annual ACM symposium on User Interface Software and Technology, 427--431. http://doi.org/10.1145/2501988.2502044

Digital Library

[30]

K Salisbury, D Brock, T Massie, and N Swarup. 1995. Haptic rendering: Programming touch interaction with virtual objects. In Proc. of the 1995 symposium on Interactive 3D graphics, 123--130. http://doi.org/10.1145/199404.199426

Digital Library

[31]

Antti Sand, Ismo Rakkolainen, Poika Isokoski, Jari Kangas, Roope Raisamo, and Karri Palovuori. 2015. Head-mounted display with mid-air tactile feedback. In Proc. of the 21st ACM Symposium on Virtual Reality Software and Technology - VRST '15, ACM Press, 51--58. http://doi.org/10.1145/2821592.2821593

Digital Library

[32]

I. Sarakoglou, N. Tsagarakis, and D.G. Caldwell. 2005. A portable fingertip tactile feedback array - transmission system reliability and modelling. First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference: 2--3. http://doi.org/10.1109/WHC.2005.17

Digital Library

[33]

Robert Scheibe, Mathias Moehring, and Bernd Froehlich. 2007. Tactile feedback at the finger tips for improved direct interaction in immersive environments. In Proc. of IEEE Symposium on 3D User Interfaces 2007 Proceedings, 3DUI 2007, 123--130. http://doi.org/10.1109/3DUI.2007.340784

[34]

Rajinder Sodhi, Ivan Poupyrev, Matthew Glisson, and Ali Israr. 2013. AIREAL: interactive tactile experiences in free air. ACM Transactions on Graphics 32, 4: 134. http://doi.org/10.1145/2461912.2462007

Digital Library

[35]

M. A. Srinivasan and R. H. LaMotte. 1995. Tactual discrimination of softness. J Neurophysiol 73, 1: 88--101. Retrieved September 24, 2015 from http://jn.physiology.org/content/73/1/88

[36]

M. Tosas and B. Li. 2004. Virtual Touch Screen for Mixed Reality. In Computer Vision in Human-Computer Interaction. 48--59. http://doi.org/10.1007/978--3--54024837--8_6

[37]

Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proc. of the SIGCHI conference on Human factors in computing, 543--552. http://doi.org/10.1145/1978942.1979018

Digital Library

[38]

Yanqing Wang and Christine L. MacKenzie. 2000. The role of contextual haptic and visual constraints on object manipulation in virtual environments. In Proc. of the SIGCHI conference on Human factors in computing systems - CHI '00, 532--539. http://doi.org/10.1145/332040.332494

Digital Library

[39]

Jun Wu, Dangxiao Wang, and Yuru Zhang. 2009. Virtual fixture based haptic rendering of handwriting. 2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurements Systems, VECIMS 2009 - Proceedings, 16--21. http://doi.org/10.1109/VECIMS.2009.5068858

Digital Library

[40]

Thomas G Zimmerman, Jaron Lanier, Chuck Blanchard, Steve Bryson, and Young Harvill. 1986. A hand gesture interface device. ACM SIGCHI Bulletin 18, 4: 189--192. http://doi.org/10.1145/30851.275628

Digital Library

Cited By

Ma YXie TZhang PKim HJe S(2024)AirPush: A Pneumatic Wearable Haptic Device Providing Multi-Dimensional Force Feedback on a FingertipProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642536(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642536
Tanaka YSerfaty JLopes P(2024)Haptic Source-Effector: Full-Body Haptics via Non-Invasive Brain StimulationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642483(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642483
Mazursky ASerfaty JLopes P(2024)Stick&Slip: Altering Fingerpad Friction via Liquid CoatingsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642299(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642299
Show More Cited By

Index Terms

HapThimble: A Wearable Haptic Device towards Usable Virtual Touch Screen
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality
UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Ungrounded haptic devices for virtual reality (VR) applications lack the ability to convincingly render the sensations of a grasped virtual object's rigidity and weight. We present Grabity, a wearable haptic device designed to simulate kinesthetic pad ...
HapCube: A Wearable Tactile Device to Provide Tangential and Normal Pseudo-Force Feedback on a Fingertip
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Haptic devices allow a more immersive experience with Virtual and Augmented Reality. However, for a wider range of usage they need to be miniaturized while maintaining the quality of haptic feedback. In this study, we used two kinds of human sensory ...
DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

We introduce DextrES, a flexible and wearable haptic glove which integrates both kinesthetic and cutaneous feedback in a thin and light form factor (weight is less than 8g). Our approach is based on an electrostatic clutch generating up to 20 N of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

May 2016

6108 pages

ISBN:9781450333627

DOI:10.1145/2858036

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Institute for Information & communications Technology Promot

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI '16 Paper Acceptance Rate 565 of 2,435 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
1,474
Total Downloads

Downloads (Last 12 months)183
Downloads (Last 6 weeks)23

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ma YXie TZhang PKim HJe S(2024)AirPush: A Pneumatic Wearable Haptic Device Providing Multi-Dimensional Force Feedback on a FingertipProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642536(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642536
Tanaka YSerfaty JLopes P(2024)Haptic Source-Effector: Full-Body Haptics via Non-Invasive Brain StimulationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642483(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642483
Mazursky ASerfaty JLopes P(2024)Stick&Slip: Altering Fingerpad Friction via Liquid CoatingsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642299(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642299
Teng SGupta ALopes P(2024)Haptic Permeability: Adding Holes to Tactile Devices Improves DexterityProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642156(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642156
Jingu ASabnis NStrohmeier PSteimle J(2024)Shaping Compliance: Inducing Haptic Illusion of Compliance in Different Shapes with Electrotactile GrainsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641907(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641907
Teng SLopes P(2024)Experience Haptics Seamlessly Across Virtual and Real Worlds2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00109(573-577)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00109
Mazursky ABrooks JDesta BLopes P(2024)ThermalGrasp: Enabling Thermal Feedback even while Grasping and Walking2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00056(342-353)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00056
Li BSharpe AGerling G(2024)A transparent hydraulic actuator to visualize finger pad deformation at programmable material compliances2024 IEEE Haptics Symposium (HAPTICS)10.1109/HAPTICS59260.2024.10520859(61-66)Online publication date: 7-Apr-2024
https://doi.org/10.1109/HAPTICS59260.2024.10520859
Kim HHyun K(2023)HAPmini: 2D haptic feedback generation using single actuator devicePLOS ONE10.1371/journal.pone.028500218:4(e0285002)Online publication date: 26-Apr-2023
https://doi.org/10.1371/journal.pone.0285002
Li BLee JGerling G(2023)Perceptibility of programmable softness displays using magnetorheological elastomersProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/2169506723119368567:1(1518-1524)Online publication date: 20-Oct-2023
https://doi.org/10.1177/21695067231193685
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents