research-article

ImpAct: Immersive haptic stylus to enable direct touch and manipulation for surface computing

Authors:

Anusha Withana,

Yasutoshi Makino,

Masahiko InamiAuthors Info & Claims

Computers in Entertainment (CIE), Volume 8, Issue 2

Article No.: 9, Pages 1 - 16

https://doi.org/10.1145/1899687.1899691

Published: 30 December 2010 Publication History

Abstract

This article explores direct touch and manipulation techniques for surface computing environments using a specialized haptic force feedback stylus, called ImpAct, which can dynamically change its effective length and equipped with sensors to calculate its orientation in world coordinates. When a user pushes it against a touch screen, the physical stylus shrinks and a rendered projection of the stylus is drawn inside the screen, giving the illusion that it is submerged in the display device. Once the users can see the stylus immersed in the digital world below the screen, he or she can manipulate and interact with the virtual objects with active haptic sensations. In this article, ImpAct's functionality, design, and prototype applications are described in detail with relevance to the concept of direct touch, giving special attention to novel interaction scenarios and design challenges. Furthermore, a technical evaluation was done to study ImpAct's accuracy and controlability and the results presented. This article concludes by discussing ImpAct's current limitations and future perspectives as a direct touch and manipulation tool.

References

[1]

Ando, H., Miki, T., Inami, M., and Maeda. T. 2002. The nail-mounted tactile display for the behavior modeling. In Proceedings of the ACM SIGGRAPH 2002 Conference. Abstracts and Applications (SIGGRAPH'02), ACM, New York, 264--264.

Digital Library

[2]

Bi, X., Moscovich, T., Ramos, G., Balakrishnan, R., and Hinckley, K. 2008. An exploration of pen rolling for pen-based interaction. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST'08), ACM, New York, 191--200.

Digital Library

[3]

Driver, J. and Spence, C. 1998. Attention and the crossmodal construction of space. Trends Cognitive Sci. 2, 7, 254--262.

[4]

Fitzmaurice, G. W., Ishii, H., and Buxton, W. A. S. 1995. Bricks: Laying the foundations for graspable user interfaces. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '95), ACM, New York, 442--449.

Digital Library

[5]

Gray, R. and Tan, H. Z. 2002. Dynamic and predictive links between touch and vision. Experimental Brain Res. 145, 1, 50--55.

[6]

Han, J. Y. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST'05), ACM, New York, 145.

Digital Library

[7]

Hirsch, M., Lanman, D., Holtzman, H., and Raskar, R. 2009. BiDi screen: A thin, depth-sensing LCD for 3D interaction using light fields. In Proceedings SIGGRAPH Asia'09, ACM, New York. 1--9.

Digital Library

[8]

Kamuro, S., Minamizawa, K., Kawakami, N., and Tachi. S. 2009. Pen de touch. In Proceedings of the ACM SIGGRAPH 2009 Emerging Technologies Conference, ACM, New York, 1--1.

Digital Library

[9]

Kennett, S., Taylor-Clarke, M., and Haggard, P. 2001. Noninformative vision improves the spatial resolution of touch in humans. Current Biol. 11, 15, 1188--1191.

[10]

Kyung, K.-U. and Lee, J.-Y. 2008. Wubi-pen: Windows graphical user interface interacting with haptic feedback stylus. In Proceedings of the ACM SIGGRAPH 2008 New Tech Demos, ACM, New York, 1--4.

Digital Library

[11]

Lapides, P., Sharlin, E., Sousa, M. C., and Streit, L. 2006. The 3d tractus: A three-dimensional drawing board. In Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'06), IEEE. Washington, D.C., 169--176.

Digital Library

[12]

Lee, J. C., Dietz, P. H., Leigh, D. W. S., Yerazunis, and Hudson, S. E. 2004. Haptic pen: A tactile feedback stylus for touch screens. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST'04), ACM, New York, 291--294.

Digital Library

[13]

Lee, S., Buxton, W., and Smith, K. C. 1985. A multi-touch three-dimensional touch-sensitive tablet. SIGCHI Bull. 16, 4, 21--25.

Digital Library

[14]

Massie, T. H. 1996. Initial haptic explorations with the phantom: Virtual touch through point interaction. MS dissertation, MIT, Cambridge, MA.

[15]

Minsky, M., Ming, O.-y., Steele, O., Brooks, F. P., Jr., and M. Behensky, M. 1990. Feeling and seeing: Issues in force display. SIGGRAPH Comput. Graph. 24, 2, 235--241.

Digital Library

[16]

Minsky, M. D. R. 1995. Computational haptics: The Sandpaper system for synthesizing texture for a force-feedback display. PhD dissertation, MIT, Cambridge, MA.

Digital Library

[17]

Polanyim, M. 1959. Personal Knowledge: Towards a Post-Critical Philosophy. University of Chicago Press, Chicago, IL.

[18]

Ramos, G., Boulos, M., and Balakrishnan, R. 2004. Pressure widgets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'04), ACM, New York, 487--494.

Digital Library

[19]

Rekimoto, J. 2002. Smartskin: An infrastructure for freehand manipulation on interactive surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'02), ACM, New York, 113--120.

Digital Library

[20]

Sato, T., Mamiya, H., Koike, and Fukuchi, K. 2009. Photoelastictouch: Transparent rubbery tangible interface using an and photoelasticity. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST'09), ACM, New York, 43--50.

Digital Library

[21]

Sinclair, M. 1997. The haptic lens. In ACM SIGGRAPH 97: Visual Proceedings, ACM, New York, 179.

Digital Library

[22]

So, E., Zhang, H., and Sheng Guan, Y. 1999. Sensing contact with analog resistive technology. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, vol. 2, IEEE, Washington, D.C., 806--811.

[23]

Suzuki, Y., Misue, K., and Tanaka, J. 2007. Stylus enhancement to enrich interaction with computers. In Proceedings of the 12th International Conference on Human-Computer Interaction (HCI'07), Springer, Berlin, 133--142.

Digital Library

[24]

Tian, F., Xu, L., Wang, H., Zhang, X., Liu, Y., Setlur, V., and Dai, G. 2008. Tilt menu: Using the 3d orientation information of pen devices to extend the selection capability of pen-based user interfaces. In Proceedings of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI'08), ACM, New York, 1371--1380.

Digital Library

[25]

Wang, F., Cao, X., Ren, X., and Irani, P. 2009. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST'09), ACM, New York, 23--32.

Digital Library

[26]

Wang, F. and Ren, X. 2009. Empirical evaluation for finger input properties in multi-touch interaction. In Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI'09), ACM, New York, 1063--1072

Digital Library

[27]

Wilson, A. D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. 2008. Bringing physics to the surface. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST'08), ACM, New York, 67--76.

Digital Library

Cited By

Kodak BVardar Y(2023)FeelPen: A Haptic Stylus Displaying Multimodal Texture Feels on TouchscreensIEEE/ASME Transactions on Mechatronics10.1109/TMECH.2023.326478728:5(2930-2940)Online publication date: Oct-2023
https://doi.org/10.1109/TMECH.2023.3264787
Lüthi GFender AHolz C(2022)DeltaPen: A Device with Integrated High-Precision Translation and Rotation Sensing on Passive SurfacesProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545655(1-12)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545655
Chen DChen GZhu DHu XWei ZLiu JSong A(2022)Comparative Experimental Research on Haptic Display Methods of Virtual Surface Shape Based on Touch ScreenIEEE Transactions on Haptics10.1109/TOH.2022.320792815:4(667-678)Online publication date: 1-Oct-2022
https://doi.org/10.1109/TOH.2022.3207928
Show More Cited By

Index Terms

ImpAct: Immersive haptic stylus to enable direct touch and manipulation for surface computing
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

ImpAct: enabling direct touch and manipulation for surface computing
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology

This paper explores direct touch and manipulation techniques for surface computing platforms using a special force feedback stylus named ImpAct(Immersive Haptic Augmentation for Direct Touch). Proposed haptic stylus can change its length when it is ...
B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

We present B2B-Swipe, a single-finger swipe gesture for a rectangular smartwatch that starts at a bezel and ends at a bezel to enrich input vocabulary. There are 16 possible B2B-Swipes because a rectangular smartwatch has four bezels. Moreover, B2B-...
Wearables as Context for Guiard-abiding Bimanual Touch
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

We explore the contextual details afforded by wearable devices to support multi-user, direct-touch interaction on electronic whiteboards in a way that-unlike previous work-can be fully consistent with natural bimanual-asymmetric interaction as set forth ...

Comments

Information & Contributors

Information

Published In

cover image Computers in Entertainment

Computers in Entertainment Volume 8, Issue 2

Special Issue: Advances in Computer Entertainment Technology

December 2010

117 pages

EISSN:1544-3574

DOI:10.1145/1899687

Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 December 2010

Published in CIE Volume 8, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
815
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kodak BVardar Y(2023)FeelPen: A Haptic Stylus Displaying Multimodal Texture Feels on TouchscreensIEEE/ASME Transactions on Mechatronics10.1109/TMECH.2023.326478728:5(2930-2940)Online publication date: Oct-2023
https://doi.org/10.1109/TMECH.2023.3264787
Lüthi GFender AHolz C(2022)DeltaPen: A Device with Integrated High-Precision Translation and Rotation Sensing on Passive SurfacesProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545655(1-12)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545655
Chen DChen GZhu DHu XWei ZLiu JSong A(2022)Comparative Experimental Research on Haptic Display Methods of Virtual Surface Shape Based on Touch ScreenIEEE Transactions on Haptics10.1109/TOH.2022.320792815:4(667-678)Online publication date: 1-Oct-2022
https://doi.org/10.1109/TOH.2022.3207928
Korres GPark WEid M(2021)Contactless Kinesthetic Feedback to Support Handwriting Using Magnetic ForceIEEE Transactions on Haptics10.1109/TOH.2021.308370214:4(825-834)Online publication date: 1-Oct-2021
https://doi.org/10.1109/TOH.2021.3083702
Huang KSun CHuang DChen YChang RHsu SYang CChen BBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Glissade: Generating Balance Shifting Feedback to Facilitate Auxiliary Digital Pen InputProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376505(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376505
Jackson B(2020)OVR Stylus: Designing Pen-Based 3D Input Devices for Virtual Reality2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW50115.2020.0-266(13-18)Online publication date: Mar-2020
https://doi.org/10.1109/VRW50115.2020.0-266
Ha-Van QSchwendinger HKim YHarders M(2020)Design and Characterization of an Actuated Drill Mockup for Orthopedic Surgical TrainingIEEE Transactions on Haptics10.1109/TOH.2020.2966608(1-1)Online publication date: 2020
https://doi.org/10.1109/TOH.2020.2966608
Korres GEid M(2020)KATIB: Haptic-Visual Guidance for HandwritingHaptics: Science, Technology, Applications10.1007/978-3-030-58147-3_31(279-287)Online publication date: 6-Sep-2020
https://dl.acm.org/doi/10.1007/978-3-030-58147-3_31
Wang QRen XSun XMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Enhancing Pen-based Interaction using Electrovibration and Vibration Haptic FeedbackProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025555(3746-3750)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025555
Tian LSong AChen D(2017)Image-based haptic display via a novel pen-shaped haptic device on touch screensMultimedia Tools and Applications10.1007/s11042-017-4387-576:13(14969-14992)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.1007/s11042-017-4387-5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents