research-article

Estimating 3D Finger Angle on Commodity Touchscreens

Authors:

Chris HarrisonAuthors Info & Claims

ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces

Pages 47 - 50

https://doi.org/10.1145/2817721.2817737

Published: 15 November 2015 Publication History

Abstract

We describe a novel approach for estimating the pitch and yaw of fingers relative to a touchscreen's surface, offering two additional, analog degrees of freedom for interactive functions. Further, we show that our approach can be achieved on off-the-shelf consumer touchscreen devices: a smartphone and smartwatch. We validate our technique though a user study on both devices and conclude with several demo applications that illustrate the value and immediate feasibility of our approach.

Supplementary Material

MOV File (its183.mov)

Download
103.90 MB

References

[1]

Android API. http://developer.android.com/reference/ android/view/MotionEvent.html#AXIS_ORIENTATION

[2]

Apple, Inc. Multi-touch gesture dictionary (2008). US Patent 20070177803.

[3]

Boring, S., Ledo, D., Chen, X., Marquardt, N., Tang, A. and Greenberg, S. The fat thumb: using the thumb's contact size for single-handed mobile interaction. In Proc. MobileHCI '12. 207--208.

Digital Library

[4]

Cao, X., A. Wilson, R. Balakrishnan, K. Hinckley, S. Hudson. ShapeTouch: Leveraging contact shape on interactive surfaces. In Proc. ITS '08. 129--136.

[5]

Dippon, A and Klinker, G. KinectTouch: accuracy test for a very low-cost 2.5D multitouch tracking system. In Proc. ITS '11. 49--52.

Digital Library

[6]

Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I. H. The WEKA Data Mining Software: An Update. SIGKDD Explorations, 11(1), 2009.

Digital Library

[7]

Harrison, C., Schwarz, J. and Hudson S. E. TapSense: Enhancing Finger Interaction on Touch Surfaces. In Proc. UIST '11. 627--636.

Digital Library

[8]

Heo, S. and Lee, G. Force gestures: augmented touch screen gestures using normal and tangential force. In Proc. UIST'11. 621--626.

Digital Library

[9]

Holz, C. and Baudisch, P. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In Proc. CHI '10. 581--590.

Digital Library

[10]

Kratz, S., Chiu, P and Back, M. PointPose: finger pose estimation for touch input on mobile devices using a depth sensor. In Proc. ITS '13. 223--230.

Digital Library

[11]

Lepinski, J.G., Grossman, T., and Fitzmaurice, G. The design and evaluation of multitouch marking menus. In Proc. CHI '10. 2233--2242.

Digital Library

[12]

Ramos, G., Boulos, M., and Balakrishnan, R. Pressure widgets. In Proc. CHI '04. 487--494.

Digital Library

[13]

Rogers, S., Williamson, J., Stewart, C., and Murray-Smith, R. AnglePose: robust, precise capacitive touch tracking via 3d orientation estimation. In Proc. CHI '11. 2575--2584

Digital Library

[14]

Roudaut, A., Lecolinet, E. and Guiard, Y. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In Proc. CHI '09. 927--936.

Digital Library

[15]

Takeoka, Y., Miyaki, T., and Rekimoto, J. Z-touch: an infrastructure for 3d gesture interaction in the proximity of tabletop surfaces. In Proc. ITS '10. 91--94.

Digital Library

[16]

Wang, F. and Ren, X. Empirical evaluation for finger input properties in multi-touch interaction. In Proc. CHI '09. 1063--1072.

Digital Library

[17]

Wang, F., Cao, X., Ren, X. and Irani, P. Detecting and leveraging finger orientation for interaction with directtouch surfaces. In Proc. UIST '09. 23--32.

Digital Library

[18]

Zaliva, V. 3D finger posture detection and gesture recognition on touch surfaces. In Proc. ICARCV '12. 359--364.

Cited By

Lu YDing DWang RXue GKostakos VKay JHoang T(2024)HCMG: Human-Capacitance based Micro Gesture for VR/ARCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678386(766-770)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678386
Li CYu JHe KFeng JZhou J(2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659584
Mollyn VHarrison C(2024)EgoTouch: On-Body Touch Input Using AR/VR Headset CamerasProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676455(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676455
Show More Cited By

Index Terms

Estimating 3D Finger Angle on Commodity Touchscreens
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks
ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

In the last years, touchscreens became the most common input device for a wide range of computers. While touchscreens are truly pervasive, commercial devices reduce the richness of touch input to two-dimensional positions on the screen. Recent work ...
Designing finger orientation input for mobile touchscreens
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

A large number of today's systems use interactive touch surfaces as the main input channel. Current devices reduce the richness of touch input to two-dimensional positions on the screen. A growing body of work develops methods that enrich touch input to ...
CapWidgets: tangile widgets versus multi-touch controls on mobile devices
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

We present CapWidgets, passive tangible controls for capacitive touch screens. CapWidgets bring back physical controls to off-the-shelf multi-touch surfaces as found in mobile phones and tablet computers. While the user touches the widget, the surface ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces

November 2015

522 pages

ISBN:9781450338998

DOI:10.1145/2817721

General Chairs:
Nuno Nunes
University of Madeira, Portugal
,
Enrico Costanza
University of Southampton, UK
,
Program Chairs:
Patrick Olivier
Newcastle University, UK
,
Johannes Schöning
Hasselt University, Belgium

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS '15

Sponsor:

SIGCHI

ITS '15: Interactive Tabletops and Surfaces

November 15 - 18, 2015

Madeira, Portugal

Acceptance Rates

ITS '15 Paper Acceptance Rate 29 of 122 submissions, 24%;

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

69
Total Citations
View Citations
943
Total Downloads

Downloads (Last 12 months)71
Downloads (Last 6 weeks)4

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lu YDing DWang RXue GKostakos VKay JHoang T(2024)HCMG: Human-Capacitance based Micro Gesture for VR/ARCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678386(766-770)Online publication date: 5-Oct-2024
Li CYu JHe KFeng JZhou J(2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
Mollyn VHarrison C(2024)EgoTouch: On-Body Touch Input Using AR/VR Headset CamerasProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676455(1-11)Online publication date: 13-Oct-2024
Liu XZhang YTong X(2024)Touchscreen-based Hand Tracking for Remote Whiteboard InteractionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676412(1-14)Online publication date: 13-Oct-2024
Huang ZGao CWang HDeng XLai YMa CQin SLiu YWang H(2024)SpeciFingersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435598:1(1-28)Online publication date: 6-Mar-2024
He KLi CDuan YFeng JZhou J(2024)TrackPoseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314597:4(1-22)Online publication date: 12-Jan-2024
Coutrix CProst C(2024)Impact of Fingernails Length on Mobile Tactile InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642037(1-21)Online publication date: 11-May-2024
Shen ZLi SZhao XZou J(2024)CT-Auth: Capacitive Touchscreen-Based Continuous Authentication on SmartphonesIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.327787936:1(90-106)Online publication date: Jan-2024
Myers B(2024)Pick, Click, Flick!undefinedOnline publication date: 14-Mar-2024
Kim DMollyn VHarrison C(2023)WorldPoint: Finger Pointing as a Rapid and Natural Trigger for In-the-Wild Mobile InteractionsProceedings of the ACM on Human-Computer Interaction10.1145/36264787:ISS(357-375)Online publication date: 1-Nov-2023
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten