research-article

Probabilistic palm rejection using spatiotemporal touch features and iterative classification

Authors:

Jennifer Mankoff,

Scott E. Hudson,

Chris HarrisonAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2009 - 2012

https://doi.org/10.1145/2556288.2557056

Published: 26 April 2014 Publication History

Abstract

Tablet computers are often called upon to emulate classical pen-and-paper input. However, touchscreens typically lack the means to distinguish between legitimate stylus and finger touches and touches with the palm or other parts of the hand. This forces users to rest their palms elsewhere or hover above the screen, resulting in ergonomic and usability problems. We present a probabilistic touch filtering approach that uses the temporal evolution of touch contacts to reject palms. Our system improves upon previous approaches, reducing accidental palm inputs to 0.016 per pen stroke, while correctly passing 98% of stylus inputs.

Supplementary Material

ZIP File (pn0583-file4.zip)

Download
3.40 MB

suppl.mov (pn0583-file3.mp4)

Supplemental video

Download
47.85 MB

MP4 File (p2009-sidebyside.mp4)

Download
109.77 MB

References

[1]

Boring, S., Ledo, D., Chen, X., Marquadt, N., Tang, A. and Greenberg, S. The fat thumb: using the thumb's contact size for single-handed mobile interaction. In Proc. MobileHCI '12, 39--48.

Digital Library

[2]

Bamboo Paper. Wacom. http://bamboopaper.wacom.com.

[3]

Camilleri, M., Malige, A., Fujimoto, J., Rempei, D. (2013). Touch Displays: the effects of palm rejection technology on productivity, comfort, biomechanics, and positioning. In Ergonomics. Taylor & Francis Group.

[4]

ClearPad^TM Series 3. http://synaptics.com/solutions/products/clearpad

[5]

EMR® Technology. Wacom. http://www.wacomcomponents.com/english/technology/emr.html.

[6]

Ewerling, P., Kulik, A, Froehlich, B. Finger and hand detection for multi-touch interfaces based on maximally stable extremal regions. In Proc. ITS '12, 173--182.

Digital Library

[7]

Gu, J., Heo, S., Han, J., Kim, S. and Lee, G. LongPad: a touchpad using the entire area below the keyboard of a laptop computer. In Proc. CHI '13, 1421--1430.

Digital Library

[8]

Hall, M. A. Correlation-based Feature Subset Selection for Machine Learning. Ph.D. Thesis, 1998. Hamilton, New Zealand.

[9]

Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. and Witten, I. H. The WEKA data mining software: an update. SIGKDD Explorations, 11(1), 10--18.

Digital Library

[10]

Hinckley, K. and Sinclair, M. Touch-Sensing Input Devices. In Proc. CHI '99, 223--230.

Digital Library

[11]

Hinckley, K., Wigdor, D., (2012). Input Technologies and Techniques (Chapter 9). In The Human-Computer Interaction Handbook, 3rd Edition, published by Taylor & Francis.

[12]

Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Pen + touch = new tools. In Proc. UIST '10, 27--36.

Digital Library

[13]

iPen 2. Cregle Inc. http://www.cregle.com/pages/pressure-sensitive-stylus-for-your-imac-and-ipad.

[14]

Jot Touch. Adonit. http://adonit.net/jot/touch

[15]

Liang, R., Cheng, K., Su, C., Weng, C., Chen, B. and Yang, D. GaussSense: attachable stylus sensing using magnetic sensor grid. In Proc. UIST '12, 319--326.

Digital Library

[16]

MyNote Pen. http://mynote.eu/mynotepen-en.html.

[17]

Notability Ginger Labs. http://www.gingerlabs.com.

[18]

Penultimate. Evernote. http://evernote.com/penultimate.

[19]

Quinlan, J. R. C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, 1993.

Digital Library

[20]

Rogers, S., Williamson, J., Stewart, C. and Murray-Smith, R. AnglePose: robust, precise capacitive touch tracking via 3D orientation estimation. In Proc. CHI '12, 2575--2584.

Digital Library

[21]

Schwarz J., Hudson S., Mankoff, J. and Wilson, A.D. A framework for robust and flexible handling of inputs with uncertainty. In Proc. UIST '10, 47--56.

Digital Library

[22]

Steimle, J. (2012). Survey of Pen-and-Paper Computing. In Pen-and-Paper User Interfaces (pp. 19--65). Springer Berlin Heidelberg.

[23]

Vogel, D., Cudmore, M., Casiez, G., Balakrishnan, R. and Keliher, L. Hand occlusion with tablet-sized direct pen input. In Proc. CHI '09, 557--566.

Digital Library

[24]

Wang, F. and Ren, F. Empirical evaluation for finger input properties in multi-touch interaction. In Proc. CHI '10, 1063--1072.

Digital Library

[25]

Wang, F., Cao, X., Ren, X. and Irani, P. Detecting and leveraging finger orientation for interaction with directtouch surfaces. In Proc. UIST '09, 23--32.

Digital Library

Cited By

Park JLee KLee SZhang MKo J(2023)AttFLProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109177:3(1-31)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610917
Wang ZLarrazabal MRucker MToner EDaniel KKumar SBoukhechba MTeachman BBarnes L(2023)Detecting Social Contexts from Mobile Sensing Indicators in Virtual Interactions with Socially Anxious IndividualsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109167:3(1-26)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610916
Villa SNiess JSchmidt AWelsch R(2023)Society's Attitudes Towards Human Augmentation and Performance Enhancement Technologies (SHAPE) ScaleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109157:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610915
Show More Cited By

Index Terms

Probabilistic palm rejection using spatiotemporal touch features and iterative classification
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Exploring and Understanding Unintended Touch during Direct Pen Interaction

The user experience on tablets that support both touch and styli is less than ideal, due in large part to the problem of unintended touch or palm rejection. Devices are often unable to distinguish between intended touch (i.e., interaction on the screen ...
A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Proximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...
Enhancing physicality in touch interaction with programmable friction
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Touch interactions have refreshed some of the 'glowing enthusiasm' of thirty years ago for direct manipulation interfaces. However, today's touch technologies, whose interactions are supported by graphics, sounds or crude clicks, have a tactile sameness ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
606
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Park JLee KLee SZhang MKo J(2023)AttFLProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109177:3(1-31)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610917
Wang ZLarrazabal MRucker MToner EDaniel KKumar SBoukhechba MTeachman BBarnes L(2023)Detecting Social Contexts from Mobile Sensing Indicators in Virtual Interactions with Socially Anxious IndividualsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109167:3(1-26)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610916
Villa SNiess JSchmidt AWelsch R(2023)Society's Attitudes Towards Human Augmentation and Performance Enhancement Technologies (SHAPE) ScaleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109157:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610915
Yfantidou SSermpezis PVakali ABaeza-Yates R(2023)Uncovering Bias in Personal InformaticsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109147:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610914
Hu JWang YJia HHu WHassan MKusy BUddin AYoussef M(2023)IrisProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109137:3(1-27)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610913
Mi TWang JChan L(2023)LapTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108787:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610878
Yeh YMatulic FVogel D(2023)Phone Sleight of Hand: Finger-Based Dexterous Gestures for Physical Interaction with Mobile PhonesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581121(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581121
Cabral D(2022)Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen TiltProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3570598(285-287)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3570598
Jiang YJi XWang KYan CMitev RSadeghi AXu W(2022)WIGHT: Wired Ghost Touch Attack on Capacitive Touchscreens2022 IEEE Symposium on Security and Privacy (SP)10.1109/SP46214.2022.9833740(984-1001)Online publication date: May-2022
https://doi.org/10.1109/SP46214.2022.9833740
Ahuja KStreli PHolz C(2021)TouchPose: Hand Pose Prediction, Depth Estimation, and Touch Classification from Capacitive ImagesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474801(997-1009)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474801
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents