research-article

Free access

Extending the vocabulary of touch events with ThumbRock

Authors:

Caroline Appert,

Michel Beaudouin-LafonAuthors Info & Claims

GI '13: Proceedings of Graphics Interface 2013

Pages 221 - 228

Published: 29 May 2013 Publication History

Abstract

Compared with mouse-based interaction on a desktop interface, touch-based interaction on a mobile device is quite limited: most applications only support tapping and dragging to perform simple gestures. Finger rolling provides an alternative to tapping but uses a recognition process that relies on either per-user calibration, explicit delimiters or extra hardware, making it difficult to integrate into current touch-based mobile devices. This paper introduces ThumbRock, a ready-to-use micro gesture that consists in rolling the thumb back and forth on the touchscreen. Our algorithm recognizes ThumbRocks with more than 96% accuracy without calibration nor explicit delimiter by analyzing the data provided by the touch screen with a low computational cost. The full trace of the gesture is analyzed incrementally to ensure compatibility with other events and to support real-time feedback. This also makes it possible to create a continuous control space as we illustrate with our MicroSlider, a 1D slider manipulated with thumb rolling gestures.

Supplementary Material

ZIP File (p221-bonnet.zip)

Supplemental material.

Download
29.13 MB

References

[1]

P. Agar and K. Novins. Polygon recognition in sketch-based interfaces with immediate and continuous feedback. In Proc. GRAPHITE '03, 147--150. ACM, 2003.

Digital Library

[2]

H. Benko, A. D. Wilson, and P. Baudisch. Precise selection techniques for multi-touch screens. In Proc. CHI '06, 1263--1272, 2006.

Digital Library

[3]

D. Bonnet and C. Appert. Sam: the swiss army menu. In Proc. IHM '11, 5:1--5:4. ACM, 2011.

Digital Library

[4]

S. Boring, D. Ledo, X. A. Chen, N. Marquardt, A. Tang, and S. Greenberg. The fat thumb: using the thumb's contact size for single-handed mobile interaction. In Proc. MobileHCI '12, 207--208. ACM, 2012.

Digital Library

[5]

C. Harrison, J. Schwarz, and S. Hudson. TapSense: enhancing finger interaction on touch surfaces. In Proc. UIST '11, 627--636, 2011.

Digital Library

[6]

S. Heo and G. Lee. Force gestures: Augmenting touch screen gestures with normal and tangential forces. In Proc. UIST '11, 621--626. ACM, 2011.

Digital Library

[7]

K. Hinckley, P. Baudisch, G. Ramos, and F. Guimbretiere. Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. In Proc. CHI '05, 451--460. ACM, 2005.

Digital Library

[8]

K. Hinckley and H. Song. Sensor synaesthesia: Touch in motion, and motion in touch. In Proc. CHI '11, 801--810. ACM, 2011.

Digital Library

[9]

C. Holz and P. Baudisch. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In Proc. CHI '10, 581--590. ACM, 2010.

Digital Library

[10]

A. K. Karlson and B. B. Bederson. One-handed touchscreen input for legacy applications. In Proc. CHI '08, 1399--1408. ACM, 2008.

Digital Library

[11]

G. Kurtenbach and W. Buxton. User learning and performance with marking menus. In Proc. CHI '94, 258--264. ACM, 1994.

Digital Library

[12]

Y. Li. Gesture search: a tool for fast mobile data access. In Proc. UIST '10, 87--96. ACM, 2010.

Digital Library

[13]

I. S. MacKenzie and A. Oniszczak. A comparison of three selection techniques for touchpads. In Proc. CHI '98, 336--343. ACM, 1998.

Digital Library

[14]

S. Malacria, E. Lecolinet, and Y. Guiard. Clutch-free panning and integrated pan-zoom control on touch-sensitive surfaces: the cyclostar approach. In Proc. CHI '10, 2615--2624, 2010.

Digital Library

[15]

A. Olwal, S. Feiner, and S. Heyman. Rubbing and tapping for precise and rapid selection on touch-screen displays. In Proc. CHI '08, 295--304, 2008.

Digital Library

[16]

K. B. Perry and J. P. Hourcade. Evaluating one handed thumb tapping on mobile touchscreen devices. In Proc. GI '08, 57--64. Canadian Information Processing Soc., 2008.

Digital Library

[17]

M. Rahman, S. Gustafson, P. Irani, and S. Subramanian. Tilt techniques: investigating the dexterity of wrist-based input. In Proc. CHI '09, 1943--1952. ACM, 2009. ACM ID: 1518997.

Digital Library

[18]

G. Ramos, M. Boulos, and R. Balakrishnan. Pressure widgets. In Proc. CHI '04, 487--494. ACM, 2004.

Digital Library

[19]

V. Roth and T. Turner. Bezel swipe: Conflict-free scrolling and multiple selection on mobile touch screen devices. In Proc. CHI '09, 1523--1526, 2009.

Digital Library

[20]

A. Roudaut, E. Lecolinet, and Y. Guiard. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In Proc. CHI '09, 927--936, 2009.

Digital Library

[21]

J. Ruiz and Y. Li. DoubleFlip: a motion gesture delimiter for mobile interaction. In Proc. CHI '11, 2717--2720, 2011.

Digital Library

[22]

J. Schwarz, J. Mankoff, and S. Hudson. Monte carlo methods for managing interactive state, action and feedback under uncertainty. In Proc. UIST '11, 235--244. ACM, 2011.

Digital Library

[23]

A. J. Sellen, G. P. Kurtenbach, and W. A. S. Buxton. The prevention of mode errors through sensory feedback. Hum.-Comput. Interact., 7(2):141--164, June 1992.

Digital Library

[24]

R. Vatavu, L. Grisoni, and S. Pentiuc. Multiscale detection of gesture patterns in continuous motion trajectories. In Gesture in Embodied Communication and HCI, LNCS 5934, 85--97. Springer, 2010.

Digital Library

[25]

F. Wang, X. Cao, X. Ren, and P. Irani. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. In Proc. UIST '09, 23--32. ACM, 2009.

Digital Library

Cited By

Mackamul ECasiez GMalacria S(2023)Exploring Visual Signifier Characteristics to Improve the Perception of Affordances of In-Place Touch InputsProceedings of the ACM on Human-Computer Interaction10.1145/36042577:MHCI(1-32)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604257
Le HMayer SHenze N(2020)Imprint-Based Input Techniques for Touch-Based Mobile DevicesProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3428393(32-41)Online publication date: 22-Nov-2020
https://dl.acm.org/doi/10.1145/3428361.3428393
Hong SJeong EHeo SLee BBaudisch PSchmidt AWilson A(2018)FDSenseProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242644(809-823)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242644
Show More Cited By

Index Terms

Extending the vocabulary of touch events with ThumbRock
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

Expanding One-Handed Touch Input Vocabulary Using Index Finger on and Above Back-of-Device
OzCHI '19: Proceedings of the 31st Australian Conference on Human-Computer-Interaction

This paper presents an input method to expand one-handed touch input vocabulary for smartphones using the index finger. To this end, our method combines thumb-based touch input and postures or gestures of the index finger on and above back-of-device. ...
Touch projector: mobile interaction through video
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In 1992, Tani et al. proposed remotely operating machines in a factory by manipulating a live video image on a computer screen. In this paper we revisit this metaphor and investigate its suitability for mobile use. We present Touch Projector, a system ...
Expanding touch input vocabulary by using consecutive distant taps
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In recent years, touch screens have emerged and matured as the main input interface for mobile and tablet computers calling for extended touch input possibilities. In this paper, we explore the use of consecutive distant taps to expand the touch screen ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

GI '13: Proceedings of Graphics Interface 2013

May 2013

243 pages

ISBN:9781482216806

Program Chairs:
Faramarz F. Samavati
University of Calgary, Canada
,
Kirstie Hawkey
Dalhousie University, Canada

Sponsors

The Canadian Human-Computer Communications Society / Société Canadienne du Dialogue Humaine Machine (CHCCS/SCDHM)

Publisher

Canadian Information Processing Society

Canada

Publication History

Published: 29 May 2013

Author Tags

Qualifiers

Research-article

Acceptance Rates

Overall Acceptance Rate 206 of 508 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
350
Total Downloads

Downloads (Last 12 months)77
Downloads (Last 6 weeks)18

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mackamul ECasiez GMalacria S(2023)Exploring Visual Signifier Characteristics to Improve the Perception of Affordances of In-Place Touch InputsProceedings of the ACM on Human-Computer Interaction10.1145/36042577:MHCI(1-32)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604257
Le HMayer SHenze N(2020)Imprint-Based Input Techniques for Touch-Based Mobile DevicesProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3428393(32-41)Online publication date: 22-Nov-2020
https://dl.acm.org/doi/10.1145/3428361.3428393
Hong SJeong EHeo SLee BBaudisch PSchmidt AWilson A(2018)FDSenseProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242644(809-823)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242644
Holderness SBott JWisniewski PLaViola JEisemann EBateman S(2017)Exploring Multi-touch Contact Size for Z-Axis Movement in 3D EnvironmentsProceedings of the 43rd Graphics Interface Conference10.5555/3141475.3141491(65-73)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.5555/3141475.3141491
Liao YChen YChan LChen BGajos KMankoff JHarrison C(2017)Dwell+Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology10.1145/3126594.3126627(5-16)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3126594.3126627
Morales González RAppert CBailly GPietriga EMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Passive yet Expressive TouchTokensProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025894(3741-3745)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025894
Buschek DAlt FMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)ProbUIProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025502(4640-4653)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025502
Wilkinson GKharrufa AHook JPursglove BWood GHaeuser HHammerla NHodges SOlivier PKaye JDruin ALampe CMorris DHourcade J(2016)ExpressyProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858223(2832-2844)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858223
Wu SChellali AOtmane SMoreau GZhao QThalmann DWu ELin MWang L(2015)TouchSketchProceedings of the 21st ACM Symposium on Virtual Reality Software and Technology10.1145/2821592.2821606(59-68)Online publication date: 13-Nov-2015
https://dl.acm.org/doi/10.1145/2821592.2821606
Han JLee GLatulipe CHartmann BGrossman T(2015)Push-PushProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807457(313-322)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1145/2807442.2807457
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten