research-article

Multitouch finger registration and its applications

Authors:

Oscar Kin-Chung Au,

Chiew-Lan TaiAuthors Info & Claims

OZCHI '10: Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction

Pages 41 - 48

https://doi.org/10.1145/1952222.1952233

Published: 22 November 2010 Publication History

Abstract

We present a simple finger registration technique that can distinguish in real-time which hand and fingers of the user are touching the touchscreen. The finger registration process is activated whenever the user places a hand, in any orientation, anywhere on the touchscreen. Such a finger registration technique enables the design of intuitive multitouch interfaces that directly map different combinations of the user's fingers to the interface operations. In this paper, we first study the effectiveness and robustness of the finger registration process. We then demonstrate the usability of our finger registration method for two new interfaces. Specifically, we describe the Palm Menu, which is an intuitive dynamic menu interface that minimizes hand and eye movement during operations, and a virtual mouse interface that enables user to perform mouse operations in multitouch environment. We conducted controlled experiments to compare the performance of the Palm Menu against common command selection interfaces and the virtual mouse against traditional pointing devices.

References

[1]

Bailly, G., Lecolinet, E., and Guiard, Y. (2010). Finger-Count and Radial-Stroke Shortcuts: Two Techniques for Augmenting Linear Menus. ACM CHI. 591--594.

Digital Library

[2]

Brandl, P., Forlines, C. Wigdor, D., Haller, M., Shen, C. (2008). Combining and Measuring the Benefits of Bimanual Pen and Direct-Touch Interaction on Horizontal Interfaces. ACM AVI. 154--161.

Digital Library

[3]

Card, S. K. (1982). User perceptual mechanisms in the search of computer command menus. ACM CHI. 190--196.

Digital Library

[4]

Davidson, P. L. and Han, J. Y. (2008). Extending 2D object arrangement with pressure-sensitive layering cues. ACM UIST. 8790.

Digital Library

[5]

Dietz, P. and Leigh, D. (2001). DiamondTouch: a multi-user touch technology. ACM UIST. 219--226.

Digital Library

[6]

Fingerworks, Inc. (2008). User's Guide. http://www.fingerworks.com/gesture_guide_mouse.html

[7]

Esenther, A. and Ryall, K. (2006). Fluid DTMouse: better mouse support for touch-based interactions. In Proceedings of the Working Conference on Advanced Visual interfaces. 112--115.

Digital Library

[8]

Holz, C and Baudisch, P. (2010) The Generalized Perceived Input Point Model and How to Double Touch Accuracy by Extracting Fingerprints, ACM CHI. 581--590.

Digital Library

[9]

Hopkins, D. (1991). The design and implementation of pie menus. In Dr. Dobb's J. 16, 12 (Dec. 1991), 16--26.

Digital Library

[10]

Izadi, S., Hodges, S., Butler, A., Rrustemi, A., and Buxton, (2007). ThinSight: integrated optical multi-touch sensing through thin form-factor displays. Proceedings of the 2007 workshop on Emerging displays technologies, vol. 252.

Digital Library

[11]

Lepinski, J., Grossman, T., Fitzmaurice, G. (2010). The design and evaluation of multitouch marking menus ACM CHI. 2233--2242.

Digital Library

[12]

Malik, S., Ranjan, A., Balakrishnan. R. (2005). Interacting with large displays from a distance with vision-tracked multi-finger gestural input. ACM UIST. 43--52.

Digital Library

[13]

Matejka, J., Grossman, T., Lo, J., and Fitzmaurice, G. (2009). The design and evaluation of multi-finger mouse emulation techniques. ACM CHI.

Digital Library

[14]

Moscovich, T., Hughes, J. F. (2006). Multi-finger cursor techniques. Proceedings of Graphics interface. 1--7.

Digital Library

[15]

Rekimoto, J. (2002). SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. ACM CHI. 113--120.

Digital Library

[16]

Wang, F., Ren, X., Cao, X., Irani, P. (2009). Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. ACM UIST. 23--32.

Digital Library

[17]

Wilson, A. (2005). PlayAnywhere: A Compact Tabletop Computer Vision System. ACM UIST. 83--92.

Digital Library

[18]

Wu, M., Balakrishnan, R. (2003). Multi-finger and whole hand gestural interaction techniques for multiuser tabletop displays. ACM UIST. 193--202.

Digital Library

Cited By

Huang ZGao CWang HDeng XLai YMa CQin SLiu YWang H(2024)SpeciFingersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435598:1(1-28)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643559
Park KKim DHeo SLee GBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)MagTouch: Robust Finger Identification for a Smartwatch Using a Magnet Ring and a Built-in MagnetometerProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376234(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376234
Le HMayer SHenze NFu WPan SBrdiczka OChau PCalvary G(2019)Investigating the feasibility of finger identification on capacitive touchscreens using deep learningProceedings of the 24th International Conference on Intelligent User Interfaces10.1145/3301275.3302295(637-649)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3301275.3302295
Show More Cited By

Index Terms

Multitouch finger registration and its applications
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

The design and evaluation of multitouch marking menus
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Despite the considerable quantity of research directed towards multitouch technologies, a set of standardized UI components have not been developed. Menu systems provide a particular challenge, as traditional GUI menus require a level of pointing ...
Multi-finger AR typing interface for mobile devices
IUI '14 Companion: Companion Proceedings of the 19th International Conference on Intelligent User Interfaces

In this paper, we propose a user interface that enables multi-finger typing in the space behind a mobile device. By using the augmented reality (AR) technology, a virtual keyboard is superimposed on the rear camera image, and a hand region of the camera ...
Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

In this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OZCHI '10: Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction

November 2010

462 pages

ISBN:9781450305020

DOI:10.1145/1952222

Conference Chair:
Margot Brereton
Queensland University of Technology
,
Program Chairs:
Stephen Viller
The University of Queensland
,
Ben Kraal
Queensland University of Technology

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Queensland University of Technology
Adobe
Coopers and Lybrand Deloitte
CSIRO
Symplicit: Symplicit
Microsoft: Microsoft
Smart Services CRC: Smart Services CRC
NICTA: National Information and Communications Technology Australia
PTG Global: The Performance Technologies Group

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 November 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Innovation and Technology Commmission

Conference

OZCHI '10

Sponsor:

Symplicit
Microsoft
Smart Services CRC
NICTA
PTG Global

OZCHI '10: Proceedings of the 22th conference of the computer-human interaction special interest group of Australia on Computer-human interaction

November 22 - 26, 2010

Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
626
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huang ZGao CWang HDeng XLai YMa CQin SLiu YWang H(2024)SpeciFingersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435598:1(1-28)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643559
Park KKim DHeo SLee GBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)MagTouch: Robust Finger Identification for a Smartwatch Using a Magnet Ring and a Built-in MagnetometerProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376234(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376234
Le HMayer SHenze NFu WPan SBrdiczka OChau PCalvary G(2019)Investigating the feasibility of finger identification on capacitive touchscreens using deep learningProceedings of the 24th International Conference on Intelligent User Interfaces10.1145/3301275.3302295(637-649)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3301275.3302295
Palanque PCockburn ADésert-Legendre LGutwin CDeleris Y(2019)Brace Touch: A Dependable, Turbulence-Tolerant, Multi-touch Interaction Technique for Interactive CockpitsComputer Safety, Reliability, and Security10.1007/978-3-030-26601-1_4(53-68)Online publication date: 8-Aug-2019
https://doi.org/10.1007/978-3-030-26601-1_4
Kim IPark KYoon YLee GBaudisch PSchmidt AWilson A(2018)Touch180Adjunct Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3266037.3266091(29-32)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3266037.3266091
Le HMayer SHenze NBaudisch PSchmidt AWilson A(2018)InfiniTouchProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242605(779-792)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242605
Mayer SLischke LLanksweirt ALe HHenze NBratteteig TSandnes FBerget G(2018)How to communicate new input techniquesProceedings of the 10th Nordic Conference on Human-Computer Interaction10.1145/3240167.3240176(460-472)Online publication date: 29-Sep-2018
https://dl.acm.org/doi/10.1145/3240167.3240176
Masson DGoguey AMalacria SCasiez GGajos KMankoff JHarrison C(2017)WhichFingersProceedings of the 30th Annual ACM Symposium on User Interface Software and Technology10.1145/3126594.3126619(41-48)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3126594.3126619
Goguey AVogel DChevalier FPietrzak TRoussel NCasiez G(2017)Leveraging finger identification to integrate multi-touch command selection and parameter manipulationInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2016.11.00299(21-36)Online publication date: Mar-2017
https://doi.org/10.1016/j.ijhcs.2016.11.002
Leftheriotis IChorianopoulos KJaccheri L(2016)Design and implement chords and personal windows for multi-user collaboration on a large multi-touch vertical displayHuman-centric Computing and Information Sciences10.1186/s13673-016-0070-56:1(1-19)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1186/s13673-016-0070-5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten