research-article

Indirect mappings of multi-touch input using one and two hands

Authors:

Tomer Moscovich,

John F. HughesAuthors Info & Claims

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1275 - 1284

https://doi.org/10.1145/1357054.1357254

Published: 06 April 2008 Publication History

Abstract

Touchpad and touchscreen interaction using multiple fingers is emerging as a valuable form of high-degree-of-freedom input. While bimanual interaction has been extensively studied, touchpad interaction using multiple fingers of the same hand is not yet well understood. We describe two experiments on user perception and control of multi-touch interaction using one and two hands. The first experiment addresses how to maintain perceptual-motor compatibility in multi-touch interaction, while the second measures the separability of control of degrees-of-freedom in the hands and fingers. Results indicate that two-touch interaction using two hands is compatible with control of two points, while twotouch interaction using one hand is compatible with control of a position, orientation, and hand-span. A slight advantage is found for two hands in separating the control of two positions.

References

[1]

Albinsson, P.-A. and Zhai, S. High precision touch screen interaction. In Proceedings of CHI, pages 105--112, New York, NY, USA, 2003. ACM Press.

Digital Library

[2]

Balakrishnan, R. and Hinckley, K. Symmetric bimanual interaction. In Proceedings of CHI, pages 33--40, New York, NY, USA, 2000. ACM Press.

Digital Library

[3]

Benko, H., Wilson, A. D., and Baudisch, P. Precise selection techniques for multi-touch screens. In Proceedings of CHI, pages 1263--1272, New York, NY, USA, 2006. ACM Press.

Digital Library

[4]

Buxton, W., Hill, R., and Rowley, P. Issues and techniques in touch-sensitive tablet input. In Proceedings of SIGGRAPH '85, pages 215--224, New York, NY, USA, 1985. ACM Press.

Digital Library

[5]

Cutler, L. D., Frolich, B., and Hanrahan, P. Two-handed direct manipulation on the responsive workbench. In SI3D '97, pages 107--ff. ACM Press, 1997.

Digital Library

[6]

Dietz, P. and Leigh, D. Diamondtouch: a multi-user touch technology. In Proceedings of UIST 2001, pages 219--226. ACM Press, 2001.

Digital Library

[7]

FingerWorks. iGesture Pad.

[8]

Forlines, C. and Shen, C. Dtlens: multi-user tabletop spatial data exploration. In Proceedings of UIST, pages 119--122, New York, NY, USA, 2005. ACM Press.

Digital Library

[9]

Forlines, C., Vogel, D., and Balakrishnan, R. Hybridpointing: Fluid switching between absolute and relative pointing with a direct input device. In UIST, New York, NY, USA, 2006. ACM Press.

Digital Library

[10]

Gingold, Y., Davidson, P., Han, J., and Zorin, D. A direct texture placement and editing interface. In Proceedings of UIST, New York, NY, USA, 2006. ACM Press.

Digital Library

[11]

Guiard, Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, pages 485--517, 1987.

[12]

Hager-Ross, C. and Schieber, M. Quantifying the independence of human finger movements: Comparisons of digits, hands, and movement frequencies. Journal of Neuroscience, 20(22):8542--8550, 2000.

[13]

Han, J. Y. Low-cost multi-touch sensing through frustrated total internal reflection. In Proceedings of UIST, pages 115--118, New York, NY, USA, 2005. ACM Press.

Digital Library

[14]

Hinckley, K., Czerwinski, M., and Sinclair, M. Interaction and modeling techniques for desktop two-handed input. In Proceedings of UIST, pages 49--58, New York, NY, USA, 1998. ACM Press.

Digital Library

[15]

Holm, S. A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6:65--70, 1979.

[16]

Igarashi, T., Moscovich, T., and Hughes, J. F. As-rigid-as-possible shape manipulation. ACM Trans. Graph., 24(3):1134--1141, 2005.

Digital Library

[17]

Jacob, R. J. K., Sibert, L. E., McFarlane, D. C., and M. Preston Mullen, J. Integrality and separability of input devices. ACM Trans. Comput.-Hum. Interact., 1(1):3--26, 1994.

Digital Library

[18]

Krueger, M. W., Gionfriddo, T., and Hinrichsen, K. Videoplace: An artificial reality. In Proceedings of CHI '85, pages 35--40, New York, NY, USA, 1985. ACM Press.

Digital Library

[19]

Kurtenbach, G., Fitzmaurice, G., Baudel, T., and Buxton, B. The design of a GUI paradigm based on tablets, two-hands, and transparency. In Proceedings of CHI, pages 35--42. ACM Press, 1997.

Digital Library

[20]

Latulipe, C., Kaplan, C. S., and Clarke, C. L. A. Bimanual and unimanual image alignment: An evaluation of mouse-based techniques. In Proceedings of UIST '05, pages 123--131, New York, NY, USA, 2005. ACM Press.

Digital Library

[21]

Latulipe, C., Mann, S., Kaplan, C. S., and Clarke, C. L. A. symspline: Symmetric two-handed spline manipulation. In Proceedings of CHI, pages 349--358, New York, NY, USA, 2006. ACM Press.

Digital Library

[22]

Lee, S., Buxton, W., and Smith, K. C. A multi-touch three dimensional touch-sensitive tablet. In Proceedings of CHI '85, pages 21--25, New York, NY, USA, 1985. ACM Press.

Digital Library

[23]

Malik, S. An Exploration of Multi-finger Interaction on Multi-touch Surfaces. PhD thesis, University of Toronto, 2007.

Digital Library

[24]

Malik, S. and Laszlo, J. Visual touchpad: A Toronto, 2007. ICMI '04, pages 289--296. ACM Press, 2004.

Digital Library

[25]

Malik, S., Ranjan, A., and Balakrishnan, R. Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In Proceedings of UIST '05, pages 43--52. ACM Press, 2005.

Digital Library

[26]

Matsushita, N. and Rekimoto, J. Holowall: Designing a finger, hand, body, and object sensitive wall. In Proceedings of UIST '97, pages 209--210. ACM Press, 1997.

Digital Library

[27]

Morris, M. R., Huang, A., Paepcke, A., and Winograd, T. Cooperative gestures: Multi-user gestural interactions for co-located groupware. In Proceedings of CHI, pages 1201--1210, New York, NY, USA, 2006. ACM Press.

Digital Library

[28]

Moscovich, T. and Hughes, J. F. Multi-finger cursor techniques. In GI '06: Proceedings of the 2006 conference on Graphics interface, pages 1--7, Quebec, Canada, 2006.

Digital Library

[29]

Rekimoto, J. Smartskin: An infrastructure for freehand manipulation on interactive surfaces. In Proceedings of CHI 2002, pages 113--120. ACM Press, 2002.

Digital Library

[30]

Santello, M., Flanders, M., and Soechting, J. F. Postural hand synergies for tool use. The Journal of Neuroscience, 18:10105--10115, 1998.

[31]

Schieber, M. H. and Santello, M. Hand function: Peripheral and central constraints on performance. Journal of Applied Physiology, 6:2293--2300, 1996.

[32]

Tactiva Inc. TactaPad.

[33]

Ullmer, B. and Ishii, H. The metadesk: Models and prototypes for tangible user interfaces. In Proceedings of UIST '97, pages 223--232. ACM Press, 1997.

Digital Library

[34]

Vlack, K., Mizota, T., Kawakami, N., Kamiyama, K., Kajimoto, H., and Tachi, S. Gelforce: a vision-based traction field computer interface. In CHI '05 extended abstracts., pages 1154--1155, New York, NY, USA, 2005. ACM Press.

Digital Library

[35]

Wang, Y., MacKenzie, C. L., Summers, V. A., and Booth, K. S. The structure of object transportation and orientation in human-computer interaction. In Proceedings of CHI, pages 312--319, New York, NY, USA, 1998. ACM Press.

Digital Library

[36]

Weigelt, C. and de Oliveira, S. C. Visuomotor transformations affect bimanual coupling. Experimental Brain Research, 148, 2003.

[37]

Wilson, A. D. Touchlight: An imaging touch screen and display for gesture-based interaction. International Conference on Multimodal Interfaces, 2004.

Digital Library

[38]

Wilson, A. D. Flowmouse: A computer vision-based pointing and gesture input device. In Interact '05, 2005.

Digital Library

[39]

Worringham, C. J. and Beringer, D. B. Directional stimulus-response compatibility: A test of three alternative principles. Ergonomics, 41(6):864--880, 1998.

[40]

Wu, M. and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In ACM UIST, pages 193--202, 2003.

Digital Library

[41]

Wu, M., Shen, C., Ryall, K., Forlines, C., and Balakrishnan, R. Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. In First IEEE International Workshop on Horizontal Interactive Human-Computer Systems, TableTop 2006, 2006.

Digital Library

[42]

Zhai, S. and Milgram, P. Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices. In Proceedings of CHI, pages 320--327, New York, NY, USA, 1998. ACM Press.

Digital Library

Cited By

Goguey AOrtega M(2023)Studies and guidelines for two concurrent stroke gesturesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102942170:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102942
XIN YLIU RLI Y(2020)Strategy for Improving Target Selection Accuracy in Indirect Touch InputIEICE Transactions on Information and Systems10.1587/transinf.2019EDP7218E103.D:7(1703-1709)Online publication date: 1-Jul-2020
https://doi.org/10.1587/transinf.2019EDP7218
Williams AGarcia JOrtega F(2020)Understanding Multimodal User Gesture and Speech Behavior for Object Manipulation in Augmented Reality Using ElicitationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302356626:12(3479-3489)Online publication date: Dec-2020
https://doi.org/10.1109/TVCG.2020.3023566
Show More Cited By

Index Terms

Indirect mappings of multi-touch input using one and two hands
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
    2. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Direct and indirect multi-touch interaction on a wall display
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-Machine

Multi-touch wall displays allow to take advantage of co-located interaction (direct interaction) on very large surfaces. However interacting with content beyond arms' reach requires body movements, introducing fatigue and impacting performance. ...
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen Tilt
MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia

Digital video technologies have been changing dramatically in the field of media production but reduced the tangibility of working with film. One interesting approach to get back such tangibility in digital systems is using pen and touch interactions. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2008

1870 pages

ISBN:9781605580111

DOI:10.1145/1357054

General Chairs:
Mary Czerwinski
Microsoft Research, USA
,
Arnie Lund
Microsoft, USA
,
Program Chair:
Desney Tan
Microsoft Research, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '08

Sponsor:

CHI '08: CHI Conference on Human Factors in Computing Systems

April 5 - 10, 2008

Florence, Italy

Acceptance Rates

CHI '08 Paper Acceptance Rate 157 of 714 submissions, 22%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

60
Total Citations
View Citations
2,801
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Goguey AOrtega M(2023)Studies and guidelines for two concurrent stroke gesturesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102942170:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102942
XIN YLIU RLI Y(2020)Strategy for Improving Target Selection Accuracy in Indirect Touch InputIEICE Transactions on Information and Systems10.1587/transinf.2019EDP7218E103.D:7(1703-1709)Online publication date: 1-Jul-2020
https://doi.org/10.1587/transinf.2019EDP7218
Williams AGarcia JOrtega F(2020)Understanding Multimodal User Gesture and Speech Behavior for Object Manipulation in Augmented Reality Using ElicitationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302356626:12(3479-3489)Online publication date: Dec-2020
https://doi.org/10.1109/TVCG.2020.3023566
Ortega FWilliams ATarre KBarreto ARishe N(2020)3D Travel Comparison Study between Multi-Touch and GamePadInternational Journal of Human–Computer Interaction10.1080/10447318.2020.178001636:18(1699-1713)Online publication date: 2-Jul-2020
https://doi.org/10.1080/10447318.2020.1780016
Butkiewicz TStevens AWare CAndrews STatarchuk N(2019)Multi-touch 3D positioning with the pantograph techniqueProceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games10.1145/3306131.3317014(1-9)Online publication date: 21-May-2019
https://dl.acm.org/doi/10.1145/3306131.3317014
Ortega FGalvan ATarre KBarreto ARishe NBernal JBalcazar RThomas J(2017)Gesture elicitation for 3D travel via multi-touch and mid-Air systems for procedurally generated pseudo-universe2017 IEEE Symposium on 3D User Interfaces (3DUI)10.1109/3DUI.2017.7893331(144-153)Online publication date: 2017
https://doi.org/10.1109/3DUI.2017.7893331
Isenberg T(2017)Interactive Exploration of Three-Dimensional Scientific Visualizations on Large Display SurfacesCollaboration Meets Interactive Spaces10.1007/978-3-319-45853-3_6(97-123)Online publication date: 10-Jan-2017
https://doi.org/10.1007/978-3-319-45853-3_6
Saidi HSerrano MDubois EPaternò FVäänänen KChurch KHäkkilä JKrüger ASerrano M(2016)Investigating the effects of splitting detailed views in Overview+Detail interfacesProceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/2935334.2935341(180-184)Online publication date: 6-Sep-2016
https://dl.acm.org/doi/10.1145/2935334.2935341
Palleis HNiedermeier VCostabile MBuono PMatera M(2016)Exploring Two-handed Indirect Multi-touch Input for a Docking TaskProceedings of the International Working Conference on Advanced Visual Interfaces10.1145/2909132.2909285(36-39)Online publication date: 7-Jun-2016
https://dl.acm.org/doi/10.1145/2909132.2909285
Tiefenbacher PChouchane AMerget DSchenk SRigoll GKaye JDruin ALampe CMorris DHourcade J(2016)Biomechanics of Thumb Touch Gestures on Handheld DevicesProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2892294(3227-3233)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2851581.2892294
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents