research-article

Multi-touch 3D positioning with the pantograph technique

Authors:

Thomas Butkiewicz,

Andrew H. Stevens,

Colin WareAuthors Info & Claims

I3D '19: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

Article No.: 13, Pages 1 - 9

https://doi.org/10.1145/3306131.3317014

Published: 21 May 2019 Publication History

Abstract

One advantage of touch interaction is the sense of direct manipulation; there is perhaps no more-intuitive interface than just reaching out and touching virtual entities. However, direct manipulation is generally limited to objects located on the 2D display surface. For 3D spaces extending behind or in front of a touchscreen, the direct manipulation metaphor quickly falls apart. In these cases, gestures are needed to convert 2D finger positions into 3D cursor positions. This paper presents the pantograph technique, a simple two-finger interaction method for positioning a 3D cursor within mono and stereoscopic applications. The pantograph's pseudomechanical linkage between fingers and cursor provides helpful depth cues and maintains the sense of direct manipulation. Extensions to the technique, which integrate selection and other advanced actions, are explored within the context of real-world visual analysis applications. A series of human factors experiments showed that, while the pantograph technique outperformed other similar multitouch 3D positioning techniques, multi-touch was still inferior to other traditional, non-touch-based interfaces for sustained 3D positioning tasks.

Supplementary Material

ZIP File (a13-butkiewicz.zip)

Supplemental material.

Download
44.66 MB

References

[1]

Erol Aygar, Colin Ware, and David Rogers. 2018. The Contribution of Stereoscopic and Motion Depth Cues to the Perception of Structures in 3D Point Clouds. ACM Transactions on Applied Perception (TAP) 15, 2 (2018), 9.

Digital Library

[2]

Hrvoje Benko and Steven Feiner. 2007. Balloon Selection: A Multi-finger Technique for Accurate Low-Fatigue 3D Selection. In 3D User Interfaces, 2007. 3DUI'07. IEEE Symposium on. IEEE.

[3]

Hrvoje Benko, Andrew D Wilson, and Patrick Baudisch. 2006. Precise Selection Techniques for Multi-Touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1263--1272.

Digital Library

[4]

Thomas Butkiewicz. 2012. A More Flexible Approach to Utilizing Depth Cameras for Hand & Touch Interaction. International Journal of Virtual Reality (IJVR) 11, 3 (2012), 53--57.

[5]

Thomas Butkiewicz and Colin Ware. 2011. Multi-Touch 3D Exploratory Analysis of Ocean Flow Models. In OCEANS 2011. IEEE, 1--10.

[6]

Stuart K Card, Jock D Mackinlay, and George G Robertson. 1991. A Morphological Analysis of the Design Space of Input Devices. ACM Transactions on Information Systems (TOIS) 9, 2 (1991), 99--122.

Digital Library

[7]

Chi Tai Dang, Martin Straub, and Elisabeth André. 2009. Hand Distinction for MultiTouch Tabletop Interaction. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM, 101--108.

Digital Library

[8]

Florian Echtler, Manuel Huber, and Gudrun Klinker. 2008. Shadow Tracking on MultiTouch Tables. In Proceedings of the Working Conference on Advanced Visual Interfaces. ACM, 388--391.

Digital Library

[9]

Paul M Fitts. 1954. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Psychology 47, 6 (1954), 381.

[10]

Chi-Wing Fu, Wooi-Boon Goh, and Junxiang Allen Ng. 2010. Multi-Touch Techniques for Exploring Large-Scale 3D Astrophysical Simulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2213--2222.

Digital Library

[11]

Martin Hachet, Benoit Bossavit, Aurélie Cohé, and Jean-Baptiste de la Rivière. 2011. Toucheo: Multitouch and Stereo Combined in a Seamless Workspace. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. ACM, 587--592.

Digital Library

[12]

Mark Hancock, Sheelagh Carpendale, and Andy Cockburn. 2007. Shallow-Depth 3D Interaction: Design and Evaluation of One-, Two- and Three-Touch Techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1147--1156.

Digital Library

[13]

Mark Hancock, Thomas Ten Cate, and Sheelagh Carpendale. 2009. Sticky Tools: Full 6DOF Force-Based Interaction for Multi-Touch Tables. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM, 133--140.

Digital Library

[14]

David M Hoffman, Ahna R Girshick, Kurt Akeley, and Martin S Banks. 2008. Vergence-Accommodation Conflicts Hinder Visual Performance and Cause Visual Fatigue. Journal of Vision 8, 3 (2008), 33.

[15]

Robert JK Jacob, Linda E Sibert, Daniel C McFarlane, and M Preston Mullen Jr. 1994. Integrality and Separability of Input Devices. ACM Transactions on Computer-Human Interaction (TOCHI) 1, 1 (1994), 3--26.

Digital Library

[16]

David López, Lora Oehlberg, Candemir Doger, and Tobias Isenberg. 2016. Towards an Understanding of Mobile Touch Navigation in a Stereoscopic Viewing Environment for 3D Data Exploration. IEEE Transactions on Visualization and Computer Graphics 22, 5 (2016), 1616--1629.

Digital Library

[17]

Anthony Martinet, Gery Casiez, and Laurent Grisoni. 2010a. The design and evaluation of 3D positioning techniques for multi-touch displays. In 3D User Interfaces (3DUI), 2010 IEEE Symposium on. IEEE, 115--118.

Digital Library

[18]

Anthony Martinet, Géry Casiez, and Laurent Grisoni. 2010b. The Effect of DOF Separation in 3D Manipulation Tasks with Multi-Touch Displays. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology. ACM, 111--118.

Digital Library

[19]

Meredith Ringel Morris, Jacob O Wobbrock, and Andrew D Wilson. 2010. Understanding Users' Preferences for Surface Gestures. In Proceedings of Graphics Interface 2010. Canadian Information Processing Society, 261--268.

Digital Library

[20]

Tomer Moscovich and John F Hughes. 2008. Indirect Mappings of Multi-Touch Input Using One and Two Hands. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1275--1284.

Digital Library

[21]

Jeffrey S Pierce, Andrew S Forsberg, Matthew J Conway, Seung Hong, Robert C Zeleznik, and Mark R Mine. 1997. Image Plane Interaction Techniques in 3D Immersive Environments. In Proceedings of the 1997 Symposium on Interactive 3D Graphics. ACM, 39--ff.

Digital Library

[22]

Richard L Potter, Linda J Weldon, and Ben Shneiderman. 1988. Improving the Accuracy of Touch Screens: An Experimental Evaluation of Three Strategies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 27--32.

Digital Library

[23]

Johannes Schöning, Frank Steinicke, Antonio Krüger, Klaus Hinrichs, and Dimitar Valkov. 2009. Bimanual Interaction with Interscopic Multi-Touch Surfaces. In IFIP Conference on Human-Computer Interaction. Springer, 40--53.

Digital Library

[24]

Adalberto L Simeone. 2016. Indirect Touch Manipulation for Interaction with Stereoscopic Displays. In 3D User Interfaces (3DUI), 2016 IEEE Symposium on. IEEE, 13--22.

[25]

Adalberto L Simeone and Hans Gellerseny. 2015. Comparing Indirect and Direct Touch in a Stereoscopic Interaction Task. In 3D User Interfaces (3DUI), 2015 IEEE Symposium on. IEEE, 105--108.

[26]

Frank Stenicke, Timo Ropinski, Gerd Bruder, and Klaus Hinrichs. 2007. Interscopic User Interface Concepts for Fish Tank Virtual Reality Systems. In Virtual Reality Conference, 2007. VR'07. IEEE, 27--34.

[27]

Sven Strothoff, Dimitar Valkov, and Klaus Hinrichs. 2011. Triangle Cursor: Interactions with Objects Above the Tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM, 111--119.

Digital Library

[28]

Dan Venolia. 1993. Facile 3D Direct Manipulation. In Proceedings of the INTERACT'93 and CHI'93 Conference on Human Factors in Computing Systems. ACM, 31--36.

Digital Library

[29]

Colin Ware, Kevin Arthur, and Kellogg S Booth. 1993. Fish Tank Virtual Reality. In Proceedings of the INTERACT'93 and CHI'93 Conference on Human Factors in Computing Systems. ACM, 37--42.

Digital Library

[30]

Colin Ware and Ravin Balakrishnan. 1994. Reaching for Objects in VR Displays: Lag and Frame Rate. ACM Transactions on Computer-Human Interaction (TOCHI) 1, 4 (1994), 331--356.

Digital Library

[31]

Colin Ware and Danny R Jessome. 1988. Using the Bat: A Six-Dimensional Mouse for Object Placement. IEEE Computer Graphics and Applications 8, 6 (1988), 65--70.

Digital Library

[32]

Daniel Wigdor, Sarah Williams, Michael Cronin, Robert Levy, Katie White, Maxim Mazeev, and Hrvoje Benko. 2009. Ripples: Utilizing Per-Contact Visualizations to Improve User Interaction with Touch Displays. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. ACM, 3--12.

Digital Library

[33]

Shumin Zhai, William Buxton, and Paul Milgram. 1994. The "Silk Cursor": Investigating Transparency for 3D Target Acquisition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 459--464.

Digital Library

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Friedl‐Knirsch JPointecker FPfistermüller SStach CAnthes CRoth D(2024)A Systematic Literature Review of User Evaluation in Immersive AnalyticsComputer Graphics Forum10.1111/cgf.1511143:3Online publication date: 10-Jun-2024
https://doi.org/10.1111/cgf.15111
Pfeuffer KDinc AObernolte JRivu RAbdrabou YShelter FAbdelrahman YAlt F(2021)Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on TabletsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474741(149-161)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474741
Show More Cited By

Index Terms

Multi-touch 3D positioning with the pantograph technique
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques

Recommendations

Extending touch: towards interaction with large-scale surfaces
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

Touch is a very intuitive modality for interacting with objects displayed on arbitrary surfaces. However, when using touch for large-scale surfaces, not every point is reachable. Therefore, an extension is required that keeps the intuitivity provided by ...
Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

In this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...
Touch Your Own Device! A COVID-Safe Alternative to Multi-touch Interactions with Public Touchscreens
CHI Greece 2021: CHI Greece 2021: 1st International Conference of the ACM Greek SIGCHI Chapter

Touchscreens are a widely used medium for interacting with digital applications in public and they are found in various contexts including entertainment, culture, travel, marketing, etc. However, in the current times of COVID-19 pandemic there are ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

I3D '19: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

May 2019

152 pages

ISBN:9781450363105

DOI:10.1145/3306131

Editor:
Stephen N. Spencer
University of Washington
,
General Chairs:
Sheldon Andrews
École de Technologie Supérieure
,
Natalya Tatarchuk
Unity Technologies

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

I3D '19

Sponsor:

SIGGRAPH

I3D '19: Symposium on Interactive 3D Graphics and Games

May 21 - 23, 2019

Quebec, Montreal, Canada

Acceptance Rates

Overall Acceptance Rate 148 of 485 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
199
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)2

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Friedl‐Knirsch JPointecker FPfistermüller SStach CAnthes CRoth D(2024)A Systematic Literature Review of User Evaluation in Immersive AnalyticsComputer Graphics Forum10.1111/cgf.1511143:3Online publication date: 10-Jun-2024
https://doi.org/10.1111/cgf.15111
Pfeuffer KDinc AObernolte JRivu RAbdrabou YShelter FAbdelrahman YAlt F(2021)Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on TabletsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474741(149-161)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474741
Besançon LYnnerman AKeefe DYu LIsenberg T(2021)The State of the Art of Spatial Interfaces for 3D VisualizationComputer Graphics Forum10.1111/cgf.1418940:1(293-326)Online publication date: 6-Jan-2021
https://doi.org/10.1111/cgf.14189
Sun WHuang MYang RHan JYue Y(2021)Mental Workload Evaluation of Virtual Object Manipulation on WebVR: An EEG Study2021 14th International Conference on Human System Interaction (HSI)10.1109/HSI52170.2021.9538783(1-6)Online publication date: 8-Jul-2021
https://doi.org/10.1109/HSI52170.2021.9538783
Sun WHuang MYang RZhang JWang LHan JYue Y(2020)Workload, Presence and Task Performance of Virtual Object Manipulation on WebVR2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)10.1109/AIVR50618.2020.00073(358-361)Online publication date: Dec-2020
https://doi.org/10.1109/AIVR50618.2020.00073
Stevens AButkiewicz T(2019)Faster Multibeam Sonar Data Cleaning: Evaluation of Editing 3D Point Clouds using Immersive VROCEANS 2019 MTS/IEEE SEATTLE10.23919/OCEANS40490.2019.8962793(1-10)Online publication date: Oct-2019
https://doi.org/10.23919/OCEANS40490.2019.8962793

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents