research-article

Sticky tools: full 6DOF force-based interaction for multi-touch tables

Authors:

Thomas ten Cate,

Sheelagh CarpendaleAuthors Info & Claims

ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

Pages 133 - 140

https://doi.org/10.1145/1731903.1731930

Published: 23 November 2009 Publication History

Abstract

Tabletop computing techniques are using physically familiar force-based interactions to enable compelling interfaces that provide a feeling of being embodied with a virtual object. We introduce an interaction paradigm that has the benefits of force-based interaction complete with full 6DOF manipulation. Only multi-touch input, such as that provided by the Microsoft Surface and the SMART Table, is necessary to achieve this interaction freedom. This paradigm is realized through sticky tools: a combination of sticky fingers, a physically familiar technique for moving, spinning, and lifting virtual objects; opposable thumbs, a method for flipping objects over; and virtual tools, a method for propagating behaviour to other virtual objects in the scene. We show how sticky tools can introduce richer meaning to tabletop computing by drawing a parallel between sticky tools and the discussion in Urp [20] around the meaning of tangible devices in terms of nouns, verbs, reconfigurable tools, attributes, and pure objects. We then relate this discussion to other force-based interaction techniques by describing how a designer can introduce complexity in how people can control both physical and virtual objects, how physical objects can control both physical and virtual objects, and how virtual objects can control virtual objects.

Supplementary Material

JPG File (182.jpg)

Download
7.35 KB

MOV File (182.mov)

Download
28.73 MB

References

[1]

Agarawala, A. and Balakrishnan, R. Keepin' it real: pushing the desktop metaphor with physics, piles and the pen. In Proc. CHI, ACM (2006), 1283--1292.

Digital Library

[2]

Apitz, G. and Guimbretière, F. Crossy: a crossing-based drawing application. In Proc. UIST, ACM (2004), 3--12.

Digital Library

[3]

Bowman, D. A., Kruijff, E., LaViola, J. J., and Poupyrev, I. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, USA, 2004.

Digital Library

[4]

Cao, X., Wilson, A. D., Balakrishnan, R., Hinckley, K., and Hudson, S. E. Shapetouch: Leveraging contact shape on interactive surfaces. In Proc. Tabletop, IEEE Computer Society (2008), 129--136.

[5]

Fröhlich, B., Hochstrate, J., Skuk, V., and Huckauf, A. The globefish and the globemouse: two new six degree of freedom input devices for graphics applications. In Proc. CHI, ACM (2006), 191--199.

Digital Library

[6]

Han, J. Y. Low-cost multi-touch sensing through frustrated total internal reflection. In Proc. UIST, ACM (2005), 115--118.

Digital Library

[7]

Hancock, M., Carpendale, S., and Cockburn, A. Shallow-depth 3D interaction: Design and evaluation of one-, two- and three-touch techniques. In Proc. CHI, ACM Press (2007), 1147--1156.

Digital Library

[8]

Hancock, M. S., Carpendale, S., Vernier, F. D., Wigdor, D., and Shen, C. Rotation and translation mechanisms for tabletop interaction. In Proc. Tabletop, IEEE Computer Society (2006), 79--88.

Digital Library

[9]

Hinrichs, U., Carpendale, S., and Scott, S. D. Evaluating the effects of fluid interface components on tabletop collaboration. In Proc. AVI, ACM (2006), 27--34.

Digital Library

[10]

Isenberg, T., Miede, A., and Carpendale, S. A buffer framework for supporting responsive interaction in information visualization interfaces. In Proc. C5, IEEE Computer Society (2006), 262--269.

Digital Library

[11]

Keijser, J., Carpendale, S., Hancock, M., and Isenberg, T. Exploring 3D interaction in alternate control-display space mappings. In Proc. 3DUI (2007).

[12]

Kruger, R., Carpendale, M. S. T., Scott, S. D., and Tang, A. Fluid integration of rotation and translation. In Proc. CHI, ACM Press (2005), 601--610.

Digital Library

[13]

Kruger, R., Carpendale, S., Scott, S. D., and Greenberg, S. Roles of orientation in tabletop collaboration: Comprehension, coordination and communication. J. CSCW 13, 5--6 (2004), 501--537.

Digital Library

[14]

Liu, J., Pinelle, D., Sallam, S., Subramanian, S., and Gutwin, C. TNT: improved rotation and translation on digital tables. In Proc. GI, CIPS (2006), 25--32.

Digital Library

[15]

Malik, S., Ranjan, A., and Balakrishnan, R. Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In Proc. UIST, ACM (2005), 43--52.

Digital Library

[16]

Norman, D. A. Psychology of everyday things. Basic Books, New York, NY, 1998.

[17]

Shen, C., Lesh, N., and Vernier, F. Personal digital historian: story sharing around the table. Interactions 10, 2 (2003), 15--22.

Digital Library

[18]

Shen, C., Vernier, F. D., Forlines, C., and Ringel, M. DiamondSpin: an extensible toolkit for around-the-table interaction. In Proc. CHI, ACM (2004), 167--174.

Digital Library

[19]

Ståhl, O., Wallberg, A., Söderberg, J., Humble, J., Fahlén, L. E., Bullock, A., and Lundberg, J. Information exploration using the pond. In Proc. CVE, ACM (2002), 72--79.

Digital Library

[20]

Underkoffler, J. and Ishii, H. Urp: a luminous-tangible workbench for urban planning and design. In Proc. CHI, ACM (1999), 386--393.

Digital Library

[21]

Wilson, A. D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. Bringing physics to the surface. In Proc. UIST, ACM (2008), 67--76.

Digital Library

[22]

Wu, M. and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In Proc. UIST, ACM (2003), 193--202.

Digital Library

[23]

Zhai, S. User performance in relation to 3D input device design. SIGGRAPH Comput. Graph. 32, 4 (1998), 50--54.

Digital Library

Cited By

Lee JYoo H(2024)Interaction with Mobile Augmented Reality EnvironmentsEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_40(978-984)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_40
Yu JFeng JZhou J(2023)PrintShearProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962577:2(1-22)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596257
Sun WHuang MWu CYang RHan JYue Y(2023)Evaluating the feeling of control in virtual object translation on 2D interfacesArtificial Intelligence for Engineering Design, Analysis and Manufacturing10.1017/S089006042300003337Online publication date: 2-Mar-2023
https://doi.org/10.1017/S0890060423000033
Show More Cited By

Index Terms

Sticky tools: full 6DOF force-based interaction for multi-touch tables
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Sticky widgets: pseudo-haptic widget enhancements for multi-monitor displays
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems

People use multiple monitors to increase their display surface and to facilitate multitasking. However, if windows are maximized to fill one screen, users may have difficulties accessing widgets and tools on the borders of the displays, accidentally ...
Blurry (sticky) finger: proprioceptive pointing and selection of distant objects for optical see-through based augmented reality
ICAT-EGVE '16: Proceedings of the 26th International Conference on Artificial Reality and Telexistence and the 21st Eurographics Symposium on Virtual Environments

Most AR interaction techniques are focused on direct interaction with close objects within one's reach (e.g. using the hands). Interacting with distant objects, especially those that are real, has not received much attention. The most prevalent method is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

November 2009

240 pages

ISBN:9781605587332

DOI:10.1145/1731903

General Chairs:
Gerald Morrison
SMART Technologies, Canada
,
Sriram Subramanian
University of Bristol, UK
,
Program Chairs:
Sheelagh Carpendale
University of Calgary, Canada
,
Michael Haller
Upper Austria University of Applied Sciences, Austria
,
Stacey Scott
University of Waterloo, Canada

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

ITS'09

Sponsor:

SIGCHI

ITS'09: The ACM International Conference on Interactive Tabletops and Surfaces

November 23 - 25, 2009

Alberta, Banff, Canada

Acceptance Rates

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

113
Total Citations
View Citations
1,156
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lee JYoo H(2024)Interaction with Mobile Augmented Reality EnvironmentsEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_40(978-984)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_40
Yu JFeng JZhou J(2023)PrintShearProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962577:2(1-22)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596257
Sun WHuang MWu CYang RHan JYue Y(2023)Evaluating the feeling of control in virtual object translation on 2D interfacesArtificial Intelligence for Engineering Design, Analysis and Manufacturing10.1017/S089006042300003337Online publication date: 2-Mar-2023
https://doi.org/10.1017/S0890060423000033
Almeida DMendes DRodrigues R(2023)SIT6Computers and Graphics10.1016/j.cag.2023.10.013117:C(51-60)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.10.013
Liu CDai CMa QMehra BCassinelli A(2022)AngleCAD: Surface-Based 3D Modelling Techniques on Foldable TouchscreensProceedings of the ACM on Human-Computer Interaction10.1145/35677356:ISS(592-616)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567735
Harris DPotts DHouben S(2022)User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented RealityAdjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3528575.3551443(1-6)Online publication date: 28-Sep-2022
https://dl.acm.org/doi/10.1145/3528575.3551443
Zhang PYing WHeo S(2022)Fringer: A Finger-Worn Passive Device Enabling Computer Vision Based Force Sensing Using Moiré FringesAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558706(1-3)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558706
Sun WHuang MWu CYang R(2022)Sense of Agency in Mid-Air Translation with Head-Mounted AR2022 1st IEEE International Conference on Cognitive Aspects of Virtual Reality (CVR)10.1109/CVR55417.2022.9967506(000061-000064)Online publication date: 11-May-2022
https://doi.org/10.1109/CVR55417.2022.9967506
Pfeuffer KDinc AObernolte JRivu RAbdrabou YShelter FAbdelrahman YAlt F(2021)Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on TabletsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474741(149-161)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474741
Hellmuth CBachinski MMüller J(2021)Interaction Techniques for 3D-positioning Objects in Mobile Augmented RealityProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479945(604-612)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479945
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten