research-article

Toward compound navigation tasks on mobiles via spatial manipulation

Authors:

Abigail Sellen,

Bill BuxtonAuthors Info & Claims

MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

Pages 113 - 122

https://doi.org/10.1145/2493190.2493210

Published: 27 August 2013 Publication History

Abstract

We contrast the Chameleon Lens, which uses 3D movement of a mobile device held in the nonpreferred hand to support panning and zooming, with the Pinch-Flick-Drag metaphor of directly manipulating the view using multi-touch gestures. Lens-like approaches have significant potential because they can support navigation-selection, navigation-annotation, and other such compound tasks by off-loading navigation to the nonpreferred hand while the preferred hand annotates, marks a location, or draws a path on the screen. Our experimental results show that the Chameleon Lens is significantly slower than Pinch-Flick-Drag for the navigation subtask in isolation. But our studies also reveal that for navigation between a few known targets the lens performs significantly faster, that differences between the Chameleon Lens and Pinch-Flick-Drag rapidly diminish as users gain experience, and that in the context of a compound navigation-annotation task, the lens performs as well as Pinch-Flick-Drag despite its deficit for the navigation subtask itself.

Supplementary Material

JPG File (fp0192-file3.jpg)

Download
12.30 KB

suppl.mov (fp0192-file3.mp4)

Supplemental video

Download
34.77 MB

References

[1]

Britton, E., Lipscomb, J., Pique, M., Making Nested Rotations Convenient for the User. Computer Graphics, 1978. 12(3): p. 222--227.

Digital Library

[2]

Bury, K. F., Boyle, J., Evey, R., Neal, A., Windowing versus scrolling on a visual display terminal. Human Factors, 198 24(4): p. 385--394.

[3]

Buxton, W., Fitzmaurice, G., HMD's, Caves, & Chameleon: A human-centric analysis of interaction in virtual space. Computer Graphics, The SIGGRAPH Quarterly. 1998. p. 64--68.

Digital Library

[4]

Cauchard, J., et al., m+pSpaces: virtual workspaces in the spatially-aware mobile environment. MobileHCI 2012.

Digital Library

[5]

Chen, X. A., et al., Extending a mobile device's interaction space through body-centric interaction. MobileHCI 2012.

Digital Library

[6]

Chun Yat Li, F., Dearman, D., Truong, K. Virtual Shelves: Interactions with Orientation-Aware Devices. UIST 2009.

Digital Library

[7]

Cohen, P., et al., Synergistic use of direct manipulation and natural language. CHI 1989.

Digital Library

[8]

Fitzmaurice, G., Situated information spaces and spatially aware palmtop computers. Comm. ACM, 1993. 36(7): p. 38--49.

Digital Library

[9]

Fitzmaurice, G., Zhai, S., Chignell, M., Virtual reality for palmtop computers. ACM Trans. Inf. Syst., July 1993. 11 (3): p. 197--218.

Digital Library

[10]

Frisch, M., Heydekorn, J., Dachselt, R. Investigating multi-touch and pen gestures for diagram editing on interactive surfaces. ITS 2009.

Digital Library

[11]

Goel, M., et al., GripSense: Using Built-In Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones. UIST 2012.

Digital Library

[12]

Guiard, Y., Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. J. Motor Behavior, 1987. 19(4).

[13]

Hinckley, K., Pausch, R., Goble, J., Kassell, N., A Survey of Design Issues in Spatial Input. UIST 1994.

Digital Library

[14]

Hinckley, K., Pausch, R., Proffitt, D., Kassell, N., Two-handed virtual manipulation. ACM Trans. Comput.-Hum. Interact., 1998. 5(3).

Digital Library

[15]

Hinckley, K., Sinclair, M., Hanson, E., Szeliski, R., Conway, M. The VideoMouse: A Camera-Based Multi-Degree-of-Freedom Input Device. UIST 1999.

Digital Library

[16]

Hinckley, K., et al. Pen + Touch = New Tools. UIST 2010.

Digital Library

[17]

Jacob, R., Sibert, L. The Perceptual Structure of Multidimensional Input Device Selection. CHI 1992.

Digital Library

[18]

Jul, S., Furnas, G. Critical zones in desert fog: aids to multiscale navigation. UIST 1998.

Digital Library

[19]

Liao, C., et al., PACER: Fine-Grained Interactive Paper via Camera-Touch Hybrid Gestures on a Cell Phone. CHI 2010.

Digital Library

[20]

Pierce, J.,. Toolspaces and Glances: Storing, Accessing, and Retrieving Objects in 3D Desktop Applications. Interactive 3D Graphics. 1999.

Digital Library

[21]

Pique, M. E. Semantics of Interactive Rotation. Proc. 1986 ACM Workshop on Interactive 3D Graphics, Chapel Hill, NC.

Digital Library

[22]

Roudaut, A., et al., TimeTilt: Using Sensor-Based Gestures to Travel through Multiple Applications on a Mobile Device. Interact 2009.

Digital Library

[23]

Tan, D., et al., The Infocockpit: Providing Location and Place to Aid Human Memory. Workshop on Perceptive User Interfaces. 2001.

Digital Library

[24]

Tan, D. S., Stefanucci, J. K., Proffitt, D. R., Pausch, R. Kinesthesis Aids Human Memory. CHI 2002 Extended Abstracts.

[25]

Thorndyke, P. W., Stasz, C., Individual differences in procedures for knowledge acquisition from maps. Cog. Psych., 1980. 12 p. 137--175.

[26]

Tsang, M., et al., Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. UIST 2002.

Digital Library

[27]

Yee, K.-P. Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. CHI 2003.

Digital Library

[28]

Zhai, S., Milgram, P. Quantifying Coordination in Multiple DOF Movement and Its Application to Evaluating 6 DOF Input. CHI 1998.

Digital Library

[29]

Zhou, F., Duh, H.B.-L., Billinghurst, M. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR 2008).

Digital Library

Cited By

Kerr WJicol CHaines TLi W(2024)Camera Chameleon — The Creative Impact of Tracked Tangible Interfaces for Virtual Film Pre-Production2024 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME57554.2024.10687756(1-6)Online publication date: 15-Jul-2024
https://doi.org/10.1109/ICME57554.2024.10687756
Hubenschmid SZagermann JLeicht DReiterer HFeuchtner T(2023)ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial MemoryProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581438(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581438
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Show More Cited By

Index Terms

Toward compound navigation tasks on mobiles via spatial manipulation
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Pinch-drag-flick vs. spatial input: rethinking zoom & pan on mobile displays
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

The multi-touch-based pinch to zoom, drag and flick to pan metaphor has gained wide popularity on mobile displays, where it is the paradigm of choice for navigating 2D documents. But is finger-based navigation really the gold standard' In this paper, we ...
Tangible navigation and object manipulation in virtual environments
TEI '11: Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction

In this paper, we introduce approaches to navigating and manipulating objects in a Collaborative Virtual Environment (CVE) that engage tangible objects and an interactive table interface. We also identify three design concerns that are common to ...
Remote interaction for 3D manipulation
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

In this paper, we present a two-handed 3D interaction approach for immersive virtual reality applications on a large vertical display. The proposed interaction scheme is based on hybrid motion sensing technology that tracks the 3D position and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

August 2013

662 pages

ISBN:9781450322737

DOI:10.1145/2493190

General Chairs:
Michael Rohs
University of Hannover, Germany
,
Albrecht Schmidt
University of Stuttgart, Germany
,
Program Chairs:
Daniel Ashbrook
Samsung, USA
,
Enrico Rukzio
University of Ulm, Germany and Lancaster University, UK

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 August 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '13

Sponsor:

SIGCHI

MobileHCI '13: 15th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 27 - 30, 2013

Munich, Germany

Acceptance Rates

MobileHCI '13 Paper Acceptance Rate 53 of 238 submissions, 22%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
424
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kerr WJicol CHaines TLi W(2024)Camera Chameleon — The Creative Impact of Tracked Tangible Interfaces for Virtual Film Pre-Production2024 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME57554.2024.10687756(1-6)Online publication date: 15-Jul-2024
https://doi.org/10.1109/ICME57554.2024.10687756
Hubenschmid SZagermann JLeicht DReiterer HFeuchtner T(2023)ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial MemoryProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581438(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581438
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Kojima YIriyama TKomuro T(2022)AR Digital Workspace Using a Mobile DeviceProceedings of the 2022 ACM Symposium on Spatial User Interaction10.1145/3565970.3567690(1-2)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1145/3565970.3567690
Zhou ZZhou J(2022)Small screen-big information challenge for older adults: a study on visual momentum and gesture navigationBehaviour & Information Technology10.1080/0144929X.2022.204238542:6(744-757)Online publication date: 27-Feb-2022
https://doi.org/10.1080/0144929X.2022.2042385
Chen CLi X(2021)Visualizing Off-screen Targets: Effects of Response Time and Visual Cue Design on Users’ Wayfinding Performance Using a Dynamic Peephole InterfaceInternational Journal of Human–Computer Interaction10.1080/10447318.2021.187635637:13(1220-1230)Online publication date: 1-Feb-2021
https://doi.org/10.1080/10447318.2021.1876356
Miyazaki MKomuro T(2021)AR Peephole InterfacePervasive and Mobile Computing10.1016/j.pmcj.2021.10148978:COnline publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1016/j.pmcj.2021.101489
Chen CLi X(2020)Spatial Knowledge Acquisition with Mobile Maps: Effects of Map Size on Users’ Wayfinding Performance with Interactive InterfacesISPRS International Journal of Geo-Information10.3390/ijgi91106149:11(614)Online publication date: 22-Oct-2020
https://doi.org/10.3390/ijgi9110614
Menzner TGesslein TOtte AGrubert J(2020)Above Surface Interaction for Multiscale Navigation in Mobile Virtual Reality2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.1581107639032(372-381)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.1581107639032
Menzner TGesslein TOtte AGrubert J(2020)Above Surface Interaction for Multiscale Navigation in Mobile Virtual Reality2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.00057(372-381)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.00057
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents