research-article

Direct manipulation and the third dimension: co-planar dragging on 3d displays

Authors:

Patrick Zimmer,

Jan BorchersAuthors Info & Claims

ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

Pages 11 - 20

https://doi.org/10.1145/2396636.2396639

Published: 11 November 2012 Publication History

Abstract

Recent advances in touch and display technologies are supporting a wide-spread use of touch-based direct manipulation techniques as well as 3D displays that give a perspectively correct view. Both techniques have consistency constraints including the following: With direct manipulation, a dragged object should stick to the finger tip. With viewer centered projection, head movement should update the scene's projection to preserve a sound 3D impression, e.g., leaning around a house should reveal its backyard. Unfortunately, these two contradict each other, making a combination, e.g., moving the head while touching or dragging an object, non-trivial. We introduce a design space of perspectively adjusted methods for direct manipulation to cope with this limitation, select nine different strategies from it, and evaluate six of them in depth. Participants dragged a box through a 3D maze with multiple, partially occluded levels. We identified one method to be among the fastest while yielding up to 32% less collisions than the other fast methods.

Supplementary Material

suppl.mov (its0118-file3.m4v)

Supplemental video

Download
31.31 MB

References

[1]

Maneesh Agrawala, Andrew C. Beers, Ian McDowall, Bernd Fröhlich, Mark Bolas, and Pat Hanrahan. The Two-User Responsive Workbench: Support for Collaboration Through Individual Views of a Shared Space. Proc. SIGGRAPH '97, pages 332--388.

Digital Library

[2]

Doug A Bowman, Ernst Kruijff, and Joseph J. Laviola. 3D User Interfaces: Theory and Practice, page 157. Addison-Wesley Longman, Amsterdam, 2005.

Digital Library

[3]

Li-Wei Chan, Hui-Shan Kao, Mike Y Chen, Ming-Sui Lee, Jane Hsu, and Yi-Ping Hung. Touching the Void: Direct-Touch Interaction for Intangible Displays. Proc. CHI '10, pages 2625--2634.

Digital Library

[4]

Carolina Cruz-Neira, Daniel J Sandin, Thomas A DeFanti, Robert V Kenyon, and John C Hart. The CAVE: audio visual experience automatic virtual environment. Communications of the ACM, 35(6):64--72.

Digital Library

[5]

Marek Czernuszenko, Dave Pape, Daniel Sandin, Tom DeFanti, Gregory L. Dawe, and Maxine D. Brown. The ImmersaDesk and Infinity Wall projection-based virtual reality displays. Proc. SIGGRAPH '97, pages 46--49.

Digital Library

[6]

Tovi Grossman and Daniel Wigdor. Going Deeper: a Taxonomy of 3D on the Tabletop. Proc. TABLETOP '07, pages 137--144.

[7]

Martin Hachet, Benoit Bossavit, Aurélie Cohé, and Jean-Baptiste de la Riviére. Toucheo: Multitouch and Stereo Combined in a Seamless Workspace. Proc. UIST '11, pages 587--592.

Digital Library

[8]

Jefferson Y Han. Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection. Proc. UIST '05, pages 115--118.

Digital Library

[9]

Mark Hancock and Sheelagh Carpendale. Shallow-depth 3D Interaction: Design and Evaluation of one-, two- and three-touch Techniques. Proc. CHI '07, pages 1147--1156.

Digital Library

[10]

Mark Hancock and Sheelagh Carpendale. Supporting Multiple Off-Axis Viewpoints at a Tabletop Display. Proc. TABLETOP '07, pages 171--178.

[11]

Mark Hancock, Miguel Nacenta, Carl Gutwin, and Sheelagh Carpendale. The effects of changing projection geometry on the interpretation of 3D orientation on tabletops. Proc. ITS '09, pages 157--164.

Digital Library

[12]

Ottmar Hilliges, Sharam Izadi, Andrew Wilson, and Steve Hodges. Interactions in the air: adding further depth to interactive tabletops. Proc. UIST '09, pages 139--148.

Digital Library

[13]

Anthony Martinet, Gery Casiez, and Laurent Grisoni. The Design and Evaluation of 3D Positioning Techniques for Multi-touch Displays. Proc. 3DUI '10, pages 115--118.

Digital Library

[14]

Max Möllers, Patrick Zimmer, and Jan Borchers. Direct Manipulation and the Third Dimension: A Design Space for Co-Planar Dragging on 3D Displays . CHI EA '12: Workshop on the 3rd dimension of CHI.

[15]

Jason L Reisman, Philip L Davidson, and Jefferson Y Han. A Screen-Space Formulation for 2D and 3D Direct Manipulation. Proc. UIST '09, pages 69--78.

Digital Library

[16]

Ben Shneiderman. Direct Manipulation: A Step Beyond Programming Languages. Computer, 16(8):57-- 69, 1983.

Digital Library

[17]

Frank Steinicke, Timo Ropinski, Gerd Bruder, and Klaus Hinrichs. Interscopic User Interface Concepts for Fish Tank Virtual Reality Systems. Proc. VR '07, pages 27--34.

[18]

Dimitar Valkov, Frank Steinicke, and Gerd Bruder. 2D Touching of 3D Stereoscopic Objects. Proc. CHI '11, pages 1353--1362.

Digital Library

[19]

Colin Ware, Kevin Arthur, and Kellogg S Booth. Fish tank virtual reality. Proc. INTERCHI '93, pages 37--42.

Digital Library

[20]

Max L Wilson, Wendy Mackay, Ed Chi, Michael Bernstein, Dan Russell, and Harold Thimbleby. RepliCHI - CHI should be replicating and validating results more: discuss. CHI EA '11, pages 463--466.

Digital Library

Cited By

Rodríguez JRomero ICodina A(2021)The Influence of NeoTrie VR’s Immersive Virtual Reality on the Teaching and Learning of GeometryMathematics10.3390/math91924119:19(2411)Online publication date: 28-Sep-2021
https://doi.org/10.3390/math9192411
Makiguchi MSakamoto DTakada HHonda KOno TGuimbretière FBernstein MReinecke K(2019)Interactive 360-Degree Glasses-Free Tabletop 3D DisplayProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347948(625-637)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347948
Mendes DCaputo FGiachetti AFerreira AJorge J(2018)A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual EnvironmentsComputer Graphics Forum10.1111/cgf.1339038:1(21-45)Online publication date: 14-Apr-2018
https://doi.org/10.1111/cgf.13390
Show More Cited By

Index Terms

Direct manipulation and the third dimension: co-planar dragging on 3d displays
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

A screen-space formulation for 2D and 3D direct manipulation
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

Rotate-Scale-Translate (RST) interactions have become the de facto standard when interacting with two-dimensional (2D) contexts in single-touch and multi-touch environments. Because the use of RST has thus far focused almost entirely on 2D, there are ...
Direct manipulation video navigation on touch screens
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

Direct Manipulation Video Navigation (DMVN) systems allow a user to directly drag an object of interest along its motion trajectory and have been shown effective for space-centric video browsing tasks. This paper designs touch-based interface techniques ...
Direct Manipulation in Tactile Displays
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Tactile displays have predominantly been used for information transfer using patterns or as assistive feedback for interactions. With recent advances in hardware for conveying increasingly rich tactile information that mirrors visual information, and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

November 2012

430 pages

ISBN:9781450312097

DOI:10.1145/2396636

General Chairs:
Orit Shaer
Wellesley College, USA
,
Chia Shen
Harvard University, USA
,
Program Chairs:
Meredith Ringel Morris
Microsoft Research, USA
,
Michael Horn
Northwestern University, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS'12

Sponsor:

SIGCHI

ITS'12: Interactive Tabletops and Surfaces

November 11 - 14, 2012

Massachusetts, Cambridge, USA

Acceptance Rates

ITS '12 Paper Acceptance Rate 24 of 63 submissions, 38%;

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
292
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rodríguez JRomero ICodina A(2021)The Influence of NeoTrie VR’s Immersive Virtual Reality on the Teaching and Learning of GeometryMathematics10.3390/math91924119:19(2411)Online publication date: 28-Sep-2021
https://doi.org/10.3390/math9192411
Makiguchi MSakamoto DTakada HHonda KOno TGuimbretière FBernstein MReinecke K(2019)Interactive 360-Degree Glasses-Free Tabletop 3D DisplayProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347948(625-637)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347948
Mendes DCaputo FGiachetti AFerreira AJorge J(2018)A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual EnvironmentsComputer Graphics Forum10.1111/cgf.1339038:1(21-45)Online publication date: 14-Apr-2018
https://doi.org/10.1111/cgf.13390
Kulik AKunert AKeil MFroehlich B(2018)RST 3D: A Comprehensive Gesture Set for Multitouch 3D Navigation2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR.2018.8447554(363-370)Online publication date: Mar-2018
https://doi.org/10.1109/VR.2018.8447554
Louvet JFleury CKranzlmüller DKlinker G(2016)Combining bimanual interaction and teleportation for 3D manipulation on multi-touch wall-sized displaysProceedings of the 22nd ACM Conference on Virtual Reality Software and Technology10.1145/2993369.2993390(283-292)Online publication date: 2-Nov-2016
https://dl.acm.org/doi/10.1145/2993369.2993390
Nacenta MHancock MGutwin CCarpendale S(2016)The Effects of Changing Projection Geometry on Perception of 3D Objects on and Around TabletopsACM Transactions on Computer-Human Interaction10.1145/284508123:2(1-54)Online publication date: 28-May-2016
https://dl.acm.org/doi/10.1145/2845081
Giesler AValkov DHinrichs KWilson ASteinicke FSuma EStuerzlinger W(2014)Void shadowsProceedings of the 2nd ACM symposium on Spatial user interaction10.1145/2659766.2659779(104-112)Online publication date: 4-Oct-2014
https://dl.acm.org/doi/10.1145/2659766.2659779
Martinez Plasencia DKarnik AMartinez Muñoz JSubramanian SQuigley ADiamond SIrani PSubramanian S(2014)PortallaxProceedings of the 16th international conference on Human-computer interaction with mobile devices & services10.1145/2628363.2628392(145-154)Online publication date: 23-Sep-2014
https://dl.acm.org/doi/10.1145/2628363.2628392
Mendes DFonseca FAraujo BFerreira AJorge J(2014)Mid-air interactions above stereoscopic interactive tables2014 IEEE Symposium on 3D User Interfaces (3DUI)10.1109/3DUI.2014.6798833(3-10)Online publication date: Mar-2014
https://doi.org/10.1109/3DUI.2014.6798833

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten