Article

Multi-finger gestural interaction with 3d volumetric displays

Authors:

Ravin BalakrishnanAuthors Info & Claims

UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technology

Pages 61 - 70

https://doi.org/10.1145/1029632.1029644

Published: 24 October 2004 Publication History

Abstract

Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive direct manipulation of objects with a 3D volumetric display. Motion tracking of the user's fingers provides for direct gestural interaction with the virtual objects, through manipulations on and around the display's hemispheric enclosure. Our techniques leverage the unique features of volumetric displays, including a 360° viewing volume that enables manipulation from any viewpoint around the display, as well as natural and accurate perception of true depth information in the displayed 3D scene. We demonstrate our techniques within a prototype 3D geometric model building application.

References

[1]

Balakrishnan, R., Fitzmaurice, G., & Kurtenbach, G. (2001). User interfaces for volumetric displays. IEEE Computer. March 2001. p. 37--45.

Digital Library

[2]

Baudel, T., & Beaudoin-Lafon, M. (1993). Charade: remote control of objects using free-hand gestures. Communications of the ACM. 36(7). p. 28--35.

Digital Library

[3]

Bowman, D., & Hodges, L. (1997). An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. ACM Symposium on Interactive 3D Graphics.

Digital Library

[4]

Bowman, D.A., Johnson, D.B., & Hodges, L.F. (1999). Testbed environment of virtual environment interaction. ACM VRST'99 Symposium on Virtual Reality Software and Technologies. p. 26--33.

Digital Library

[5]

Buxton, W., & Fitzmaurice, G.W. (1998). HMD's, Caves, & Chameleon: A human-centric analysis of interaction in virtual space. p. 64--68.

[6]

Conner, B., Snibbe, S.S., Herndon, K.P., Robbins, D., Zeleznik, R., & Dam, A.v. (1992). Three dimensional widgets. Computer Graphics. 22(4). p. 121--129.

[7]

Ebert, D., Bedwell, E., Maher, S., Smoliar, L., & Downing, E. (1999). Realizing 3D visualization using crossed-beam volumetric displays. Communications of the ACM. 42(8). p. 101--107.

Digital Library

[8]

Grossman, T., & Balakrishnan, R. (2004 - in press). Pointing at trivariate targets in 3D environments. ACM CHI Conference on Human Factors in Computing Systems.

Digital Library

[9]

Hinckley, K., Pausch, R., Goble, J.C., & Kassell, N. (1994). A survey of design issues in spatial input. ACM UIST 1994 Symposium on User Interface Software and Technology. p. 213--222.

Digital Library

[10]

Kurtenbach, G., Fitzmaurice, G., Baudel, T., & Buxton, W. (1997). The design of a GUI paradigm based on tablets, two-hands, and transparency. ACM CHI 1997 Conference on Human Factors in Computing Systems. p. 35--42.

Digital Library

[11]

Liang, J., & Green, M. (1994). JDCAD: A highly interactive 3D modelingsystem. Computers and Graphics. 18(4). p. 499--506.

[12]

Lucente, M. (1997). Interactive three-dimensional holographic displays: seeing the future in depth. Computer Graphics issue on Current, New, and Emerging Display Systems. May 1997.

Digital Library

[13]

McCauley, M.E., & Sharkey, T.J. (1992). Cybersickness: Perception of self-motion in virtual environments. Presence. 1(3). p. 311--318.

Digital Library

[14]

Mine, M. (1995). ISAAC: A virtual environment tool for the interactive construction of virtual worlds. UNC Chapel Hill Computer Science Technical Report TR95-020.

Digital Library

[15]

Mine, M. (1995). Virtual environment interaction techniques. UNC Chapel Hill Computer Science Technical Report TR95-018.

Digital Library

[16]

Patterson, R., & Martin, W. Human Stereopsis. Human Factors. 34(6). p. 669--692.

[17]

Poupyrev, I., Billinghurst, M., Weghorst, S., & Ichikawa, T. (1996). The go-go interaction technique: non-linear mapping for direct manipulation in VR. ACM UIST Symposium on User Interface Software and Technology.

Digital Library

[18]

Ware, C., & Balakrishnan, R. (1994). Reaching for objects in VR displays: Lag and frame rate. ACM Transactions on Computer-Human Interaction. 1(4). p. 331--356.

Digital Library

[19]

Ware, C., & Lowther, K. (1997). Selection using a one-eyed cursor in a fish-tank VR environment. ACM Transactions on Computer Human Interaction. 4(4). p. 309--322.

Digital Library

[20]

Zhai, S. (1995). Human performance in six degree-of-freedom input control. Ph.D. thesis. University of Toronto.

Cited By

Fernández USarasate IEzcurdia ILopez-Amo MFernández IMarzo A(2024)PointerVol: A Laser Pointer for Swept Volumetric DisplaysProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676432(1-8)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676432
Courtoux EAppert CChapuis O(2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580877
Wang GRen GHong XPeng XLi WO’Neill E(2022)Freehand Gestural Selection with Haptic Feedback in Wearable Optical See-Through Augmented RealityInformation10.3390/info1312056613:12(566)Online publication date: 2-Dec-2022
https://doi.org/10.3390/info13120566
Show More Cited By

Index Terms

Multi-finger gestural interaction with 3d volumetric displays
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices
    2. Interaction paradigms

Recommendations

The design and evaluation of selection techniques for 3D volumetric displays
UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

Volumetric displays, which display imagery in true 3D space, are a promising platform for the display and manipulation of 3D data. To fully leverage their capabilities, appropriate user interfaces and interaction techniques must be designed. In this ...
Multi-finger gestural interaction with 3D volumetric displays
SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive ...
Multi-finger gestural interaction with 3D volumetric displays

Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technology

October 2004

312 pages

ISBN:1581139578

DOI:10.1145/1029632

General Chair:
Steven K. Feiner
Columbia University
,
Program Chair:
James A. Landay
University of Washington & Intel Research

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

UIST04

Sponsor:

UIST04: 17th Annual ACM Symposium on User Interface Software and Technology

October 24 - 27, 2004

NM, Santa Fe, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

132
Total Citations
View Citations
3,471
Total Downloads

Downloads (Last 12 months)71
Downloads (Last 6 weeks)3

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fernández USarasate IEzcurdia ILopez-Amo MFernández IMarzo A(2024)PointerVol: A Laser Pointer for Swept Volumetric DisplaysProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676432(1-8)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676432
Courtoux EAppert CChapuis O(2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580877
Wang GRen GHong XPeng XLi WO’Neill E(2022)Freehand Gestural Selection with Haptic Feedback in Wearable Optical See-Through Augmented RealityInformation10.3390/info1312056613:12(566)Online publication date: 2-Dec-2022
https://doi.org/10.3390/info13120566
Naumann AMethfessel P(2022)Improving 3D-Editing Workflows via Acoustic LevitationAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3561353(1-4)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3561353
Xie YZhou RQu J(2022)Fitts’ law on the flight deck: evaluating touchscreens for aircraft tasks in actual flight scenariosErgonomics10.1080/00140139.2022.209731866:4(506-523)Online publication date: 13-Jul-2022
https://doi.org/10.1080/00140139.2022.2097318
Zhou WLi TLi SZhu Y(2022)Color-in-fist: a metaphor for color selection with mid-air interactionJournal of Visualization10.1007/s12650-021-00792-w25:1(207-218)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1007/s12650-021-00792-w
Besançon LYnnerman AKeefe DYu LIsenberg T(2021)The State of the Art of Spatial Interfaces for 3D VisualizationComputer Graphics Forum10.1111/cgf.1418940:1(293-326)Online publication date: 6-Jan-2021
https://doi.org/10.1111/cgf.14189
Ma XXing YZheng JLi XWang Q(2021)A real‐time interactive rendering method for 360° tabletop integral imaging 3D displayJournal of the Society for Information Display10.1002/jsid.101729:9(679-688)Online publication date: 29-Apr-2021
https://doi.org/10.1002/jsid.1017
Englmeier DO'Hagan JZhang MAlt FButz AHöllerer TWilliamson JLamas DSarapuu HŠmorgun IBerget G(2020)TangibleSphere – Interaction Techniques for Physical and Virtual Spherical DisplaysProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420101(1-11)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3419249.3420101
Clark LBhagat ARiggs S(2020)Extending Fitts’ law in three-dimensional virtual environments with current low-cost virtual reality technologyInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2020.102413139(102413)Online publication date: Jul-2020
https://doi.org/10.1016/j.ijhcs.2020.102413
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten