Article

Free access

A survey of design issues in spatial input

Authors:

Neal F. KassellAuthors Info & Claims

UIST '94: Proceedings of the 7th annual ACM symposium on User interface software and technology

Pages 213 - 222

https://doi.org/10.1145/192426.192501

Published: 02 November 1994 Publication History

Abstract

We present a survey of design issues for developing effective free-space three-dimensional (3D) user interfaces. Our survey is based upon previous work in 3D interaction, our experience in developing free-space interfaces, and our informal observations of test users. We illustrate our design issues using examples drawn from instances of 3D interfaces.

For example, our first issue suggests that users have difficulty understanding three-dimensional space. We offer a set of strategies which may help users to better perceive a 3D virtual environment, including the use of spatial references, relative gesture, two-handed interaction, multisensory feedback, physical constraints, and head tracking. We describe interfaces which employ these strategies.

Our major contribution is the synthesis of many scattered results, observations, and examples into a common framework. This framework should serve as a guide to researchers or systems builders who may not be familiar with design issues in spatial input. Where appropriate, we also try to identify areas in free-space 3D interaction which we see as likely candidates for additional research.

An extended and annotated version of the references list for this paper is available on-line through mosaic at address http://uvacs.cs.virginia.edu/~kph2q/.

References

[1]

Adelstein, B., Johnston, E., Ellis, S., "A Testbed for Characterizing Dynamic Response of Virtual Environment Spatial Sensors," UIST'92, 15-22.

Digital Library

[2]

Badler, N., Manoochehri, K., Baraff, D. "Multi- Dimensional Input Techniques and Articulated Figure Positioning by Multiple Constraints," ACM Workshop on Interactive 3D Graphics, 1986, pp. 151-170.

Digital Library

[3]

T. Baudel, M. Beaudouin-Lafon, "Charade: Remote Control of Objects Using Hand Gestures," Communications of the ACM, 36 (7), 1993, 28-35.

Digital Library

[4]

Bergman, L., Fuchs, H., Grant, E., "Image Rendering by Adaptive Refinement," Computer Graphics, 20 (4), 1986, pp. 29-37.

Digital Library

[5]

Bier, E. A., Stone, M. C., "Snap-Dragging," Computer Graphics, 20 (4), 1986, pp. 233-240.

Digital Library

[6]

Bier, E. A., "Snap-Dragging In Three Dimensions," Proc. 1990 Symposium on Interactive 3D Graphics, Computer Graphics, 24 (2), pp. 193-204.

Digital Library

[7]

Bier, E., Stone, M., Pier, K., Buxton, W., DeRose, T., "Toolglass and Magic Lenses: The See-Through Interface," SIGGRAPH '93, pp. 73-80.

Digital Library

[8]

Bolt, R., "Put-That-There: Voice and Gesture at the Graphics Interface," SIGG~H '80, 262-70.

Digital Library

[9]

Bolt, R. A., Herranz, E., "Two-Handed Gesture in Multi-Modal Natural Dialog," UIST '92, pp. 7-13.

Digital Library

[10]

Brooks, F. P. Jr., "Walkthrough--a Dynamic Graphics System for Simulating Virtual Buildings," Proc. ACM Workshop on Interactive 3D Graphics, 1986, pp. 9-21.

Digital Library

[11]

Brooks, F., "Grasping Reality Through Illusion: Interactive Graphics Serving Science," CHI'88.

Digital Library

[12]

Brooks, F., Ouh-Young, M., Batter, J., Kilpatrick, P., "Project GROPE--Haptic Displays for Scien-tific Visualization," Comp. Graph. 24 (4), 1990.

Digital Library

[13]

Bryson, S., Levit, C., "The Virtual Wind Tunnel," IEEE CG&A, July 1992, pp. 25-34.

Digital Library

[14]

Butterworth, J., Davidson, A., Hench, S., Olano, T. M., "3DM: A Three Dimensional Modeler Using a Headmounted Display," Proc. 1992 Symp. on Interactive 3D Graphics, pp. 135-138.

Digital Library

[15]

Buxton, W., Myers, B., "A Study in Two-Handed Input," CHI'86, pp. 321-326.

Digital Library

[16]

Card, S., Mackinlay, J., Robertson, G., "The Design Space of Input Devices," CHI'89, 117-124.

Digital Library

[17]

Card, S., Robertson, G., Mackinlay, J., "The Information Visualizer, an Information Workspace," CHI'91, pp. 181-187.

Digital Library

[18]

Chung, J. C., "A comparison of Head-tracked and Non-head-tracked Steering Modes in the Targeting of Radiotherapy Treatment Beams," Proc. 1992 Symp. on Interactive 3D Graphics, 193-196.

Digital Library

[19]

Cohen, P., Sullivan, J., "Synergistic Use of Direct Manipulation and Natural Language," CHi'89, pp. 227-233.

Digital Library

[20]

Conner, D., Snibbe, S., Herndon, K., Robbins, D., Zeleznik, R., van Dam, A., "Three-Dimensional Widgets," 1992 Symp. on Int. 3D Graph, 183-188.

Digital Library

[21]

Cruz-Neira, C., Sandin, D., DeFanti, T., "Surround- Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE," SIGGRAPH '93, pp. 135-142.

Digital Library

[22]

M. Deering, "High Resolution Virtual Reality," Computer Graphics, 26 (2), pp. 195-202.

Digital Library

[23]

Feiner, S., Maclntyre, B., Haupt, M., Solomon, E., "Windows on the World: 2D Windows for 3D Augmented Reality," UIST'93, pp. 145-155.

Digital Library

[24]

Feiner, S., Macintyre, B., Seligmann, D., "Knowlege- Based Augmented Reality," Comm. of the ACM, 36 (7), 1993, pp. 53-61.

Digital Library

[25]

Feiner, S., Shamash, A., "Hybrid User Interfaces: Breeding Virtually Bigger Interfaces for Physically Smaller Computers," UIST '91, pp. 9-17.

Digital Library

[26]

S.S. Fisher, M. McGreevy, J. Humphries, W. Robinett, "Virtual Interface Environment for Telepresence Applications," Oct. 1988, Proc. Human Factors Society 32nd Annual Meeting.

[27]

Fitzmaurice, G. W., "Situated Information Spaces and Spatially Aware Palmtop Computers," Comm. of the ACM, 36 (7), 1993, pp. 39-49.

Digital Library

[28]

Foley, J. D., Wallace, V., Chan, P., "The Human Factors of Computer Graphics Interaction Techniques," iEEE CG&A, Nov. 1984, pp. 13-48.

Digital Library

[29]

Galyean, T. A., Hughes, J. F., "Sculpting: An Interactive Volumetric Modeling Technique," Computer Graphics, 25 (4), pp. 267-274.

Digital Library

[30]

Gibson, J., The Ecological Approach to Visual Perception. Lawrence Efibaum, Hillsdale, NJ.

[31]

Gleicher, M., "Supporting Numerical Computations in Interactive Contexts," Graphics Interface '93.

[32]

Guiard, Y., "Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model," The Journal of Motor Behavior, 19 (4), 1987, pp. 486-517.

[33]

Hauptmann, A. G., "Speech and Gestures for Graphic Image Manipulation," CHI'89, 241-245.

Digital Library

[34]

Herndon, K., Zeleznik, R., Robbins, D., Conner, B., Snibbe, S., van Dam, A., "Interactive Shadows," UIST '92, pp. 1-6.

Digital Library

[35]

Hinckley, K., Pausch, R, Goble, J., Kassell, N., "Passive Real-World Interface Props for Neurosurgical Visualization," CHI'94, 452-458.

Digital Library

[36]

Iwata, H., "Artificial Reality with Force-feedback: Development of Desktop Virtual Space with Compact Master Manipulator," Computer Graphics, 24 (4), pp. 165-170.

Digital Library

[37]

Jacob, R., Sibert, L., "The Perceptual Structure of Multidimensional Input Device Selection," CHI'92, pp. 211-218.

Digital Library

[38]

Kabbash, P., MacKenzie, I. S., Buxton, W., "Human Performance Using Computer Input Devices in the Preferred and Non-Preferred Hands," INTERCHI'93, pp. 474-481.

Digital Library

[39]

Kabbash, P., Buxton, W., Sellen, A., "Two-Handed Input in a Compound Task," CHI'94, pp. 417-423.

Digital Library

[40]

Kaufman, A., Yagel, R., "Tools for Interaction in Three Dimensions," Proc. 3rd International Conf. on HCI (Boston, MA), Vol. 1, Sept. 1989, pp. 468~475.

Digital Library

[41]

Krueger, M., "Environmental Technology: Making the Real World Virtual," Communications of the ACM, 36 (7), 1993, pp. 36-37.

Digital Library

[42]

Liang, J., Shaw, C., Green, M., "On Temporal-Spatial Realism in the Virtual Reality Environment," UIST'91, pp. 19-25.

Digital Library

[43]

Liang, J., Green, M., "JDCAD: A Highly Interactive 3D Modeling System," 3rd International Conference on CAD and Computer Graphics, Beijing, China, Aug. 1993, 217-222.

[44]

Mackinlay, J., Card, S., Robertson, G., "Rapid Controlled Movement Through a Virtual 3D Workspace," Comp. Grap., 24 (4), 1990, 171-176.

Digital Library

[45]

McKenna, M., "Interactive Viewpoint Control and Three-dimensional Operations," Proc. 1992 Symposium on Interactive 3D Graphics, pp. 53-56.

Digital Library

[46]

Minsky, M., Ouh-young, M., Brooks, F. P., Behensky, M., "Feeling and Seeing: Issues in Force Display," Comp. Graph., 24 (2), 234-244.

Digital Library

[47]

Nielsen, J., "Noncommand User Interfaces," Communications of the ACM, 36 (4), pp. 83-99.

Digital Library

[48]

Norman D., The Design of Everyday Things. Doubleday: New York, New York, 1990.

[49]

Ostby, E., "Describing Free-Form 3D Surfaces for Animation," Proc. ACM Workshop on interactive 3D Graphics, Oct. 1986, pp. 251-258.

Digital Library

[50]

Pausch, R., "Support for Rapid Prototyping of Twoand Three-Dimensional User Interfaces," Proposal for ARPA BAA 93-42. Comp. Science Department, University of Virginia, March, 1994.

[51]

Pausch, R., Shackelford, M. A., Proffitt, D., "A User Study Comparing Head-Mounted and Stationary Displays," Proc. IEEE Symposium on Research Frontiers in Virtual Reality, Oct. 1993.

[52]

Pixsys Inc., 3522 22nd St., Boulder, CO 80304. (303) 443-0771.

[53]

Polhemus Navigation Sciences, Inc., P. O. Box 560, Colchester, VT 05446. (802) 655-3159.

[54]

Sachs, E., Roberts, A., Stoops, D., "3-Draw: A Tool for Designing 3D Shapes," IEEE Computer Graphics & Applications, Nov. 1991, pp. 18-26.

Digital Library

[55]

Schmandt, C. M., "Spatial Input/Display Correspondence in a Stereoscopic Computer Graphic Work Station," Computer Graphics, 17 (3), 1983, pp. 253- 262.

Digital Library

[56]

Sears, A.,Plaisant, C., Shneiderman, B., "A New Era for High Precision Touchscreens," in Advances in Human-Computer Interaction, Hartson, Hix, eds., Vol. 3, 1992, pp. 1-33.

Digital Library

[57]

Shepard, R. N., Metzler, J., "Mental Rotation of Three- Dimensional Objects," Science, Vol. 171, 1971, pp. 701-703.

[58]

Spaceball Technologies, Inc. (508) 970-0330.

[59]

Stoakley, R., Pausch, R., "Virtual Kit of Parts," unpublished manuscript, available through mosaic at http ://uvacs. cs. vi rg inia. edu/~ rws2v/p linth, html.

[60]

Sturman, D., Zeltzer, D., Pieper, S., "Hands-On Interaction with Virtual Environments," UIST'89, pp. 19-24.

Digital Library

[61]

I.E. Sutherland, "A Head-mounted Three Dimensional Display," Proc. the Fall Joint Computer Conference, 1968, pp. 757-764.

[62]

Takemura, H., Tomono, A., Kayashi, Y., "An Evaluation of 3-D Object Pointing Using a Field Sequential Stereoscopic Display," Proc. Graphics Interface '88, June 1988, pp. 112-118.

Digital Library

[63]

Taylor, R., Robinett, W., Chi, V., Brooks, F., Wright, W., Williams, R., Snyder, E., "The Nanomanipulator: A Virtual-Reality interface for a Scanning Tunneling Microscope," SIGGRAPH'93, pp. 127-134.

Digital Library

[64]

Ware, C., "Using Hand Position for Virtual Object Placement," Visual Comp., 6 (5), 1990, 245-253.

Digital Library

[65]

Ware, C., Osborne, S., "Exploration and Virtual Camera Control in Virtual Three Dimensional Environments," Comp. Graph., 24 (2), 175-183.

Digital Library

[66]

Ware, C., Arthur, K., Booth, K. S., "Fish Tank Virtual Reality," INTERCHI'93, pp. 37-41.

Digital Library

[67]

Wellner, P., "Interacting with Paper on the DigitalDesk," Communications of the ACM, 36 (7), 1993, pp. 87-97.

Digital Library

[68]

Zhai, S., Buxton, W., Milgram, P., "The "Silk Cursor": Investigating Transparency for 3D Target Acquisition," CHI'94, pp. 459-464.

Digital Library

[69]

Zimmerman, T., Lanier, J., Blanchard, C., Bryson, S., Harvill, Y., "A Hand Gesture Interface Device," CHI+GI'87, pp. 189-192.

Digital Library

Cited By

Yeo AKwok BJoshna AChen KLee J(2024)Entering the Next Dimension: A Review of 3D User Interfaces for Virtual RealityElectronics10.3390/electronics1303060013:3(600)Online publication date: 1-Feb-2024
https://doi.org/10.3390/electronics13030600
Diaz DVernon LSkerritt EO'Neil JDuchowski AVolonte M(2024)A Comparative Study of Omnidirectional Locomotion Systems: Task Performance and User Preferences in Virtual RealityProceedings of the 17th ACM SIGGRAPH Conference on Motion, Interaction, and Games10.1145/3677388.3696326(1-11)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3677388.3696326
Alghofaili RSendhilnathan NZhang TGrossman TGlueck MJonker TLafreniere B(2024)Interactive Mediation Techniques for Error-Aware Gesture Input SystemsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670964(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670964
Show More Cited By

Index Terms

A survey of design issues in spatial input
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

Head-mounted display with mid-air tactile feedback
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology

Virtual and physical worlds are merging. Currently users of head-mounted displays cannot have unobtrusive tactile feedback while touching virtual objects. We present a mid-air tactile feedback system for head-mounted displays. Our prototype uses the ...
Pinch-drag-flick vs. spatial input: rethinking zoom & pan on mobile displays
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

The multi-touch-based pinch to zoom, drag and flick to pan metaphor has gained wide popularity on mobile displays, where it is the paradigm of choice for navigating 2D documents. But is finger-based navigation really the gold standard' In this paper, we ...
The role of kinesthetic reference frames in two-handed input performance
UIST '99: Proceedings of the 12th annual ACM symposium on User interface software and technology

We present experimental work which explores how the match (or mismatch) between the input space of the hands and the output space of a graphical display influences two-handed input performance. During interaction with computers, a direct correspondence ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '94: Proceedings of the 7th annual ACM symposium on User interface software and technology

November 1994

226 pages

ISBN:0897916573

DOI:10.1145/192426

Chairman:
Pedro Szekely
USC/ISI

Copyright © 1994 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 1994

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

7UIST94

Sponsor:

7UIST94: 7th ACM Symposium on User Interface and Software Technology

November 2 - 4, 1994

California, Marina del Rey, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

222
Total Citations
View Citations
4,136
Total Downloads

Downloads (Last 12 months)296
Downloads (Last 6 weeks)34

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yeo AKwok BJoshna AChen KLee J(2024)Entering the Next Dimension: A Review of 3D User Interfaces for Virtual RealityElectronics10.3390/electronics1303060013:3(600)Online publication date: 1-Feb-2024
https://doi.org/10.3390/electronics13030600
Diaz DVernon LSkerritt EO'Neil JDuchowski AVolonte M(2024)A Comparative Study of Omnidirectional Locomotion Systems: Task Performance and User Preferences in Virtual RealityProceedings of the 17th ACM SIGGRAPH Conference on Motion, Interaction, and Games10.1145/3677388.3696326(1-11)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3677388.3696326
Alghofaili RSendhilnathan NZhang TGrossman TGlueck MJonker TLafreniere B(2024)Interactive Mediation Techniques for Error-Aware Gesture Input SystemsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670964(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670964
Truillet CSerrano MDubois E(2024)Interaction with Physical Referents In and Around the Field of View of Optical See-Through Augmented-Reality HeadsetsProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649796(1-15)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649796
Gonzalez EChatterjee IGonzalez-Franco MColaço AAhuja K(2024)Intent-driven input device arbitration for XRExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650758(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650758
Cheng ZTang SLiu HLei Z(2023)Digital Technologies in Offsite and Prefabricated Construction: Theories and ApplicationsBuildings10.3390/buildings1301016313:1(163)Online publication date: 9-Jan-2023
https://doi.org/10.3390/buildings13010163
Rantamaa HKangas JKumar SMehtonen HJärnstedt JRaisamo R(2023)Comparison of a VR Stylus with a Controller, Hand Tracking, and a Mouse for Object Manipulation and Medical Marking Tasks in Virtual RealityApplied Sciences10.3390/app1304225113:4(2251)Online publication date: 9-Feb-2023
https://doi.org/10.3390/app13042251
Li XWang JDudley JKristensson P(2023)Swarm Manipulation in Virtual RealityProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614519(1-11)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614519
Wei JZhu KYe Y(2023)FanRay: Using Fan Mechanism in Ray-casting to Improve Target Selection in VRProceedings of the 2023 3rd International Conference on Human Machine Interaction10.1145/3604383.3604395(1-6)Online publication date: 26-May-2023
https://dl.acm.org/doi/10.1145/3604383.3604395
Gong WSantosa SGrossman TGlueck MClarke DLai F(2023)Affordance-Based and User-Defined Gestures for Spatial Tangible InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596032(1500-1514)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596032
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents