research-article

A Non-linear Mapping Technique for Bare-hand Interaction in Large Virtual Environments

Authors:

Mark BillinghurstAuthors Info & Claims

OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

Pages 53 - 61

https://doi.org/10.1145/2838739.2838774

Published: 07 December 2015 Publication History

Abstract

Computer vision-based bare-hand tracking systems have become popular as they free the users from wearing any hardware devices (e.g. gloves). However, due to the limitations in tracking methods and human body constraints, interaction methods developed for other 3D interaction devices can have problems when applied to computer vision-based bare-hand tracking systems. Therefore, there is a need to develop interaction techniques suitable for bare-hand input. In this paper we investigate a non-linear mapping technique for bare-hand input in large-scale virtual environments based on physiological constraints. This method not only enables high precision interaction with objects at both near and far distances, but also allows users to manipulate objects efficiently with significant translation and rotation. Through a user study, we show that the proposed method can be fairly effective, precise, more usable, and less stressful compared to two more traditional baseline interaction techniques

References

[1]

Bowman, D., Kruijff, E., LaViola, J., and Poupyrev, I. 3D User Interfaces: Theory and Practice. Pearson Education, 2004.

Digital Library

[2]

Bowman, D. A., and Hodges, L. F. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In Proceedings of the 1997 Symposium on Interactive 3D Graphics, I3D '97, ACM (New York, NY, USA, 1997), 35--ff.

Digital Library

[3]

Bowman, D. A., Johnson, D. B., and Hodges, L. F. Test bed evaluation of virtual environment interaction techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST '99, ACM (New York, NY, USA, 1999), 26--33.

Digital Library

[4]

Bowman, D. A., Kruijff, E., and Poupyrev, I. An introduction to 3-d user interface design. In Presence: Teleoperators and Virtual Environments, MIT Press '01', MIT Press (2001), 96--108.

Digital Library

[5]

Chen, M., Mountford, S. J., and Sellen, A. A study in interactive 3-d rotation using 2-d control devices. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '88, ACM (New York, NY, USA, 1988), 121--129.

Digital Library

[6]

Faion, F., Friedberger, S., Zea, A., and Hanebeck, U. Intelligent sensor-scheduling for multi-kinect-tracking. In Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on (Oct 2012), 3993--3999.

[7]

Frees, S., Kessler, G. D., and Kay, E. Prism interaction for enhancing control in immersive virtual environments. ACM Trans. Comput.-Hum. Interact. 14, 1 (May 2007).

Digital Library

[8]

Hart, S., and Staveland, L. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Proceeding of Hancock & N. Meshkati (Eds.), Human mental workload (Amsterdam, 1988), 139--183

[9]

Hinckley, K., Tullio, J., Pausch, R., Proffitt, D., and Kassell, N. Usability analysis of 3d rotation techniques. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology, UIST '97, ACM (New York, NY, USA, 1997), 1--10.

Digital Library

[10]

Scott MacKenzie. 1992. Fitts' law as a research and design tool in human-computer interaction. Hum.-Comput. Interact. 7, 1 (March 1992), 91--139

Digital Library

[11]

Marshall, M. M., Mozrall, J. R., and Shealy, J. E. The effects of complex wrist and forearm posture on wrist range of motion. In The Journal of the Human Factors and Ergonomics Society, The Journal of the Human Factors and Ergonomics Society (1999), 205--213.

[12]

McAtamney, L., and Corlett, E. N. Rula: a survey method for the investigation of work-related upper limb disorders. Applied Ergonomics 24, 2 (1993), 91--99.

[13]

Mine, M. R., Brooks, Jr., F. P., and Sequin, C. H. Moving objects in space: Exploiting proprioception in virtual-environment interaction. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '97, ACM Press/Addison-Wesley Publishing Co. (New York, NY, USA, 1997), 19--26.

Digital Library

[14]

Mossel, A., Venditti, B., and Kaufmann, H. 3dtouch and homer-s: Intuitive manipulation techniques for one-handed handheld augmented reality. In Proceedings of the Virtual Reality International Conference: Laval Virtual, VRIC '13, ACM (New York, NY, USA, 2013), 12:1--12:10.

Digital Library

[15]

Osawa, N., and Asai, K. Adjustment and control methods for precise rotation and positioning of virtual object by hand. In Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI '10, ACM (New York, NY, USA, 2010), 131--138.

Digital Library

[16]

Pierce, J. S., Stearns, B. C., and Pausch, R. Voodoo dolls: Seamless interaction at multiple scales in virtual environments. In Proceedings of the 1999 Symposium on Interactive 3D Graphics, I3D '99, ACM (New York, NY, USA, 1999), 141--145.

Digital Library

[17]

Poupyrev, I. 3d manipulation techniques. 3D User Interface Design, Lecture Slides. SIGGRAPH (2000).

[18]

Poupyrev, I., Billinghurst, M., Weghorst, S., and Ichikawa, T. The go-go interaction technique: Non-linear mapping for direct manipulation in vr. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, UIST '96, ACM (New York, NY, USA, 1996), 79--80.

Digital Library

[19]

Poupyrev, I., Weghorst, S., and Fels, S. Non-isomorphic 3d rotational techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '00, ACM (New York, NY, USA, 2000), 540--547.

Digital Library

[20]

Scott.M, I., and Riddersma, S. Effects of output display and control display gain on human performance in interactive systems. Behaviour & Information Technology 13, 5 (1994), 328--337.

[21]

Stoakley, R., Conway, M. J., and Pausch, R. Virtual reality on a wim: Interactive worlds in miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '95, ACM Press/Addison-Wesley Publishing Co. (New York, NY, USA, 1995), 265--272.

Digital Library

[22]

Veit, M., Capobianco, A., and Bechmann, D. Influence of degrees of freedom's manipulation on performances during orientation tasks in virtual reality environments. In Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, VRST '09, ACM (New York, NY, USA, 2009), 51--58.

Digital Library

[23]

Wang, R., Paris, S., and Popović J. 6d hands: Markerless hand-tracking for computer aided design. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST '11, ACM (New York, NY, USA, 2011), 549--558.

Digital Library

[24]

Wilkes, C., and Bowman, D. A. Advantages of velocity-based scaling for distant 3d manipulation. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology, VRST '08, ACM (New York, NY, USA, 2008), 23--29.

Digital Library

[25]

Wilson, A. D., and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology, UIST '10, ACM (New York, NY, USA, 2010), 273--282.

Digital Library

Cited By

Wu JWang LIm SLam C(2024)EEBA: Efficient and ergonomic Big-Arm for distant object manipulation in VRInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103273188(103273)Online publication date: Aug-2024
https://doi.org/10.1016/j.ijhcs.2024.103273
Zheng QWang LKe WIm S(2023)VVIR-OM: Efficient Object Manipulation in VR with Variable Virtual Interaction RegionInternational Journal of Human–Computer Interaction10.1080/10447318.2023.228612640:24(8689-8702)Online publication date: 27-Nov-2023
https://doi.org/10.1080/10447318.2023.2286126
Liu XWang LLuan SShi XLiu X(2022)Distant Object Manipulation with Adaptive Gains in Virtual Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00092(739-747)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00092

Index Terms

A Non-linear Mapping Technique for Bare-hand Interaction in Large Virtual Environments
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Gaze + pinch interaction in virtual reality
SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

Virtual reality affords experimentation with human abilities beyond what's possible in the real world, toward novel senses of interaction. In many interactions, the eyes naturally point at objects of interest while the hands skilfully manipulate in 3D ...
Handheld Augmented Reality Interaction Technique
IVIC 2013: Third International Visual Informatics Conference on Advances in Visual Informatics - Volume 8237

Handheld devices are popular device for an Augmented Reality application. It has a basic hardware requirement for AR system. However it must be overcome some technical obstacle to realize its true power. One of the problems is interaction in handheld AR ...
Interaction techniques in desktop virtual environment: the study of visual feedback and precise manipulation method

Gesture-based systems allow users to interact with a virtual reality application in a natural way. Visual feedback for the gesture-based interaction technique has an impact on the performance and the hand instability making the manipulation of the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

December 2015

691 pages

ISBN:9781450336734

DOI:10.1145/2838739

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction
HFESA: Human Factors and Ergonomics Society of Australia Inc.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 December 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

OzCHI '15

OzCHI '15: The Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

December 7 - 10, 2015

VIC, Parkville, Australia

Acceptance Rates

OzCHI '15 Paper Acceptance Rate 47 of 97 submissions, 48%;

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
182
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wu JWang LIm SLam C(2024)EEBA: Efficient and ergonomic Big-Arm for distant object manipulation in VRInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103273188(103273)Online publication date: Aug-2024
https://doi.org/10.1016/j.ijhcs.2024.103273
Zheng QWang LKe WIm S(2023)VVIR-OM: Efficient Object Manipulation in VR with Variable Virtual Interaction RegionInternational Journal of Human–Computer Interaction10.1080/10447318.2023.228612640:24(8689-8702)Online publication date: 27-Nov-2023
https://doi.org/10.1080/10447318.2023.2286126
Liu XWang LLuan SShi XLiu X(2022)Distant Object Manipulation with Adaptive Gains in Virtual Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00092(739-747)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00092

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten