poster

Gaze and gesture based object manipulation in virtual worlds

Authors:

Dana Slambekova,

Reynold Bailey,

Joe GeigelAuthors Info & Claims

VRST '12: Proceedings of the 18th ACM symposium on Virtual reality software and technology

Pages 203 - 204

https://doi.org/10.1145/2407336.2407380

Published: 10 December 2012 Publication History

Get Access

Abstract

In this work we present a framework for enabling the use of both eye gaze and hand gestures for interaction within a 3D virtual world. We define a set of natural interaction mechanisms for manipulation of objects within the 3D space and describe a prototype implementation based on Second Life that allows these mechanisms to be used in that world. We also explore how these mechanisms can be extended to other spatial tasks such as camera positioning and motion.

References

[1]

G. Hackenberg, R. McCall, and W. Broll. Lightweight palm and finger tracking for real-time 3d gesture control. In Virtual Reality Conference (VR), 2011 IEEE, pages 19 --26, march 2011.

Digital Library

Google Scholar

[2]

P. Song, W. B. Goh, W. Hutama, C.-W. Fu, and X. Liu. A handle bar metaphor for virtual object manipulation with mid-air interaction. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, CHI '12, pages 1297--1306, New York, NY, USA, 2012. ACM.

Digital Library

Google Scholar

Cited By

View all

Tian JWang YYu KXu LXie JLi FNiu YFan M(2024)Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VRProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642884(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642884
Lai YSun MLi Z(2024)GazePuffer: Hands-Free Input Method Leveraging Puff Cheeks for VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00055(331-341)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00055
Shi RWei YQin XHui PLiang H(2023)Exploring Gaze-assisted and Hand-based Region Selection in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/35911297:ETRA(1-19)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591129
Show More Cited By

Index Terms

Gaze and gesture based object manipulation in virtual worlds
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

Gaze + pinch interaction in virtual reality
SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

Virtual reality affords experimentation with human abilities beyond what's possible in the real world, toward novel senses of interaction. In many interactions, the eyes naturally point at objects of interest while the hands skilfully manipulate in 3D ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)

Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality
IUI '23: Proceedings of the 28th International Conference on Intelligent User Interfaces

Mid-air text input in augmented or virtual reality (AR/VR) is an open problem. One proposed solution is gesture typing where the user performs a gesture trace over the keyboard. However, this requires the user to move their hands precisely and ...

Comments

Information & Contributors

Information

Published In

VRST '12: Proceedings of the 18th ACM symposium on Virtual reality software and technology

December 2012

226 pages

ISBN:9781450314695

DOI:10.1145/2407336

General Chair:
Mark Green
University of Ontario Institute of Technology, Canada
,
Program Chairs:
Wolfgang Stuerzlinger
York University, Toronto, Canada
,
Marc Erich Latoschik
University of Würzburg, Germany
,
Bill Kapralos
University of Ontario Institute of Technology, Canada

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 December 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

VRST'12

Sponsor:

VRST'12: The 18th ACM Symposium on Virtual Reality Software and Technology 2012

December 10 - 12, 2012

Ontario, Toronto, Canada

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Upcoming Conference

VRST '24

Sponsor:
sigchi
sigchi

30th ACM Symposium on Virtual Reality Software and Technology

October 9 - 11, 2024

Trier , Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
456
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)6

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tian JWang YYu KXu LXie JLi FNiu YFan M(2024)Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VRProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642884(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642884
Lai YSun MLi Z(2024)GazePuffer: Hands-Free Input Method Leveraging Puff Cheeks for VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00055(331-341)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00055
Shi RWei YQin XHui PLiang H(2023)Exploring Gaze-assisted and Hand-based Region Selection in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/35911297:ETRA(1-19)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591129
Zheng QWang LKe WIm S(2023)VVIR-OM: Efficient Object Manipulation in VR with Variable Virtual Interaction RegionInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2286126(1-14)Online publication date: 27-Nov-2023
https://doi.org/10.1080/10447318.2023.2286126
Plopski AHirzle TNorouzi NQian LBruder GLanglotz T(2022)The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended RealityACM Computing Surveys10.1145/349120755:3(1-39)Online publication date: 25-Mar-2022
https://dl.acm.org/doi/10.1145/3491207
Abtahi PHough SLanday JFollmer S(2022)Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517706(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517706
Sapkota SRam AZhao S(2021)Ubiquitous Interactions for Heads-Up Computing: Understanding Users’ Preferences for Subtle Interaction Techniques in Everyday SettingsProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472035(1-15)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447526.3472035
Yu DLu XShi RLiang HDingler TVelloso EGoncalves JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Gaze-Supported 3D Object Manipulation in Virtual RealityProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445343(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445343
Tadeja SLu YRydlewicz MRydlewicz WBubas TKristensson P(2021)Exploring gestural input for engineering surveys of real-life structures in virtual reality using photogrammetric 3D modelsMultimedia Tools and Applications10.1007/s11042-021-10520-zOnline publication date: 30-Jan-2021
https://doi.org/10.1007/s11042-021-10520-z
Tadeja SLu YSeshadri PKristensson P(2020)Digital Twin Assessments in Virtual Reality: An Explorational Study with Aeroengines2020 IEEE Aerospace Conference10.1109/AERO47225.2020.9172389(1-13)Online publication date: Mar-2020
https://doi.org/10.1109/AERO47225.2020.9172389
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Gaze + pinch interaction in virtual reality

Multi-scenario gesture recognition using Kinect

Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality