extended-abstract

Guess the Gesture: Uncovering an Intuitive Gesture-based User Interface for 3D Content Interaction in Virtual Reality

Authors:

Meghna Raswan,

Tyler Kay,

Hector M Camarillo-Abad,

Franceli L. Cibrian,

Trudi Di QiAuthors Info & Claims

C&C '23: Proceedings of the 15th Conference on Creativity and Cognition

Pages 361 - 364

https://doi.org/10.1145/3591196.3596610

Published: 19 June 2023 Publication History

Get Access

Abstract

This paper presents a novel approach to co-designing an immersive virtual reality (VR) experience where users can participate in a guessability process for a full gesture-based user interface for 3D content interactions using hand controllers. The proposed VR system includes animated visual prompts to allow users to create their own gestures for 13 different object interactions. A pilot study with two participants demonstrated that the visual prompts helped users understand expected interactions and enhanced their creativity in gesture design while maintaining an enjoyable user experience. Hand motion data and user feedback were collected and will be analyzed to provide quantitative insights into gesture efficiency and economy. This paper contributes to developing an intuitive and interactive gesture-based interface for VR and sets the foundation for future studies with more participants to gather additional gesture design ideas.

References

[1]

Yang Li, Jin Huang, Feng Tian, Hong-An Wang, & Guo-Zhong Dai (2019). Gesture interaction in virtual reality. Virtual Reality & Intelligent Hardware, 1(1), 84-112.

Crossref

Google Scholar

[2]

Salman Cheema, Michael Hoffman, & Joseph J. LaViola (2013). 3D Gesture classification with linear acceleration and angular velocity sensing devices for video games. Entertainment Computing, 4(1), 11-24.

Crossref

Google Scholar

[3]

Arora, R., Kazi, R., Kaufman, D., Li, W., & Singh, K. (2019). MagicalHands: Mid-Air Hand Gestures for Animating in VR. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (pp. 463–477). Association for Computing Machinery.

Digital Library

Google Scholar

[4]

Lee, S., Park, K., Lee, J., & Kim, K. (2017). User Study of VR Basic Controller and Data Glove as Hand Gesture Inputs in VR Games. In 2017 International Symposium on Ubiquitous Virtual Reality (ISUVR) (pp. 1-3).

Crossref

Google Scholar

[5]

Wobbrock, J. O., Aung, H. H., Rothrock, B., & Myers, B. A. (2005, April). Maximizing the guessability of symbolic input. In CHI'05 extended abstracts on Human Factors in Computing Systems (pp. 1869-1872).

Digital Library

Google Scholar

[6]

Di Qi, LouAnne Boyd, Scott Fitzpatrick, & Meghna Raswan. (2023). VRMoVi: Towards an Expressive Visualization for Human Motion and Object Interaction in Virtual Reality.

Crossref

Google Scholar

Cited By

View all

Qi TCibrian FRaswan MKay TCamarillo-Abad HWen Y(2024)Toward Intuitive 3D Interactions in Virtual Reality: A Deep Learning- Based Dual-Hand Gesture Recognition ApproachIEEE Access10.1109/ACCESS.2024.340029512(67438-67452)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3400295

Recommendations

User Defined Eye Movement-Based Interaction for Virtual Reality
Cross-Cultural Design. Methods, Tools, and Users
Abstract
Most of the applications of eye movement-based interaction in VR are limited to blinking and gaze at present, however, gaze gestures were neglected. Therefore, the potential of eye movement-based interaction in VR is far from being realized. In ...
A User-Defined Gesture Set for Music Interaction in Immersive Virtual Environment
CHIuXiD '17: Proceedings of the 3rd International Conference on Human-Computer Interaction and User Experience in Indonesia

In recent years, hand-tracking technologies had been implemented in Virtual Reality application, allowing users to use natural hand gesture for interaction within the environment. However, little efforts have been conducted in understanding user's ...
Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality
IUI '23: Proceedings of the 28th International Conference on Intelligent User Interfaces

Mid-air text input in augmented or virtual reality (AR/VR) is an open problem. One proposed solution is gesture typing where the user performs a gesture trace over the keyboard. However, this requires the user to move their hands precisely and ...

Comments

Information & Contributors

Information

Published In

C&C '23: Proceedings of the 15th Conference on Creativity and Cognition

June 2023

564 pages

ISBN:9798400701801

DOI:10.1145/3591196

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2023

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

C&C '23

Sponsor:

SIGCHI

C&C '23: Creativity and Cognition

June 19 - 21, 2023

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
156
Total Downloads

Downloads (Last 12 months)101
Downloads (Last 6 weeks)15

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Qi TCibrian FRaswan MKay TCamarillo-Abad HWen Y(2024)Toward Intuitive 3D Interactions in Virtual Reality: A Deep Learning- Based Dual-Hand Gesture Recognition ApproachIEEE Access10.1109/ACCESS.2024.340029512(67438-67452)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3400295

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Recommendations

User Defined Eye Movement-Based Interaction for Virtual Reality

A User-Defined Gesture Set for Music Interaction in Immersive Virtual Environment

Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations