abstract

Tap-tap menu: body touching for virtual interactive menus

Authors:

Asako KimuraAuthors Info & Claims

VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

Article No.: 57, Pages 1 - 2

https://doi.org/10.1145/3281505.3281561

Published: 28 November 2018 Publication History

Get Access

Abstract

Virtual and mixed realities make it possible to view and interact with virtual objects in 3D space. However, where to position menus in 3D space and how to interact with them are often problems. Existing studies developed methods of displaying a menu on the hand or arm. In this study, we proposed a menu system that appears at various body parts. By placing the menu on the body, it enables the user to operate the menus comfortably through kinesthesia, and perceive tactile feedback. Furthermore, displaying the menu not only in the hands and arms but also in the upper legs and the abdomen, the menu display area can be expanded. In this study, we developed a modeling application and introduced a proposed menu design for that application.

Supplementary Material

MP4 File (a57-azai.mp4)

Download
72.82 MB

References

[1]

F. Tecchia, G. Avveduto, R. Brondi, M. Carrozzino, M. Bergamasco, and L. Alem, "I'm in VR!: using your own hands in a fully immersive MR system," Proc. VRST '14, 2014, pp. 73--76.

Digital Library

Google Scholar

[2]

B. Ens, A. Byagowi, T. Han, J. D. Hincapié-Ramos, and P. Irani, "Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces," Proc. SUI '16, 2016, pp. 99--102.

Digital Library

Google Scholar

[3]

A. Colaço, A. Kirmani, H. S. Yang, N.-W. Gong, C. Schmandt, and V. K. Goyal, "Mime: compact, low power 3D gesture sensing for interaction with head mounted displays," Proc. UIST '13, 2013, pp. 227--236.

Digital Library

Google Scholar

[4]

J. Grubert, M. Heinisch, A. Quigley, and D. Schmalstieg, "MultiFi: Multi-Fidelity Interaction with Displays On and Around the Body," Proc. CHI'15, 2015, pp. 3933--3942.

Digital Library

Google Scholar

[5]

Z. He and X. Yang, "Hand-based interaction for object manipulation with augmented reality glasses," Proc. VRCAI '14, 2014, pp. 227--230.

Digital Library

Google Scholar

[6]

T. Azai, S. Ogawa, M. Otsuki, F. Shibata, and A. Kimura, "Selection and Manipulation Methods for a Menu Widget on the Human Forearm," Proc. CHI EA '17, 2017, pp. 357--360.

Digital Library

Google Scholar

[7]

M. R. Mine, F. P. Brooks, Jr., and C. H. Sequin, "Moving Objects in Space: Exploiting Proprioception In Virtual-Environment Interaction," Proc. ACM SIGGRAPH '97, 1997, pp. 19--26.

Digital Library

Google Scholar

Cited By

View all

Li XHe WJin SGugenheimer JHui PLiang HKristensson P(2024)Investigating Creation Perspectives and Icon Placement Preferences for On-Body Menus in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981368:ISS(236-254)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698136
Mi TWang JChan L(2023)LapTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108787:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610878
Paredes LIpsita AMesa JMartinez Garrido RRamani K(2022)StretchARProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503056:3(1-26)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550305
Show More Cited By

Index Terms

Tap-tap menu: body touching for virtual interactive menus
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality
    2. Interaction techniques
      1. Gestural input

Recommendations

Selection and Manipulation Methods for a Menu Widget on the Human Forearm
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Mixed reality (MR) space merges the real and virtual worlds in real time and makes it possible to present and manipulate virtual objects in the real world. However, to manipulate virtual objects, menus are required, and where to display menus in MR ...
Open Palm Menu: A Virtual Menu Placed in Front of the Palm
AH '18: Proceedings of the 9th Augmented Human International Conference

Virtual and mixed realities make it possible to view and interact with virtual objects in a three-dimensional space. However, the location to display menus in three-dimensional space and the means of manipulating them are often problems. Existing ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...

Comments

Information & Contributors

Information

Published In

VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

November 2018

570 pages

ISBN:9781450360869

DOI:10.1145/3281505

Editor:
Stephen N. Spencer
University of Washington
,
General Chair:
Shigeo Morishima
Waseda University
,
Program Chairs:
Yuichi Itoh
Osaka University
,
Takaaki Shiratori
Facebook Reality Labs
,
Yonghao Yue
The University of Tokyo
,
Rob Lindeman
University of Canterbury

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2018

Check for updates

Author Tags

Qualifiers

Abstract

Conference

VRST '18

Sponsor:

VRST '18: 24th ACM Symposium on Virtual Reality Software and Technology

November 28 - December 1, 2018

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
435
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)4

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li XHe WJin SGugenheimer JHui PLiang HKristensson P(2024)Investigating Creation Perspectives and Icon Placement Preferences for On-Body Menus in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981368:ISS(236-254)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698136
Mi TWang JChan L(2023)LapTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108787:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610878
Paredes LIpsita AMesa JMartinez Garrido RRamani K(2022)StretchARProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503056:3(1-26)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550305
Yu DZhou QDingler TVelloso EGoncalves J(2022)Blending On-Body and Mid-Air Interaction in Virtual Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00081(637-646)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00081
Lu JLiu ZBrooks JLopes P(2021)Chemical Haptics: Rendering Haptic Sensations via Topical StimulantsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474747(239-257)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474747
Simonson A(2021)Pockets: User-Assigned Menus Based on Physical Buttons for Virtual EnvironmentsACM SIGGRAPH 2021 Posters10.1145/3450618.3469174(1-2)Online publication date: 5-Aug-2021
https://dl.acm.org/doi/10.1145/3450618.3469174
Saidi HDubois ESerrano MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View InteractionProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445255(1-17)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445255
Teng SLi PNith RFonseca JLopes PKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Touch&Fold: A Foldable Haptic Actuator for Rendering Touch in Mixed RealityProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445099(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445099

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Selection and Manipulation Methods for a Menu Widget on the Human Forearm

Open Palm Menu: A Virtual Menu Placed in Front of the Palm

Merging environments for shared spaces in mixed reality