research-article

Hand-based interaction for object manipulation with augmented reality glasses

Authors:

Xubo YangAuthors Info & Claims

VRCAI '14: Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Pages 227 - 230

https://doi.org/10.1145/2670473.2670505

Published: 30 November 2014 Publication History

Abstract

An increase number of gesture sensors and AR(augmented reality) displays are emerging these years. There are more and more study working on spatial interaction. In this work, we focus on evaluating the feasibility of hand-based interaction designed for AR glasses to do basic manipulation on 3D virtual objects in AR applications with current interaction technology. We design a user study with 10 volunteers to discuss whether and how to use natural user interfaces like gestures, with the help of 3D menus, to finish the tasks of manipulating AR scenes. The interface including 3D menus presents the advantages of usability and merits of intuition; However, it also exposes some issues like ergonomic discomfort and limitation like imprecise input. So our results indicate the kind of interactive device and technology are valuable in natural interaction without extra knowledge, though they are limited in serious applications now.

References

[1]

Azenkot, S., Bennett, C. L., and Ladner, R. E. 2013. Digitaps: eyes-free number entry on touchscreens with minimal audio feedback. In Proceedings of the 26th annual ACM symposium on User interface software and technology, ACM, 85--90.

Digital Library

[2]

Brewster, S., Lumsden, J., Bell, M., Hall, M., and Tasker, S. 2003. Multimodal' eyes-free' interaction techniques for wearable devices. In Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 473--480.

Digital Library

[3]

Colaço, A., Kirmani, A., Yang, H. S., Gong, N.-W., Schmandt, C., and Goyal, V. K. 2013. Mime: compact, low power 3d gesture sensing for interaction with head mounted displays. In Proceedings of the 26th annual ACM symposium on User interface software and technology, ACM, 227--236.

Digital Library

[4]

De Marsico, M., Levialdi, S., Nappi, M., and Ricciardi, S. 2012. Figi: floating interface for gesture-based interaction. Journal of Ambient Intelligence and Humanized Computing, 1--14.

[5]

Grossman, T., Wigdor, D., and Balakrishnan, R. 2004. Multi-finger gestural interaction with 3d volumetric displays. In Proceedings of the 17th annual ACM symposium on User interface software and technology, 61--70.

Digital Library

[6]

Hürst, W., and Dekker, J. 2013. Tracking-based interaction for object creation in mobile augmented reality. In Proceedings of the 21st ACM international conference on Multimedia, ACM, 93--102.

Digital Library

[7]

Jia, Y., Li, S., and Liu, Y. 2007. Tracking pointing gesture in 3d space for wearable visual interfaces. In Proceedings of the international workshop on Human-centered multimedia, 23--30.

Digital Library

[8]

Lee, H., and Woo, W. 2010. Tangible spin cube for 3d ring menu in real space. In CHI'10 Extended Abstracts on Human Factors in Computing Systems, 4147--4152.

Digital Library

[9]

Looser, J., Billinghurst, M., and Cockburn, A. 2004. Through the looking glass: the use of lenses as an interface tool for augmented reality interfaces. In Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia, 204--211.

Digital Library

[10]

Maimone, A., and Fuchs, H. 2013. Computational augmented reality eyeglasses. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on, 29--38.

[11]

Motion, L. 2012. Leap. URL: https://www. leapmotion. com.

[12]

Oakley, I., Sunwoo, J., and Cho, I.-Y. 2008. Pointing with fingers, hands and arms for wearable computing. In CHI'08 Extended Abstracts on Human Factors in Computing Systems, 3255--3260.

Digital Library

[13]

Oikonomidis, I., Kyriazis, N., and Argyros, A. A. 2011. Efficient model-based 3d tracking of hand articulations using kinect. In BMVC, 1--11.

[14]

Tamaki, E., Miyaki, T., and Rekimoto, J. 2009. Brainy hand: an ear-worn hand gesture interaction device. In CHI'09 Extended Abstracts on Human Factors in Computing Systems, 4255--4260.

Digital Library

[15]

Wang, R. Y., and Popović, J. 2009. Real-time hand-tracking with a color glove. In ACM Transactions on Graphics (TOG), vol. 28, ACM, 63.

Digital Library

[16]

Witt, H., Nicolai, T., and Kenn, H. 2006. Designing a wearable user interface for hands-free interaction in maintenance applications. In PerCom Workshops, 652--655.

Digital Library

[17]

Zhou, Y., David, B., and Chalon, R. 2011. Innovative user interfaces for wearable computers in real augmented environment. In Human-Computer Interaction. Interaction Techniques and Environments. 500--509.

Digital Library

Cited By

Yu MBi C(2024)Adaptive 360° video timeline exploration in VR environmentComputers & Graphics10.1016/j.cag.2024.104108125(104108)Online publication date: Dec-2024
https://doi.org/10.1016/j.cag.2024.104108
Yu MBi C(2023)Timeline Exploration in 360° VideoProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614533(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614533
Pfeuffer KObernolte JDietz FMäkelä VSidenmark LManakhov PPakanen MAlt F(2023)PalmGazer: Unimanual Eye-hand Menus in Augmented RealityProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614523(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614523
Show More Cited By

Index Terms

Hand-based interaction for object manipulation with augmented reality glasses
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Move'n'Hold Pro: Consistent Spatial Interaction Techniques for Object Manipulation with Handheld and Head-mounted Displays in Extended Reality
ECCE '24: Proceedings of the European Conference on Cognitive Ergonomics 2024

Extended Reality (XR) technologies are still lacking appropriate interaction methods that enable users to seamlessly switch between different XR devices and degrees of virtuality. Addressing this gap, we present Move’n’Hold Pro – a set of consistent ...
Occlusion based interaction methods for tangible augmented reality environments
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry

Traditional Tangible Augmented Reality (Tangible AR) interfaces combine a mixture of tangible user interface and augmented reality technology, complementing each other for novel interaction methods and real world anchored visualization. However, well ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '14: Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

November 2014

246 pages

ISBN:9781450332545

DOI:10.1145/2670473

General Chairs:
Xiaogang Jin
Zhejiang University, China
,
Nadia Magnenat-Thalmann
Nanyang Technological University, Singapore and MIRALab, University of Geneva, Switzerland
,
Hyun Seung Yang
Korea Advanced Institute of Science & Technology, Korea
,
Program Chairs:
Xubo Yang
Shanghai Jiao Tong University, China
,
Tomasz Bednarz
CSRIO, Australia
,
Issei Fujishiro
Keio University, Japan

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRCAI 2014

Sponsor:

SIGGRAPH

VRCAI 2014: 13th ACM International Conference on Virtual Reality Continuum and Its Applications in Industry

November 30 - December 2, 2014

Shenzhen, China

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
839
Total Downloads

Downloads (Last 12 months)60
Downloads (Last 6 weeks)6

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yu MBi C(2024)Adaptive 360° video timeline exploration in VR environmentComputers & Graphics10.1016/j.cag.2024.104108125(104108)Online publication date: Dec-2024
https://doi.org/10.1016/j.cag.2024.104108
Yu MBi C(2023)Timeline Exploration in 360° VideoProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614533(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614533
Pfeuffer KObernolte JDietz FMäkelä VSidenmark LManakhov PPakanen MAlt F(2023)PalmGazer: Unimanual Eye-hand Menus in Augmented RealityProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614523(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614523
Rejeb AKeogh JLeong GTreiblmaier H(2021)Potentials and challenges of augmented reality smart glasses in logistics and supply chain management: a systematic literature reviewInternational Journal of Production Research10.1080/00207543.2021.187694259:12(3747-3776)Online publication date: 3-Feb-2021
https://doi.org/10.1080/00207543.2021.1876942
Bailly CLeitner FNigay L(2020)Bring2MeProceedings of the 2020 International Conference on Advanced Visual Interfaces10.1145/3399715.3399842(1-9)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3399715.3399842
Park CCho HPark SYoon YJung SLee BLee GScott STory MKim J(2019)HandPoseMenuProceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces10.1145/3343055.3360752(361-366)Online publication date: 10-Nov-2019
https://dl.acm.org/doi/10.1145/3343055.3360752
Qian JMa JLi XAttal BLai HTompkin JHughes JHuang JGuimbretière FBernstein MReinecke K(2019)Portal-ble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented RealityProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347904(133-145)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347904
Bailly CLeitner FNigay L(2019)Head-Controlled Menu in Mixed Reality with a HMDHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29390-1_22(395-415)Online publication date: 2-Sep-2019
https://dl.acm.org/doi/10.1007/978-3-030-29390-1_22
Azai TUshiro SLi JOtsuki MShibata FKimura AMorishima SItoh YShiratori TYue YLindeman R(2018)Tap-tap menuProceedings of the 24th ACM Symposium on Virtual Reality Software and Technology10.1145/3281505.3281561(1-2)Online publication date: 28-Nov-2018
https://dl.acm.org/doi/10.1145/3281505.3281561
Azai TOtsuki MShibata FKimura A(2018)Open Palm MenuProceedings of the 9th Augmented Human International Conference10.1145/3174910.3174929(1-5)Online publication date: 6-Feb-2018
https://dl.acm.org/doi/10.1145/3174910.3174929
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents