research-article

Wall-based Space Manipulation Technique for Efficient Placement of Distant Objects in Augmented Reality

Authors:

Jeong-in Hwang,

Jinwook SeoAuthors Info & Claims

UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Pages 45 - 52

https://doi.org/10.1145/3242587.3242631

Published: 11 October 2018 Publication History

Abstract

We present a wall-based space manipulation (WSM) technique that enables users to efficiently select and move distant objects by dynamically squeezing their surrounding space in augmented reality. Users can bring a target object closer by dragging a solid plane behind the object and squeezing the space between them and the plane so that they can select and move the object more delicately and efficiently. We furthermore discuss the unique design challenges of WSM, including the dimension of space reduction and the recognition of the reduced space in relation to the real space. We conducted a user evaluation to verify how WSM improves the performance of the hand-centered object manipulation technique on the HoloLens for moving near objects far away and vice versa. The results indicate that WSM overall performed consistently well and significantly improved efficiency while alleviating arm fatigue.

Supplementary Material

suppl.mov (ufp1305.mp4)

Supplemental video

Download
43.77 MB

suppl.mov (ufp1305p.mp4)

Supplemental video

Download
11.99 MB

MP4 File (p45-chae.mp4)

Download
172.57 MB

References

[1]

Ferran Argelaguet, Carlos Andujar, and Ramon Trueba. 2008. Overcoming Eye-hand Visibility Mismatch in 3D Pointing Selection. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (VRST '08). ACM, New York, NY, USA, 43--46.

Digital Library

[2]

Claudia Armbrüster, Marc Wolter, Torsten Kuhlen, Will Spijkers, and Bruno Fimm. 2008. Depth perception in virtual reality: distance estimations in peri-and extrapersonal space. Cyberpsychology & Behavior 11, 1 (2008), 9--15.

[3]

Doug A. Bowman and Larry F. Hodges. 1997. An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environments. In Proceedings of the 1997 Symposium on Interactive 3D Graphics (I3D '97). ACM, New York, NY, USA, 35--ff.

Digital Library

[4]

John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.

[5]

Volkert Buchmann, Stephen Violich, Mark Billinghurst, and Andy Cockburn. 2004. FingARtips: Gesture Based Direct Manipulation in Augmented Reality. In Proceedings of the 2Nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (GRAPHITE '04). ACM, New York, NY, USA, 212--221.

Digital Library

[6]

Taejin Ha, Steven Feiner, and Woontack Woo. 2014. WeARHand: Head-worn, RGB-D camera-based, bare-hand user interface with visually enhanced depth perception. In Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on. IEEE, 219--228.

[7]

Don Hannema. 2001. Interaction in virtual reality. Interaction in Virtual Reality (2001).

[8]

Whie Jung, Woojin Cho, Hayun Kim, and Woontack Woo. 2017. BoostHand: Distance-free Object Manipulation System with Switchable Non-linear Mapping for Augmented Reality Classrooms. In Mixed and Augmented Reality (ISMAR-Adjunct), 2017 IEEE International Symposium on. IEEE, 321--325.

[9]

Max Krichenbauer, Goshiro Yamamoto, Takafumi Taketomi, Christian Sandor, and Hirokazu Kato. 2017. Augmented Reality vs Virtual Reality for 3D Object Manipulation. IEEE Transactions on Visualization and Computer Graphics (2017).

[10]

Ernst Kruijff, J Edward Swan, and Steven Feiner. 2010. Perceptual issues in augmented reality revisited. In Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on. IEEE, 3--12.

[11]

Joon Hyub Lee, Sang-Gyun An, Yongkwan Kim, and Seok-Hyung Bae. 2018. Projective Windows: Bringing Windows in Space to the Fingertip. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 218, 8 pages.

Digital Library

[12]

Microsoft. 2018a. Gestures - Mixed Reality. (2018). Retrieved April 3, 2018 from https://docs.microsoft.com/en-us/windows/mixed-reality/gestures.

[13]

Microsoft. 2018b. MixedRealityToolkit-Unity. (2018). Retrieved March 29, 2018 from https://github.com/Microsoft/MixedRealityToolkit-Unity.

[14]

Mark R Mine. 1995. Virtual environment interaction techniques. UNC Chapel Hill CS Dept (1995).

Digital Library

[15]

Mark R. Mine, Frederick P. Brooks, Jr., and Carlo H. Sequin. 1997. Moving Objects in Space: Exploiting Proprioception in Virtual-environment Interaction. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '97). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 19--26.

Digital Library

[16]

Tamara Munzner. 2014. Visualization analysis and design. AK Peters/CRC Press.

[17]

Benjamin Nuernberger, Eyal Ofek, Hrvoje Benko, and Andrew D. Wilson. 2016. SnapToReality: Aligning Augmented Reality to the Real World. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1233--1244.

Digital Library

[18]

Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The Go-go Interaction Technique: Non-linear Mapping for Direct Manipulation in VR. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (UIST '96). ACM, New York, NY, USA, 79--80.

Digital Library

[19]

Ivan Poupyrev, T Ichikawa, S Weghorst, and M Billinghurst. 1998. Egocentric object manipulation in virtual environments: empirical evaluation of interaction techniques. In Computer graphics forum, Vol. 17. Wiley Online Library, 41--52.

[20]

Dong Woo Seo and Jae Yeol Lee. 2013. Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences. Expert Systems with Applications 40, 9 (2013), 3784--3793.

Digital Library

[21]

Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual Reality on a WIM: Interactive Worlds in Miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '95). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 265--272.

Digital Library

[22]

R. Troy Surdick, Elizabeth T. Davis, Robert A. King, and Larry F. Hodges. 1997. The Perception of Distance in Simulated Visual Displays:A Comparison of the Effectiveness and Accuracy of Multiple Depth Cues Across Viewing Distances. Presence: Teleoperators and Virtual Environments 6, 5 (1997), 513--531.

Digital Library

[23]

Curtis Wilkes and Doug A. Bowman. 2008. Advantages of Velocity-based Scaling for Distant 3D Manipulation. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (VRST '08). ACM, New York, NY, USA, 23--29.

Digital Library

[24]

Ya-Ting Yue, Yong-Liang Yang, Gang Ren, and Wenping Wang. 2017. SceneCtrl: Mixed Reality Enhancement via Efficient Scene Editing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 427--436.

Digital Library

Cited By

Xie WChen HWei JZhang JZhang Q(2024)RimSenseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314567:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631456
Kim SLee G(2024)Evaluating an In-Hand Ball-Shaped Controller for Object Manipulation in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00025(10-19)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00025
Shin YLee YKim SPark S(2023)Spatial Chef: A Spatial Transforming VR Game with Full Body InteractionExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583826(1-6)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583826
Show More Cited By

Index Terms

Wall-based Space Manipulation Technique for Efficient Placement of Distant Objects in Augmented Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

Virtual Object Placement in MR Space Using a 3D Miniature Model of a Room
Asian HCI '22: Proceedings of the Asian HCI Symposium 2022

In this research, we propose a World in Miniature (WIM) -based technique for object placement in MR space. We considered that this would make it possible to freely place objects in 3D space, and to immediately check the position of objects that have ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

October 2018

1016 pages

ISBN:9781450359481

DOI:10.1145/3242587

General Chairs:
Patrick Baudisch
Hasso-Plattner Institute, Germany
,
Albrecht Schmidt
LMU, Germany
,
Program Chair:
Andy Wilson
Microsoft Research, USA

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '18

Sponsor:

UIST '18: The 31st Annual ACM Symposium on User Interface Software and Technology

October 14, 2018

Berlin, Germany

Acceptance Rates

UIST '18 Paper Acceptance Rate 80 of 375 submissions, 21%;

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
958
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)13

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xie WChen HWei JZhang JZhang Q(2024)RimSenseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314567:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631456
Kim SLee G(2024)Evaluating an In-Hand Ball-Shaped Controller for Object Manipulation in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00025(10-19)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00025
Shin YLee YKim SPark S(2023)Spatial Chef: A Spatial Transforming VR Game with Full Body InteractionExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583826(1-6)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583826
Ullah MChatterjee SFagundes CLam CNahum-Shani IRehg JWetter DKumar S(2022)mRiskProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503086:3(1-29)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550308
Cao YLi FChen Hliu XZhang LWang Y(2022)Guard Your Heart SilentlyProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503076:3(1-29)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550307
Zhang JChen ZLuo CWei BKanhere SLi J(2022)MetaGanFiProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503066:3(1-21)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550306
Paredes LIpsita AMesa JMartinez Garrido RRamani K(2022)StretchARProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503056:3(1-26)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550305
Isomoto TYamanaka SShizuki B(2022)Dwell Selection with ML-based Intent Prediction Using Only Gaze DataProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503016:3(1-21)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550301
Ihara KKawaguchi I(2022)Virtual Object Placement in MR Space Using a 3D Miniature Model of a RoomProceedings of the Asian HCI Symposium 202210.1145/3516492.3558789(23-29)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3516492.3558789
Qian XHe FHu XWang TIpsita ARamani K(2022)ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517665(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517665
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents