research-article

vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors

Authors:

Zhengquan Zhang,

Mingming FanAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 132, Pages 1 - 11

https://doi.org/10.1145/3411764.3445537

Published: 07 May 2021 Publication History

Abstract

Interacting with out of reach or occluded VR objects can be cumbersome. Although users can change their position and orientation, such as via teleporting, to help observe and select, doing so frequently may cause loss of spatial orientation or motion sickness. We present vMirror, an interactive widget leveraging reflection of mirrors to observe and select distant or occluded objects. We first designed interaction techniques for placing mirrors and interacting with objects through mirrors. We then conducted a formative study to explore a semi-automated mirror placement method with manual adjustments. Next, we conducted a target-selection experiment to measure the effect of the mirror’s orientation on users’ performance. Results showed that vMirror can be as efficient as direct target selection for most mirror orientations. We further compared vMirror with teleport technique in a virtual treasure hunt game and measured participants’ task performance and subjective experiences. Finally, we discuss vMirorr user experience and present future directions.

Supplementary Material

VTT File (3411764.3445537_videofigurecaptions.vtt)

Download
1.80 KB

MP4 File (3411764.3445537_videofigure.mp4)

Supplemental video

Download
55.29 MB

MP4 File (3411764.3445537_videopreview.mp4)

Preview video

Download
2.24 MB

References

[1]

Johnny Accot and Shumin Zhai. 2001. Scale effects in steering law tasks. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1–8.

Digital Library

[2]

Ferran Argelaguet and Carlos Andujar. 2013. A survey of 3D object selection techniques for virtual environments. Computers & Graphics 37, 3 (2013), 121–136.

Digital Library

[3]

Marc Baloup, Thomas Pietrzak, and Géry Casiez. 2019. RayCursor: A 3D pointing facilitation technique based on raycasting. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[4]

Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human–Computer Interaction 24, 6(2008), 574–594.

[5]

Hrvoje Benko, Andrew D Wilson, and Patrick Baudisch. 2006. Precise selection techniques for multi-touch screens. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 1263–1272.

Digital Library

[6]

Christoph Bichlmeier, Sandro Michael Heining, Marco Feuerstein, and Nassir Navab. 2009. The virtual mirror: a new interaction paradigm for augmented reality environments. IEEE Transactions on Medical Imaging 28, 9 (2009), 1498–1510.

[7]

Géry Casiez, Nicolas Roussel, and Daniel Vogel. 2012. 1€ filter: a simple speed-based low-pass filter for noisy input in interactive systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2527–2530.

Digital Library

[8]

Gerwin De Haan, Michal Koutek, and Frits H Post. 2005. IntenSelect: Using Dynamic Object Rating for Assisting 3D Object Selection. In Ipt/egve. Citeseer, 201–209.

[9]

Niklas Elmqvist. 2005. BalloonProbe: Reducing occlusion in 3D using interactive space distortion. In Proceedings of the ACM symposium on Virtual reality software and technology. 134–137.

Digital Library

[10]

Niklas Elmqvist and M Eduard Tudoreanu. 2007. Occlusion Management in Immersive and Desktop 3D Virtual Environments: Theory and Evaluation.IJVR 6, 2 (2007), 21–32.

[11]

Andrew Forsberg, Kenneth Herndon, and Robert Zeleznik. 1996. Aperture based selection for immersive virtual environments. In Proceedings of the 9th annual ACM symposium on User interface software and technology. 95–96.

Digital Library

[12]

Scott Frees, G Drew Kessler, and Edwin Kay. 2007. PRISM interaction for enhancing control in immersive virtual environments. ACM Transactions on Computer-Human Interaction (TOCHI) 14, 1(2007), 2–es.

Digital Library

[13]

Sebastian Freitag, Dominik Rausch, and Torsten Kuhlen. 2014. Reorientation in virtual environments using interactive portals. In 2014 IEEE symposium on 3D user interfaces (3DUI). IEEE, 119–122.

[14]

Tovi Grossman and Ravin Balakrishnan. 2006. The design and evaluation of selection techniques for 3D volumetric displays. In Proceedings of the 19th annual ACM symposium on User interface software and technology. 3–12.

Digital Library

[15]

Wansu Ha, Myung Geol Choi, and Kang Hoon Lee. 2020. Automatic Control of Virtual Mirrors for Precise 3D Manipulation in VR. IEEE Access 8(2020), 156274–156284.

[16]

Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.

[17]

Werner A König, Jens Gerken, Stefan Dierdorf, and Harald Reiterer. 2009. Adaptive pointing–design and evaluation of a precision enhancing technique for absolute pointing devices. In IFIP Conference on Human-Computer Interaction. Springer, 658–671.

Digital Library

[18]

Regis Kopper, Doug A Bowman, Mara G Silva, and Ryan P McMahan. 2010. A human motor behavior model for distal pointing tasks. International journal of human-computer studies 68, 10 (2010), 603–615.

Digital Library

[19]

André Kunert, Alexander Kulik, Stephan Beck, and Bernd Froehlich. 2014. Photoportals: shared references in space and time. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 1388–1399.

Digital Library

[20]

Nianlong Li, Teng Han, Feng Tian, Jin Huang, Minghui Sun, Pourang Irani, and Jason Alexander. 2020. Get a Grip: Evaluating Grip Gestures for VR Input using a Lightweight Pen. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[21]

Yung-Ta Lin, Yi-Chi Liao, Shan-Yuan Teng, Yi-Ju Chung, Liwei Chan, and Bing-Yu Chen. 2017. Outside-in: visualizing out-of-sight regions-of-interest in a 360 video using spatial picture-in-picture previews. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 255–265.

Digital Library

[22]

Robert W Lindeman, John L Sibert, and James K Hahn. 1999. Hand-held windows: towards effective 2D interaction in immersive virtual environments. In Proceedings IEEE Virtual Reality (Cat. No. 99CB36316). IEEE, 205–212.

[23]

David Lindlbauer and Andy D Wilson. 2018. Remixed reality: manipulating space and time in augmented reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[24]

Fabrice Matulic, Riku Arakawa, Brian Vogel, and Daniel Vogel. 2020. PenSight: Enhanced Interaction with a Pen-Top Camera. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[25]

Mark R Mine. 1995. Virtual environment interaction techniques. UNC Chapel Hill CS Dept(1995).

[26]

Diederick C Niehorster, Li Li, and Markus Lappe. 2017. The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research. i-Perception 8, 3 (2017), 204166951770820.

[27]

Ko Nishino and Shree K Nayar. 2006. Corneal imaging system: Environment from eyes. International Journal of Computer Vision 70, 1 (2006), 23–40.

Digital Library

[28]

Jeffrey S Pierce, Andrew S Forsberg, Matthew J Conway, Seung Hong, Robert C Zeleznik, and Mark R Mine. 1997. Image plane interaction techniques in 3D immersive environments. In Proceedings of the 1997 symposium on Interactive 3D graphics. 39–ff.

Digital Library

[29]

Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology. 79–80.

Digital Library

[30]

Daniel Schneider and Jens Grubert. 2017. Towards Around-Device Interaction using Corneal Imaging. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 287–293.

Digital Library

[31]

Ludwig Sidenmark, Christopher Clarke, Xuesong Zhang, Jenny Phu, and Hans Gellersen. 2020. Outline Pursuits: Gaze-Assisted Selection of Occluded Objects in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376438

Digital Library

[32]

Richard Stoakley, Matthew J Conway, and Randy Pausch. 1995. Virtual reality on a WIM: interactive worlds in miniature. In Proceedings of the SIGCHI conference on Human factors in computing systems. 265–272.

Digital Library

[33]

Robert J. Teather and Wolfgang Stuerzlinger. 2013. Pointing at 3d Target Projections with One-Eyed and Stereo Cursors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 159–168. https://doi.org/10.1145/2470654.2470677

Digital Library

[34]

Huawei Tu, Susu Huang, Jiabin Yuan, Xiangshi Ren, and Feng Tian. 2019. Crossing-based selection with virtual reality head-mounted displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[35]

Daniel Vogel and Ravin Balakrishnan. 2005. Distant freehand pointing and clicking on very large, high resolution displays. In Proceedings of the 18th annual ACM symposium on User interface software and technology. 33–42.

Digital Library

[36]

Chiu-Hsuan Wang, Chia-En Tsai, Seraphina Yong, and Liwei Chan. 2020. Slice of light: Transparent and integrative transition among realities in a multi-HMD-user environment. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 805–817.

Digital Library

[37]

Lili Wang, Jian Wu, Xuefeng Yang, and Voicu Popescu. 2019. VR Exploration Assistance through Automatic Occlusion Removal. IEEE transactions on visualization and computer graphics 25, 5(2019), 2083–2092.

[38]

Graham Wilson, Mark McGill, Matthew Jamieson, Julie R. Williamson, and Stephen A. Brewster. 2018. Object Manipulation in Virtual Reality Under Increasing Levels of Translational Gain. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, Article 99, 13 pages. https://doi.org/10.1145/3173574.3173673

Digital Library

[39]

Yuko Yanagawa, Kaori Ikematsu, Chihiro Suga, Mana Sasagawa, Yasushi Matoba, and Itiro Siio. 2017. Anamorphicons: An Extended Display Utilizing a Cylindrical Mirror Widget. In Proceedings of the 29th Australian Conference on Computer-Human Interaction. 457–461.

Digital Library

[40]

Xing-Dong Yang, Khalad Hasan, Neil Bruce, and Pourang Irani. 2013. Surround-see: enabling peripheral vision on smartphones during active use. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 291–300.

Digital Library

[41]

Chun Yu, Xiaoying Wei, Shubh Vachher, Yue Qin, Chen Liang, Yueting Weng, Yizheng Gu, and Yuanchun Shi. 2019. HandSee: Enabling Full Hand Interaction on Smartphone with Front Camera-based Stereo Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

Cited By

Zhou JWu JIm SFan RWang L(2025)Manipulable cone based bare hand object selection in high occlusion virtual environmentInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103432196(103432)Online publication date: Feb-2025
https://doi.org/10.1016/j.ijhcs.2024.103432
Kim WXiong S(2024)TouchView: Mid-Air Touch on Zoomable 2D View for Distant Freehand Selection on a Virtual Reality User InterfaceSensors10.3390/s2422720224:22(7202)Online publication date: 11-Nov-2024
https://doi.org/10.3390/s24227202
Li XHe WJin SGugenheimer JHui PLiang HKristensson P(2024)Investigating Creation Perspectives and Icon Placement Preferences for On-Body Menus in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981368:ISS(236-254)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698136
Show More Cited By

Index Terms

vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
    2. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Real-Time Global Illumination for VR Applications

Real-time global illumination in VR systems enhances scene realism by incorporating soft shadows, reflections of objects in the scene, and color bleeding. The Virtual Light Field (VLF) method enables real-time global illumination rendering in VR. The ...
Thinning trainer based on forest-growth model, virtual reality and computer-aided virtual environment

Immersive virtual reality is applied in many human activities. This virtual reality can be used as a training tool for thinning operations in forests. The aim of this study is to describe the complex solution of Thinning Trainer, that we developed. This ...
Low cost rendering method for virtual factory considering interpolation of occluded objects

Recent technology of computer graphics and image processing enables us to realize the construction of real world on a computer with virtual reality (VR). However, easiness constructing the VR space is not enough for most of users. This is because the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
1,363
Total Downloads

Downloads (Last 12 months)269
Downloads (Last 6 weeks)25

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou JWu JIm SFan RWang L(2025)Manipulable cone based bare hand object selection in high occlusion virtual environmentInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103432196(103432)Online publication date: Feb-2025
https://doi.org/10.1016/j.ijhcs.2024.103432
Kim WXiong S(2024)TouchView: Mid-Air Touch on Zoomable 2D View for Distant Freehand Selection on a Virtual Reality User InterfaceSensors10.3390/s2422720224:22(7202)Online publication date: 11-Nov-2024
https://doi.org/10.3390/s24227202
Li XHe WJin SGugenheimer JHui PLiang HKristensson P(2024)Investigating Creation Perspectives and Icon Placement Preferences for On-Body Menus in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981368:ISS(236-254)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698136
Pereira MLancelotte Fde Classe TGarcia A(2024)Simulation Sickness in Virtual Reality Games, How to Relieve it - Systematic Literature StudyProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691588(168-176)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691588
Ohara KSaito TIjiri T(2024)TeleHand: Hand-only Teleportation for Distant Object Pointing in Virtual RealityAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686327(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686327
Weissker TMeier-Krueger MBimberg PLindeman RKuhlen T(2024)Semi-Automated Guided Teleportation through Immersive Virtual EnvironmentsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687724(1-11)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687724
Wu ZWang DZhang SHuang YWang ZFan M(2024)Toward Making Virtual Reality (VR) More Inclusive for Older Adults: Investigating Aging Effect on Target Selection and Manipulation Tasks in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642558(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642558
Shao ZWang ZLi ZWang DLin XZhang YFan MWang Z(2024)SplattingAvatar: Realistic Real-Time Human Avatars With Mesh-Embedded Gaussian Splatting2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00159(1606-1616)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00159
Wu JWang LIm SLam C(2024)EEBA: Efficient and ergonomic Big-Arm for distant object manipulation in VRInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103273188(103273)Online publication date: Aug-2024
https://doi.org/10.1016/j.ijhcs.2024.103273
Pei SChen AChen CLi FFozzard MChi HWeibel NCarrington PZhang Y(2023)Embodied Exploration: Facilitating Remote Accessibility Assessment for Wheelchair Users with Virtual RealityProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608410(1-17)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608410
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents