research-article

Poros: Configurable Proxies for Distant Interactions in VR

Authors:

Kasper HornbækAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 532, Pages 1 - 12

https://doi.org/10.1145/3411764.3445685

Published: 07 May 2021 Publication History

Abstract

A compelling property of virtual reality is that it allows users to interact with objects as they would in the real world. However, such interactions are limited to space within reach. We present Poros, a system that allows users to rearrange space. After marking a portion of space, the distant marked space is mirrored in a nearby proxy. Thereby, users can arrange what is within their reachable space, making it easy to interact with multiple distant spaces as well as nearby objects. Proxies themselves become part of the scene and can be moved, rotated, scaled, or anchored to other objects. Furthermore, they can be used in a set of higher-level interactions such as alignment and action duplication. We show how Poros enables a variety of tasks and applications and also validate its effectiveness through an expert evaluation.

Supplementary Material

MP4 File (3411764.3445685_videofigure.mp4)

Supplemental video

Download
96.20 MB

References

[1]

Parastoo Abtahi, Mar Gonzalez-Franco, Eyal Ofek, and Anthony Steed. 2019. I’m a Giant: Walking in Large Virtual Environments at High Speed Gains. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300752

Digital Library

[2]

Ferran Argelaguet and Carlos Andujar. 2013. A survey of 3D object selection techniques for virtual environments. Computers & Graphics 37, 3 (2013), 121–136. https://doi.org/10.1016/j.cag.2012.12.003

Digital Library

[3]

Hrvoje Benko and Steven Feiner. 2007. Balloon selection: A multi-finger technique for accurate low-fatigue 3d selection. In 2007 IEEE symposium on 3D user interfaces. IEEE.

[4]

Andrew Bluff. 2019. Don’t Panic: Recursive Interactions in a Miniature Metaworld. In The 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry(Brisbane, QLD, Australia) (VRCAI ’19). Association for Computing Machinery, New York, NY, USA, Article 33, 9 pages. https://doi.org/10.1145/3359997.3365682

Digital Library

[5]

Doug A. Bowman and Larry F. Hodges. 1997. An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environments. In Proceedings of the 1997 Symposium on Interactive 3D Graphics (Providence, Rhode Island, USA) (I3D ’97). ACM, New York, NY, USA, 35–ff.https://doi.org/10.1145/253284.253301

Digital Library

[6]

Doug A. Bowman, David Koller, and Larry F. Hodges. 1997. Travel in Immersive Virtual Environments: An Evaluation of Viewpoint Motion Control Techniques. In Proceedings of the 1997 Virtual Reality Annual International Symposium (VRAIS ’97)(VRAIS ’97). IEEE Computer Society, USA, 45.

[7]

Doug A. Bowman, Ernst Kruijff, Joseph J. LaViola, and Ivan Poupyrev. 2001. An Introduction to 3-D User Interface Design. Presence: Teleoperators and Virtual Environments 10, 1(2001), 96–108. https://doi.org/10.1162/105474601750182342

Digital Library

[8]

Han Joo Chae, Jeong-in Hwang, and Jinwook Seo. 2018. Wall-based Space Manipulation Technique for Efficient Placement of Distant Objects in Augmented Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). ACM, New York, NY, USA, 45–52. https://doi.org/10.1145/3242587.3242631

Digital Library

[9]

Niklas Elmqvist. 2005. BalloonProbe: Reducing Occlusion in 3D Using Interactive Space Distortion. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Monterey, CA, USA) (VRST ’05). Association for Computing Machinery, New York, NY, USA, 134–137. https://doi.org/10.1145/1101616.1101643

Digital Library

[10]

Andrew Forsberg, Kenneth Herndon, and Robert Zeleznik. 1996. Aperture based selection for immersive virtual environments. In ACM Symposium on User Interface Software and Technology. Citeseer, 95–96.

Digital Library

[11]

Wolfgang Kabsch. 1976. A solution for the best rotation to relate two sets of vectors. Acta Crystallographica Section A 32, 5 (Sep 1976), 922–923. https://doi.org/10.1107/S0567739476001873

[12]

Azam Khan, George Fitzmaurice, Don Almeida, Nicolas Burtnyk, and Gordon Kurtenbach. 2004. A Remote Control Interface for Large Displays. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA) (UIST ’04). Association for Computing Machinery, New York, NY, USA, 127–136. https://doi.org/10.1145/1029632.1029655

Digital Library

[13]

Ioannis Kotziampasis, Nathan Sidwell, and Alan Chalmers. 2003. Portals: Increasing Visibility in Virtual Worlds. In Proceedings of the 19th Spring Conference on Computer Graphics (Budmerice, Slovakia) (SCCG ’03). Association for Computing Machinery, New York, NY, USA, 257–261. https://doi.org/10.1145/984952.984995

Digital Library

[14]

André Kunert, Alexander Kulik, Stephan Beck, and Bernd Froehlich. 2014. Photoportals: Shared References in Space and Time. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (Baltimore, Maryland, USA) (CSCW ’14). Association for Computing Machinery, New York, NY, USA, 1388–1399. https://doi.org/10.1145/2531602.2531727

Digital Library

[15]

Bum chul Kwon, Waqas Javed, Niklas Elmqvist, and Ji Soo Yi. 2011. Direct Manipulation through Surrogate Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 627–636. https://doi.org/10.1145/1978942.1979033

Digital Library

[16]

H. Lee, S. Noh, and W. Woo. 2017. TunnelSlice: Freehand Subspace Acquisition Using an Egocentric Tunnel for Wearable Augmented Reality. IEEE Transactions on Human-Machine Systems 47, 1 (Feb 2017), 128–139. https://doi.org/10.1109/THMS.2016.2611821

[17]

Klemen Lilija, Henning Pohl, Sebastian Boring, and Kasper Hornbæk. 2019. Augmented Reality Views for Occluded Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, Article 446, 12 pages. https://doi.org/10.1145/3290605.3300676

Digital Library

[18]

James Liu, Hirav Parekh, Majed Al-Zayer, and Eelke Folmer. 2018. Increasing Walking in VR Using Redirected Teleportation. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 521–529. https://doi.org/10.1145/3242587.3242601

Digital Library

[19]

Daniel Mendes, Daniel Medeiros, Eduardo Cordeiro, Maurício Sousa, Alfredo Ferreira, and Joaquim Jorge. 2017. PRECIOUS! Out-of-reach selection using iterative refinement in VR. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 237–238.

[20]

Mark R. Mine, Frederick P. Brooks, and Carlo H. Sequin. 1997. Moving Objects in Space: Exploiting Proprioception in Virtual-Environment Interaction. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., USA, 19–26. https://doi.org/10.1145/258734.258747

Digital Library

[21]

Roberto A. Montano Murillo, Sriram Subramanian, and Diego Martinez Plasencia. 2017. Erg-O: Ergonomic Optimization of Immersive Virtual Environments. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 759–771. https://doi.org/10.1145/3126594.3126605

Digital Library

[22]

Alex Olwal and Steven Feiner. 2003. The Flexible Pointer: An Interaction Technique for Selection in Augmented and Virtual Reality. In Proc. UIST’03. 81–82.

[23]

Randy Pausch, Tommy Burnette, Dan Brockway, and Michael E. Weiblen. 1995. Navigation and Locomotion in Virtual Worlds via Flight into Hand-Held Miniatures. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’95). Association for Computing Machinery, New York, NY, USA, 399–400. https://doi.org/10.1145/218380.218495

Digital Library

[24]

Randy Pausch, Dennis Proffitt, and George Williams. 1997. Quantifying Immersion in Virtual Reality. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., USA, 13–18. https://doi.org/10.1145/258734.258744

Digital Library

[25]

Ken Perlin and David Fox. 1993. Pad: An Alternative Approach to the Computer Interface. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (Anaheim, CA) (SIGGRAPH ’93). Association for Computing Machinery, New York, NY, USA, 57–64. https://doi.org/10.1145/166117.166125

Digital Library

[26]

Ken Pfeuffer, Benedikt Mayer, Diako Mardanbegi, and Hans Gellersen. 2017. Gaze + Pinch Interaction in Virtual Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (Brighton, United Kingdom) (SUI ’17). Association for Computing Machinery, New York, NY, USA, 99–108. https://doi.org/10.1145/3131277.3132180

Digital Library

[27]

Jeffrey S. Pierce, Andrew S. Forsberg, Matthew J. Conway, Seung Hong, Robert C. Zeleznik, and Mark R. Mine. 1997. Image plane interaction techniques in 3D immersive environments. In Proceedings of the 1997 symposium on Interactive 3D graphics. ACM, 39–ff.

Digital Library

[28]

J. S. Pierce and R. Pausch. 2004. Navigation with place representations and visible landmarks. In IEEE Virtual Reality 2004. 173–288. https://doi.org/10.1109/VR.2004.1310071

[29]

Jeffrey S. Pierce, Brian C. Stearns, and Randy Pausch. 1999. Voodoo Dolls: Seamless Interaction at Multiple Scales in Virtual Environments. In Proceedings of the 1999 Symposium on Interactive 3D Graphics (Atlanta, Georgia, USA) (I3D ’99). Association for Computing Machinery, New York, NY, USA, 141–145. https://doi.org/10.1145/300523.300540

Digital Library

[30]

Thammathip Piumsomboon, Gun A. Lee, Andrew Irlitti, Barrett Ens, Bruce H. Thomas, and Mark Billinghurst. 2019. On the Shoulder of the Giant: A Multi-Scale Mixed Reality Collaboration with 360 Video Sharing and Tangible Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3290605.3300458

Digital Library

[31]

Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In ACM Symposium on User Interface Software and Technology. Citeseer, 79–80.

Digital Library

[32]

Christian Sandor, Arindam Dey, Andrew Cunningham, Sebastien Barbier, Ulrich Eck, Donald Urquhart, Michael R. Marner, Graeme Jarvis, and Sang Rhee. 2010. Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality. In 2010 IEEE Virtual Reality Conference (VR). 47–50. https://doi.org/10.1109/VR.2010.5444815

Digital Library

[33]

Frank Steinicke, Timo Ropinski, and Klaus Hinrichs. 2006. Object selection in virtual environments using an improved virtual pointer metaphor. In Computer Vision and Graphics. Springer, 320–326.

[34]

Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual reality on a WIM: interactive worlds in miniature. In CHI, Vol. 95. 265–272.

[35]

Stanislav L. Stoev and Dieter Schmalstieg. 2002. Application and Taxonomy of Through-the-Lens Techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Hong Kong, China) (VRST ’02). Association for Computing Machinery, New York, NY, USA, 57–64. https://doi.org/10.1145/585740.585751

Digital Library

[36]

R. Trueba, C. Andujar, and F. Argelaguet. 2009. Multi-Scale Manipulation in Indoor Scenes with the World in Miniature Metaphor. In Proceedings of the 15th Joint Virtual Reality Eurographics Conference on Virtual Environments(Lyon, France) (JVRC’09). Eurographics Association, Goslar, DEU, 93–100.

[37]

Hans Peter Wyss, Roland Blach, and Matthias Bues. 2006. iSith-Intersection-based spatial interaction for two hands. In 3D User Interfaces (3DUI’06). IEEE, 59–61.

[38]

Haijun Xia, Sebastian Herscher, Ken Perlin, and Daniel Wigdor. 2018. Spacetime: Enabling Fluid Individual and Collaborative Editing in Virtual Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 853–866. https://doi.org/10.1145/3242587.3242597

Digital Library

[39]

Yuhang Zhao, Edward Cutrell, Christian Holz, Meredith Ringel Morris, Eyal Ofek, and Andrew D. Wilson. 2019. SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, Article 111, 14 pages. https://doi.org/10.1145/3290605.3300341

Digital Library

Cited By

Kim WXiong S(2024)TouchView: Mid-Air Touch on Zoomable 2D View for Distant Freehand Selection on a Virtual Reality User InterfaceSensors10.3390/s2422720224:22(7202)Online publication date: 11-Nov-2024
https://doi.org/10.3390/s24227202
Shi RWei YHu XLiu YYue YYu LLiang H(2024)Experimental Analysis of Freehand Multi-object Selection Techniques in Virtual Reality Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981298:ISS(93-111)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698129
Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Show More Cited By

Index Terms

Poros: Configurable Proxies for Distant Interactions in VR
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Spatial virtual keyboard for wand based virtual reality
SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

We propose a virtual keyboard for virtual environments using tracked controllers that users interact with spatially. Based on how users interact with touch screen keyboards, users move their controller into the volume of a key. Input on the controller ...
ViewfinderVR: configurable viewfinder for selection of distant objects in VR
Abstract
Selection is one of the fundamental user interactions in virtual reality (VR) and 3D user interaction, and raycasting has been one of the most popular object selection techniques in VR. However, the selection of small or distant objects through ...
Explorations of Wrist Haptic Feedback for AR/VR Interactions with Tasbi
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Most widespread haptic feedback devices for augmented and virtual reality (AR/VR) fall into one of two categories: simple hand-held controllers with a single vibration actuator, or complex glove systems with several embedded actuators. In this work, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

European Research Council

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
976
Total Downloads

Downloads (Last 12 months)211
Downloads (Last 6 weeks)18

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kim WXiong S(2024)TouchView: Mid-Air Touch on Zoomable 2D View for Distant Freehand Selection on a Virtual Reality User InterfaceSensors10.3390/s2422720224:22(7202)Online publication date: 11-Nov-2024
https://doi.org/10.3390/s24227202
Shi RWei YHu XLiu YYue YYu LLiang H(2024)Experimental Analysis of Freehand Multi-object Selection Techniques in Virtual Reality Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981298:ISS(93-111)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698129
Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Perelman GSerrano MDubois E(2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3648613
Linne KThomas SWeigel M(2024)Off-The-Shelf: Exploring 3D Arrangements of See-Through Masks to Switch between Virtual EnvironmentsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3689501(1-2)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3689501
Kondo RSugimoto M(2024)Teleporting Split Body: Can Portals Extend Self-Location?2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00118(608-612)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00118
Wu JWang LIm SLam C(2024)EEBAInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103273188:COnline publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103273
Caputo ABartolomioli ROrso VMingardi MDa Granaiola LGamberini LGiachetti A(2024)Comparison of deviceless methods for distant object manipulation in mixed realityComputers & Graphics10.1016/j.cag.2024.103959122(103959)Online publication date: Aug-2024
https://doi.org/10.1016/j.cag.2024.103959
Shin YLee YKim SPark S(2023)Spatial Chef: A Spatial Transforming VR Game with Full Body InteractionExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583826(1-6)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583826
Zhu ZLiu ZZhang YZhu LHuang JVillanueva AQian XPeppler KRamani K(2023)LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of ThingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581396(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581396
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten