Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3379337.3415893acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

GyroSuite: General-Purpose Interactions for Handheld Perspective Corrected Displays

Published: 20 October 2020 Publication History

Abstract

Handheld Perspective-Corrected Displays (HPCDs) are physical objects that have a notable volume and that display a virtual 3D scene on their entire surface. Being handheld, they create the illusion of holding the scene in a physical container (the display). This has strong benefits for the intuitiveness of 3D interaction: manipulating objects of the virtual scene amounts to physical manipulations of the display. HPCDs have been limited so far to technical demonstrators and experimental tools to assess their merits. However, they show great potential as interactive systems for actual 3D applications. This requires that novel interactions be created to go beyond object manipulation and to offer general-purpose services such as menu command selection and continuous parameter control. Working with a two-handed spherical HPCD, we report on the design and informal evaluations of various interaction techniques for distant object selection, scene scaling, menu interaction and continuous parameter control. In particular, our design leverages the efficient two-handed control of the rotations of the display. We demonstrate how some of these techniques can be assemble in a self-contained anatomy learning application. Novice participants used the application in a qualitative user experiment. Most participants used the application effortlessly without any training or explanations.

Supplementary Material

VTT File (3379337.3415893.vtt)
MP4 File (ufp8856pv.mp4)
Preview video
MP4 File (ufp8856vf.mp4)
Video figure
MP4 File (3379337.3415893.mp4)
Presentation Video

References

[1]
Johnny Accot and Shumin Zhai. 2002. More than dotting the i's--foundations for crossing-based interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 73--80.
[2]
Georg Apitz and Franc cois Guimbretière. 2004. CrossY: a crossing-based drawing application. In Proceedings of the 17th annual ACM symposium on User interface software and technology. ACM, 3--12.
[3]
O. R. Belloc, M. R. Nagamura, D. Fonseca, A. Rodrigues, D. A. R. Souza, C. S. Kurashima, M. M. Almeida, E. Z. Borba, R. D. Lopes, and M. K. Zuffo. 2017. OrbeVR: A Handheld Convex Spherical Virtual Reality Display. SIGGRAPH ET (2017), 19:1--19:2. http://dx.doi.org/10.1145/3084822.3091104
[4]
Hrvoje Benko, Andrew D. Wilson, and Ravin Balakrishnan. 2008. Sphere: multi-touch interactions on a spherical display. In Proceedings of the 21st annual ACM symposium on User interface software and technology. 77--86.
[5]
Franccois Bérard, Jessica Ip, Mitchel Benovoy, Dalia El-Shimy, Jeffrey R. Blum, and Jeremy R. Cooperstock. 2009. Did “Minority Report” Get It Wrong? Superiority of the Mouse over 3D Input Devices in a 3D Placement Task. In IFIP Conference on Human-Computer Interaction, INTERACT. Lecture Notes in Computer Science, Vol. 5727. Springer, Chapter 45, 400--414.
[6]
Francois Berard and Thibault Louis. 2017. The Object Inside: Assessing 3D Examination with a Spherical Handheld Perspective-Corrected Display, In Proceedings of the Conference on Human Factors in Computing Systems. CHI (2017), 4396--4404.
[7]
John Bolton, Kibum Kim, and Roel Vertegaal. 2011. Snowglobe: a spherical fish-tank vr display. In CHI'11 Extended Abstracts on Human Factors in Computing Systems. 1159--1164.
[8]
Doug A. Bowman and Larry F. Hodges. 1997. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In Proceedings of the symposium on Interactive 3D graphics. 35--ff.
[9]
Long Chen, Thomas W. Day, Wen Tang, and Nigel W. John. 2017. Recent developments and future challenges in medical mixed reality. In International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 123--135.
[10]
Pierre Dragicevic, Anastasia Bezerianos, Waqas Javed, Niklas Elmqvist, and Jean-Daniel Fekete. 2011. Temporal distortion for animated transitions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2009--2018.
[11]
David Englmeier, Isabel Schönewald, Andreas Butz, and Tobias Höllerer. 2019. Feel the Globe: Enhancing the Perception of Immersive Spherical Visualizations with Tangible Proxies. In Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 1693--1698.
[12]
Dylan Fafard, Ian Stavness, Martin Dechant, Regan Mandryk, Qian Zhou, and Sidney Fels. 2019. FTVR in VR: Evaluation of 3D Perception With a Simulated Volumetric Fish-Tank Virtual Reality Display. In ACM Conference on Human Factors in Computing Systems (CHI). 1--12.
[13]
F. Ferreira, M. Cabral, O. Belloc, G. Miller, C. Kurashima, R. de Deus Lopes, I. Stavness, J. Anacleto, M. Zuffo, and S. Fels. 2014. Spheree: A 3D Perspective-corrected Interactive Spherical Scalable Display. SIGGRAPHPosters (2014), 86:1--86:1. http://dx.doi.org/10.1145/2614217.2630585
[14]
J. Grosjean, J. Burkhardt, S. Coquillart, and P. Richard. 2002. Evaluation of the Command and Control Cube, In Proceedings. Fourth IEEE International Conference on Multimodal Interfaces. ICMI (2002), 473--478.
[15]
Tovi Grossman and Ravin Balakrishnan. 2006. The design and evaluation of selection techniques for 3D volumetric displays, In Proceedings of the 19th annual symposium on User Interface Software and Technology. UIST (2006), 3--12.
[16]
T. Grossman, D. Wigdor, and R. Balakrishnan. 2004. Multi-finger gestural interaction with 3d volumetric displays., In Symposium on User Interface Software and Technology. UIST (2004), 61--70.
[17]
Aymeric Guillot, Sté phane Champely, Christophe Batier, Patrice Thiriet, and Christian Collet. 2006. Relationship Between Spatial Abilities, Mental Rotation and Functional Anatomy Learning. Advances in Health Sciences Education 12, 4 (jul 2006), 491--507.
[18]
Jay Henderson, Sylvain Malacria, Mathieu Nancel, and Edward Lank. 2020. Investigating the Necessity of Delay in Marking Menu Invocation, In Proceedings of the Conference on Human Factors in Computing Systems. CHI (2020), 13.
[19]
Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-air Interactions, In ACM Conference on Human Factors in Computing Systems. CHI (2014), 1063--1072. http://dx.doi.org/10.1145/2556288.2557130
[20]
Paul Issartel, Lonni Besanc con, Tobias Isenberg, and Mehdi Ammi. 2016. A tangible volume for portable 3d interaction, In Adjunct proceedings of the International Symposium on Mixed and Augmented Reality. ISMAR-adjunct (2016), 215--220.
[21]
Paul Issartel, Florimond Guéniat, Tobias Isenberg, and Mehdi Ammi. 2017. Analysis of Locally Coupled 3D Manipulation Mappings Based on Mobile Device Motion. Presence: Teleoperators and Virtual Environments 26, 1 (2017), 66--95. http://dx.doi.org/10.1162/PRES_a_00287
[22]
Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-Based Interaction: A Framework for Post-WIMP Interfaces, In ACM Conference on Human Factors in Computing Systems. CHI (2008), 201--210. http://dx.doi.org/10.1145/1357054.1357089
[23]
Robert J. K. Jacob, Linda E. Sibert, Daniel C. McFarlane, and Jr. M. Preston Mullen. 1994. Integrality and separability of input devices. ACM Transactions on Computer-Human Interaction 1, 1 (1994), 3--26.
[24]
Mikko Kytö, Barrett Ens, Thammathip Piumsomboon, Gun A. Lee, and Mark Billinghurst. 2018. Pinpointing: Precise head-and eye-based target selection for augmented reality, In Proceedings of the 2018 Conference on Human Factors in Computing Systems. CHI (2018), 1--14.
[25]
Julian Looser, Raphael Grasset, and Mark Billinghurst. 2007. A 3D Flexible and Tangible Magic Lens in Augmented Reality, In Proceedings of the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. ISMAR (2007), 1--4. http://dx.doi.org/10.1109/ISMAR.2007.4538825
[26]
Thibault Louis and Francois Berard. 2017. Superiority of a Handheld Perspective-Coupled Display in Isomorphic Docking Performances, In ACM Conference on Interactive Surfaces and Spaces. ISS (2017), 72--81. http://dx.doi.org/10.1145/3132272.3134124
[27]
P. Lubos, G. Bruder, and F. Steinicke. 2014. Analysis of direct selection in head-mounted display environments, In IEEE Symposium on 3D User Interfaces. 3DUI (2014), 11--18.
[28]
Mark R. Mine. 1995. Virtual environment interaction techniques. UNC Chapel Hill CS Dept (1995).
[29]
Mark R. Mine, Jr. Frederick P. Brooks, and Carlo H. Sequin. 1997. Moving objects in space: exploiting proprioception in virtual-environment interaction, In ACM Conference on Computer Graphics and Interactive Techniques. SIGGRAPH (1997), 19--26.
[30]
Shio Miyafuji, Toshiki Sato, Zhengqing Li, and Hideki Koike. 2017. Qoom: An Interactive Omnidirectional Ball Display, In ACM Symposium on User Interface Software and Technology. UIST (2017), 599--609. http://dx.doi.org/10.1145/3126594.3126607
[31]
Christian Müller-Tomfelde. 2007. Dwell-based pointing in applications of human computer interaction, In IFIP Conference on Human-Computer Interaction. INTERACT (2007), 560--573.
[32]
Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR, In ACM Symposium on User Interface Software and Technology. UIST (1996), 79--80.
[33]
Majid Pourmemar and Charalambos Poullis. 2019. Visualizing and Interacting with Hierarchical Menus in Immersive Augmented Reality. In The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry. 1--9.
[34]
Jing Qian, Jiaju Ma, Xiangyu Li, Benjamin Attal, Haoming Lai, James Tompkin, John F. Hughes, and Jeff Huang. 2019. Portal-ble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented Reality, In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. UIST (2019), 133--145.
[35]
Rebekka S. Renner, Boris M. Velichkovsky, and Jens R. Helmert. 2013. The Perception of Egocentric Distances in Virtual Environments - A Review. ACM Comput. Surv. 46, 2, Article Article 23 (Dec. 2013), 40 pages. http://dx.doi.org/10.1145/2543581.2543590
[36]
Shirin Sadri, Shalva Kohen, Carmine Elvezio, Shawn Sun, Alon Grinshpoon, Gabrielle Loeb, Naomi Basu, and Steven Feiner. 2019. Manipulating 3D Anatomic Models in Augmented Reality: Comparing a Hands-Free Approach and a Manual Approach, In International Symposium on Mixed and Augmented Reality. ISMAR (2019), 93--102.
[37]
Krystian Samp and Stefan Decker. 2010. Supporting menu design with radial layouts, In Proceedings of the International Conference on Advanced Visual Interfaces. AVI (2010), 155--162.
[38]
Martin Spindler, Wolfgang Büschel, and Raimund Dachselt. 2012. Use your head: tangible windows for 3D information spaces in a tabletop environment, In International Conference on Interactive Tabletops and Surfaces. ITS (2012), 245--254. http://dx.doi.org/10.1145/2396636.2396674
[39]
Ian Stavness, Billy Lam, and Sidney Fels. 2010. pCubee: a perspective-corrected handheld cubic display, In Proceedings of the 28th international conference on Human factors in computing systems. CHI (2010), 1381--1390.
[40]
Ian Stavness, Florian Vogt, and Sidney Fels. Cubee: A Cubic 3D Display for Physics-Based Interaction. In ACM SIGGRAPH 2006 Sketches. Association for Computing Machinery, 165--es. http://dx.doi.org/10.1145/1179849.1180055
[41]
Yichen Tang, Ian Stavness, and Sidney S. Fels. 2014. The new pCubee: Multi-touch perspective-corrected cubic display. In Extended Abstracts on Human Factors in Computing Systems (CHI EA). 419--422.
[42]
Michael Tsang, George W. Fitzmaurice, Gordon Kurtenbach, Azam Khan, and Bill Buxton. 2002. Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display, In ACM Symposium on User Interface Software and Technology. UIST (2002), 111--120. http://dx.doi.org/10.1145/571985.572001
[43]
Huawei Tu, Susu Huang, Jiabin Yuan, Xiangshi Ren, and Feng Tian. 2019. Crossing-based selection with virtual reality head-mounted displays, In Proceedings of the Conference on Human Factors in Computing Systems. CHI (2019), 1--14.
[44]
Dimitar Valkov, Frank Steinicke, Gerd Bruder, and Klaus Hinrichs. 2011. 2d touching of 3d stereoscopic objects, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI (2011), 1353--1362.
[45]
Colin Ware, Kevin Arthur, and Kellogg S. Booth. 1993. Fish tank virtual reality. In INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems. ACM, 6. http://dx.doi.org/10.1145/169059.169066
[46]
C. Ware and D. R. Jessome. 1988. Using the bat: a six dimensional mouse for object placement, In Proceedings of Graphics Interface. GI (1988), 119--124.
[47]
Qian Zhou, Georg Hagemann, Sidney Fels, Dylan Fafard, Andrew Wagemakers, Chris Chamberlain, and Ian Stavness. 2018. Coglobe: A Co-Located Multi-Person FTVR Experience. In ACM SIGGRAPH 2018 Emerging Technologies. Association for Computing Machinery, Article Article 5, 2 pages. http://dx.doi.org/10.1145/3214907.3214914
[48]
D. J. Zielinski, D. Nankivil, and R. Kopper. 2017. Specimen Box: A tangible interaction technique for world-fixed virtual reality displays, In IEEE Symposium on 3D User Interfaces. 3DUI (March 2017), 50--58. http://dx.doi.org/10.1109/3DUI.2017.7893317

Cited By

View all
  • (2024)Pressure-Based Menu Selection on a Spherical Tangible DeviceExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651090(1-6)Online publication date: 11-May-2024
  • (2024)A Comparative Usability Study of Physical Multi-touch versus Virtual Desktop-Based Spherical Interfaces2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00100(806-816)Online publication date: 16-Mar-2024
  • (2024)Evaluating an In-Hand Ball-Shaped Controller for Object Manipulation in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00025(10-19)Online publication date: 16-Mar-2024
  • Show More Cited By

Index Terms

  1. GyroSuite: General-Purpose Interactions for Handheld Perspective Corrected Displays

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology
    October 2020
    1297 pages
    ISBN:9781450375146
    DOI:10.1145/3379337
    Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 October 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. gui
    2. hpcd
    3. spatial augmented reality

    Qualifiers

    • Research-article

    Funding Sources

    • ANR

    Conference

    UIST '20

    Acceptance Rates

    Overall Acceptance Rate 842 of 3,967 submissions, 21%

    Upcoming Conference

    UIST '24

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)44
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 06 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Pressure-Based Menu Selection on a Spherical Tangible DeviceExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651090(1-6)Online publication date: 11-May-2024
    • (2024)A Comparative Usability Study of Physical Multi-touch versus Virtual Desktop-Based Spherical Interfaces2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00100(806-816)Online publication date: 16-Mar-2024
    • (2024)Evaluating an In-Hand Ball-Shaped Controller for Object Manipulation in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00025(10-19)Online publication date: 16-Mar-2024
    • (2024)At the Confluence of Software Engineeringand Human-Computer Interaction:A Personal AccountThe French School of Programming10.1007/978-3-031-34518-0_5(89-122)Online publication date: 30-Apr-2024
    • (2022)Tangible Globes for Data Visualisation in Augmented RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517715(1-16)Online publication date: 29-Apr-2022
    • (2021)Spherical World in Miniature: Exploring the Tiny Planets Metaphor for Discrete Locomotion in Virtual Reality2021 IEEE Virtual Reality and 3D User Interfaces (VR)10.1109/VR50410.2021.00057(345-352)Online publication date: Mar-2021

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media