research-article

Understanding the Heisenberg Effect of Spatial Interaction: A Selection Induced Error for Spatially Tracked Input Devices

Authors:

Jan Gugenheimer,

Marco Combosch,

Enrico RukzioAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 10

https://doi.org/10.1145/3313831.3376876

Published: 23 April 2020 Publication History

Abstract

Virtual and augmented reality head-mounted displays (HMDs) are currently heavily relying on spatially tracked input devices (STID) for interaction. These STIDs are all prone to the phenomenon that a discrete input (e.g. button press) will disturb the position of the tracker, resulting in a different selection point during ray-cast interaction (Heisenberg Effect of Spatial Interaction). Besides the knowledge of its existence, there is currently a lack of a deeper understanding of its severity, structure and impact on throughput and angular error during a selection task. In this work, we present a formal evaluation of the Heisenberg effect and the impact of body posture, arm position and STID degrees of freedom on its severity. In a Fitt's Law inspired user study (N=16), we found that the Heisenberg effect is responsible for 30.45% of the overall errors occurring during a pointing task, but can be reduced by 25.4% using a correction function.

Supplementary Material

MP4 File (a747-wolf-presentation.mp4)

Download
63.49 MB

References

[1]

Mayra Donaji Barrera Machuca and Wolfgang Stuerzlinger. 2019. The Effect of Stereo Display Deficiencies on Virtual Hand Pointing. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 207, 14 pages.

Digital Library

[2]

Anil Ufuk Batmaz and Wolfgang Stuerzlinger. 2019. The Effect of Rotational Jitter on 3D Pointing Tasks. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, NY, NY, USA, Article LBW2112, 6 pages.

Digital Library

[3]

Doug Bowman, Chadwick Wingrave, Joshua Campbell, and Vinh Ly. 2001. Using pinch gloves for both natural and abstract interaction techniques in virtual environments. Proceedings of HCI International (01 2001).

[4]

William Buxton, Ralph Hill, and Peter Rowley. 1985. Issues and Techniques in Touch-sensitive Tablet Input. SIGGRAPH Comput. Graph. 19, 3 (July 1985), 215--224.

Digital Library

[5]

Alex Olwal Steven Feiner. 2003. The flexible pointer: An interaction technique for selection in augmented and virtual reality. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST'03). 81--82.

[6]

C.C.A.M. Gielen, E. J. Vrijenhoek, T. Flash, and S.F.W. Neggers. 1997. Arm Position Constraints During Pointing and Reaching in 3-D Space. Journal of Neurophysiology 78, 2 (1997), 660--673. 9307103.

[7]

Tovi Grossman and Ravin Balakrishnan. 2006. The Design and Evaluation of Selection Techniques for 3D Volumetric Displays. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, NY, NY, USA, 3--12.

Digital Library

[8]

Niels Henze, Enrico Rukzio, and Susanne Boll. 2011. 100,000,000 Taps: Analysis and Improvement of Touch Performance in the Large. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, NY, NY, USA, 133--142.

Digital Library

[9]

Ricardo Jota, Miguel A. Nacenta, Joaquim A. Jorge, Sheelagh Carpendale, and Saul Greenberg. 2010. A Comparison of Ray Pointing Techniques for Very Large Displays. In Proceedings of Graphics Interface 2010 (GI '10). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 269--276. http://dl.acm.org/citation.cfm?id=1839214.1839261

Digital Library

[10]

Luv Kohli and Mary Whitton. 2005. The Haptic Hand: Providing User Interface Feedback with the Non-dominant Hand in Virtual Environments. In Proceedings of Graphics Interface 2005 (GI '05). Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada, 1--8. http://dl.acm.org/citation.cfm?id=1089508.1089510

[11]

Werner A. König, Jens Gerken, Stefan Dierdorf, and Harald Reiterer. 2009. Adaptive Pointing -- Design and Evaluation of a Precision Enhancing Technique for Absolute Pointing Devices. In Human-Computer Interaction -- INTERACT 2009, Tom Gross, Jan Gulliksen, Paula Kotzé, Lars Oestreicher, Philippe Palanque, Raquel Oliveira Prates, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 658--671.

Digital Library

[12]

Regis Kopper, Doug A. Bowman, Mara G. Silva, and Ryan P. McMahan. 2010. A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies 68, 10 (2010), 603 -- 615.

Digital Library

[13]

I. Scott MacKenzie. 1992. Fitts' Law As a Research and Design Tool in Human-computer Interaction. Humam-Computer Interaction 7, 1 (March 1992), 91--139.

Digital Library

[14]

Ville Mäkelä, Tomi Heimonen, and Markku Turunen. 2014. Magnetic Cursor: Improving Target Selection in Freehand Pointing Interfaces. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14). ACM, NY, NY, USA, Article 112, 6 pages.

Digital Library

[15]

Sven Mayer, Valentin Schwind, Robin Schweigert, and Niels Henze. 2018. The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 653, 13 pages.

Digital Library

[16]

L. E. Miller, M. Theeuwen, and C. C. A. M. Gielen. 1992. The control of arm pointing movements in three dimensions. Experimental Brain Research 90, 2 (01 Aug 1992), 415--426.

[17]

Salim Nana-Ibrahim, Stéphane Vieilledent, Pierre Leroyer, Fabrice Viale, and Maurice Zattara. 2008. Target size modifies anticipatory postural adjustments and subsequent elementary arm pointing. Experimental Brain Research 184, 2 (01 Jan 2008), 255--260.

[18]

Mathieu Nancel, Emmanuel Pietriga, Olivier Chapuis, and Michel Beaudouin-Lafon. 2015. Mid-Air Pointing on Ultra-Walls. ACM Trans. Comput.-Hum. Interact. 22, 5, Article 21 (Aug. 2015), 62 pages.

Digital Library

[19]

Andriy Pavlovych and Wolfgang Stuerzlinger. 2009. The Tradeoff Between Spatial Jitter and Latency in Pointing Tasks. In Proceedings of the 1st ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '09). ACM, NY, NY, USA, 187--196.

Digital Library

[20]

E. S. Pearson, R. B. D'Agostino, and K. O. Bowman. 1977. Tests for departure from normality: Comparison of powers. Biometrika 64, 2 (08 1977), 231--246.

[21]

Jean-François Pilon, Sophie J. De Serres, and Anatol G. Feldman. 2007. Threshold position control of arm movement with anticipatory increase in grip force. Experimental Brain Research 181, 1 (01 Jul 2007), 49--67.

[22]

Katrin Plaumann, Matthias Weing, Christian Winkler, Michael Müller, and Enrico Rukzio. 2018. Towards Accurate Cursorless Pointing: The Effects of Ocular Dominance and Handedness. Personal Ubiquitous Comput. 22, 4 (Aug. 2018), 633--646.

Digital Library

[23]

I. Poupyrev, T. Ichikawa, S. Weghorst, and M. Billinghurst. 1998. Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques. Computer Graphics Forum 17, 3 (1998), 41--52.

[24]

Shashi Shekhar, Steven K. Feiner, and Walid G. Aref. 2015. Spatial Computing. Commun. ACM 59, 1 (Dec. 2015), 72--81.

Digital Library

[25]

R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International Journal of Human-Computer Studies 61, 6 (2004), 751 -- 789. Fitts' law 50 years later: applications and contributions from human-computer interaction.

Digital Library

[26]

R. J. Teather, A. Pavlovych, W. Stuerzlinger, and I. S. MacKenzie. 2009. Effects of tracking technology, latency, and spatial jitter on object movement. In 2009 IEEE Symposium on 3D User Interfaces. 43--50.

Digital Library

[27]

IBM Van der Fits, AWJ Klip, LA Van Eykern, and M Hadders-Algra. 1998. Postural adjustments accompanying fast pointing movements in standing, sitting and lying adults. Experimental Brain Research 120, 2 (1998), 202--216.

[28]

T. S. Young, R. J. Teather, and I. S. MacKenzie. 2017. An arm-mounted inertial controller for 6DOF input: Design and evaluation. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). 26--35.

Cited By

Jeong JJeong J(2024)Effect of Onset Position of Ray Casting in Virtual RealityExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650905(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650905
Sindhupathiraja SUllah ADelamare WHasan K(2024)Exploring Bi-Manual Teleportation in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00095(754-764)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00095
Krüger MGerrits TRömer TKuhlen TWeissker T(2024)IntenSelect+: Enhancing Score-Based Selection in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337207730:5(2829-2838)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372077
Show More Cited By

Index Terms

Understanding the Heisenberg Effect of Spatial Interaction: A Selection Induced Error for Spatially Tracked Input Devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction devices
      1. Pointing devices

Recommendations

Investigating mid-air pointing interaction for projector phones
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

Projector phones, mobile phones with built-in projectors, might significantly change the way we are going to use and interact with mobile phones. The potential of combining the mobile and the projected display and further the potential of the mid-air ...
Back-of-device interaction allows creating very small touch devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper, we explore how to add pointing input capabilities to very small screen devices. On first sight, touchscreens seem to allow for particular compactness, because they integrate input and screen into the same physical space. The opposite is ...
Comparing cursor orientations for mouse, pointer, and pen interaction
CHI '05: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Most graphical user interfaces provide visual cursors to facilitate interaction with input devices such as mice, pointers, and pens. These cursors often include directional cues that could influence the stimulus-response compatibility of user input. We ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
574
Total Downloads

Downloads (Last 12 months)141
Downloads (Last 6 weeks)17

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jeong JJeong J(2024)Effect of Onset Position of Ray Casting in Virtual RealityExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650905(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650905
Sindhupathiraja SUllah ADelamare WHasan K(2024)Exploring Bi-Manual Teleportation in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00095(754-764)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00095
Krüger MGerrits TRömer TKuhlen TWeissker T(2024)IntenSelect+: Enhancing Score-Based Selection in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337207730:5(2829-2838)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372077
Pfeuffer KGellersen HGonzalez-Franco M(2024)Design Principles and Challenges for Gaze + Pinch Interaction in XRIEEE Computer Graphics and Applications10.1109/MCG.2024.338296144:3(74-81)Online publication date: May-2024
https://doi.org/10.1109/MCG.2024.3382961
Monteiro PCoelho HGonçalves GMelo MBessa M(2024)Exploring the user experience of hands-free VR interaction methods during a Fitts’ taskComputers and Graphics10.1016/j.cag.2023.10.005117:C(1-12)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1016/j.cag.2023.10.005
Chen DGiordano MBenko HGrossman TSantosa S(2023)GazeRayCursor: Facilitating Virtual Reality Target Selection by Blending Gaze and Controller RaycastingProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615693(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615693
Waugh KMcGill MFreeman E(2023)Demonstrating Proxemic Cursor Input for Touchless DisplaysProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3618014(1-2)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3618014
Waugh KMcGill MFreeman E(2023)Proxemic Cursor Interactions for Touchless Widget ControlProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614525(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614525
Chowdhury SDelamare WIrani PHasan K(2023)PAWS: Personalized Arm and Wrist Movements With Sensitivity Mappings for Controller-Free Locomotion in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36042647:MHCI(1-21)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604264
Wagner ULystbæk MManakhov PGrønbæk JPfeuffer KGellersen H(2023)A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User InterfacesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581423(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581423
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents