research-article

Open access

Object Manipulations in VR Show Task- and Object-Dependent Modulation of Motor Patterns

Authors:

Jaime Maldonado and

Christoph ZetzscheAuthors Info & Claims

VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

December 2021

Article No.: 41, Pages 1 - 9

https://doi.org/10.1145/3489849.3489858

Published: 08 December 2021 Publication History

All formats PDF

Abstract

Humans can perform object manipulations in VR in spite of missing haptic and acoustic information. Whether their movements under these artificial conditions do still rely on motor programs based on natural experience or are impoverished due to the restrictions imposed by VR is unclear. We investigated whether reach-to-place and reach-to-grasp movements in VR can still be adapted to the task and to the specific properties of the objects being handled, or whether they reflect a stereotypic, task- and object-independent motor program. We analyzed reach-to-grasp and reach-to-place movements from participants performing an unconstrained ”set-the-table” task involving a variety of different objects in virtual reality. These actions were compared based on their kinematic features. We encountered significant differences in peak speed and the duration of the deceleration phase which are modulated depending on the action and on the manipulated object. The flexibility of natural human sensorimotor control thus is at least partially transferred and exploited in impoverished VR conditions. We discuss possible explanations of this behavior and the implications for the design of object manipulations in VR.

References

[1]

Satyajit Ambike and James P. Schmiedeler. 2013. Invariant geometric characteristics of spatial arm motion. Experimental Brain Research 229, 1 (jun 2013), 113–124. https://doi.org/10.1007/s00221-013-3599-9

[2]

Sivakumar Balasubramanian, Alejandro Melendez-Calderon, Agnes Roby-Brami, and Etienne Burdet. 2015. On the analysis of movement smoothness. Journal of NeuroEngineering and Rehabilitation 12, 1 (dec 2015). https://doi.org/10.1186/s12984-015-0090-9

[3]

Ettiene Burdet and Theodore E. Milner. 1998. Quantization of human motions and learning of accurate movements. Biological Cybernetics 78, 4 (may 1998), 307–318. https://doi.org/10.1007/s004220050435

[4]

Qiuwen Cai, Junhua Li, and Jinyi Long. 2021. Effect of Physical and Virtual Feedback on Reach-to-Grasp Movements in Virtual Environments. IEEE Transactions on Cognitive and Developmental Systems (2021), 1–1. https://doi.org/10.1109/tcds.2021.3066618

[5]

Andrea Cavallo, Atesh Koul, Caterina Ansuini, Francesca Capozzi, and Cristina Becchio. 2016. Decoding intentions from movement kinematics. Scientific Reports 6, 1 (nov 2016). https://doi.org/10.1038/srep37036

[6]

Michel Desmurget, Denis Pelisson, Yves Rossetti, and Claude Prablanc. 1998. From Eye to Hand: Planning Goal-directed Movements. Neuroscience & Biobehavioral Reviews 22, 6 (oct 1998), 761–788. https://doi.org/10.1016/s0149-7634(98)00004-9

[7]

Ida Egmose and Simo Køppe. 2017. Shaping of Reach-to-Grasp Kinematics by Intentions: A Meta-Analysis. Journal of Motor Behavior 50, 2 (jun 2017), 155–165. https://doi.org/10.1080/00222895.2017.1327407

[8]

J. Randall Flanagan, Miles C. Bowman, and Roland S. Johansson. 2006. Control strategies in object manipulation tasks. Current Opinion in Neurobiology 16, 6 (dec 2006), 650–659. https://doi.org/10.1016/j.conb.2006.10.005

[9]

Mariusz P. Furmanek, Luis F. Schettino, Mathew Yarossi, Sofia Kirkman, Sergei V. Adamovich, and Eugene Tunik. 2019. Coordination of reach-to-grasp in physical and haptic-free virtual environments. Journal of NeuroEngineering and Rehabilitation 16, 1 (jun 2019). https://doi.org/10.1186/s12984-019-0525-9

[10]

Roland S. Johansson and J. Randall Flanagan. 2009. Coding and use of tactile signals from the fingertips in object manipulation tasks. Nature Reviews Neuroscience 10, 5 (apr 2009), 345–359. https://doi.org/10.1038/nrn2621

[11]

Sophie Kenny, Naureen Mahmood, Claire Honda, Michael J. Black, and Nikolaus F. Troje. 2019. Perceptual Effects of Inconsistency in Human Animations. ACM Transactions on Applied Perception 16, 1 (mar 2019), 1–18. https://doi.org/10.1145/3301411

Digital Library

[12]

Russell V. Lenth. 2021. emmeans: Estimated Marginal Means, aka Least-Squares Means. https://CRAN.R-project.org/package=emmeans R package version 1.6.2-1.

[13]

Steson Lo and Sally Andrews. 2015. To transform or not to transform: using generalized linear mixed models to analyse reaction time data. Frontiers in Psychology 6 (aug 2015). https://doi.org/10.3389/fpsyg.2015.01171

[14]

Eliane C. Magdalon, Stella M. Michaelsen, Antonio A. Quevedo, and Mindy F. Levin. 2011. Comparison of grasping movements made by healthy subjects in a 3-dimensional immersive virtual versus physical environment. Acta Psychologica 138, 1 (sep 2011), 126–134. https://doi.org/10.1016/j.actpsy.2011.05.015

[15]

H. Nagasaki. 1989. Asymmetric velocity and acceleration profiles of human arm movements. Experimental Brain Research 74, 2 (1989). https://doi.org/10.1007/bf00248865

[16]

Wendy L. Nelson. 1983. Physical principles for economies of skilled movements. Biological Cybernetics 46, 2 (feb 1983), 135–147. https://doi.org/10.1007/bf00339982

Digital Library

[17]

Dennis A. Nowak, Stefan Glasauer, and Joachim Hermsdörfer. 2004. How predictive is grip force control in the complete absence of somatosensory feedback?Brain 127, 1 (jan 2004), 182–192. https://doi.org/10.1093/brain/awh016

[18]

Charalambos Papaxanthis, Thierry Pozzo, and Paul Stapley. 1998. Effects of movement direction upon kinematic characteristics of vertical arm pointing movements in man. Neuroscience Letters 253, 2 (sep 1998), 103–106. https://doi.org/10.1016/s0304-3940(98)00604-1

[19]

Shahina Pardhan, Amy Scarfe, Rupert Bourne, and Matthew Timmis. 2017. A Comparison of Reach-to-Grasp and Transport-to-Place Performance in Participants With Age-Related Macular Degeneration and Glaucoma. Investigative Opthalmology & Visual Science 58, 3 (mar 2017), 1560. https://doi.org/10.1167/iovs.16-20273

[20]

R Core Team. 2021. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/

[21]

Karinne Ramirez-Amaro, Constantin Uhde, Tamas Bates, and Gordon Cheng. 2019. A benchmarking dataset for automatic symbolic grounding from virtual demonstrations. In 2nd International Workshop on Computational Models of Affordance in Robotics (ICRA).

[22]

Marco Santello, Martha Flanders, and John F. Soechting. 1998. Postural Hand Synergies for Tool Use. The Journal of Neuroscience 18, 23 (dec 1998), 10105–10115. https://doi.org/10.1523/jneurosci.18-23-10105.1998

[23]

Henrik Singmann, Ben Bolker, Jake Westfall, Frederik Aust, and Mattan S. Ben-Shachar. 2021. afex: Analysis of Factorial Experiments. https://CRAN.R-project.org/package=afex R package version 0.28-1.

[24]

Henrik Singmann and David Kellen. 2019. An Introduction to Mixed Models for Experimental Psychology. In New Methods in Cognitive Psychology. Routledge, 4–31. https://doi.org/10.4324/9780429318405-2

[25]

James C. Thompson, J. Gregory Trafton, and Patrick McKnight. 2011. The Perception of Humanness from the Movements of Synthetic Agents. Perception 40, 6 (jan 2011), 695–704. https://doi.org/10.1068/p6900

[26]

Constantin Uhde, Nicolas Berberich, Karinne Ramirez-Amaro, and Gordon Cheng. 2020. The Robot as Scientist: Using Mental Simulation to Test Causal Hypotheses Extracted from Human Activities in Virtual Reality. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE. https://doi.org/10.1109/iros45743.2020.9341505

[27]

David A. Winter. 2009. Biomechanics and Motor Control of Human Movement (4th ed.). John Wiley & Sons, Inc.

[28]

Bing Yu, David Gabriel, Larry Noble, and Kai-Nan An. 1999. Estimate of the Optimum Cutoff Frequency for the Butterworth Low-Pass Digital Filter. Journal of Applied Biomechanics 15, 3 (aug 1999), 318–329. https://doi.org/10.1123/jab.15.3.318

Cited By

Yang XZhang YYang X(2023)Redirected Placement: Evaluating the Redirection of Passive Props during Reach-to-Place in Virtual RealityProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615688(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615688

Recommendations

Virtual Object Categorisation Methods: Towards a Richer Understanding of Object Grasping for Virtual Reality
VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

Object categorisation methods have been historically used in literature for understanding and collecting real objects together into meaningful groups and can be used to define human interaction patterns (i. e grasping). When investigating grasping ...
Read More
Can Haptic Feedback on One Virtual Object Increase the Presence of Another Virtual Object?
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

This paper investigated whether increased presence from experiencing haptic feedback on one virtual object can transfer to another virtual object. Two similar studies were run in different environments: an immersive virtual environment and a mixed ...
Read More
Fingertip Tactile Devices for Virtual Object Manipulation and Exploration
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

One of the main barriers to immersivity during object manipulation in virtual reality is the lack of realistic haptic feedback. Our goal is to convey compelling interactions with virtual objects, such as grasping, squeezing, pressing, lifting, and ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

December 2021

563 pages

ISBN:9781450390927

DOI:10.1145/3489849

Editors:
Yuichi Itoh
Aoyama Gakuin University, Japan
,
Kazuki Takashima
Tohoku University, Japan
,
Parinya Punpongsanon
Osaka University, Japan
,
Misha Sra
University of California, Santa Barbara, USA
,
Kazuyuki Fujita
Tohoku University, Japan
,
Shigeo Yoshida
The University of Tokyo, Japan
,
Tham Piumsomboon
University of Canterbury, New Zealand

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 December 2021

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VRST '21

Sponsor:

VRST '21: 27th ACM Symposium on Virtual Reality Software and Technology

December 8 - 10, 2021

Osaka, Japan

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Upcoming Conference

VRST '24

Sponsor:
sigchi
sigchi

30th ACM Symposium on Virtual Reality Software and Technology

October 9 - 11, 2024

Trier , Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
417
Total Downloads

Downloads (Last 12 months)114
Downloads (Last 6 weeks)7

Other Metrics

View Author Metrics

Citations

Cited By

Yang XZhang YYang X(2023)Redirected Placement: Evaluating the Redirection of Passive Props during Reach-to-Place in Virtual RealityProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615688(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615688

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents