Abstract
Virtual reality (VR) has recently emerged as a promising technology to rehabilitate upper limb functions after stroke. To promote the recovery of functions, retraining physiological movement patterns is essential. However, it is still unclear whether VR can elicit functional movements that are similar to those performed in the real world (RW). This study aimed to investigate the kinematics of reach-to-grasp and transport movements performed in the real world and immersive VR by examining whether kinematic differences between the two conditions exist and their extent. A within-subject repeated-measures study was conducted. A realistic setup resembling a supermarket shelf unit was built in RW and VR. The analysis compared reaching and transport gestures in VR and RW, also considering potential differences due to: (i) holding the controller needed to interact with virtual items, (ii) hand dominance, and (iii) target positions. Ten healthy young adults were enrolled in the study. Motion data analysis showed that reach-to-grasp and transport required more time in VR, and that holding the controller had no effects. No major differences occurred between the two hands. Joint angles, except for thorax rotation, and hand trajectory curvature were comparable across conditions, suggesting that VR has the potentialities to retrain physiological movement patterns. Results were satisfying, though they did not demonstrate the superiority of ecological environments in eliciting natural gestures. Further studies should determine the extent of kinematic similarity required to obtain functional gains in VR-based upper limb rehabilitation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
Data are available upon request to the corresponding author.
Notes
HTC devices description is available at: https://www.vive.com/eu/.
Oculus devices description is available at: https://www.oculus.com/.
HMD Geometry Database, available at: https://risa2000.github.io/hmdgdb/.
Cybergrasp system v2.0 user-guide: https://www.upc.edu/sct/documents_equipament/d_184_id-485.pdf.
Unity Real-Time Development Platform, available at: https://unity.com.
Steam VR, available at: https://store.steampowered.com/steamvr.
VICON VR Alignment Tool, available at: https://www.Vicon.com/Software/ Utilities-and-Sdk/vr-Alignment-Tool/.
VICON Datastream SDK, available at: https://www.Vicon.Com/Software/ Datastream-Sdk/.
VICON Nexus, Available at: https://www.Vicon.Com/Software/Nexus/.
Full Body Modeling with Plug-in Gait, available at: https://docs.Vicon.com/Display/Nexus210/Plug-In+Gait+Reference+Guide.
HTC Vive setting up room-scale play area, available at: https://www.vive.com/nz/support/vive-pro-hmd/category_howto/setting-up-room-scale-play-area.html
Calibrate a VICON system, available at: https://docs.vicon.com/display/Nexus27/Calibrate+a+Vicon+system
Create a new subject from a template, available at: https://docs.vicon.com/display/Nexus27/Create+a+new+subject+from+a+template
References
Arlati S, Spoladore D, Baldassini D, Sacco M, Greci L (2018) VirtualCruiseTour: an AR/VR application to promote shore excursions on cruise ships. In: De Paolis LT, Bourdot P (eds) Augmented reality, virtual reality, and computer graphics. Springer, Cham, pp 133–147
Arlati S, Di Santo SG, Franchini F, Mondellini M, Filiputti B, Luchi M, Greci L (2021) Acceptance and usability of immersive virtual reality in older adults with objective and subjective cognitive decline. J Alzheimer’s Dis 80(3):1025–1038. https://doi.org/10.3233/JAD-201431
Assi A, Bakouny Z, Karam M, Massaad A, Skalli W, Ghanem I (2016) Three-dimensional kinematics of upper limb anatomical movements in asymptomatic adults: dominant vs. non-dominant. Hum Mov Sci 50:10–18. https://doi.org/10.1016/j.humov.2016.09.002
Bagesteiro LB, Sainburg RL (2002) Handedness: dominant arm advantages in control of limb dynamics. J Neurophysiol 88(5):2408–2421. https://doi.org/10.1152/jn.00901.2001
Bradshaw JL, Bradshaw JA, Nettleton NC (1990) Abduction, adduction and hand differences in simple and serial movements. Neuropsychologia 28(9):917–931. https://doi.org/10.1016/0028-3932(90)90108-Z
Câmara J, Ferreira R, Teixeira L, Nóbrega J, Romeira C, Badia SBI, Faria AL (2021) Efficacy of adaptive cognitive training through desktop virtual reality and paper-and-pencil in the treatment of mental and behavioral disorders. Virtual Reality. https://doi.org/10.1007/s10055-021-00559-6
Cirstea MC, Mitnitski AB, Feldman AG, Levin MF (2003) Interjoint coordination dynamics during reaching in stroke. Exp Brain Res 151(3):289–300. https://doi.org/10.1007/s00221-003-1438-0
Connolly JD, Goodale MA (1999) The role of visual feedback of hand position in the control of manual prehension. Exp Brain Res 125(3):281–286. https://doi.org/10.1007/s002210050684
Costela FM, Woods RL (2020) The impact of field of view on understanding of a movie is reduced by magnifying around the center of interest. Translational Vision Sci Technol 9(8):1–11. https://doi.org/10.1167/tvst.9.8.6
Cummings JJ, Bailenson JN (2016) How immersive is enough? a meta-analysis of the effect of immersive technology on user presence. Media Psychol 19(2):272–309. https://doi.org/10.1080/15213269.2015.1015740
Diffendaffer AZ, Fleisig GS, Ivey B, Aune KT (2019) Kinematic and kinetic differences between left-and right-handed professional baseball pitchers. Sports Biomech 18(4):448–455. https://doi.org/10.1080/14763141.2018.1429489
Fahle M, Henke-Fahle S (1996) Interobserver variance in perceptual performance and learning. Invest Ophthalmol vis Sci 37(5):869–877
Faria AL, Andrade A, Soares L, Badia ISB (2016) Benefits of virtual reality based cognitive rehabilitation through simulated activities of daily living: a randomized controlled trial with stroke patients. J NeuroEng Rehabil 13(1):1–12. https://doi.org/10.1186/s12984-016-0204-z
Furmanek MP, Schettino LF, Yarossi M, Kirkman S, Adamovich SV, Tunik E (2019) Coordination of reach-to-grasp in physical and haptic-free virtual environments. J Neuroeng Rehabil 16(1):78. https://doi.org/10.1186/s12984-019-0525-9
Gerig N, Mayo J, Baur K, Wittmann F, Riener R, Wolf P (2018) Missing depth cues in virtual reality limit performance and quality of three dimensional reaching movements. PLoS ONE 13(1):e0189275. https://doi.org/10.1371/journal.pone.0189275
Gershon P, Klatzky RL, Lee R (2015) Handedness in a virtual haptic environment: assessments from kinematic behavior and modeling. Acta Physiol (oxf) 155:37–42. https://doi.org/10.1016/j.actpsy.2014.11.014
González-Alvarez C, Subramanian A, Pardhan S (2007) Reaching and grasping with restricted peripheral vision. Ophthalmic Physiol Opt 27(3):265–274. https://doi.org/10.1111/j.1475-1313.2007.00476.x
Grassini S, Laumann K, Rasmussen Skogstad M (2020) The use of virtual reality alone does not promote training performance (but sense of presence does). Front Psychol. https://doi.org/10.3389/fpsyg.2020.01743
Haaland KY, Prestopnik JL, Knight RT, Lee RR (2004) Hemispheric asymmetries for kinematic and positional aspects of reaching. Brain 127(5):1145–1158. https://doi.org/10.1093/brain/awh133
Holmes D, Charles D, Morrow P, McClean S, McDonough S (2016) Usability and performance of leap motion and oculus rift for upper arm virtual reality stroke rehabilitation. J Altern Med Res 9(4):1–10
IJsselsteijn WA, Riva G (2003). Being there: the experience of presence in mediated environments. In Being there: concepts, effects and measurements of user presence in synthetic environments (pp. 3-16). IOS Press
Jamiy FEl, & Marsh R (2019) Distance estimation in virtual reality and augmented reality: a survey. IEEE International Conference on Electro Information Technology, 2019-May, 063–068 https://doi.org/10.1109/EIT.2019.8834182
Jang SH (2013) Motor function-related maladaptive plasticity in stroke: a review. NeuroRehabilitation 32(2):311–316
Jones TA (2017) Motor compensation and its effects on neural reorganization after stroke. Nat Rev Neurosci 18(5):267–280. https://doi.org/10.1038/nrn.2017.26
Knaut LA, Subramanian SK, McFadyen BJ, Bourbonnais D, Levin MF (2009) Kinematics of pointing movements made in a virtual versus a physical 3-Dimensional environment in healthy and stroke subjects. Arch Phys Med Rehabil 90(5):793–802. https://doi.org/10.1016/j.apmr.2008.10.030
Koenig ST, Krch D, Lange BS, Rizzo A (2019) Virtual reality and rehabilitation In Handbook of rehabilitation psychology, 3rd ed (pp 521–539) American Psychological Association
Laver KE, Lange B, George S, Deutsch JE, Saposnik G, Crotty M (2017) Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev. https://doi.org/10.1002/14651858.CD008349.pub4
Lee S, Kim Y, Lee BH (2016) Effect of virtual reality-based bilateral upper extremity training on upper extremity function after stroke: a randomized controlled clinical trial. Occup Ther Int 23(4):357–368. https://doi.org/10.1002/oti.1437
Levin MF (2020) What is the potential of virtual reality for post-stroke sensorimotor rehabilitation? Expert Rev Neurother 20(3):195–197. https://doi.org/10.1080/14737175.2020.1727741
Levin MF, Kleim JA, Wolf SL (2009) What do motor “recovery” and “compensationg” mean in patients following stroke? Neurorehabil Neural Repair 23(4):313–319. https://doi.org/10.1177/1545968308328727
Levin MF, Magdalon EC, Michaelsen SM, Quevedo AAF (2015) Quality of grasping and the role of haptics in a 3-D immersive virtual reality environment in individuals with stroke. IEEE Trans Neural Syst Rehabil Eng 23(6):1047–1055. https://doi.org/10.1109/TNSRE.2014.2387412
Liebermann DG, Berman S, Weiss PL, Levin MF (2012) Kinematics of reaching movements in a 2-D virtual environment in adults with and without stroke. IEEE Trans Neural Syst Rehabil Eng 20(6):778–787. https://doi.org/10.1109/TNSRE.2012.2206117
Lindsay MP, Norrving B, Sacco RL, Brainin M, Hacke W, Martins S, Feigin V (2019) World stroke organization (WSO): global stroke fact sheet 2019. Int J Stroke 14(8):806–817. https://doi.org/10.1177/1747493019881353
Liu L, Lierey RV, Nieuwenhuizen C, Martens JB (2009) Comparing aimed movements in the real world and in virtual reality. Proc IEEE Virtual Reality. https://doi.org/10.1109/VR.2009.4811026
Loftus A, Murphy S, McKenna I, Mon-Williams M (2004) Reduced fields of view are neither necessary nor sufficient for distance underestimation but reduce precision and may cause calibration problems. Exp Brain Res 158(3):328–335. https://doi.org/10.1007/s00221-004-1900-7
Lum PS, Mulroy S, Amdur RL, Requejo P, Prilutsky BI, Dromerick AW (2009b) Gains in upper extremity function after stroke via recovery or compensation: potential differential effects on amount of real-world limb use. Top Stroke Rehabil 16(4):237–253
Lum PS, Mulroy S, Amdur RL, Requejo P, Prilutsky BI, Dromerick AW (2009a) Gains in upper extremity function after stroke via recovery or compensation: Potential differential effects on amount of real-world limb use Topics in Stroke Rehabilitation, 16(4), 237–253 Retrieved from http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L355283571%0Ahttp://dx.doi.org/https://doi.org/10.1310/tsr1604-237
Magdalon EC, Michaelsen SM, Quevedo AA, Levin MF (2011) Comparison of grasping movements made by healthy subjects in a 3-dimensional immersive virtual versus physical environment. Acta Physiol (oxf) 138(1):126–134. https://doi.org/10.1016/j.actpsy.2011.05.015
Matsuki K, Matsuki KO, Mu S, Yamaguchi S, Ochiai N, Sasho T, Banks SA (2011) In vivo 3-dimensional analysis of scapular kinematics: comparison of dominant and non-dominant shoulders. J Shoulder Elbow Surg 20(4):659–665. https://doi.org/10.1016/j.jse.2010.09.012
Mayo NE, Wood-Dauphinee S, Côté R, Durcan L, Carlton J (2002) Activity, participation, and quality of life 6 months poststroke. Arch Phys Med Rehabil 83(8):1035–1042. https://doi.org/10.1053/apmr.2002.33984
Mekbib DB, Han J, Zhang L, Fang S, Jiang H, Zhu J, Xu D (2020) Virtual reality therapy for upper limb rehabilitation in patients with stroke: a meta-analysis of randomized clinical trials. Brain Inj 34(4):456–465. https://doi.org/10.1080/02699052.2020.1725126
Mieschke PE, Elliott D, Helsen WF, Carson RG, Coull JA (2001) Manual asymmetries in the preparation and control of goal-directed movements. Brain Cogn 45(1):129–140. https://doi.org/10.1006/brcg.2000.1262
Minderer M, Harvey CD, Donato F, Moser EI (2016) Neuroscience: virtual reality explored. Nature 533(7603):324–325. https://doi.org/10.1038/nature17899
Mondellini M, Arlati S, Pizzagalli S, Greci L, Sacco M, Ferrigno G, Sacco M (2018) Assessment of the usability of an immersive virtual supermarket for the cognitive rehabilitation of elderly patients: a pilot study on young adults 2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH), 1–8 https://doi.org/10.1109/SeGAH.2018.8401313
Mottura S, Fontana L, Arlati S, Zangiacomi A, Redaelli C, Sacco M (2015) A virtual reality system for strengthening awareness and participation in rehabilitation for post-stroke patients. J Multimodal User Interfaces. https://doi.org/10.1007/s12193-015-0184-5
Murphy S, Maraj C, Hurter J (2018) Field of view: Evaluation of Oculus Rift and HTC Vive
Norrving B, Kissela B (2013) The global burden of stroke and need for a continuum of care Neurology, 80(3 SUPPL.2), S5–S12. Retrieved from http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emed11&NEWS=N&AN=2013103123
Olbrich M, Graf H, Keil J, Gad R, Bamfaste S Nicolini F (2018) Virtual reality based space operations – a study of ESA’s potential for VR based training and simulation Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 10909 LNCS, 438–451 https://doi.org/10.1007/978-3-319-91581-4_33
Parsons TD (2015) Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences. Front Human Neurosci 9:660. https://doi.org/10.3389/fnhum.2015.00660
Pieri L, Serino S, Cipresso P, Mancuso V, Riva G, Pedroli E (2021) The ObReco-360°: a new ecological tool to memory assessment using 360° immersive technology. Virtual Reality. https://doi.org/10.1007/s10055-021-00526-1
Pollock A, Farmer SE, Brady MC, Langhorne P, Mead GE, Mehrholz J, van Wijck F (2014) Interventions for improving upper limb function after stroke. Cochrane Database Syst Rev. https://doi.org/10.1002/14651858.CD010820.pub2
Przybyla A, Good DC, Sainburg RL (2012) Dynamic dominance varies with handedness: reduced interlimb asymmetries in left-handers. Exp Brain Res 216(3):419–431. https://doi.org/10.1007/s00221-011-2946-y
Rizzo A, Kim GJJ (2005) A SWOT analysis of the field of virtual reality rehabilitation and therapy. Presence Teleoperators Virtual Environ 14(2):119–146. https://doi.org/10.1162/1054746053967094
Sachlikidis A, Salter C (2007) A biomechanical comparison of dominant and non-dominant arm throws for speed and accuracy. Sports Biomech 6(3):334–344. https://doi.org/10.1080/14763140701491294
Sampson M, Shau YW, James King M (2012) Bilateral upper limb trainer with virtual reality for post-stroke rehabilitation: case series report. Disabil Rehabil Assist Technol 7(1):55–62. https://doi.org/10.3109/17483107.2011.562959
Schettino LF, Adamovich SV, Poizner H (2003) Effects of object shape and visual feedback on hand configuration during grasping. Exp Brain Res 151(2):158–166. https://doi.org/10.1007/s00221-003-1435-3
Slater M, Steed A (2000) A virtual presence counter. Presence Teleoperators Virtual Environ. 9(5):413–434. https://doi.org/10.1162/105474600566925
Stanney K, Lawson BD, Rokers B, Dennison M, Fidopiastis C, Stoffregen T, Fulvio JM (2020) Identifying causes of and solutions for cybersickness in immersive technology: reformulation of a research and development agenda. Int J Human-Computer Interact 36(19):1783–1803. https://doi.org/10.1080/10447318.2020.1828535
Stewart JC, Gordon J, Winstein CJ (2013) Planning and adjustments for the control of reach extent in a virtual environment. J Neuroeng Rehabil. https://doi.org/10.1186/1743-0003-10-27
Subramanian S, Beaudoin C, Levin MF (2008) Arm pointing movements in a three dimensional virtual environment: effect of two different viewing media 2008 Virtual Rehabilitation, IWVR, 181–185 https://doi.org/10.1109/ICVR.2008.4625157
Viau A, Feldman AG, McFadyen BJ, Levin MF (2004) Reaching in reality and virtual reality: a comparison of movement kinematics in healthy subjects and in adults with hemiparesis. J Neuroeng Rehabil. https://doi.org/10.1186/1743-0003-1-11
Villa R, Tidoni E, Porciello G, Aglioti SM (2018) Violation of expectations about movement and goal achievement leads to sense of agency reduction. Exp Brain Res 236(7):2123–2135. https://doi.org/10.1007/s00221-018-5286-3
Weech S, Kenny S, Barnett-Cowan M (2019) Presence and cybersickness in virtual reality are negatively related: a review. Front Psychol 10:158
Xiao X, Hu H, Li L, Li L (2019) Comparison of dominant hand to non-dominant hand in conduction of reaching task from 3D kinematic data: trade-off between successful rate and movement efficiency. Math Biosci Eng 16(3):1611–1624. https://doi.org/10.3934/mbe.2019077
Yates M, Kelemen A, Sik Lanyi C (2016) Virtual reality gaming in the rehabilitation of the upper extremities post-stroke. Brain Inj 30(7):855–863. https://doi.org/10.3109/02699052.2016.1144146
Yoshizaki K, Hamada J, Tamai K, Sahara R, Fujiwara T, Fujimoto T (2009) Analysis of the scapulohumeral rhythm and electromyography of the shoulder muscles during elevation and lowering: comparison of dominant and non-dominant shoulders. J Shoulder Elbow Surg 18(5):756–763. https://doi.org/10.1016/j.jse.2009.02.021
Zahabi M, Abdul Razak AM (2020) Adaptive virtual reality-based training: a systematic literature review and framework. Virtual Reality 24(4):725–752. https://doi.org/10.1007/s10055-020-00434-w
Zimmerli L, Krewer C, Gassert R, Müller F, Riener R, Lünenburger L (2012) Validation of a mechanism to balance exercise difficulty in robot-assisted upper-extremity rehabilitation after stroke. J NeuroEng Rehabil. https://doi.org/10.1186/1743-0003-9-6
Acknowledgements
The authors would like to acknowledge Dr. Lize Wilders and of Dr. Cheriel Hofstad for their help in the performance of the study.
Funding
This work received no specific funding.
Author information
Authors and Affiliations
Contributions
SA, NK, GF, and MS had contributed to conceptualization; SA and NK were involved in methodology; SA and GP took part in software and investigation; SA prepared the original draft; NK, GP, GF, and MS wrote, reviewed, and edited the manuscript; NK and MS helped with resources; and GF and MS carried out supervision.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflict of interest to declare.
Consent to participate
All participants signed an informed consent form.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Arlati, S., Keijsers, N., Paolini, G. et al. Kinematics of aimed movements in ecological immersive virtual reality: a comparative study with real world. Virtual Reality 26, 885–901 (2022). https://doi.org/10.1007/s10055-021-00603-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-021-00603-5