research-article

Integrating Serious Games and Tangible Objects for Functional Handgrip Training: A User Study of Handly in Persons with Multiple Sclerosis.

Authors:

Marijke Vandermaesen,

Karin ConinxAuthors Info & Claims

DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

Pages 924 - 935

https://doi.org/10.1145/2901790.2901841

Published: 04 June 2016 Publication History

Abstract

We present Handly, an integrated upper-limb rehabilitation system for persons with a neurological disorder. Handly consists of tangibles for training four hand tasks with specific functional handgrips and a motivational game. These persons need intensive personalized therapy in order to sustain or enhance their abilities and aptitude in daily activities. Conventional approaches require intense support by a therapist or usage of expensive robots, both of which are not a sustainable model of training. Handly combines tangibles specifically designed for repetitive task-oriented motor skill training of typical daily activities with serious gaming, thus offering a comprehensive approach. A feedback mechanism guides the user and an accessible game environment stimulates individual training. We performed an initial evaluation of Handly with eight persons with Multiple Sclerosis. We show that a tangible-virtual environment for intensive upper-limb rehabilitation is feasible and that this approach is highly appreciated by the patients.

Supplementary Material

suppl.mov (pn373.mp4)

Supplemental video

Download
20.91 MB

References

[1]

Rita Bertoni, Ilse Lamers, Chirstine C Chen, Peter Feys, Davide Cattaneo. 2015. Unilateral and bilateral upper limb dysfunction at body functions, activity and participation levels in people with multiple sclerosis. Multiple Sclerosis Journal.

[2]

Sergi Bermúdez i Badia, Mónica S. Cameirão, 2012. The Neurorehabilitation Training Toolkit (NTT): A Novel Worldwide Accessible Motor Training Approach for At-Home Rehabilitation after Stroke, Stroke Research and Treatment, Article ID 802157, 13 pages.

[3]

Luuk Beursgens, Annick Timmermans, and Panos Markopoulos. 2012. Playful arm hand training after stroke. In Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts, p. 2399--2404.

Digital Library

[4]

Laura Bonzano, Andrea Tacchino, Giampaolo Brichetto, Luca Roccatagliata, Adriano Dessypris, Paola Feraco, Maria L. Lopes De Carvalho, Mario A. Battaglia, Giovanni L. Mancardi, Marco Bove. 2013. Upper limb motor rehabilitation impacts white matter microstructure in multiple sclerosis. Neuroimage. 90: 107--116.

[5]

David M. Brennan, Sue Mawson, Simon Brownsell. 2009. Telerehabilitation: Enabling the remote delivery of healthcare, rehabilitation, and selfmanagement. Studies in Health Technology and Informatics, 145: 231--248.

[6]

Floor Buma, Gert Kwakkel, Nick Ramsey. 2013. Understanding upper limb recovery after stroke. Restorative Neurology and Neuroscience, 31, 6: 707--22.

[7]

Ilaria Carpinella, Davide Cattaneo, Rita Bertoni, Maurizio Ferrarin. 2012. Robot training of upper limb in multiple sclerosis: comparing protocols with or without manipulative task components. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 20, 3: 351--60.

[8]

Jane Case-Smith. 2003. Outcomes in hand rehabilitation using occupational therapy services. American Journal of Occupational Therapy, 57: 499--506.

[9]

Peter Feys, Karin Coninx, Lore Kerkhofs, Tom De Weyer, Veronique Truyens,Anneleen Maris. 2015. Robot-supported upper limb training in a virtual learning environment: a pilot randomized controlled trial in persons with MS. Journal of Neuroengineering and Rehabilitation, 12: 60.

[10]

Domien Gijbe1s, Ilse Lamers, Lore Kerkhofs, Geert Alders, Els Knippenberg, and Peter Feys.2011. The armeo spring as training tool to improve upper limb functionality in multiple sclerosis: a pilot study. Journal of NeuroEngineering and Rehabilitation, 8, 5: 1--5

[11]

Alexander Goodson, Alison H. McGregor, Jane Douglas, Peter Taylor. 2006. Direct, quantitative clinical assessment of hand function: useful and reproducibility, Manual Therapy, 12: 144--152

[12]

Andrew E. Jackson, Raymond John Holt, Peter R. Culmer, Sophie G. Makower, Martin C. Levesley, R. C. Richardson, J. Alistair Cozens, Mark Mon Williams and Bipin B. Bhakta. 2007. Dual robot system for upper limb rehabilitation after stroke: the design process, In Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, 221, 7: 845--857

[13]

Jan Kowalczewski. 2009. Upper extremity neurorehabilitation. Ph.D. Dissertation, University of Alberta, Edmonton, Alberta, Canada.

[14]

Jan Kozalczewski, E. Ravid, A. Prochazka. 2011. Fully-automated test of upper-extremity function. In Proceedings of IEEE engineering in Medicine and Biology Society.

[15]

Gert Kwakkel, Boudewijn J. Kollen, Hermano I. Krebs. 2008. Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review, Neurorehabilitation and neural repair, 22:

[16]

Gert Kwakkel, Roland van Peppen, Robert C. Wagenaar, Sharon Wood Dauphinee, Carol Richards, Ann Ashburn, Kimberly Miller, Nadina Lincoln, Cecily Partridge, Ian Wellwood, and Peter Langhorne. 2004. Effects of augmented exercise therapy time after stroke: a meta-analysis. Stroke, 35, 11: 2529--2539.

[17]

Ilse Lamers, Anneleen Maris, Deborah Severijns, Wouter Dielkens, Sander Geurts, Bart Van Wijmeersch, Peter Feys. 2016. Upper Limb Rehabilitation in People With Multiple Sclerosis: A Systematic Review. Neurorehabilitation and neural repair.

[18]

Catherine E. Lang, Keith R. Lohse, Rebecca L. Birkenmeier. 2015. Dose and timing in neurorehabilitation: prescribing motor therapy after stroke, Current Opinion in Neurology, 28, 6: 549--55.

[19]

Peter Langhorne, Fiona Coupar, Alex Pollock. 2009. Motor recovery after stroke: a systematic review. Lancet Neurology. 8, 8: 741--54.

[20]

Gwyn N. Lewis, Claire Woods, Juliet A. Rosie, Kathryn M. McPherson. 2011. Virtual reality games for rehabilitation: Perspectives from the users and new directions, in Proceeding of International Conference on Virtual Rehabilitation (ICVR), 1--2.

[21]

Gwyn N. Lewis, Juliet A. Rosie. 2012. Virtual Reality games for movement rehabilitation in neurological conditions: how do we meet the needs and expectations of the users' Disability and Rehabilitation, 34, 22: 1880--6

[22]

Rui Loureiro, Farshid Amirabdollahian, Michael Topping, Bart Driessen, and William Harwin. 2003. Upper limb robot mediated stroke therapy - gentle/s approach. Autonomous Robots, 15, 1: 35--51

Digital Library

[23]

Victor W. Mark, Edward Taub, Kashan Bashir, Gary Uswatte, Adriana Delgado, Mary H. Bowman, Camille C. Bryson, Staci McKay, Gary R. Cutter. 2008. Constraint-Induced Movement therapy can improve hemiparetic progressive multiple sclerosis. Preliminary findings. Multiple Sclerosis, 14, 7: 992--4.

[24]

Jan Mehrholz, Anja Hädrich, Thomas Platz, Joachim Kugler, Marcus Pohl. 2012. Electromechanical and robot-assisted arm training for improving generic activities of daily living, arm function, and arm muscle strength after stroke. Cochrane Database Of Systematic Reviews.

[25]

Sofie Notelaers, Tom De Weyer, Johanna Octavia, Karin Coninx, and Peter Feys. 2011. Individualized training for MS- and stroke patients in I-TRAVLE. In Proceedings of the International Conference SKILLS, 267--270.

[26]

Johanna Renny Octavia, Peter Feys and Karin Coninx, 2015. Development of Activity-Related Muscle Fatigue during Robot-Mediated Upper Limb Rehabilitation Training in Persons with Multiple Sclerosis: A Pilot Trial, Multiple Sclerosis International, 1--11.

[27]

Johanna Renny Octavia, Karin Coninx, 2014. Adaptive Personalized Training Games for Individual and Collaborative Rehabilitation of People with Multiple Sclerosis, journal BioMed Research International in the special issue "Advanced User Interfaces for Neurorehabilitation", Article ID 345728, 22 pages. 2014

[28]

Deborah Severijns, Johanna Renny Octavia, Lore Kerkhofs, Karin Coninx, Ilse Lamers. 2015. Investigation of Fatigability during Repetitive Robot-Mediated Arm Training in People with Multiple Sclerosis. PLoS ONE 10, 7.

[29]

Anne Shumwau-cook and Majorie H. Woollacott. 2007. Theoretical framework In Motor control: translating research into clinical practice, Lippincott Williams & Wilkins.

[30]

Patrizio Sale, Valentina Lombardi, Marco Franceschini. 2012. Hand robotics rehabilitation: feasibility and preliminary results of a robotic treatment in patients with hemiparesis. Stroke Research and Treatment. 2012: 820931.

[31]

Patrizio Sale, Stefano Mazzoleni, Valentina Lombardi, Daniele Galafate, Maria P. Massimiani, Federico Posteraro, Carlo Damiani, Marco Franceschini, 2014. Recovery of hand function with robot-assisted therapy in acute stroke patients: a randomized-controlled trial. International Journal of Rehabilitation research. 37, 3: 236--42.

[32]

Christer Sollerman, Arvic Ejeskar: 1995. Sollerman hand function test. A standardized method and its use in tetraplegic patients, Scandinavian Journal of Plastic and Reconstructive Surgery and Hand Surgery, 29, 2: 167--176.

[33]

Annick A. Timmermans, Annemie I. Spooren, Herman Kingma, Henk A. Seelen. 2010. Influence of task-oriented training content on skilled armhand performance in stroke: a systematic review. Neurorehabilitation and Neural Repair, 24, 9: 858--870.

[34]

John Tozzi. 2015. How much would you pay for an old drug? If you have MS, a fortune, Bloomberg Business, Last retrieved on 28 August 2015. http://www.bloomberg.com/news/articles/201504-24/health-the-price-of-multiple-sclerosis-drugsonly-goes-up

[35]

Marijke Vandermaesen, Tom de Weyer, Kris Luyten, and Karin Coninx. 2014. PhysiCube: providing tangible interaction in a pervasive upperlimb rehabilitation system. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI'14). 85--92. DOI=10.1145/2540930.2540936

Digital Library

[36]

Hartwig Woldag and Horst Hummersheim. 2002. Evidence-based physiotherapeutic concepts for improving arm and hand function in stroke patients, Journal of Neurology, 249: 518--528.

[37]

World Health Organization. 2006. Neurological disorders; Public health challenges, WHO Press.

Cited By

Carvalho CTeran LMota MPereira R(2024)Technologies to Support Adaptable Game Design: A Systematic Mapping StudyJournal of the Brazilian Computer Society10.5753/jbcs.2024.309030:1(69-101)Online publication date: 26-Apr-2024
https://doi.org/10.5753/jbcs.2024.3090
Korsten HBaratè ALudovico L(2023)Design, Implementation, and Early Experimentation of a Music Tangible User Interface for Elderly People RehabilitationComputer-Human Interaction Research and Applications10.1007/978-3-031-41962-1_6(108-129)Online publication date: 24-Aug-2023
https://doi.org/10.1007/978-3-031-41962-1_6
Baratè AKorsten HLudovico LOriolo E(2023)Music Tangible User Interfaces and Vulnerable Users: State of the Art and ExperimentationComputer-Human Interaction Research and Applications10.1007/978-3-031-41962-1_1(1-25)Online publication date: 24-Aug-2023
https://doi.org/10.1007/978-3-031-41962-1_1
Show More Cited By

Index Terms

Integrating Serious Games and Tangible Objects for Functional Handgrip Training: A User Study of Handly in Persons with Multiple Sclerosis.

Recommendations

Segara: Integrating Serious Games and Handgrip for Hand Rehabilitation in Rheumatoid Arthritis Patients
Chinese CHI '21: Proceedings of the Ninth International Symposium of Chinese CHI

We present Segara, an integrated hand rehabilitation system for patients with rheumatoid arthritis (RA). Studies have shown that people with RA need intensive and personalized treatment to maintain or enhance their ability and aptitude in daily ...
Serious Games for Upper Limb Rehabilitation Following Stroke
VS-GAMES '09: Proceedings of the 2009 Conference in Games and Virtual Worlds for Serious Applications

Stroke is a leading cause of severe physical disability, causing a range of impairments. Frequently stroke survivors are left with partial paralysis on one side of the body and movement can be severely restricted in the affected side’s hand and arm. We ...
Liftacube: a prototype for pervasive rehabilitation in a residential setting
PETRA '13: Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments

Persons with neurological disorders or spinal cord injuries, such as Cerebrovascular Accident (CVA) or Paraplegia patients, experience significantly reduced physical abilities during their activities of daily living. By frequent and intense physical ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

June 2016

1374 pages

ISBN:9781450340311

DOI:10.1145/2901790

General Chair:
Marcus Foth
Queensland University of Technology
,
Program Chairs:
Wendy Ju
Stanford University
,
Ronald Schroeter
Queensland University of Technology
,
Stephen Viller
University of Queensland

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Agentschap voor Innovatie door Wetenschap en Technologie

Conference

DIS '16

Sponsor:

SIGCHI

DIS '16: Designing Interactive Systems Conference 2016

June 4 - 8, 2016

QLD, Brisbane, Australia

Acceptance Rates

DIS '16 Paper Acceptance Rate 107 of 418 submissions, 26%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
306
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)7

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Carvalho CTeran LMota MPereira R(2024)Technologies to Support Adaptable Game Design: A Systematic Mapping StudyJournal of the Brazilian Computer Society10.5753/jbcs.2024.309030:1(69-101)Online publication date: 26-Apr-2024
https://doi.org/10.5753/jbcs.2024.3090
Korsten HBaratè ALudovico L(2023)Design, Implementation, and Early Experimentation of a Music Tangible User Interface for Elderly People RehabilitationComputer-Human Interaction Research and Applications10.1007/978-3-031-41962-1_6(108-129)Online publication date: 24-Aug-2023
https://doi.org/10.1007/978-3-031-41962-1_6
Baratè AKorsten HLudovico LOriolo E(2023)Music Tangible User Interfaces and Vulnerable Users: State of the Art and ExperimentationComputer-Human Interaction Research and Applications10.1007/978-3-031-41962-1_1(1-25)Online publication date: 24-Aug-2023
https://doi.org/10.1007/978-3-031-41962-1_1
Carvalho CTeran LMota MPereira RSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)A systematic mapping study on digital game adaptation dimensionsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559122(1-14)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559122
Mégard CBouchigny SPouplin SBonnyaud CBertholier LGoulamhoussen RFoulon PRoche NBarbot F(2022)Including Grip Strength Activities into Tabletop Training EnvironmentsSmart Multimedia10.1007/978-3-031-22061-6_19(261-271)Online publication date: 25-Aug-2022
https://dl.acm.org/doi/10.1007/978-3-031-22061-6_19
Zhao XDeng ZJin MLi XZhang WJin MYing FWang QWang G(2021)Segara: Integrating Serious Games and Handgrip for Hand Rehabilitation in Rheumatoid Arthritis PatientsProceedings of the Ninth International Symposium of Chinese CHI10.1145/3490355.3490366(101-104)Online publication date: 16-Oct-2021
https://dl.acm.org/doi/10.1145/3490355.3490366
Subramanian SDahl YVereijken BSvanæs D(2020)ExerTiles: A Tangible Interactive Physiotherapy Toolkit for Balance Training with Older AdultsProceedings of the 32nd Australian Conference on Human-Computer Interaction10.1145/3441000.3441043(233-244)Online publication date: 2-Dec-2020
https://dl.acm.org/doi/10.1145/3441000.3441043
Olcay DUlusam Seckiner S(2020)Gamification of Upper Limb Tangible-Wearable Rehabilitation DevicesIndustrial Engineering in the Digital Disruption Era10.1007/978-3-030-42416-9_29(328-335)Online publication date: 17-Mar-2020
https://doi.org/10.1007/978-3-030-42416-9_29
Arango-López JCastillo Ossa LCollazos CVela FFardoun HFardoun HPérez SHassan Ade la Guia E(2019)Pervasive games in the rehabilitation processProceedings of the 5th Workshop on ICTs for improving Patients Rehabilitation Research Techniques10.1145/3364138.3364167(140-143)Online publication date: 11-Sep-2019
https://dl.acm.org/doi/10.1145/3364138.3364167
Yang ZJie SYanhao JYixuan BKuznetsov SSaakes DWakkary RGeurts LHayes LLau M(2019)Interactive Tabletop Arm Reaching ExerciseProceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3294109.3300978(423-428)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3294109.3300978
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents