short-paper

Public Access

Interactive Learning and Adaptation for Robot Assisted Therapy for People with Dementia

Authors:

Konstantinos Tsiakas,

Cheryl Abellanoza,

Fillia MakedonAuthors Info & Claims

PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Article No.: 58, Pages 1 - 4

https://doi.org/10.1145/2910674.2935849

Published: 29 June 2016 Publication History

Abstract

In this paper, we present an adaptive cognitive music game designed to monitor and improve the attention levels of people with dementia. The goal of this game is to provide a customized protocol based on user needs and preferences, following the Reinforcement Learning (RL) framework. The game adjusts its parameters (e.g., difficulty level) so as to help the user complete the task successfully, while keeping them engaged. The main contribution of this paper is an interactive learning and adaptation framework that enables and facilitates the adaptation of the robot behavior towards new users, providing a safe, tailored and efficient interaction.

References

[1]

Global health and aging - the burden of dementia. https://www.nia.nih.gov/research/publication/longer-lives-and-disability/burden-dementia, 2011.

[2]

M. Abujelala, C. Abellanoza, A. Sharma, and F. Makedon. Brain-ee: Brain enjoyment evaluation using commercial eeg headband. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 2016.

Digital Library

[3]

A. Baker. An investigation of long-term effects of group music therapy on agitation levels of people with alzheimer's disease. volume 11, pages 330--338, 2007.

[4]

K. Baraka and M. Veloso. Adaptive interaction of persistent robots to user temporal preferences. In Social Robotics, pages 61--71. Springer, 2015.

[5]

F. Cruz et al. Interactive reinforcement learning through speech guidance in a domestic scenario. In Proc. IJCNN, pages 1--8. IEEE, 2015.

[6]

M. Dewar et al. Insights into spared memory capacity in amnestic mci and alzheimer's disease via minimal interference. volume 78, pages 189--199, 2011.

[7]

S. Douglas, I. James, and C. Ballard. Non-pharmacological interventions in dementia. volume 10, pages 171--179, 2004.

[8]

P. Georgakopoulos, M. Chatzidimitriou, and M. Tsolaki. A review of interventions with assistive technologies for patients with cognitive impairment. Handbook of Research on Innovations in the Diagnosis and Treatment of Dementia, page 118, 2015.

[9]

L. Gerdner. Effects of individualized versus classical "relaxation" music on the frequency of agitation in elderly persons with alzheimer's disease and related disorders. volume 12, pages 49--65, 2000.

[10]

N. Giullian et al. Detailed requirements for robots in autism therapy. In Proc SMC 2010, pages 2595--2602. IEEE.

[11]

M. H. Hsu, R. Flowerdew, M. Parker, et al. Individual music therapy for managing neuropsychiatric symptoms for people with dementia and their carers: a cluster randomised controlled feasibility study. BMC geriatrics, 2015.

[12]

N. Hurless et al. Music genre preference and tempo alter alpha and beta waves in human non-musicians. The Premier Undergraduate Neuroscience Journal, 2013.

[13]

T. Karydis et al. Performance characterization of self-calibrating protocols for wearable eeg applications. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments, page 38. ACM, 2015.

Digital Library

[14]

W. B. Knox and P. Stone. Reinforcement learning from simultaneous human and mdp reward. In Proc. AAMAS, pages 475--482, 2012.

Digital Library

[15]

K. Kurbatskaya et al. Upregulation of calpain activity precedes tau phosphorylation and loss of synaptic proteins in alzheimer disease brain. Acta Neuropathologica Communications, 2016.

[16]

A. Libin and J. Cohen-Mansfield. Therapeutic robocat for nursing home residents with dementia: preliminary inquiry. American journal of Alzheimer's disease and other dementias, 19(2):111--116, 2004.

[17]

H. Modares et al. Optimized assistive human--robot interaction using reinforcement learning. 2015.

[18]

L. Ozdemir and N. Akdemir. Effects of multisensory stimulation on cognition, depression and anxiety levels of mildly-affected alzheimer's patients. Journal of the neurological sciences, 283(1):211--213, 2009.

[19]

A. Plotnikov et al. Exploiting real-time eeg analysis for assessing flow in games. In Advanced Learning Technologies (ICALT), 2012 IEEE 12th International Conference on, pages 688--689. IEEE, 2012.

Digital Library

[20]

M. Prince, M. Guerchet, M. Prina, B. U. P. Association, et al. World Alzheimer report 2013: Journey of caring: an analysis of long-term care for dementia. Alzheimer's Disease International, 2013.

[21]

S. Samson et al. Efficacy of musical interventions in dementia: methodological requirements of nonpharmacological trials. Annals of the New York Academy of Sciences, 1337(1):249--255, 2015.

[22]

B. Sandak et al. Computational paradigm to elucidate the effects of arts-based approaches and interventions: Individual and collective emerging behaviors in artwork construction. PloS one, 10(6):e0126467, 2015.

[23]

E. Senft, P. Baxter, and T. Belpaeme. Human-guided learning of social action selection for robot-assisted therapy. In 4th Workshop on Machine Learning for Interactive Systems, 2015.

[24]

S. Smith and E. Vela. Environmental context-dependent memory: A review and meta-analysis. volume 8, pages 203--220, 2001.

[25]

R. S. Sutton and A. G. Barto. Introduction to reinforcement learning, volume 135. MIT Press Cambridge, 1998.

Digital Library

[26]

A. Tapus. Improving the quality of life of people with dementia through the use of socially assistive robots. In Advanced Technologies for Enhanced Quality of Life, 2009. AT-EQUAL'09., pages 81--86. IEEE, 2009.

Digital Library

[27]

K. Tsiakas. Facilitating safe adaptation of interactive agents using interactive reinforcement learning. In Companion Publication of the 21st International Conference on Intelligent User Interfaces, pages 106--109. ACM, 2016.

Digital Library

[28]

K. Tsiakas, M. Huber, and F. Makedon. A multimodal adaptive session manager for physical rehabilitation exercising. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 2015.

Digital Library

[29]

K. Wada, T. Shibata, et al. Robot therapy for elders affected by dementia. Engineering in Medicine and Biology Magazine, IEEE, 2008.

Cited By

Carvalho CTeran LMota MPereira R(2024)Technologies to Support Adaptable Game Design: A Systematic Mapping StudyJournal of the Brazilian Computer Society10.5753/jbcs.2024.309030:1(69-101)Online publication date: 26-Apr-2024
https://doi.org/10.5753/jbcs.2024.3090
Carvalho CTeran LMota MPereira RSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)A systematic mapping study on digital game adaptation dimensionsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559122(1-14)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559122
Zhang CWang ZRanzato MBeygelzimer ADauphin YLiang PVaughan J(2021)Provably efficient multi-task reinforcement learning with model transferProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3541773(19771-19783)Online publication date: 6-Dec-2021
https://dl.acm.org/doi/10.5555/3540261.3541773
Show More Cited By

Recommendations

An Interactive Learning and Adaptation Framework for Adaptive Robot Assisted Therapy
PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

In this paper, we present an interactive learning and adaptation framework. The framework combines Interactive Reinforcement Learning methods to effectively adapt and refine a learned policy to cope with new users. We argue that implicit feedback ...
Facilitating Safe Adaptation of Interactive Agents using Interactive Reinforcement Learning
IUI '16 Companion: Companion Publication of the 21st International Conference on Intelligent User Interfaces

In this paper, we propose a learning framework for the adaptation of an interactive agent to a new user. We focus on applications where safety and personalization are essential, as Rehabilitation Systems and Robot Assisted Therapy. We argue that ...
Environment Guided Interactive Reinforcement Learning: Learning from Binary Feedback in High-Dimensional Robot Task Environments
AAMAS '22: Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems

Continuous Action-space Interactive Reinforcement learning (CAIR) is the first continuous action-space interactive reinforcement learning algorithm that can out-preform state-of-the-art reinforcement learning algorithms early on in training. We test ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

June 2016

455 pages

ISBN:9781450343374

DOI:10.1145/2910674

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

PETRA '16

PETRA '16: 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

June 29 - July 1, 2016

Island, Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
461
Total Downloads

Downloads (Last 12 months)58
Downloads (Last 6 weeks)17

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Carvalho CTeran LMota MPereira R(2024)Technologies to Support Adaptable Game Design: A Systematic Mapping StudyJournal of the Brazilian Computer Society10.5753/jbcs.2024.309030:1(69-101)Online publication date: 26-Apr-2024
https://doi.org/10.5753/jbcs.2024.3090
Carvalho CTeran LMota MPereira RSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)A systematic mapping study on digital game adaptation dimensionsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559122(1-14)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559122
Zhang CWang ZRanzato MBeygelzimer ADauphin YLiang PVaughan J(2021)Provably efficient multi-task reinforcement learning with model transferProceedings of the 35th International Conference on Neural Information Processing Systems10.5555/3540261.3541773(19771-19783)Online publication date: 6-Dec-2021
https://dl.acm.org/doi/10.5555/3540261.3541773
den Hengst FGrua Eel Hassouni AHoogendoorn M(2020)Reinforcement learning for personalization: A systematic literature reviewData Science10.3233/DS-2000283:2(107-147)Online publication date: 10-Apr-2020
https://doi.org/10.3233/DS-200028
Unbehaun DTaugerbeck SAal KVaziri DLehmann JTolmie PWieching RWulf V(2020)Notes of memories: Fostering social interaction, activity and reminiscence through an interactive music exergame developed for people with dementia and their caregiversHuman–Computer Interaction10.1080/07370024.2020.1746910(1-34)Online publication date: 24-Jun-2020
https://doi.org/10.1080/07370024.2020.1746910
Dixon EBrewster SFitzpatrick GCox AKostakos V(2019)Understanding the Occupational Therapists Method to Inform the Design of Technologies for People with DementiaExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3308453(1-6)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290607.3308453

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten