research-article

Ambient Assisted Living and Social Robots: Towards Learning Relations between User’s Daily Routines and Mood

Authors:

Berardina de Carolis,

Stefano Ferilli,

Nicola MacchiaruloAuthors Info & Claims

UMAP '22 Adjunct: Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization

Pages 123 - 129

https://doi.org/10.1145/3511047.3537691

Published: 04 July 2022 Publication History

Abstract

Endowing social robots with the ability to learn and predict the user’s activities during the day is one of the main aims of research in the field of ambient assisted living. Social robots should support older adults with daily activity and, at the same time, they should contribute to emotional wellness by considering affective factors in everyday situations. The main goal of this research is to investigate whether it is possible to learn relations between the user’s affective state and daily routines, made by activities, with the aid of a social robot, Pepper in this case. To this aim, we use the WoMan system able to incrementally learn daily routines and the context in which activities take place. WoMan will be used as a back-end module of the Daily Diary application running on the Pepper robot to collect data concerning daily activities and their relation to emotions and mood. Results of this phase of the research will be used to assess the validity of the approach in ambient assisted living houses for seniors to make the social robot able to provide not only proactive service assistance but also an affective empathic experience.

References

[1]

Aitor Almeida, Rubén Mulero, Piercosimo Rametta, Vladimir Urošević, Marina Andrić, and Luigi Patrono. 2019. A critical analysis of an IoT—aware AAL system for elderly monitoring. Future Generation Computer Systems 97 (2019), 598–619.

Digital Library

[2]

Farshid Amirabdollahian, Rieks Op den Akker, Sandra Bedaf, Richard Bormann, Heather Draper, Vanessa Evers, Gert Jan Gelderblom, Carolina Gutierrez Ruiz, David Hewson, Ninghang Hu, 2013. Accompany: Acceptable robotiCs COMPanions for AgeiNG Years—Multidimensional aspects of human-system interactions. In 2013 6th International Conference on Human System Interactions (HSI). IEEE, 570–577.

[3]

Ionut Anghel, Tudor Cioara, Dorin Moldovan, Marcel Antal, Claudia Daniela Pop, Ioan Salomie, Cristina Bianca Pop, and Viorica Rozina Chifu. 2020. Smart environments and social robots for age-friendly integrated care services. International Journal of Environmental Research and Public Health 17, 11(2020), 3801.

[4]

Joost Broekens, Marcel Heerink, Henk Rosendal, 2009. Assistive social robots in elderly care: a review. Gerontechnology 8, 2 (2009), 94–103.

[5]

Berardina De Carolis, Stefano Ferilli, and Domenico Redavid. 2015. Incremental learning of daily routines as workflows in a smart home environment. ACM Transactions on Interactive Intelligent Systems (TiiS) 4, 4(2015), 1–23.

Digital Library

[6]

Giovanna Castellano, Berardina De Carolis, Nicola Macchiarulo, and Olimpia Pino. 2022. Detecting Emotions During Cognitive Stimulation Training with the Pepper Robot. In Human-Friendly Robotics 2021. Springer, 61–75.

[7]

Yuxin Chen, Ziqi Zhang, Chunfeng Yuan, Bing Li, Ying Deng, and Weiming Hu. 2021. Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 13359–13368.

[8]

Yuxin Chen, Ziqi Zhang, Chunfeng Yuan, Bing Li, Ying Deng, and Weiming Hu. 2021. Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition. CoRR abs/2107.12213(2021). arXiv:2107.12213https://arxiv.org/abs/2107.12213

[9]

Gabriella Cortellessa, Riccardo De Benedictis, Francesca Fracasso, Andrea Orlandini, Alessandro Umbrico, and Amedeo Cesta. 2021. AI and robotics to help older adults: Revisiting projects in search of lessons learned. Paladyn, Journal of Behavioral Robotics 12, 1 (2021), 356–378.

[10]

Angelo Costa, Ester Martinez-Martin, Miguel Cazorla, and Vicente Julian. 2018. PHAROS—PHysical Assistant RObot System. Sensors 18, 8 (2018). https://www.mdpi.com/1424-8220/18/8/2633

[11]

Berardina De Carolis, Valeria Carofiglio, I Grimandli, Nicola Macchiarulo, G Palestra, and O Pino. 2020. Using the pepper robot in cognitive stimulation therapy for people with mild cognitive impairment and mild dementia. In Proceedings of ACHI-The Thirteenth International Conference on Advances in Computer-Human Interactions. 452–457.

[12]

Berardina De Carolis and Stefano Ferilli. 2014. Towards Learning Relations Between User Daily Routines and Mood. In UMAP Workshops. Citeseer.

[13]

Claudia Di Napoli and Silvia Rossi. 2019. A layered architecture for socially assistive robotics as a service. In 2019 IEEE international conference on systems, man and cybernetics (SMC). IEEE, 352–357.

Digital Library

[14]

Alessandro Di Nuovo, Frank Broz, Ning Wang, Tony Belpaeme, Angelo Cangelosi, Ray Jones, Raffaele Esposito, Filippo Cavallo, and Paolo Dario. 2018. The multi-modal interface of Robot-Era multi-robot services tailored for the elderly. Intelligent Service Robotics 11, 1 (2018), 109–126.

Digital Library

[15]

Peter Ford Dominey, Victor Paléologue, Amit Kumar Pandey, and Jocelyne Ventre-Dominey. 2017. Improving quality of life with a narrative companion. In 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 127–134.

Digital Library

[16]

Natalie C Ebner, Michaela Riediger, and Ulman Lindenberger. 2010. FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation. Behavior research methods 42, 1 (2010), 351–362.

[17]

Paul Ekman. 1999. Basic emotions. Handbook of cognition and emotion 98, 45-60 (1999), 16.

[18]

Floriana Esposito, Giovanni Semeraro, Nicola Fanizzi, and Stefano Ferilli. 2000. Multistrategy theory revision: Induction and abduction in inthelex. Machine Learning 38, 1 (2000), 133–156.

Digital Library

[19]

Iram Fatima, Muhammad Fahim, Young-Koo Lee, and Sungyoung Lee. 2013. A unified framework for activity recognition-based behavior analysis and action prediction in smart homes. Sensors 13, 2 (2013), 2682–2699.

[20]

David Feil-Seifer and Maja J Mataric. 2005. Defining socially assistive robotics. In 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005. IEEE, 465–468.

[21]

S. Ferilli. 2014. WoMan: Logic-based Workflow Learning and Management. IEEE Transaction on Systems, Man and Cybernetics: Systems 44 (2014), 744–756. Issue 6.

[22]

Stefano Ferilli, Floriana Esposito, Domenico Redavid, and Sergio Angelastro. 2016. Predicting process behavior in woman. In Conference of the Italian Association for Artificial Intelligence. Springer, 308–320.

Digital Library

[23]

Hemant Ghayvat, Muhammad Awais, Sharnil Pandya, Hao Ren, Saeed Akbarzadeh, Subhas Chandra Mukhopadhyay, Chen Chen, Prosanta Gope, Arpita Chouhan, and Wei Chen. 2019. Smart aging system: uncovering the hidden wellness parameter for well-being monitoring and anomaly detection. Sensors 19, 4 (2019), 766.

[24]

Chih-Lin Hu, Chitrin Bamrung, Wasita Kamintra, Somchoke Ruengittinun, Pattanasak Mongkolwat, Lin Hui, and Shih-Hsiang Lo. 2019. Using camera array to detect elderly falling and distribute alerting media for smart home care. In 2019 8th International Conference on Innovation, Communication and Engineering (ICICE). IEEE, 98–101.

[25]

Jun Liu, Amir Shahroudy, Dong Xu, and Gang Wang. 2016. Spatio-Temporal LSTM with Trust Gates for 3D Human Action Recognition. In Computer Vision – ECCV 2016, Bastian Leibe, Jiri Matas, Nicu Sebe, and Max Welling (Eds.). Springer International Publishing, Cham, 816–833.

[26]

Marco Manca, Fabio Paternò, Carmen Santoro, Eleonora Zedda, Chiara Braschi, Roberta Franco, and Alessandro Sale. 2021. The impact of serious games with humanoid robots on mild cognitive impairment older adults. International Journal of Human-Computer Studies 145 (2021), 102509.

[27]

Amit Kumar Pandey and Rodolphe Gelin. 2018. A mass-produced sociable humanoid robot: Pepper: The first machine of its kind. IEEE Robotics & Automation Magazine 25, 3 (2018), 40–48.

[28]

S.U. Park, J.H. Park, M.A. Al-masni, M.A. Al-antari, Md.Z. Uddin, and T.-S. Kim. 2016. A Depth Camera-based Human Activity Recognition via Deep Learning Recurrent Neural Network for Health and Social Care Services. Procedia Computer Science 100 (2016), 78–84. https://doi.org/10.1016/j.procs.2016.09.126 International Conference on ENTERprise Information Systems/International Conference on Project MANagement/International Conference on Health and Social Care Information Systems and Technologies, CENTERIS/ProjMAN / HCist 2016.

[29]

M. Pesic and W. van der Aalst. 2006. A declarative approach for flexible business processes management. In Proceedings of the 2006 international conference on Business Process Management Workshops (Vienna, Austria) (BPM’06). Springer-Verlag, 169–180.

Digital Library

[30]

Olimpia Pino, Giuseppe Palestra, Rosalinda Trevino, and Berardina De Carolis. 2020. The humanoid robot NAO as trainer in a memory program for elderly people with mild cognitive impairment. International Journal of Social Robotics 12, 1 (2020), 21–33.

[31]

Carlos Ramos, Juan Carlos Augusto, and Daniel Shapiro. 2008. Ambient intelligence—the next step for artificial intelligence. IEEE Intelligent Systems 23, 2 (2008), 15–18.

Digital Library

[32]

James A Russell. 1980. A circumplex model of affect.Journal of personality and social psychology 39, 6(1980), 1161.

[33]

Matteo Spezialetti, Giuseppe Placidi, and Silvia Rossi. 2020. Emotion Recognition for Human-Robot Interaction: Recent Advances and Future Perspectives. Frontiers in Robotics and AI 7 (2020). https://doi.org/10.3389/frobt.2020.532279

[34]

Ioan Susnea, Luminita Dumitriu, Mihai Talmaciu, Emilia Pecheanu, and Dan Munteanu. 2019. Unobtrusive monitoring the daily activity routine of elderly people living alone, with low-cost binary sensors. Sensors 19, 10 (2019), 2264.

[35]

Elena Torta, Franz Werner, David O Johnson, James F Juola, Raymond H Cuijpers, Marco Bazzani, Johannes Oberzaucher, John Lemberger, Hadas Lewy, and Joseph Bregman. 2014. Evaluation of a small socially-assistive humanoid robot in intelligent homes for the care of the elderly. Journal of Intelligent & Robotic Systems 76, 1 (2014), 57–71.

Digital Library

[36]

Md Uddin, Weria Khaksar, Jim Torresen, 2018. Ambient sensors for elderly care and independent living: a survey. Sensors 18, 7 (2018), 2027.

[37]

Jan Vanus, Jana Belesova, Radek Martinek, Jan Nedoma, Marcel Fajkus, Petr Bilik, and Jan Zidek. 2017. Monitoring of the daily living activities in smart home care. Human-centric Computing and Information Sciences 7, 1 (2017), 1–34.

Digital Library

[38]

Ju Wang, Nicolai Spicher, Joana M Warnecke, Mostafa Haghi, Jonas Schwartze, and Thomas M Deserno. 2021. Unobtrusive health monitoring in private spaces: The smart home. Sensors 21, 3 (2021), 864.

[39]

Wentao Zhu, Cuiling Lan, Junliang Xing, Wenjun Zeng, Yanghao Li, Li Shen, and Xiaohui Xie. 2016. Co-Occurrence Feature Learning for Skeleton Based Action Recognition Using Regularized Deep LSTM Networks. Proceedings of the AAAI Conference on Artificial Intelligence 30, 1 (Mar. 2016). https://ojs.aaai.org/index.php/AAAI/article/view/10451

Cited By

Ganal ESiol LLugrin B(2023)PePUT: A Unity Toolkit for the Social Robot Pepper2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309447(1012-1019)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309447

Recommendations

Ambient assisted living: elderly people's needs and how to face them
SAME '08: Proceedings of the 1st ACM international workshop on Semantic ambient media experiences

This paper is about challenges of technological and media innovations concerning elderly's quality of life. Ambient Assisted Living (AAL) aims at producing technological and media support to help elderly people to stay at their homes longer. There are ...
Towards better social integration through mobile web 2.0 ambient assisted living devices
SAC '11: Proceedings of the 2011 ACM Symposium on Applied Computing

Within a few decades, the number of elderly people in Europe and Northern America will increase significantly. One of the challenges of this development is to keep elderly people integrated in society. We present a prototype for a Web 2.0-enabled ...
An ambient assisted living nighttime wandering system for elderly
iiWAS '16: Proceedings of the 18th International Conference on Information Integration and Web-based Applications and Services

The Assistive living technologies provide good results for the support of specific activities transforming a home into a smart home. In this paper, we present a personalized ambient support system for elderly suffering from Alzheimer's dementia and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UMAP '22 Adjunct: Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization

July 2022

409 pages

ISBN:9781450392327

DOI:10.1145/3511047

General Chairs:
Alejandro Bellogin
Universidad Autonoma de Madrid, Spain
,
Ludovico Boratto
University of Cagliari, Italy
,
Olga C. Santos
UNED, Spain
,
Program Chairs:
Liliana Ardissono
Universita di Torino, Italy
,
Bart Knijnenburg
Clemson University, United States

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 July 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

UMAP '22

Sponsor:

UMAP '22: 30th ACM Conference on User Modeling, Adaptation and Personalization

July 4 - 7, 2022

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Sponsor:
sigchi
sigchi

33rd ACM Conference on User Modeling, Adaptation and Personalization

June 16 - 19, 2025

New York City , NY , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
171
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)7

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ganal ESiol LLugrin B(2023)PePUT: A Unity Toolkit for the Social Robot Pepper2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309447(1012-1019)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309447

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents