research-article

The EMPATHIC project: mid-term achievements

PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Pages 629 - 638

https://doi.org/10.1145/3316782.3322764

Published: 05 June 2019 Publication History

Abstract

The goal of active aging is to promote changes in the elderly community so as to maintain an active, independent and socially-engaged lifestyle. Technological advancements currently provide the necessary tools to foster and monitor such processes. This paper reports on mid-term achievements of the European H2020 EMPATHIC project, which aims to research, innovate, explore and validate new interaction paradigms and platforms for future generations of personalized virtual coaches to assist the elderly and their carers to reach the active aging goal, in the vicinity of their home. The project focuses on evidence-based, user-validated research and integration of intelligent technology, and context sensing methods through automatic voice, eye and facial analysis, integrated with visual and spoken dialogue system capabilities. In this paper, we describe the current status of the system, with a special emphasis on its components and their integration, the creation of a Wizard of Oz platform, and findings gained from user interaction studies conducted throughout the first 18 months of the project.

References

[1]

Graham Alexander. 2010. Behavioural coaching-the GROW model. Excellence in coaching: The industry guide (2010), 83--93.

[2]

Luisa Brinkschulte, Natascha Mariacher, Stephan Schlögl, Maria Inès Torres, Raquel Justo, Javier Mikel Olaso, Anna Esposito, Gennaro Cordasco, Gérard Chollet, Cornelius Glackin, et al. 2018. The EMPATHIC project: building an expressive, advanced virtual coach to improve independent healthy-life-years of the elderly. In SMARTER LIVES 2018: digitalisation and quality of life in the ageing society. Universität Inssbrück, 36--52.

[3]

Gennaro Cordasco, Marilena Esposito, Francesco Masucci, Maria Teresa Riviello, Anna Esposito, Gérard Chollet, Stephan Schlögl, Pierrick Milhorat, and Gianni Pelosi. 2014. Assessing voice user interfaces: the vAssist system prototype. In 2014 5th IEEE Conference on Cognitive Infocommunications. IEEE, 91--96.

[4]

Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly (1989), 319--340.

Digital Library

[5]

Richard C Davis, T Scott Saponas, Michael Shilman, and James A Landay. 2007. SketchWizard: Wizard of Oz prototyping of pen-based user interfaces. In Proceedings of the 20th annual ACM symposium on User interface software and technology. ACM, 119--128.

Digital Library

[6]

Ondřej Dušek and Filip Jurcicek. 2015. Training a natural language generator from unaligned data. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Vol. 1. 451--461.

[7]

Anna Esposito, Terry Amorese, Marialucia Cuciniello, Antonietta M Esposito, Alda Troncone, Maria Inés Torres, Stephan Schlögl, and Gennaro Cordasco. 2018. Seniors' Acceptance of Virtual Humanoid Agents. In Italian Forum of Ambient Assisted Living. Springer, 429--443.

[8]

Anna Esposito, Stephan Schlögl, Terry Amorese, Antonietta Esposito, Maria Inés Torres, Francesco Masucci, and Gennaro Cordasco. 2018. Seniors' sensing of agents' personality from facial expressions. In International Conference on Computers Helping People with Special Needs. Springer, 438--442.

[9]

Armin Fiedler and Malte Gabsdil. 2002. Supporting progressive refinement of Wizard-of-Oz experiments. In Proceedings of the Sixth International Conference on Intelligent Tutoring Systems Workshop, Vol. 6.

[10]

Marc Hassenzahl. 2004. The interplay of beauty, goodness, and usability in interactive products. Human-computer interaction 19, 4 (2004), 319--349.

Digital Library

[11]

Marc Hassenzahl. 2018. The thing and I: understanding the relationship between user and product. In Funology 2. Springer, 301--313.

[12]

Marcel Heerink, Ben Kröse, Vanessa Evers, and Bob Wielinga. 2010. Assessing acceptance of assistive social agent technology by older adults: the almere model. International journal of social robotics 2, 4 (2010), 361--375.

[13]

Christopher D Hundhausen, Anzor Balkar, Mohamed Nuur, and Stephen Trent. 2007. WOZ pro: a pen-based low fidelity prototyping environment to support wizard of oz studies. In CHI'07 Extended Abstracts on Human Factors in Computing Systems. ACM, 2453--2458.

Digital Library

[14]

Thomas B.L. Kirkwood. 2005. Understanding the odd science of aging. Cell 120:4 (2005), 437--447.

[15]

Minha Lee, Stephan Schlögl, Seth Montenegro, Asier López, Ahmed Ratni, Trung Ngo Trong, JM Olaso, F Haider, G Chollet, K Jokinen, et al. 2017. First time encounters with Roberta: a humanoid assistant for conversational autobiography creation. In eNTERFACE'16, July 18th-August 12th 2016, Enschede, the Netherlands.

[16]

David V Lu and William D Smart. 2011. Polonius: A Wizard of Oz interface for HRI experiments. In Proceedings of the 6th international conference on Human-robot interaction. ACM, 197--198.

Digital Library

[17]

Abigail A Marsh, Nalini Ambady, and Robert E Kleck. 2005. The effects of fear and anger facial expressions on approach-and avoidance-related behaviors. Emotion 5, 1 (2005), 119.

[18]

George A Miller. 1995. WordNet: a lexical database for English. Commun. ACM 38, 11 (1995), 39--41.

Digital Library

[19]

Cosmin Munteanu and Marian Boldea. 2000. MDWOZ: A Wizard of Oz Environment for Dialog Systems Development. In LREC. Citeseer.

[20]

Magalie Ochs, Radosław Niewiadomski, and Catherine Pelachaud. 2010. How a virtual agent should smile?. In International Conference on Intelligent Virtual Agents. Springer, 427--440.

Digital Library

[21]

Alice H Oh and Alexander I Rudnicky. 2000. Stochastic language generation for spoken dialogue systems. In ANLP-NAACL 2000 Workshop: Conversational Systems. 27--32.

Digital Library

[22]

Claudia Pagliari. 2007. Design and evaluation in eHealth: challenges and implications for an interdisciplinary field. J. of medical Internet research 9, 2 (2007).

[23]

Matthew Roddy, Gabriel Skantze, and Naomi Harte. 2018. Investigating Speech Features for Continuous Turn-Taking Prediction Using LSTMs. arXiv preprint arXiv:1806.11461 (2018).

[24]

Mark Rotteveel and R Hans Phaf. 2004. Automatic affective evaluation does not automatically predispose for arm flexion and extension. Emotion 4, 2 (2004), 156.

[25]

Susana Sayas. 2018. Dialogues on Leisure and Free Time. Technical Report DP3. Sayasalud and Empathic project.

[26]

Susana Sayas. 2018. Dialogues on Nutrition. Technical Report DP1. Sayasalud and Empathic project.

[27]

Susana Sayas. 2018. Dialogues on Physical Exercise. Technical Report DP2. Sayasalud and Empathic project.

[28]

Susana Sayas. 2018. Rationale and basis for the structure of the dialogue between the user and the virtual coach. To establish the concept of goal setting in coaching: SMART. Technical Report D.R1_2. Sayasalud and Empathic project.

[29]

Stephan Schlögl, Saturnino Luz, and Gavin Doherty. 2013. WebWOZ: A Platform for Designing and Conducting Web-based Wizard of Oz Experiments. In Proceedings of the SIGDIAL 2013 Conference. 160--162.

[30]

Stephan Schlögl, Pierrick Milhorat, Gérard Chollet, and Jérôme Boudy. 2014. Designing language technology applications: a Wizard of Oz driven prototyping framework. In Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics. 85--88.

[31]

Matt Shannon, Gabor Simko, S yiin Chang, and Carolina Parada. 2017. Improved end-of-query detection for streaming speech recognition. In Proceedings of Interspeech 2017. 1909--1913.

[32]

Jan Smeddinck, Kamila Wajda, Adeel Naveed, Leen Touma, Yuting Chen, Muhammad Abu Hasan, Muhammad Waqas Latif, and Robert Porzel. 2010. QuickWoZ: a multi-purpose wizard-of-oz framework for experiments with embodied conversational agents. In Proceedings of the 15th international conference on Intelligent user interfaces. ACM, 427--428.

Digital Library

[33]

Carolin Straßmann and Nicole C Krämer. 2017. A categorization of virtual agent appearances and a qualitative study on age-related user preferences. In International Conference on Intelligent Virtual Agents. Springer, 413--422.

[34]

Christiana Tsiourti, Emilie Joly, Cindy Wings, Maher Ben Moussa, and Katarzyna Wac. 2014. Virtual assistive companions for older adults: qualitative field study and design implications. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare. ICST (Institute for Computer Sciences, Social-Informatics and âĂę, 57--64.

Digital Library

[35]

Viswanath Venkatesh and Fred D Davis. 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science 46, 2 (2000), 186--204.

[36]

Viswanath Venkatesh, Michael G Morris, Gordon B Davis, and Fred D Davis. 2003. User acceptance of information technology: Toward a unified view. MIS quarterly (2003), 425--478.

Digital Library

[37]

Viswanath Venkatesh, James YL Thong, and Xin Xu. 2012. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS quarterly 36, 1 (2012), 157--178.

Digital Library

[38]

Michael Villano, Charles R Crowell, Kristin Wier, Karen Tang, Brynn Thomas, Nicole Shea, Lauren M Schmitt, and Joshua J Diehl. 2011. DOMER: A Wizard of Oz interface for using interactive robots to scaffold social skills for children with Autism Spectrum Disorders. In Proceedings of the 6th international conference on Human-robot interaction. ACM, 279--280.

Digital Library

[39]

Donald Craig Willcox, Giovanni Scapagnini, and Bradley J. Willcox. 2014. Healthy aging diets other than the Mediterranean: A focus on the Okinawan diet. Mechanisms of Ageing and Development 136--137 (2014), 148--162.

[40]

Ramin Yaghoubzadeh, Marcel Kramer, Karola Pitsch, and Stefan Kopp. 2013. Virtual agents as daily assistants for elderly or cognitively impaired people. In International Workshop on Intelligent Virtual Agents. Springer, 79--91.

Cited By

Vázquez ALópez Zorrilla AOlaso JTorres M(2023)Dialogue Management and Language Generation for a Robust Conversational Virtual Coach: Validation and User StudySensors10.3390/s2303142323:3(1423)Online publication date: 27-Jan-2023
https://doi.org/10.3390/s23031423
Montenegro CSantana RLozano J(2023)Introducing multi-dimensional hierarchical classification: Characterization, solving strategies and performance measuresNeurocomputing10.1016/j.neucom.2023.02.050533(141-160)Online publication date: May-2023
https://doi.org/10.1016/j.neucom.2023.02.050
Brinkschulte LSchlögl SMonz ASchöttle PJanetschek M(2022)Perspectives on Socially Intelligent Conversational AgentsMultimodal Technologies and Interaction10.3390/mti60800626:8(62)Online publication date: 25-Jul-2022
https://doi.org/10.3390/mti6080062
Show More Cited By

Index Terms

The EMPATHIC project: mid-term achievements
1. Applied computing
  1. Life and medical sciences
    1. Health informatics
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Video-based activity level recognition for assisted living using motion features
ICDSC '15: Proceedings of the 9th International Conference on Distributed Smart Cameras

Activities of daily living of the elderly is often monitored using passive sensor networks. With the reduction of camera prices, there is a growing interest of video-based approaches to provide a smart, safe and independent living environment for the ...
User-centred multimodal reminders for assistive living
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

While there has been a lot of research on the usability of reminders and alarms in the work context, the home has been somewhat neglected despite the importance of reminder systems for telecare and assistive living systems. We conducted a comprehensive ...
Where to, Roberta?: reflecting on the role of technology in assisted living
NordiCHI '06: Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles

This paper reports on a study of a newly developed system for assisted living, which was implemented in the homes of seven elderly residents. Based on these findings we point out three fundamental issues that will enrich and improve the use of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

June 2019

655 pages

ISBN:9781450362320

DOI:10.1145/3316782

Conference Chair:
Fillia Makedon
University of Texas at Arlington

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Union

Conference

PETRA '19

PETRA '19: The 12th PErvasive Technologies Related to Assistive Environments Conference

June 5 - 7, 2019

Rhodes, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
262
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vázquez ALópez Zorrilla AOlaso JTorres M(2023)Dialogue Management and Language Generation for a Robust Conversational Virtual Coach: Validation and User StudySensors10.3390/s2303142323:3(1423)Online publication date: 27-Jan-2023
https://doi.org/10.3390/s23031423
Montenegro CSantana RLozano J(2023)Introducing multi-dimensional hierarchical classification: Characterization, solving strategies and performance measuresNeurocomputing10.1016/j.neucom.2023.02.050533(141-160)Online publication date: May-2023
https://doi.org/10.1016/j.neucom.2023.02.050
Brinkschulte LSchlögl SMonz ASchöttle PJanetschek M(2022)Perspectives on Socially Intelligent Conversational AgentsMultimodal Technologies and Interaction10.3390/mti60800626:8(62)Online publication date: 25-Jul-2022
https://doi.org/10.3390/mti6080062
de Velasco MJusto RInés Torres M(2022)Automatic Identification of Emotional Information in Spanish TV Debates and Human–Machine InteractionsApplied Sciences10.3390/app1204190212:4(1902)Online publication date: 11-Feb-2022
https://doi.org/10.3390/app12041902
Zorrilla ATorres M(2022)A Multilingual Neural Coaching Model with Enhanced Long-term Dialogue StructureACM Transactions on Interactive Intelligent Systems10.1145/348706612:2(1-47)Online publication date: 12-Jul-2022
https://dl.acm.org/doi/10.1145/3487066
Bastardo RPavão JRocha N(2022)User-Centred Usability Evaluation of Embodied Communication Agents to Support Older Adults: A Scoping ReviewInformation Technology and Systems10.1007/978-3-030-96293-7_42(509-518)Online publication date: 2-Mar-2022
https://doi.org/10.1007/978-3-030-96293-7_42
Greco CBuono CBuch-Cardona PCordasco GEscalera SEsposito AFernandez AKyslitska DKornes MPalmero CLaranga JJohansen ATorres M(2021)Emotional Features of Interactions with Empathic Agents2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW54120.2021.00246(2168-2176)Online publication date: Oct-2021
https://doi.org/10.1109/ICCVW54120.2021.00246
Letaifa LTorres M(2021)Perceptual Borderline for Balancing Multi-Class Spontaneous Emotional DataIEEE Access10.1109/ACCESS.2021.30714859(55939-55954)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3071485
Andreoni GKonstantinidis EPetsani DBamidis PGatsios DFotiadis Dop den Akker HTorres MTenorio-Laranga JCordasco GGonzález-Fraile EEsposito AKornes MChollet GFernández-Ruanova BVeleva VŽnidaršič MŽenko BOsojnik AWheeler RGand KSchlieter HKyriazakos SCaprino MNicolas LKropf JLuengo IJimeno PMambretti C(2021)Other Advanced Research Initiatives in Elderly Care and Fragility PreventionDigital Health Technology for Better Aging10.1007/978-3-030-72663-8_20(327-359)Online publication date: 1-Jul-2021
https://doi.org/10.1007/978-3-030-72663-8_20
Montenegro CSantana RLozano J(2020) Transfer learning in hierarchical dialogue topic classification with neural networks * 2020 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN48605.2020.9206680(1-8)Online publication date: Jul-2020
https://doi.org/10.1109/IJCNN48605.2020.9206680
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents