demonstration

The EMPATHIC Virtual Coach: a demo

ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction

Pages 848 - 851

Published: 18 October 2021 Publication History

Abstract

The main objective of the EMPATHIC project has been the design and development of a virtual coach to engage the healthy-senior user and to enhance well-being through awareness of personal status. The EMPATHIC approach addresses this objective through multimodal interactions supported by the GROW coaching model. The paper summarizes the main components of the EMPATHIC Virtual Coach (EMPATHIC-VC) and introduces a demonstration of the coaching sessions in selected scenarios.

Supplementary Material

MP4 File (p848-FRENCH_Interactions.mp4)

Supplemental video

Download
170.78 MB

References

[1]

Anna Esposito, Terry Amorese, Nelson Mauro Maldonato, Alessandro Vinciarelli, Maria Ines Torres, Sergio Escalera, and Gennaro Cordasco. 2020. Seniors’ ability to decode differently aged facial emotional expressions. In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020). 716–722. https://doi.org/10.1109/FG47880.2020.00077

Digital Library

Google Scholar

[2]

Mohamed Amine Hmani, Aymen Mtibaa, and Dijana Petrovska-Delacrétaz. 2021. Joining Forces of Voice and Facial Biometrics: a Case Study in the Scope of NIST SRE’19. In Voice Biometrics: Technology, Trust and Security, Carmen Garcia-Mateo and Gérard Chollet (Eds.). IET to appear, Chapter 9.

Google Scholar

[3]

Raquel Justo, Leila Ben Letaifa, Cristina Palmero, Eduardo Gonzalez-Fraile, Alain Torp Johansen, Annaand Vázquez, Gennaro Cordasco, Stephan Schlögl, Begoña Fernández-Ruanova, Micaela Silva, Sergio Escalera, Mikel deVelasco, Joffre Tenorio-Laranga, Anna Esposito, Maria Korsnes, and M. Inés Torres. 2020. Analysis of the Interaction between Elderly People and a Simulated Virtual Coach. Journal of Ambient Intelligence and Humanized Computing 11, 12(2020), 6125–6140. https://doi.org/10.1007/s12652-020-01983-3

Crossref

Google Scholar

[4]

Leila Ben Letaifa and M. Inés Torres. 2021. Perceptual Borderline for Balancing Multi-Class Spontaneous Emotional Data. IEEE Access 9(2021), 55939–55954.

Crossref

Google Scholar

[5]

César Montenegro, Asier López Zorrilla, Javier Mikel Olaso, Roberto Santana, Raquel Justo, Jose A. Lozano, and María Inés Torres. 2019. A Dialogue-Act Taxonomy for a Virtual Coach Designed to Improve the Life of Elderly. Multimodal Technologies and Interaction 3, 3 (2019), 1–19. https://doi.org/10.3390/mti3030052

Crossref

Google Scholar

[6]

Jofre Tenorio-Laranga, Begoña Fernandez Ruanova, M. Inés Torres Barañano, Raquel Justo, Alfredo Alday, and Josu Xabier Llano Hernaiz. 2019. Designing a virtual coach: Involvement of end-users from early design to prototype. International Journal of Integrated Care 19 (2019), 1–8. Issue S1. https://doi.org/10.5334/ijic.s3207

Crossref

Google Scholar

[7]

Markus Thaler, Stephan Schlögl, and Aleksander Groth. 2020. Agent vs. Avatar: Comparing Embodied Conversational Agents Concerning Characteristics of the Uncanny Valley. In 2020 IEEE International Conference on Human-Machine Systems (ICHMS). 1–6. https://doi.org/10.1109/ICHMS49158.2020.9209539

Crossref

Google Scholar

[8]

M. Inés Torres, Javier Mikel Olaso, Neil Glackin, Raquel Justo, and Gérard Chollet. 2019. A Spoken Dialogue System for the EMPATHIC Virtual Coach. In 9th International Workshop on Spoken Dialogue System Technology(Lecture Notes in Electrical Engineering, Vol. 579), Luis Fernando D’Haro, Rafael E. Banchs, and Haizhou Li(Eds.). Springer Singapore, Singapore, 259–265.

Crossref

Google Scholar

[9]

M. I. Torres, J. M. Olaso, C. Montenegro, R. Santana, A. Vázquez, R. Justo, J. A. Lozano, S. Schlögl, G. Chollet, N. Dugan, M. Irvine, N. Glackin, C. Pickard, A. Esposito, G. Cordasco, A. Troncone, D. Petrovska-Delacretaz, A. Mtibaa, M. A. Hmani, M. S. Korsnes, L. J. Martinussen, S. Escalera, C. Palmero Cantariño, O. Deroo, O. Gordeeva, J. Tenorio-Laranga, E. Gonzalez-Fraile, B. Fernandez-Ruanova, and A. Gonzalez-Pinto. 2019. The EMPATHIC Project: Mid-Term Achievements. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments(Rhodes, Greece) (PETRA ’19). Association for Computing Machinery, New York, NY, USA, 629–638. https://doi.org/10.1145/3316782.3322764

Crossref

Google Scholar

Cited By

View all

Mallol-Ragolta ASchuller B(2024)Coupling Sentiment and Arousal Analysis Towards an Affective Dialogue ManagerIEEE Access10.1109/ACCESS.2024.336175012(20654-20662)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3361750
Vázquez ALópez Zorrilla AOlaso JTorres M(2023)Dialogue Management and Language Generation for a Robust Conversational Virtual Coach: Validation and User StudySensors10.3390/s2303142323:3(1423)Online publication date: 27-Jan-2023
https://doi.org/10.3390/s23031423
Olaso JGarcía-Sebastián MLópez Zorrilla ATainta MEcay-Torres MTorres MMartínez-Lage P(2023)The CITA GO-ON dialogue system: mid-term achievementsProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3596548(652-657)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3596548
Show More Cited By

Recommendations

Demo: Helping to Tackle Social Isolation and Loneliness of Older Adults Using Mobile Applications
HotMobile '19: Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications

We live in a society with an ageing population in which the number of 65+ will significantly increase within the next 50 years. In parallel, we observe an increasing amount of technology deployed to people - both in the form of more sophisticated mobile ...
Designing personalized prompts for a virtual assistant to support elderly care home residents
PervasiveHealth '16: Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare

In this paper, we present the first results of the ACT@HOME research project which aims to develop an artificially intelligent virtual assistant (VA) to engage and help older adults with Alzheimer's disease (AD) to complete activities of daily living (...
A virtual coach with more or less empathy: impact on older adults' engagement to exercise
IVA '23: Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents

This paper presents a study that assesses the effectiveness of Motivational Interviewing (MI) interventions on the engagement of adults over 50 years to do more physical activity. While MI's four step process may easily be adapted to online devices, ...

Comments

Information & Contributors

Information

Published In

ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction

October 2021

876 pages

ISBN:9781450384810

DOI:10.1145/3462244

Editors:
Zakia Hammal
Carnegie Mellon University
,
Carlos Busso
University of Texas at Dallas
,
Catherine Pelachaud
CNRS - ISIR, Sorbonne University
,
Sharon Oviatt
Monash University
,
Albert Ali Salah
Utrecht University and Boğaziçi University
,
Guoying Zhao
University of Oulu

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 October 2021

Check for updates

Author Tags

Qualifiers

Demonstration
Research
Refereed limited

Conference

ICMI '21

Sponsor:

SIGCHI

ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 18 - 22, 2021

QC, Montréal, Canada

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
151
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)3

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Mallol-Ragolta ASchuller B(2024)Coupling Sentiment and Arousal Analysis Towards an Affective Dialogue ManagerIEEE Access10.1109/ACCESS.2024.336175012(20654-20662)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3361750
Vázquez ALópez Zorrilla AOlaso JTorres M(2023)Dialogue Management and Language Generation for a Robust Conversational Virtual Coach: Validation and User StudySensors10.3390/s2303142323:3(1423)Online publication date: 27-Jan-2023
https://doi.org/10.3390/s23031423
Olaso JGarcía-Sebastián MLópez Zorrilla ATainta MEcay-Torres MTorres MMartínez-Lage P(2023)The CITA GO-ON dialogue system: mid-term achievementsProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3596548(652-657)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3596548
Zorrilla ATorres MCuayáhuitl H(2022)Audio Embedding-Aware Dialogue Policy LearningIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2022.322565831(525-538)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1109/TASLP.2022.3225658

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Affiliations

Javier M. Olaso

Universidad del País Vasco UPV/EHU, Spain

Abstract

Supplementary Material

References

Cited By

Recommendations

Demo: Helping to Tackle Social Isolation and Loneliness of Older Adults Using Mobile Applications

Designing personalized prompts for a virtual assistant to support elderly care home residents

A virtual coach with more or less empathy: impact on older adults' engagement to exercise

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations