demonstration

AI Therapist for Daily Functioning Assessment and Intervention Using Smart Home Devices

Authors:

Xiaofan JiangAuthors Info & Claims

SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems

Pages 764 - 765

https://doi.org/10.1145/3560905.3568074

Published: 24 January 2023 Publication History

Get Access

Abstract

In this demonstration, in collaboration with licensed therapists, we introduce an AI therapist that takes advantage of the smart-home environment to screen day-to-day functioning and infer mental wellness of an occupant. Our system can assess a user's daily functioning and mental wellness based on a combination of direct conversation with users and information obtained from smart home devices using psychological rubrics proposed in [1]. We demonstrate that our system can converse with a user in a natural way (through a smartphone or smart speaker) and analyze a user's response semantically and sentimentally. In addition, we show that our system can provide preliminary interventions to help improve the user's wellness. In particular, when abnormal behavior is detected during the conversation or by smart home devices, the system provides psychotherapeutic consolations during the conversation and will check on the occupant's condition by actuating a home robot.

Supplementary Material

MP4 File (p764-nie.mp4)

Download
11.71 MB

References

[1]

Jingping Nie, Hanya Shao, Minghui Zhao, Stephen Xia, Matthias Preindl, and Xiaofan Jiang. Conversational ai therapist for daily function screening in home environments. In Proceedings of the 1st ACM International Workshop on Intelligent Acoustic Systems and Applications, pages 31--36, 2022.

Digital Library

Google Scholar

[2]

Mark Carlson. CBT for Psychological Well-being in Cancer: A Skills Training Manual Integrating DBT, ACT, Behavioral Activation and Motivational Interviewing. John Wiley & Sons, 2017.

Google Scholar

[3]

Jingping Nie, Yanchen Liu, Yigong Hu, Yuanyuting Wang, Stephen Xia, Matthias Preindl, and Xiaofan Jiang. SPIDERS+: A light-weight, wireless, and low-cost glasses-based wearable platform for emotion sensing and bio-signal acquisition. Pervasive and Mobile Computing, 75:101424, 2021.

Digital Library

Google Scholar

[4]

Stephen Xia, Jingping Nie, and Xiaofan Jiang. CSafe: An intelligent audio wearable platform for improving construction worker safety in urban environments. In Proceedings of the 20th International Conference on Information Processing in Sensor Networks (Co-Located with CPS-IoT Week 2021), IPSN '21, page 207--221, New York, NY, USA, 2021. Association for Computing Machinery.

Digital Library

Google Scholar

[5]

Yanchen Liu, Stephen Xia, Jingping Nie, Peter Wei, Zhan Shu, Jeffrey Andrew Chang, and Xiaofan Jiang. aimse: Toward an ai-based online mental status examination. IEEE Pervasive Computing, 2022.

Google Scholar

Cited By

View all

Villarreal-Zegarra DReategui-Rivera CGarcía-Serna JQuispe-Callo GLázaro-Cruz GCenteno-Terrazas GGalvez-Arevalo REscobar-Agreda SDominguez-Rodriguez AFinkelstein J(2024)Self-Administered Interventions Based on Natural Language Processing Models for Reducing Depressive and Anxiety Symptoms: Systematic Review and Meta-AnalysisJMIR Mental Health10.2196/5956011(e59560)Online publication date: 21-Aug-2024
https://doi.org/10.2196/59560
Liu YJi YZhao MJiang XZhou XZheng C(2023)Demo Abstract: Seamless High-Speed Optical Communication for Mobile Wide-Area Using Diffused Infrared LaserProceedings of the 22nd International Conference on Information Processing in Sensor Networks10.1145/3583120.3589811(370-371)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3583120.3589811
Hou KXia SBejerano EWu JJiang X(2023)ARSteth: Enabling Home Self-Screening with AR-Assisted Intelligent StethoscopesProceedings of the 22nd International Conference on Information Processing in Sensor Networks10.1145/3583120.3586962(205-218)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3583120.3586962
Show More Cited By

Index Terms

AI Therapist for Daily Functioning Assessment and Intervention Using Smart Home Devices
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Sensor networks
    2. Sensors and actuators

Recommendations

Conversational AI Therapist for Daily Function Screening in Home Environments
IASA '22: Proceedings of the 1st ACM International Workshop on Intelligent Acoustic Systems and Applications

The growth of smart devices is making typical homes more intelligent. In this work, in collaboration with therapists, we introduce a home-based AI therapist that takes advantage of the smart home environment to screen the day-to-day functioning and ...
Monitoring meaningful activities using small low-cost devices in a smart home

A challenge associated with an ageing population is increased demand on health and social care, creating a greater need to enable persons to live independently in their own homes. Ambient assistant living technology aims to address this by monitoring ...
Fusion of Multiple Sensors Sources in a Smart Home to Detect Scenarios of Activities in Ambient Assisted Living

This work takes place within the framework of Smart Homes, with the goal to monitor the activities of elderly people, living independently at home, in order to continuously assess their level of activity and therefore their autonomy. A method is ...

Comments

Information & Contributors

Information

Published In

SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems

November 2022

1280 pages

ISBN:9781450398862

DOI:10.1145/3560905

General Chairs:
Jeremy Gummeson
University of Massachusetts Amherst
,
Sunghoon Ivan Lee
University of Massachusetts Amherst
,
Program Chairs:
Jie Gao
Rutgers University
,
Guoliang Xing
The Chinese University of Hong Kong

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 January 2023

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

National Science Foundation under Grant

Conference

SenSys '22

Sponsor:

SenSys '22: The 20th ACM Conference on Embedded Networked Sensor Systems

November 6 - 9, 2022

Massachusetts, Boston

Acceptance Rates

SenSys '22 Paper Acceptance Rate 52 of 187 submissions, 28%;

Overall Acceptance Rate 174 of 867 submissions, 20%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
206
Total Downloads

Downloads (Last 12 months)93
Downloads (Last 6 weeks)11

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Villarreal-Zegarra DReategui-Rivera CGarcía-Serna JQuispe-Callo GLázaro-Cruz GCenteno-Terrazas GGalvez-Arevalo REscobar-Agreda SDominguez-Rodriguez AFinkelstein J(2024)Self-Administered Interventions Based on Natural Language Processing Models for Reducing Depressive and Anxiety Symptoms: Systematic Review and Meta-AnalysisJMIR Mental Health10.2196/5956011(e59560)Online publication date: 21-Aug-2024
https://doi.org/10.2196/59560
Liu YJi YZhao MJiang XZhou XZheng C(2023)Demo Abstract: Seamless High-Speed Optical Communication for Mobile Wide-Area Using Diffused Infrared LaserProceedings of the 22nd International Conference on Information Processing in Sensor Networks10.1145/3583120.3589811(370-371)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3583120.3589811
Hou KXia SBejerano EWu JJiang X(2023)ARSteth: Enabling Home Self-Screening with AR-Assisted Intelligent StethoscopesProceedings of the 22nd International Conference on Information Processing in Sensor Networks10.1145/3583120.3586962(205-218)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3583120.3586962
Zhao MXia SNie JHou KDhupar AJiang X(2023)LegoSENSE: An Open and Modular Sensing Platform for Rapidly-Deployable IoT ApplicationsProceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation10.1145/3576842.3582369(367-380)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3576842.3582369

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Conversational AI Therapist for Daily Function Screening in Home Environments

Monitoring meaningful activities using small low-cost devices in a smart home

Fusion of Multiple Sensors Sources in a Smart Home to Detect Scenarios of Activities in Ambient Assisted Living

Comments

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

Conversational AI Therapist for Daily Function Screening in Home Environments

Monitoring meaningful activities using small low-cost devices in a smart home

Fusion of Multiple Sensors Sources in a Smart Home to Detect Scenarios of Activities in Ambient Assisted Living

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations