Exploring Scaffolding Techniques for Agent-Administered Brief Cognitive Screening in Hospital Settings
Authors: 
Dingdong Liu, Sensen Gao, Zixin Chen, Yifan Shen, Chuhan Shi, Bertram E. Shi, Xiaojuan MaAuthors Info & Claims
Dingdong Liu, Sensen Gao, Zixin Chen, Yifan Shen, Chuhan Shi, Bertram E. Shi, Xiaojuan MaAuthors Info & ClaimsPages 185 - 189
Abstract
Cognitive screening in hospitalized older patients is a critical, yet time-consuming process. While conversational agents present a promising solution to aid clinicians, current models fall short in their ability to scaffold questions to accommodate patients with potential cognitive decline effectively. To bridge this gap, we conducted a study with 13 clinicians to identify effective scaffolding strategies empirically. Our findings revealed six key strategies that clinicians use to scaffold the Abbreviated Mental Test (AMT) in practice, together with the underlying rationale and potential challenges. We discuss the implications of these findings for the design of conversational agents to assist in cognitive screening and propose design considerations for future research.
References
[1]
Ho Seok Ahn, Wesley Yep, Jongyoon Lim, Byeong Kyu Ahn, Deborah L. Johanson, Eui Jun Hwang, Min Ho Lee, Elizabeth Broadbent, and Bruce A. Macdonald. 2019. Hospital Receptionist Robot v2: Design for Enhancing Verbal Interaction with Social Skills. 2019 28th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2019 (2019), 1–6. https://doi.org/10.1109/RO-MAN46459.2019.8956300
[2]
Patrícia Belchior, Nicol Korner-Bitensky, Melanie Holmes, and Alexandra Robert. 2015. Identification and Assessment of Functional Performance in Mild Cognitive Impairment: A Survey of Occupational Therapy Practices. Australian Occupational Therapy Journal 62, 3 (2015), 187–196. https://doi.org/10.1111/1440-1630.12201
[3]
Jason Brandt, Miriam Spencer, and Marshal Folstein. 1988. The Telephone Interview for Cognitive Status. Cognitive and Behavioral Neurology 1 (Jan. 1988).
[4]
Irene Celino and Gloria Re Calegari. 2020. Submitting Surveys via a Conversational Interface: An Evaluation of User Acceptance and Approach Effectiveness. International Journal of Human-Computer Studies 139 (July 2020), 102410. https://doi.org/10.1016/j.ijhcs.2020.102410
[5]
LW Chu, CKW Pei, MH Ho, and PT Chan. 1995. Validation of the abbreviated mental test (Hong Kong version) in the elderly medical patient.
[6]
M. F. Folstein, S. E. Folstein, and P. R. McHugh. 1975. "Mini-mental State". A Practical Method for Grading the Cognitive State of Patients for the Clinician. Journal of Psychiatric Research 12, 3 (Nov. 1975), 189–198. https://doi.org/10.1016/0022-3956(75)90026-6
[7]
Eui Jun Hwang, Bruce A. MacDonald, and Ho Seok Ahn. 2019. End-to-End Dialogue System with Multi Languages for Hospital Receptionist Robot. 2019 16th International Conference on Ubiquitous Robots, UR 2019 (2019), 278–283. https://doi.org/10.1109/URAI.2019.8768694
[8]
Catherine E. Jansen, Bruce A. Cooper, Marylin J. Dodd, and Christine A. Miaskowski. 2011. A Prospective Longitudinal Study of Chemotherapy-Induced Cognitive Changes in Breast Cancer Patients. Supportive Care in Cancer 19, 10 (Oct. 2011), 1647–1656. https://doi.org/10.1007/s00520-010-0997-4
[9]
S. Jitapunkul, I. Pillay, and S. Ebrahim. 1991. The Abbreviated Mental Test: Its Use and Validity. Age and Ageing 20, 5 (Sept. 1991), 332–336. https://doi.org/10.1093/ageing/20.5.332
[10]
Melissa Johnson and Feng Lin. January/March 2014. Communication Difficulty and Relevant Interventions in Mild Cognitive Impairment: Implications for Neuroplasticity. Topics in Geriatric Rehabilitation 30, 1 (January/March 2014), 18. https://doi.org/10.1097/TGR.0000000000000001
[11]
Junhan Kim, Sun Park, and Lionel + "Jr" Robert. 2019. Conversational Agents for Health and Wellbeing: Review and Future Agendas. CSCW 2019.
[12]
Klaus Krippendorff. 2004. Reliability in Content Analysis: Some Common Misconceptions and Recommendations. Human Communication Research 30, 242 (July 2004), 411–433.
[13]
Esther Levin and Alex Levin. 2006. Evaluation of Spoken Dialogue Technology for Real-Time Health Data Collection. Journal of Medical Internet Research 8, 4 (Dec. 2006), e30. https://doi.org/10.2196/jmir.8.4.e30
[14]
Nora McDonald, Sarita Schoenebeck, and Andrea Forte. 2019. Reliability and Inter-rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 1–23. https://doi.org/10.1145/3359174
[15]
Mark A. Neerincx, Willeke Van Vught, Olivier Blanson Henkemans, Elettra Oleari, Joost Broekens, Rifca Peters, Frank Kaptein, Yiannis Demiris, Bernd Kiefer, Diego Fumagalli, and Bert Bierman. 2019. Socio-cognitive engineering of a robotic partner for child’s diabetes self-management. Frontiers in Robotics and AI 6, November (2019). https://doi.org/10.3389/frobt.2019.00118
[16]
Sarah T. Pendlebury, Sarah J.V. Welch, Fiona C. Cuthbertson, Jose Mariz, Ziyah Mehta, and Peter M. Rothwell. 2013. Telephone Assessment of Cognition After Transient Ischemic Attack and Stroke. Stroke 44, 1 (Jan. 2013), 227–229. https://doi.org/10.1161/STROKEAHA.112.673384
[17]
R. C. Petersen. 2004. Mild Cognitive Impairment as a Diagnostic Entity. Journal of Internal Medicine 256, 3 (Sept. 2004), 183–194. https://doi.org/10.1111/j.1365-2796.2004.01388.x
[18]
Pamela A. Saunders, Kate de Medeiros, and Ashley Bartell. 2011. ‘Oh He Was Forgettable’: Construction of Self Identity through Use of Communicative Coping Behaviors in the Discourse of Persons with Cognitive Impairment. Dementia 10, 3 (Aug. 2011), 341–359. https://doi.org/10.1177/1471301211407805
[19]
Korok Sengupta, Sayan Sarcar, Alisha Pradhan, Roisin McNaney, Sergio Sayago, Debaleena Chattopadhyay, and Anirudha Joshi. 2020. Challenges and Opportunities of Leveraging Intelligent Conversational Assistant to Improve the Well-being of Older Adults. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–4. https://doi.org/10.1145/3334480.3381057
[20]
Claire Tochel, Michael Smith, Helen Baldwin, Anders Gustavsson, Amanda Ly, Christin Bexelius, Mia Nelson, Christophe Bintener, Enrico Fantoni, Josep Garre-Olmo, Olin Janssen, Christoph Jindra, Isabella F. Jørgensen, Alex McKeown, Buket Öztürk, Anna Ponjoan, Michele H. Potashman, Catherine Reed, Emilse Roncancio-Diaz, Stephanie Vos, and Cathie Sudlow. 2019. What Outcomes Are Important to Patients with Mild Cognitive Impairment or Alzheimer’s Disease, Their Caregivers, and Health-Care Professionals? A Systematic Review. Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring 11 (Dec. 2019), 231–247. https://doi.org/10.1016/j.dadm.2018.12.003
[21]
Simone Varrasi, Santo Di Nuovo, Daniela Conti, and Alessandro Di Nuovo. 2018. A Social Robot for Cognitive Assessment. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction(HRI ’18). Association for Computing Machinery, New York, NY, USA, 269–270. https://doi.org/10.1145/3173386.3176995
[22]
H.J. Woodford and J. George. 2007. Cognitive Assessment in the Elderly: A Review of Clinical Methods. QJM: An International Journal of Medicine 100, 8 (Aug. 2007), 469–484. https://doi.org/10.1093/qjmed/hcm051
[23]
Tamara Zubatiy, Kayci L Vickers, Niharika Mathur, and Elizabeth D Mynatt. 2021. Empowering Dyads of Older Adults With Mild Cognitive Impairment And Their Care Partners Using Conversational Agents. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3411764.3445124
Index Terms
- Exploring Scaffolding Techniques for Agent-Administered Brief Cognitive Screening in Hospital Settings
Recommendations
Designing Scaffolding Strategies for Conversational Agents in Dialog Task of Neurocognitive Disorders Screening
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing SystemsRegular screening is critical for individuals at risk of neurocognitive disorders (NCDs) to receive early intervention. Conversational agents (CAs) have been adopted to administer dialog-based NCD screening tests for their scalability compared to human-...
Sara, the Lecturer: Improving Learning in Online Education with a Scaffolding-Based Conversational Agent
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsEnrollment in online courses has sharply increased in higher education. Although online education can be scaled to large audiences, the lack of interaction between educators and learners is difficult to replace and remains a primary challenge in the ...
Situated Scaffolding for Sustainable Participatory Design: Learning Online with Older Adults
GROUPAn extensive literature on participatory design with older adults has, thus far, little to say about the support older adults need when involved in online activities. Our research suggests that to empower older adults in participatory design, scaffolding ...
Comments
Information & Contributors
Information
Published In
July 2024
501 pages
ISBN:9798400706325
DOI:10.1145/3656156
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Hong Kong University of Science and Technology (Research Program Development in Aging, Healthcare and Mental Wellbeing)
Conference
DIS '24
Sponsor:
DIS '24: Designing Interactive Systems Conference
July 1 - 5, 2024
IT University of Copenhagen, Denmark
Acceptance Rates
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 80Total Downloads
- Downloads (Last 12 months)80
- Downloads (Last 6 weeks)13
Reflects downloads up to 03 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format