research-article

Enhancing Cognitive Recall in Dementia Patients: Integrating Generative AI with Virtual Reality for Behavioral and Memory Rehabilitation

Authors:

Yubo Wang,

Yujia ZhangAuthors Info & Claims

BDSIC '24: Proceedings of the 2024 6th International Conference on Big-data Service and Intelligent Computation

Pages 86 - 91

https://doi.org/10.1145/3686540.3686552

Published: 19 September 2024 Publication History

Get Access

Abstract

In this Project, we developed a cognitive rehabilitation program for dementia patients, leveraging generative AI and virtual reality (VR) to evoke personal memories [4]. Integrating Open AI, DreamStudio, and Unity, our system allows patients to input descriptions, generating visual memories in a VR environment [5]. In trials, 85% of AI-generated images matched patients' expectations, although some inaccuracies arose from AI generalizations. Further validation with dementia patients is needed to assess memory recovery impacts. This novel approach modernizes Cognitive Stimulation Therapy (CST), traditionally reliant on non-visual exercises, by incorporating AI and VR to enhance memory recall and visual-spatial skills.

While the world is developing more and more into Artificial Intelligence (AI) and Virtual Reality (VR), our program successfully coordinates them to help stimulate dementia patients’ brains and perform the memory recall and visual spatial aspects of CST.

References

[1]

Chiu, Hui-Min, Mei-Chi Hsu, and Wen-Chen Ouyang. "Effects of incorporating virtual reality training intervention into health care on cognitive function and wellbeing in older adults with cognitive impairment: a randomized controlled trial." International Journal of Human-Computer Studies 170 (2023): 102957.

Digital Library

Google Scholar

[2]

Eisapour, Mahzar, "Participatory design of a virtual reality exercise for people with mild cognitive impairment." Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 2018.

Google Scholar

[3]

Appel, Lora, "Virtual reality to promote wellbeing in persons with dementia: a scoping review." Journal of rehabilitation and assistive technologies engineering 8 (2021): 20556683211053952.

Crossref

Google Scholar

[4]

Spector, Aimee, Bob Woods, and Martin Orrell. "Cognitive stimulation for the treatment of Alzheimer's disease." Expert Review of Neurotherapeutics 8.5 (2008): 751-757.

Crossref

Google Scholar

[5]

Sincich, Lawrence C., and Jonathan C. Horton. "The circuitry of V1 and V2: integration of color, form, and motion." Annu. Rev. Neurosci. 28 (2005): 303-326.

Crossref

Google Scholar

[6]

Garcia-Betances, Rebeca I., "Using virtual reality for cognitive training of the elderly." American Journal of Alzheimer's Disease & Other Dementias® 30.1 (2015): 49-54.

Crossref

Google Scholar

[7]

Oates, Joyce M., and Lynne M. Reder. "Memory for pictures: Sometimes a picture is not worth a single word." Successful remembering and successful forgetting. Psychology Press, 2011. 465-480.

Google Scholar

[8]

Gregory, Richard L. Eye and brain: The psychology of seeing. Vol. 38. Princeton university press, 2015.

Crossref

Google Scholar

[9]

Spector, Aimee, "Efficacy of an evidence-based cognitive stimulation therapy programme for people with dementia: randomised controlled trial." The British Journal of Psychiatry 183.3 (2003): 248-254.

Crossref

Google Scholar

[10]

Sacchi, Dario LM, Franca Agnoli, and Elizabeth F. Loftus. "Changing history: Doctored photographs affect memory for past public events." Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition 21.8 (2007): 1005-1022.

Crossref

Google Scholar

[11]

Seriès, Peggy, and Aaron R. Seitz. "Learning what to expect (in visual perception)." Frontiers in human neuroscience 7 (2013): 668.

Crossref

Google Scholar

[12]

Boas, Y. A. G. V. "Overview of virtual reality technologies." Interactive Multimedia Conference. Vol. 2013. sn, 2013.

Google Scholar

[13]

Buckley, Robin, and Pierre Berini. "Figures of merit for 2D surface plasmon waveguides and application to metal stripes." Optics express 15.19 (2007): 12174-12182.

Crossref

Google Scholar

[14]

Engkamat, Adeline, Ming Leong Yii, and Shirley Sinatra Gran. "Replit: a simple approach to real-time collaborative coding." (2023): 882-886.

Google Scholar

Cited By

View all

Rohrer CBen Souissi SKurpicz-Briki M(2025)Systematic review of recent years: machine learning-based interactive therapy for people suffering from dementiaArtificial Intelligence Review10.1007/s10462-024-11084-858:3Online publication date: 6-Jan-2025
https://doi.org/10.1007/s10462-024-11084-8

Index Terms

Enhancing Cognitive Recall in Dementia Patients: Integrating Generative AI with Virtual Reality for Behavioral and Memory Rehabilitation
1. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software design engineering

Recommendations

Thinning trainer based on forest-growth model, virtual reality and computer-aided virtual environment

Immersive virtual reality is applied in many human activities. This virtual reality can be used as a training tool for thinning operations in forests. The aim of this study is to describe the complex solution of Thinning Trainer, that we developed. This ...
Design of Virtual Reality Interactive Product Software Based on Artificial Intelligence
FAIML '23: Proceedings of the 2023 International Conference on Frontiers of Artificial Intelligence and Machine Learning

Abstract. Virtual reality (VR) technology is a new type of practical technology that was developed in the 20th century. Virtual reality involves the use and synthesis of computers, computer information and simulation technology. It is based on the latest ...
Diagnosis and rehabilitation of hemispatial neglect patients with virtual reality technology
Frontiers of Medical Informatics

Victims of a stroke or an accident with damage on the parietal lobe can suffer from hemispatial neglect. This disorder is characterized by misperception of the space contralateral to the damaged area. Paper and pencil tests, such as line bisection tests,...

Comments

Information & Contributors

Information

Published In

BDSIC '24: Proceedings of the 2024 6th International Conference on Big-data Service and Intelligent Computation

May 2024

110 pages

ISBN:9798400718069

DOI:10.1145/3686540

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 September 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

BDSIC 2024

BDSIC 2024: 2024 6th International Conference on Big-data Service and Intelligent Computation

May 29 - 31, 2024

Hong Kong, Hong Kong

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
78
Total Downloads

Downloads (Last 12 months)78
Downloads (Last 6 weeks)19

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rohrer CBen Souissi SKurpicz-Briki M(2025)Systematic review of recent years: machine learning-based interactive therapy for people suffering from dementiaArtificial Intelligence Review10.1007/s10462-024-11084-858:3Online publication date: 6-Jan-2025
https://doi.org/10.1007/s10462-024-11084-8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

Thinning trainer based on forest-growth model, virtual reality and computer-aided virtual environment

Design of Virtual Reality Interactive Product Software Based on Artificial Intelligence

Diagnosis and rehabilitation of hemispatial neglect patients with virtual reality technology

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations