Unlocking Memories with AI: Exploring the Role of AI-Generated Cues in Personal Reminiscing
Article No.: 356, Pages 1 - 6
Abstract
While technology-mediated reminiscing has been studied for decades, generating relevant cues to trigger personal reminiscing remains challenging. The potential of AI in generating relevant content across various domains has been recently recognized, yet its use in facilitating reminiscing is still less explored. This work aims to explore the use of AI in supporting the recall of personal memories associated with significant objects at home. We designed Treasurefinder, a device powered by a large language model (LLM) that generates open-ended questions based on stories stored in NFC-tagged physical objects or cards. We conducted an exploratory study with 12 participants, grouped in pairs, to observe reminiscing behaviors when using Treasurefinder. The results showed the AI-generated questions 1) supported individuals to recall the past, 2) provided new insights about the other person, and 3) encouraged reflection. Notably, the device facilitated active memory retrieval related to cherished objects that are often overlooked.
Supplemental Material
MP4 File
Talk Video
- Download
- 77.54 MB
- Transcript
References
[1]
Rowanne Fleck and Geraldine Fitzpatrick. 2010. Reflecting on reflection: framing a design landscape. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction. ACM, Brisbane Australia, 216–223. https://doi.org/10.1145/1952222.1952269
[2]
Christopher Frauenberger, Marjo Rauhala, and Geraldine Fitzpatrick. 2017. In-Action Ethics. Interacting with Computers 29, 2 (March 2017), 220–236. https://doi.org/10.1093/iwc/iww024
[3]
David Frohlich and Rachel Murphy. 2000. The Memory Box. Personal and Ubiquitous Computing 4 (Jan. 2000), 238–240. https://doi.org/10.1007/PL00000011
[4]
Celia B. Harris, Penny Van Bergen, Paul A. Strutt, Gabrielle K. Picard, Sophia A. Harris, Ruth Brookman, and Karn Nelson. 2022. Teaching Elaborative Reminiscing to Support Autobiographical Memory and Relationships in Residential and Community Aged Care Services. Brain Sciences 12, 3 (March 2022), 374. https://doi.org/10.3390/brainsci12030374
[5]
Subin Kim, Sangsu Jang, Jin-young Moon, Minjoo Han, and Young-Woo Park. 2022. Slide2Remember: an Interactive Wall Frame Enriching Reminiscence Experiences by Providing Re-encounters of Taken Photos and Heard Music in a Similar Period. In Designing Interactive Systems Conference. ACM, Virtual Event Australia, 288–300. https://doi.org/10.1145/3532106.3533456
[6]
David S. Kirk, Shahram Izadi, Abigail Sellen, Stuart Taylor, Richard Banks, and Otmar Hilliges. 2010. Opening up the family archive. In Proceedings of the 2010 ACM conference on Computer supported cooperative work. ACM, Savannah Georgia USA, 261–270. https://doi.org/10.1145/1718918.1718968
[7]
Sarah Kulkofsky, Qi Wang, and Yubo Hou. 2010. Why I remember that: The influence of contextual factors on beliefs about everyday memory. Memory & Cognition 38, 4 (June 2010), 461–473. https://doi.org/10.3758/MC.38.4.461
[8]
Cun Li, Jun Hu, Bart Hengeveld, and Caroline Hummels. 2019. Slots-Memento: Facilitating Intergenerational Memento Storytelling and Preservation for the Elderly. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, Tempe Arizona USA, 359–366. https://doi.org/10.1145/3294109.3300979
[9]
Karin Niemantsverdriet and Maarten Versteeg. 2016. Interactive Jewellery as Memory Cue: Designing a Sound Locket for Individual Reminiscence. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, Eindhoven Netherlands, 532–538. https://doi.org/10.1145/2839462.2856524
[10]
Svetlana Nikitina, Sara Callaioli, and Marcos Baez. 2018. Smart conversational agents for reminiscence. In Proceedings of the 1st International Workshop on Software Engineering for Cognitive Services. ACM, Gothenburg Sweden, 52–57. https://doi.org/10.1145/3195555.3195567
[11]
William Odom, Richard Banks, David Kirk, Richard Harper, Siân Lindley, and Abigail Sellen. 2012. Technology heirlooms?: considerations for passing down and inheriting digital materials. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Austin Texas USA, 337–346. https://doi.org/10.1145/2207676.2207723
[12]
William T. Odom, Abigail J. Sellen, Richard Banks, David S. Kirk, Tim Regan, Mark Selby, Jodi L. Forlizzi, and John Zimmerman. 2014. Designing for slowness, anticipation and re-visitation: a long term field study of the photobox. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Toronto Ontario Canada, 1961–1970. https://doi.org/10.1145/2556288.2557178
[13]
Aditya Kumar Purohit, Aditya Upadhyaya, and Adrian Holzer. 2023. ChatGPT in Healthcare: Exploring AI Chatbot for Spontaneous Word Retrieval in Aphasia. In Computer Supported Cooperative Work and Social Computing. ACM, Minneapolis MN USA, 1–5. https://doi.org/10.1145/3584931.3606993
[14]
Samarth Singhal, Carman Neustaedter, William Odom, Lyn Bartram, and Yasamin Heshmat. 2018. Time-Turner: Designing for Reflection and Remembrance of Moments in the Home. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–14. https://doi.org/10.1145/3173574.3173753
[15]
Daniel Street and Joseph Wilck. 2023. ’Let’s Have a Chat’: Principles for the Effective Application of ChatGPT and Large Language Models in the Practice of Forensic Accounting. https://doi.org/10.2139/ssrn.4351817
[16]
Doménique van Gennip, Elise van den Hoven, and Panos Markopoulos. 2015. Things That Make Us Reminisce: Everyday Memory Cues as Opportunities for Interaction Design. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3443–3452. https://doi.org/10.1145/2702123.2702460
[17]
A. Zijlema, E. Van den Hoven, and B. Eggen. 2017. Preserving objects, preserving memories: repair professionals and object owners on the relation between memories and traces on personal possessions. In Proceedings of the Conference on Product Lifetimes and the Environment (PLATE2017). IOS Press, Delft Netherlands, 453–457. https://doi.org/10.3233/978-1-61499-820-4-453
Index Terms
- Unlocking Memories with AI: Exploring the Role of AI-Generated Cues in Personal Reminiscing
Recommendations
Exploring Self-Defining Memories in Old Age and their Digital Cues
DIS '18: Proceedings of the 2018 Designing Interactive Systems ConferenceSelf-defining memories represent significant emotional events capturing the most important concerns in our lives. While much HCI work on memory technologies has focused on autobiographic memories and lifelogging technologies for capturing them, there ...
Self-Reflection and Personal Physicalization Construction
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsSelf-reflection is a central goal of personal informatics systems, and constructing visualizations from physical tokens has been found to help people reflect on data. However, so far, constructive physicalization has only been studied in lab ...
Comments
Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Data Availability
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 264Total Downloads
- Downloads (Last 12 months)264
- Downloads (Last 6 weeks)69
Reflects downloads up to 11 Aug 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format