You Know What I’m Saying: Designing Conversational Strategies of AI Agent for Tip of the Tongue Phenomenon
Authors: 
Juhye Ha, Dayoung Lee, Changhoon OhAuthors Info & Claims
Juhye Ha, Dayoung Lee, Changhoon OhAuthors Info & ClaimsArticle No.: 324, Pages 1 - 6
Abstract
The phenomenon of being unable to recall a specific word or term from memory is called “tip-of-the-tongue” (TOT). Despite its significance, potential applications for solving TOT from the user experience (UX) and human–computer interface (HCI) perspectives are yet to be fully explored. With the advent of advanced artificial intelligence (AI) interfaces and technologies, new opportunities have emerged to address TOT. This study aims to investigate the applicability of AI in addressing TOT and the roles of conversation design strategies in mitigating this phenomenon. To this end, we developed a prototype called “Tip-pong,” which is a turn-taking user interface that provides semantic and episodic clues, as well as targeted and optional answers to assist users in resolving TOT. Through a quantitative and qualitative study involving 23 participants, we evaluated the prototype and found that while the type of clue had no significant impact on usability, users preferred optional answers over targeted answers. Additionally, we found that allowing users to experience the process of approaching the answer on their own was more effective than providing the correct answer immediately. Based on these findings, we discuss the design implications for the development of AI agents to solve TOT in everyday life.
Supplementary Material
References
[1]
Jaime Arguello, Adam Ferguson, Emery Fine, Bhaskar Mitra, Hamed Zamani, and Fernando Diaz. 2021. Tip of the tongue known-item retrieval: A case study in movie identification. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval. 5–14.
[2]
Shiho Arima, Shingo Kuroiwa, Yasuo Horiuchi, and Daisuke Furukawa. 2015. Question-asking strategy for people with aphasia to remember food names. Journal on Technology & Persons with Disabilities 3 (2015), 10–19.
[3]
Jonathan Arnowitz, Michael Arent, and Nevin Berger. 2007. Wizard-of-oz Protoyping. 402–419. https://doi.org/10.1016/B978-012088568-8/50022-9
[4]
Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human–Computer Interaction 24, 6 (2008), 574–594.
[5]
Serge Brédart and Marie Geurten. 2020. Strategies to resolve recall failures for proper names: New data. Memory & Cognition 48, 8 (2020), 1417–1428.
[6]
Tim Brennen, Thom Baguley, Jim Bright, and Vicki Bruce. 1990. Resolving semantically induced tip-of-the-tongue states for proper nouns. Memory & Cognition 18, 4 (1990), 339–347.
[7]
Roger Brown and David McNeill. 1966. The “tip of the tongue” phenomenon. Journal of verbal learning and verbal behavior 5, 4 (1966), 325–337.
[8]
Kahneman Daniel. 2017. Thinking, fast and slow.
[9]
David Elsweiler, Ian Ruthven, and Christopher Jones. 2007. Towards memory supporting personal information management tools. Journal of the American Society for Information Science and Technology 58, 7 (2007), 924–946.
[10]
Teresa Fernandes and Elisabete Oliveira. 2021. Understanding consumers’ acceptance of automated technologies in service encounters: Drivers of digital voice assistants adoption. Journal of Business Research 122 (2021), 180–191.
[11]
J Richard Hanley and Elaine S Cowell. 1988. The effects of different types of retrieval cues on the recall of names of famous faces. Memory & Cognition 16, 6 (1988), 545–555.
[12]
Tianyong Hao, Wenxiu Xie, Qingyao Wu, Heng Weng, and Yingying Qu. 2017. Leveraging question target word features through semantic relation expansion for answer type classification. Knowledge-Based Systems 133 (2017), 43–52.
[13]
Liadh Kelly, Yi Chen, Marguerite Fuller, and Gareth JF Jones. 2008. A study of remembered context for information access from personal digital archives. In Proceedings of the second international symposium on Information interaction in context. 44–50.
[14]
Kazuhiro Kuwabara, Takayuki Iwamae, Yudai Wada, Hung-Hsuan Huang, and Keisuke Takenaka. 2016. Toward a conversation partner agent for people with aphasia: Assisting word retrieval. In International Conference on Intelligent Decision Technologies. Springer, 203–213.
[15]
Ye Ni Lee, So Young Choi, Ye Ni Lee, and So Young Choi. 2016. Differences in tip-of-the-tongue phenomenon and resolving patterns according to vocabulary characteristics between young and elderly adults. Communication Sciences & Disorders 21, 1 (2016), 139–150.
[16]
Q Vera Liao, Biplav Srivastava, and Pavan Kapanipathi. 2017. Tailoring Conversational UX through the Lens of Dialogue Complexity. In CHI Workshop on Conversational UX Design.
[17]
Junfeng Liu, Christopher Symons, and Ranga Raju Vatsavai. 2022. Persona-Based Conversational AI: State of the Art and Challenges. arXiv preprint arXiv:2212.03699 (2022).
[18]
Qianli Ma, Yaping Zhang, Wenti Xu, and Ronggang Zhou. 2022. Ask a Further Question or Give a List? How Should Conversational Agents Reply to Users’ Uncertain Queries. International Journal of Human–Computer Interaction (2022), 1–15.
[19]
Janet Metcalfe, Bennett L Schwartz, and Paul A Bloom. 2017. The tip-of-the-tongue state and curiosity. Cognitive research: principles and implications 2, 1 (2017), 1–8.
[20]
Clifford Nass and Youngme Moon. 2000. Machines and mindlessness: Social responses to computers. Journal of social issues 56, 1 (2000), 81–103.
[21]
Costanza Papagno and Erminio Capitani. 1998. Proper name anomia: A case with sparing of the first-letter knowledge. Neuropsychologia 36, 7 (1998), 669–679.
[22]
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J Liu, 2020. Exploring the limits of transfer learning with a unified text-to-text transformer.J. Mach. Learn. Res. 21, 140 (2020), 1–67.
[23]
Jeff Sauro and James R Lewis. 2016. Quantifying the user experience: Practical statistics for user research. Morgan Kaufmann.
[24]
Bennett L Schwartz and Alan S Brown. 2014. Tip-of-the-tongue states and related phenomena. Cambridge University Press.
[25]
Bennett L Schwartz and Janet Metcalfe. 2011. Tip-of-the-tongue (TOT) states: Retrieval, behavior, and experience. Memory & cognition 39, 5 (2011), 737–749.
[26]
Larry R Squire and Stuart M Zola. 1998. Episodic memory, semantic memory, and amnesia. Hippocampus 8, 3 (1998), 205–211.
Index Terms
- You Know What I’m Saying: Designing Conversational Strategies of AI Agent for Tip of the Tongue Phenomenon
Recommendations
On the tip of the tongue: Modulation of the primary motor cortex during audiovisual speech perception
Recent neurophysiological studies show that cortical brain regions involved in the planning and execution of speech gestures are also activated in processing speech sounds. These findings suggest that speech perception is in part mediated by reference ...
On the tip-of-the-tongue: Neural correlates of increased word-finding failures in normal aging
Tip-of-the-tongue (TOT) experiences are frustrating word-finding failures where people are temporarily unable to produce a word they are certain they know. TOT frequency increases with normal aging during adulthood, and behavioral evidence suggests that ...
Between thought and expression, a magnetoencephalography study of the "tip-of-the-tongue" phenomenon
"Tip-of-the-tongue" (TOT) is the phenomenon associated with the inaccessibility of a known word from memory. It is universally experienced, increases in frequency with age, and is most common for proper nouns. It is a good model for the symptom of ...
Comments
Information & Contributors
Information
Published In
April 2023
3914 pages
ISBN:9781450394222
DOI:10.1145/3544549
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 April 2023
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Conference
CHI '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 352Total Downloads
- Downloads (Last 12 months)202
- Downloads (Last 6 weeks)23
Reflects downloads up to 10 Oct 2024
Other Metrics
Citations
Cited By
View allView Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format