Age-related Difference in Conversational Search Behavior: Preliminary Findings
Pages 259 - 265
Abstract
When it comes to emerging technologies, older adults are often those who can greatly benefit from the advancements but are vastly under-represented in research and designs. This study presents preliminary findings of older adults' search behavior with a spoken conversational search agent which represents the next generation search paradigm. Our findings show that, compared with their younger counterparts, older adults' search conversations lasted longer and included more requests. Their requests had greater length and tended to have a lower proportion of unique words, more grammatically complex sentences and short pauses. In addition, the older subjects preferred to start a request with "I" and request questions with modal verbs were less frequent. They reformulated spoken requests as competently as did younger adults but elaborations on requests were uniquely founded among older adults. They also tended to have more than one query or question in a single request and rephrasing requests was more frequently observed than younger adults. System implications and future research directions are discussed.
References
[1]
Agresti, A. 2007. An introduction to categorical data analysis. John Wiley & Sons, Inc.
[2]
Anand, A., Cavedon, L., Joho, H., Sanderson, M. and Stein, B. 2020. Conversational Search (Dagstuhl Seminar 19461). Schloss Dagstuhl – Leibniz Zentrum für Informatik. (2020). https://doi.org/10.4230/dagrep.9.11.34.
[3]
Arguello, J., Choi, B. and Capra, R. 2018. Factors influencing users’ information requests. ACM Transactions on Information Systems. 36, 4 (Jul. 2018), 1–37. https://doi.org/10.1145/3209624.
[4]
Aula, A. 2005. User study on older adults’ use of the Web and search engines. Universal Access in the Information Society. 4, 1 (Sep. 2005), 67–81. https://doi.org/10.1007/s10209-004-0097-7.
[5]
Azzopardi, L., Dubiel, M., Halvey, M. and Dalton, J. 2018. Conceptualizing agent-human interactions during the conversational search process. (Jul. 2018).
[6]
Bandura, A. 1986. Social Foundations of Thought and Action: A Social Cognitive Theory. Prentice-Hall, Inc.
[7]
Bigot, L.L., Terrier, P., Amiel, V., Poulain, G., Jamet, E. and Rouet, J.-F. 2007. Effect of modality on collaboration with a dialogue system. International journal of human-computer studies. 65, 12 (Dec. 2007), 983–991. https://doi.org/10.1016/j.ijhcs.2007.07.002.
[8]
Borlund, P. 2000. Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation. 56, 1 (Feb. 2000), 71–90. https://doi.org/10.1108/EUM0000000007110.
[9]
Bortfeld, H., Leon, S.D., Bloom, J.E., Schober, M.F. and Brennan, S.E. 2001. Disfluency rates in conversation: effects of age, relationship, topic, role, and gender. Language and speech. 44, Pt 2 (Jun. 2001), 123–147. https://doi.org/10.1177/00238309010440020101.
[10]
Brennan, K., Kelly, D. and Zhang, Y. 2016. Factor Analysis of a Search Self-Efficacy Scale. Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval (New York, NY, USA, Mar. 2016), 241–244.
[11]
Brennan, S.E. 1991. Conversation with and through computers. User modeling and user-adapted interaction. (1991).
[12]
Brewer, R., Pierce, C., Upadhyay, P. and Park, L. 2021. An Empirical Study of Older Adult's Voice Assistant Use for Health Information Seeking . ACM Trans. Interact. Intell. Syst. 1, 1 (Jan. 2021), 39.
[13]
Chevalier, A., Dommes, A. and Marquié, J.-C. 2011. Information searching on the web: the cognitive difficulties experienced by older users in modifying unsuccessful information searches. Engineering psychology and cognitive ergonomics. D. Harris, ed. Springer Berlin Heidelberg. 225–232.
[14]
Chevalier, A., Dommes, A. and Marquié, J.-C. 2015. Strategy and accuracy during information search on the Web: Effects of age and complexity of the search questions. Computers in human behavior. 53, (Dec. 2015), 305–315. https://doi.org/10.1016/j.chb.2015.07.017.
[15]
Chin, J., Anderson, E., Chin, C.-L. and Fu, W.-T. 2015. Age differences in information search: An exploration-exploitation tradeoff model. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 59, 1 (Dec. 2015), 85–89. https://doi.org/10.1177/1541931215591018.
[16]
Chin, J., Fu, W.-T. and Kannampallil, T. 2009. Adaptive information search: age-dependent interactions between cognitive profiles and strategies. Proceedings of the 27th international conference on Human factors in computing systems (New York, New York, USA, Apr. 2009), 1683.
[17]
Cohen, J. 1960. A Coefficient of Agreement for Nominal Scales. Educational and psychological measurement. 20, 1 (Apr. 1960), 37–46. https://doi.org/10.1177/001316446002000104.
[18]
Culpepper, J.S., Diaz, F. and Smucker, M.D. 2018. Research frontiers in information retrieval. ACM SIGIR Forum. 52, 1 (Aug. 2018), 34–90. https://doi.org/10.1145/3274784.3274788.
[19]
Dahlbäck, N., Jönsson, A. and Ahrenberg, L. 1993. Wizard of Oz studies — why and how. Knowledge-Based Systems. 6, 4 (Dec. 1993), 258–266. https://doi.org/10.1016/0950-7051(93)90017-N.
[20]
Dalton, J., Xiong, C. and Callan, J. 2020. TREC CAsT 2019: The Conversational Assistance Track Overview. arXiv. (Mar. 2020).
[21]
Dommes, A., Chevalier, A. and Lia, S. 2011. The role of cognitive flexibility and vocabulary abilities of younger and older users in searching for information on the web. Applied cognitive psychology. 25, 5 (Sep. 2011), 717–726. https://doi.org/10.1002/acp.1743.
[22]
Dubiel, M., Halvey, M. and Azzopardi, L. 2018. Investigating how conversational search agents affect user's behaviour, performance and search experience. (New York, NY, USA, Jul. 2018).
[23]
Ghosh, S. 2020. Exploring intelligent functionalities of spoken conversational search systems. No Publisher Supplied. (May 2020). https://doi.org/10.7282/t3-74mh-bq82.
[24]
Guy, I. 2018. The characteristics of voice search: comparing spoken with typed-in mobile web search queries. ACM Transactions on Information Systems. 36, 3 (Mar. 2018), 1–28. https://doi.org/10.1145/3182163.
[25]
Horton, W.S., Spieler, D.H. and Shriberg, E. 2010. A corpus analysis of patterns of age-related change in conversational speech. Psychology and Aging. 25, 3 (Sep. 2010), 708–713. https://doi.org/10.1037/a0019424.
[26]
Huang, J. and Efthimiadis, E.N. 2009. Analyzing and evaluating query reformulation strategies in web search logs. Proceeding of the 18th ACM conference on Information and knowledge management (New York, New York, USA, Nov. 2009), 77.
[27]
Jansen, B.J., Spink, A. and Narayan, B. 2007. Query modifications patterns during web searching. Fourth International Conference on Information Technology (ITNG’07) (Apr. 2007), 439–444.
[28]
Jiang, J., Jeng, W. and He, D. 2013. How do users respond to voice input errors? Lexical and phonetic query reformulation in voice search. Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (New York, New York, USA, Jul. 2013), 143.
[29]
Karanam, S. and van Oostendorp, H. 2016. Age-related Differences in the Content of Search Queries when Reformulating. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (New York, New York, USA, May 2016), 5720–5730.
[30]
Kelly, D. 2009. Methods for Evaluating Interactive Information Retrieval Systems with Users. Foundations and Trends® in Information Retrieval. 3, 1—2 (2009), 1–224. https://doi.org/10.1561/1500000012.
[31]
Kemper, S. and Sumner, A. 2001. The structure of verbal abilities in young and older adults. Psychology and Aging. 16, 2 (2001), 312–322. https://doi.org/10.1037/0882-7974.16.2.312.
[32]
Kiesel, J., Cai, X., EI Baff, R., Stein, B. and Hagen, M. 2021. Toward Conversational Query Reformulation. (September 15–18, 2021, Padua, Italy, Sep. 2021), 91–101.
[33]
Kimberly Miller, A.A. 2013. Smart-Home Technologies to Assist Older People to Live Well at Home. Journal of aging science. 01, 01 (2013). https://doi.org/10.4172/2329-8847.1000101.
[34]
Kim, S. 2021. Exploring How Older Adults Use a Smart Speaker-Based Voice Assistant in Their First Interactions: Qualitative Study. JMIR mHealth and uHealth. 9, 1 (Jan. 2021), e20427. https://doi.org/10.2196/20427.
[35]
Kobayashi, M., Kosugi, A., Takagi, H., Nemoto, M., Nemoto, K., Arai, T. and Yamada, Y. 2019. Effects of Age-Related Cognitive Decline on Elderly User Interactions with Voice-Based Dialogue Systems. Human-Computer Interaction – INTERACT 2019: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2–6, 2019, Proceedings, Part IV. D. Lamas, F. Loizides, L. Nacke, H. Petrie, M. Winckler, and P. Zaphiris, eds. Springer International Publishing. 53–74.
[36]
Laserna, C.M., Seih, Y.-T. and Pennebaker, J.W. 2014. Um . . . Who Like Says You Know: Filler Word Use as a Function of Age, Gender, and Personality. Journal of Language and Social Psychology. 33, 3 (Jun. 2014), 328–338. https://doi.org/10.1177/0261927X14526993.
[37]
Lau, T. and Horvitz, E. 1999. Patterns of search: analyzing and modeling Web query refinement. (Banff, Canada, Jun. 1999), 119–128.
[38]
McLellan, E., MacQueen, K.M. and Neidig, J.L. 2003. Beyond the Qualitative Interview: Data Preparation and Transcription. Field methods. 15, 1 (Feb. 2003), 63–84. https://doi.org/10.1177/1525822X02239573.
[39]
Nearly half of Americans use digital voice assistants, mostly on their smartphones.: 2017. https://www.pewresearch.org/fact-tank/2017/12/12/nearly-half-of-americans-use-digital-voice-assistants-mostly-on-their-smartphones/. Accessed: 2022-01-01.
[40]
Pradhan, A., Lazar, A. and Findlater, L. 2020. Use of Intelligent Voice Assistants by Older Adults with Low Technology Use. ACM Transactions on Computer-Human Interaction. 27, 4 (Sep. 2020), 1–27. https://doi.org/10.1145/3373759.
[41]
Qu, C., Yang, L., Croft, W.B., Zhang, Y., Trippas, J.R. and Qiu, M. 2019. User Intent Prediction in Information-seeking Conversations. Proceedings of the 2019 Conference on Human Information Interaction and Retrieval (New York, New York, USA, Mar. 2019), 25–33.
[42]
Radlinski, F. and Craswell, N. 2017. A theoretical framework for conversational search. Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval (New York, New York, USA, Mar. 2017), 117–126.
[43]
Rieh, S.Y. and Xie, H. (Iris) 2006. Analysis of multiple query reformulations on the web: The interactive information retrieval context. Information Processing & Management. 42, 3 (May 2006), 751–768. https://doi.org/10.1016/j.ipm.2005.05.005.
[44]
Sanchiz, M., Amadieu, F. and Chevalier, A. 2020. An Evolving Perspective to Capture Individual Differences Related to Fluid and Crystallized Abilities in Information Searching with a Search Engine. Understanding and improving information search: A cognitive approach. W.T. Fu and H. van Oostendorp, eds. Springer International Publishing. 71–96.
[45]
Sanchiz, M., Amadieu, F., Fu, W.T. and Chevalier, A. 2019. Does pre-activating domain knowledge foster elaborated online information search strategies? Comparisons between young and old web user adults. Applied Ergonomics. 75, (Feb. 2019), 201–213. https://doi.org/10.1016/j.apergo.2018.10.010.
[46]
Sanchiz, M., Chin, J., Chevalier, A., Fu, W.T., Amadieu, F. and He, J. 2017. Searching for information on the web: Impact of cognitive aging, prior domain knowledge and complexity of the search problems. Information Processing & Management. 53, 1 (Jan. 2017), 281–294. https://doi.org/10.1016/j.ipm.2016.09.003.
[47]
Sayago, S., Neves, B.B. and Cowan, B.R. 2019. Voice assistants and older people: Some open issues. Proceedings of the 1st International Conference on Conversational User Interfaces - CUI ’19 (New York, New York, USA, Aug. 2019), 1–3.
[48]
Sa, N. and Yuan, X. (Jenny) 2019. Examining users’ partial query modification patterns in voice search. Journal of the Association for Information Science and Technology. (Apr. 2019). https://doi.org/10.1002/asi.24238.
[49]
Schlögl, S., Chollet, G., Garschall, M., Tscheligi, M. and Legouverneur, G. 2013. Exploring voice user interfaces for seniors. Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments - PETRA ’13 (New York, New York, USA, May 2013), 1–2.
[50]
Sharit, J., Hernández, M.A., Czaja, S.J. and Pirolli, P. 2008. Investigating the roles of knowledge and cognitive abilities in older adult information seeking on the web. ACM transactions on computer-human interaction: a publication of the Association for Computing Machinery. 15, 1 (2008), 3. https://doi.org/10.1145/1352782.1352785.
[51]
Stigall, B., Waycott, J., Baker, S. and Caine, K. 2019. Older adults’ perception and use of voice user interfaces: A preliminary review of the computing literature. Proceedings of the 31st Australian Conference on Human-Computer-Interaction (New York, NY, USA, Dec. 2019), 423–427.
[52]
Stronge, A.J., Rogers, W.A. and Fisk, A.D. 2006. Web-based information search and retrieval: effects of strategy use and age on search success. Human Factors. 48, 3 (2006), 434–446. https://doi.org/10.1518/001872006778606804.
[53]
Traum, D.R. and Heeman, P.A. 1997. Utterance units in spoken dialogue. Dialogue processing in spoken language systems. E. Maier, M. Mast, and S. LuperFoy, eds. Springer Berlin Heidelberg. 125–140.
[54]
Trippas, J.R., Spina, D., Cavedon, L., Joho, H. and Sanderson, M. 2018. Informing the design of spoken conversational search: perspective paper. Proceedings of the 2018 Conference on Human Information Interaction and Retrieval (New York, New York, USA, Mar. 2018), 32–41.
[55]
Trippas, J.R., Spina, D., Cavedon, L. and Sanderson, M. 2017. A conversational search transcription protocol and analysis. SIGIR 1st International Workshop on Conversational Approaches to Information Retrieval (CAIR’17). 17, (2017).
[56]
Trunk, D.L. and Abrams, L. 2009. Do younger and older adults’ communicative goals influence off-topic speech in autobiographical narratives? Psychology and Aging. 24, 2 (Jun. 2009), 324–337. https://doi.org/10.1037/a0015259.
[57]
Vakulenko, S., Revoredo, K., Di Ciccio, C. and de Rijke, M. 2019. QRFA: A Data-Driven Model of Information-Seeking Dialogues. Advances in information retrieval: 41st European conference on IR research, ECIR 2019. L. Azzopardi, B. Stein, N. Fuhr, P. Mayr, C. Hauff, and D. Hiemstra, eds. Springer International Publishing. 541–557.
[58]
Vtyurina, A., Savenkov, D., Agichtein, E. and Clarke, C.L.A. 2017. Exploring conversational search with humans, assistants, and wizards. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ’17 (New York, New York, USA, May 2017), 2187–2193.
[59]
Ziman, R. and Walsh, G. 2018. Factors Affecting Seniors’ Perceptions of Voice-enabled User Interfaces. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18 (New York, New York, USA, Apr. 2018), 1–6.
Index Terms
- Age-related Difference in Conversational Search Behavior: Preliminary Findings
Index terms have been assigned to the content through auto-classification.
Recommendations
Age-Related differences in factors contributing to affective experiences among japanese adults
UAHCI'13: Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: user and context diversity - Volume 2People's needs for products and services providing affective experiences continue to grow. Previous studies have made initial attempts at clarifying affective factors contributing to the generation of affects among Japanese participants. However, those ...
Age-related difference in the use of mobile phones
This study examined the difference between younger adults and older adults in requirements for mobile phones and acceptance of new functions. A survey was conducted among 351 older adults and 140 younger adults in China. Four major findings were ...
Understanding age and technology experience differences in use of prior knowledge for everyday technology interactions
Technology designers must understand relevant prior knowledge in a target user population to facilitate adoption and effective use. To assess prior knowledge used in naturalistic settings, we systematically collected information about technologies used ...
Comments
Information & Contributors
Information
Published In
March 2022
399 pages
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 14 March 2022
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval
March 14 - 18, 2022
Regensburg, Germany
Acceptance Rates
Overall Acceptance Rate 55 of 163 submissions, 34%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 227Total Downloads
- Downloads (Last 12 months)35
- Downloads (Last 6 weeks)2
Reflects downloads up to 08 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format