Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2600428.2609626acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Using information scent and need for cognition to understand online search behavior

Published: 03 July 2014 Publication History

Abstract

The purpose of this study is to investigate the extent to which two theories, Information Scent and Need for Cognition, explain people's search behaviors when interacting with search engine results pages (SERPs). Information Scent, the perception of the value of information sources, was manipulated by varying the number and distribution of relevant results on the first SERP. Need for Cognition (NFC), a personality trait that measures the extent to which a person enjoys cognitively effortful activities, was measured by a standardized scale. A laboratory experiment was conducted with forty-eight participants, who completed six open-ended search tasks. Results showed that while interacting with SERPs containing more relevant documents, participants examined more documents and clicked deeper in the search result list. When interacting with SERPs that contained the same number of relevant results distributed across different ranks, participants were more likely to abandon their queries when relevant documents appeared later on the SERP. With respect to NFC, participants with higher NFC paginated less frequently and paid less attention to results at lower ranks than those with lower NFC. The interaction between NFC and the number of relevant results on the SERP affected the time spent on searching and a participant's likelihood to reformulate, paginate and stop. Our findings suggest evaluating system effectiveness based on the first page of results, even for tasks that require the user to view multiple documents, and varying interface features based on NFC.

References

[1]
Anick, P. (2003). Using terminological feedback for Web search refinement - A log-based Study. In Proceedings of SIGIR'03, 88--95.
[2]
Azzopardi, L., Kelly, D., & Brennan, K. (2013). How query cost affects search behavior. In Proceedings of SIGIR'13, 23--32.
[3]
Bailey, J. (1997). Need for cognition and response mode in the active construction of an information domain. Journal of Economic Psychology, 18(1), 69--85.
[4]
Borlund, P. (2003). The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Information Research, 8(3), 152.
[5]
Browne, G., & Pitts, M. (2004). Stopping rule use during information search in design problems. Organizational Behavior and Human Decision Processes, 95(2), 208--224.
[6]
Cacioppo, J., Petty, R., Feinstein, J., & Jarvis, W. (1996). Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psychological Review, 119(2), 197--253.
[7]
Cacioppo, J., Petty, R., & Kao, C. (1984). The efficient assessment of need for cognition. Journal of Personality Assessment, 48, 306--307.
[8]
Cacioppo, J., Petty, R., & Morris, K. (1983). Effects of need for cognition on message evaluation, recall, and persuasion. Journal of Personality and Social Psychology, 45, 805--818.
[9]
Card, S., Pirolli, P., Van Der Wege, M. M., Morrison, J. B., Reeder, R. W., Shraedley, P. K., & Boshart, J. (2001). Information scent as a driver of Web behavior graphs: results of a protocol analysis method for Web usability. In Proceedings of CHI, 498--505.
[10]
Chi, E. H, Pirolli, P., Chen, K., & Pitkow, J. E. (2001). Using information scent to model searcher needs and actions on the web. In Proceeding of CHI, (CHI Letters), 3(1), 490--497.
[11]
Chi, E. H, Pirolli, P., & Pitkow, J. (2000). The scent of a site: A system for analyzing and predicting information scent, usage, and usability of a Web site. In Proceeding of CHI, 161--168.
[12]
Cooper, W. (1968). Expected search length: A single measure of retrieval effectiveness based on the weak ordering action of retrieval systems. American Documentation, 19(1), 30--41.
[13]
Cooper, W. S. (1973). On selecting a measure of retrieval effectiveness part II. JASIS, 24(6), 413--424.
[14]
Cutrell, E., & Guan, Z. (2007). What are you looking for? An eye-tracking study of information usage in web search. In Proceeding of CHI, 407--416.
[15]
Dostert, M., & Kelly, D. (2009). Searchers' stopping behaviors and estimates of recall. In Proceedings of SIGIR, 820--821.
[16]
Diriye, A., White, R. W., Buscher, G., & Dumais, S. T. (2012). Leaving so soon? Understanding and predicting Web search abandonment rationales. In Proceedings of CIKM, 1025--1034.
[17]
Ford, N., Miller, D., & Moss, N. (2001). The role of individual differences in Internet searching: An empirical study. JASIS & T, 52(12), 1049--1066.
[18]
Hassan, A., Shi, X., Craswell, N., & Ramsey, B. (2013). Beyond clicks: Query reformulation as a predictor of search satisfaction. In Proceedings of CIKM, 2019--2018.
[19]
Huang, J., & Efthimiadis, E. N. (2009). Analyzing and evaluating query reformulation strategies in web search logs. In Proceeding of CIKM, 77--86.
[20]
Huang, J., White, R. W., & Dumais, S. (2011). No clicks, no problem. In Proceeding of CHI, 1225--1234.
[21]
Jansen, B. J., Booth, D. L., & Spink, A. (2009). Patterns of query reformulation during Web searching, JASIS & T, 60(7), 1358--1371.
[22]
Jansen, B.J., & Spink, A. (2005). How are we searching the World Wide Web? A comparison of nine search engine transaction logs. IP & M, 42(1), 248--263.
[23]
Järvelin. K. & Kekäläinen, J. (2002). Cumulated gain-based evaluation of IR techniques. ACM TOIS, 20(4), 422--446.
[24]
Joachims, T., Granka, L., Pan, B., Hembrooke, H., & Gay, G. (2005). Accurately interpreting clickthrough data as implicit feedback. In Proceedings of SIGIR, 154--161.
[25]
Kammerer, Y., Wollny, E., Gerjets, P., & Scheiter, K. (2009). How authority-related epistemological beliefs and salience of source information influence the evaluation of Web search results--An eye tracking study. In Proceedings of the 31st Annual Conference of the Cognitive Science Society, 2158--2163.
[26]
Kantor, P. B. (1987). A model for the stopping behavior of searchers of online systems. JASIS, 38(1), 211--214.
[27]
Kraft, D., & Lee, T. (1979). Stopping rules and their effect on expected search length. Information Processing and Management, 15(1), 47--58.
[28]
Lorigo, L., Haridasan, M., Brynjarsdóttir, H., Xia, L., Joachims, T., Gay, G., Granka, L., Pellacini, F., & Pan, B. (2008). Eye tracking and online search: Lessons learned and challenges ahead. JASIS & T, 59(7), 1041--1052.
[29]
Loumakis, F., Stumpf, S., & Grayson, D. (2011). This image smells good: Effects of image information scent in search engine results pages. In Proceedings of CIKM, 11, 475--484.
[30]
Mansourian, Y., & Ford, N. (2007). Search persistence and failure on the web: a "bounded rationality" and "satisficing" analysis. Journal of Documentation, 63(5), 680--701.
[31]
Nickles, K. R., Curley, S. P., & Benson, P. G. (1995). Judgment-based and reasoning-based stopping rules in decision making under uncertainty. Working Paper, Wake Forest University.
[32]
Nov, O., Arazy, O., López, C., & Brusilovsky, P. (2013). Exploring personality-targeted UI design in online social participation systems. In Proceedings of CHI, 361--370
[33]
Pirolli, P., & Card, S. (1999). Information foraging. Psychological Review, 106(4), 643--675.
[34]
Prabha, C., Connaway, L. S., Olszewski, L., & Jenkins, L. R. (2007). What is enough? Satisficing information needs. Journal of Documentation, 63(1), 74--89.
[35]
Rieh, S. (2002). Judgment of information quality and cognitive authority in the Web. JASIS & T, 53(2), 145--161.
[36]
Rieh, S.Y. and Xie, H. (2006). Analysis of multiple query reformulations on the web: the interactive information retrieval context. IP & M, 42(3), 751--768.
[37]
Scholer, F., Kelly, D., Wu, W. C., Lee, H. S., & Webber, W. (2013). The effect of threshold priming and need for cognition on relevance calibration and assessment. In Proceedings of SIGIR, 623--632.
[38]
Smith, C. L., Kantor, P. B., & Street, H. (2008). User adaptation?: Good results from poor systems. In Proceedings SIGIR, 144--154.
[39]
Spink, A., Jansen, B. J., & Ozmultu, H. C. (2000). Use of query reformulation and relevance feedback by Excite users. Internet Research, 10(4), 317--328.
[40]
Toms, E., & Freund, L. (2009). Predicting stopping behaviour: A preliminary analysis. In Proceedings of SIGIR, 750--751.
[41]
Vittinghoff, E. (2012). Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models. Boston: Springer.
[42]
White, R. W., & Dumais, S. T. (2009). Characterizing and predicting search engine switching behavior. In Proceedings of CIKM, 87--96.
[43]
Wu, W.C., Kelly, D., Edwards, A. & Arguello, J. Grannies, tanning beds, tattoos and NASCAR: Evaluation of search tasks with varying levels of cognitive complexity. Poster presented in the 4th Information Interaction in Context Symposium (IIiX--2012).
[44]
Zach, L. (2005). When is "enough" enough? Modeling the information-seeking and stopping behavior of senior arts administrators. JASIS & T, 56(1), 23--35.

Cited By

View all
  • (2024)Exploring the Impact of Verbal-Imagery Cognitive Style on Web Search Behaviour and Mental WorkloadProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638313(303-316)Online publication date: 10-Mar-2024
  • (2023)Analysis of the factors affecting information search stopping behavior: A systematic reviewJournal of Librarianship and Information Science10.1177/09610006231157091(096100062311570)Online publication date: 23-Mar-2023
  • (2023)A Field Study of Developer Documentation FormatExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585767(1-7)Online publication date: 19-Apr-2023
  • Show More Cited By

Index Terms

  1. Using information scent and need for cognition to understand online search behavior

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval
    July 2014
    1330 pages
    ISBN:9781450322577
    DOI:10.1145/2600428
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 July 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. information scent
    2. need for cognition
    3. pagination
    4. personality
    5. query reformulation
    6. search behavior
    7. search depth
    8. search stopping
    9. search strategies.

    Qualifiers

    • Research-article

    Conference

    SIGIR '14
    Sponsor:

    Acceptance Rates

    SIGIR '14 Paper Acceptance Rate 82 of 387 submissions, 21%;
    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)57
    • Downloads (Last 6 weeks)14
    Reflects downloads up to 13 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Exploring the Impact of Verbal-Imagery Cognitive Style on Web Search Behaviour and Mental WorkloadProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638313(303-316)Online publication date: 10-Mar-2024
    • (2023)Analysis of the factors affecting information search stopping behavior: A systematic reviewJournal of Librarianship and Information Science10.1177/09610006231157091(096100062311570)Online publication date: 23-Mar-2023
    • (2023)A Field Study of Developer Documentation FormatExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585767(1-7)Online publication date: 19-Apr-2023
    • (2023)An F-shape Click Model for Information Retrieval on Multi-block Mobile PagesProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3570365(1057-1065)Online publication date: 27-Feb-2023
    • (2023)The Influences of a Knowledge Representation Tool on Searchers with Varying Cognitive AbilitiesACM Transactions on Information Systems10.1145/352766141:1(1-35)Online publication date: 25-Feb-2023
    • (2022)The Dark Side of Relevance: The Effect of Non-Relevant Results on Search BehaviorProceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505770(1-11)Online publication date: 14-Mar-2022
    • (2022)Searching, Learning, and Subtopic Ordering: A Simulation-Based AnalysisAdvances in Information Retrieval10.1007/978-3-030-99736-6_10(142-156)Online publication date: 5-Apr-2022
    • (2021)An Integrated Model of Task, Information Needs, Sources and Uncertainty to Design Task-Aware Search SystemsProceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3471158.3472231(83-92)Online publication date: 11-Jul-2021
    • (2021)In quest of goldilocks ranges in searching for information on the webJournal of Documentation10.1108/JD-01-2021-001978:2(264-283)Online publication date: 25-May-2021
    • (2020)Investigating Reference Dependence Effects on User Search Interaction and SatisfactionProceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3397271.3401085(1141-1150)Online publication date: 25-Jul-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media