Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2348283.2348328acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Search, interrupted: understanding and predicting search task continuation

Published: 12 August 2012 Publication History

Abstract

Many important search tasks require multiple search sessions to complete. Tasks such as travel planning, large purchases, or job searches can span hours, days, or even weeks. Inevitably, life interferes, requiring the searcher either to recover the "state" of the search manually (most common), or plan for interruption in advance (unlikely). The goal of this work is to better understand, characterize, and automatically detect search tasks that will be continued in the near future. To this end, we analyze a query log from the Bing Web search engine to identify the types of intents, topics, and search behavior patterns associated with long-running tasks that are likely to be continued. Using our insights, we develop an effective prediction algorithm that significantly outperforms both the previous state-of-the-art method, and even the ability of human judges, to predict future task continuation. Potential applications of our techniques would allow a search engine to pre-emptively "save state" for a searcher (e.g., by caching search results), perform more targeted personalization, and otherwise better support the searcher experience for interrupted search tasks.

References

[1]
E. Agichtein, E. Brill and S. Dumais. Improving Web search ranking by incorporating user behavior information. SIGIR '06, 19--26, 2006.
[2]
L. M. Aiello, D. Donato, U. Ozertem, and F. Menczer. Behavior-driven clustering of queries into topics. CIKM '11, 1373--1382, 2011.
[3]
A. Aula, N. Jhaveri and M. Käki. Information search and re-access strategies of experienced Web users. WWW '05, 583--592, 2005.
[4]
J.T. Austin and J.B. Vancouver. Goal constructs in psychology: Structure, process, and content. Psychological Bulletin, 120(3): 338--375, 1996.
[5]
P.N. Bennett, K. Svore and S.T. Dumais. Classification-enhanced ranking. WWW '10, 111--120, 2010.
[6]
A. Broder. A taxonomy of Web search. SIGIR Forum, 32(2): 3--10, 2002.
[7]
H. Cao, D. Jiang, J. Pei, Q. He, Z. Liao, E. Chen and H. Li. Context-aware query suggestion by mining click-through and session data. KDD '08, 875--883, 2008.
[8]
Y.-S. Chang, K.-Y. He, S. Yu and W.-H. Lu. Identifying user goals from Web search results. WWW '06, 1038--1041, 2006.
[9]
M. Czerwinski, E. Horvitz and S. Wilhite. A diary study of task switching and interruptions. CHI '04, 175--182, 2004.
[10]
D. Donato, F. Bonchi, T. Chi and Y. Maarek. Do you want to take notes? Identifying research missions in Yahoo! Search Pad. WWW '10, 321--330, 2010.
[11]
D. Downey, S.T. Dumais, D. Liebling and E. Horvitz. Under-standing the relationship between searchers' queries and information goals. CIKM'08, 449--458, 2008.
[12]
S. Dumais, G. Buscher and E. Cutrell. Individual differences in gaze patterns for web search. IIiX '10, 185--194, 2010.
[13]
S. Fox, K. Karnawat, M. Mydland, S. T. Dumais and T. White. Evaluating implicit measures to improve the search experience. TOIS, 23(2): 147--168, 2005.
[14]
J. Friedman. MART boosted decision trees: Greedy function approximation: a gradient boosting machine. Annals of Statistics, 25(5): 1189--1232, 2001.
[15]
J. Friedman, T. Hastie and T. Tibshirani. Additive logistic regression: A statistical view of boosting. Annals of Statistics, 28(2): 337--407, 2000.
[16]
A. Hassan, R. Jones and K. Klinkner. Beyond DCG: User behavior as a predictor of a successful search. WSDM '09, 221--230, 2010.
[17]
A. Hassan, Y. Song and L. He. A task level metric for measuring web search satisfaction and its application on improving relevance estimation. CIKM'11, 125--134, 2011.
[18]
V. Hu, M. Stone, J. Pedersen and R.W. White. Effects of search success on search engine reuse. CIKM'11, 1841--1846, 2011.
[19]
R. Jones and K. Klinkner. Beyond the session timeout: Automatic hierarchical segmentation of search topics in query logs. CIKM '08, 699--708, 2008.
[20]
M. Kellar, C. Watters and M. Shepherd. A field study characterizing Web-based information-seeking tasks. JASIST, 58(7): 999--1018, 2007.
[21]
A. Kotov, P.N. Bennett, R.W. White, S.T. Dumais, and J. Teevan. Modeling and analysis of cross-session search tasks. SIGIR'11, 5--14, 2011.
[22]
U. Lee, Z. Liu and J. Cho. Automatic indentification of user goals in Web search. WWW '05, 391--400, 2005.
[23]
Y. Li and N.J. Belkin. A faceted approach to conceptualizing tasks in information seeking. IP&M, 44(6): 1822--1837, 2008.
[24]
J. Liu and N.J. Belkin. Personalizing information retrieval for multi-session tasks: The roles of task stage and task type. SIGIR '10, 26--33, 2010.
[25]
B. MacKay and C. Watters. Exploring multi-session Web tasks. CHI '08, 1187--1196, 2008.
[26]
Q. Mei, K. Klinkner, R. Kumar and A. Tomkins. An analysis framework for search sequences. CIKM '09, 1991--94, 2009.
[27]
D. Morris, M. Ringel Morris and G. Venolia. SearchBar: A search-centric Web history for task resumption and information re-finding. CHI '08, 1207--1216, 2008.
[28]
B. Piwowarski and H. Zaragoza. Predictive user click models based on click-through history. CIKM '07, 175--182, 2007.
[29]
F. Radlinski and T. Joachims. Query chains: Learning to rank from implicit feedback. KDD '05, 239--248, 2005.
[30]
F. Radlinski, M. Szummer and N. Craswell. Inferring query intent from reformulations and clicks. WWW '10, 1171--1172, 2010.
[31]
J.J. Randolph. Free-marginal multirater Kappa (multirater K free): an alternative to Fleiss' fixed-marginal multirater Kappa. JULIS'05, 2005.
[32]
D.E. Rose and D. Levinson. Understanding user goals in Web search. WWW '04, 13--19, 2004.
[33]
M.D. Smucker, J. Allan and B. Carterette. A comparison of statistical significance tests for information retrieval evaluation. CIKM'07, 623--632, 2007.
[34]
D. Sontag, K. Collins-Thompson, P.N. Bennett, R.W. White, S.T. Dumais and B. Billerbeck. Probabilistic models for personalizing web search. WSDM '12, 433--442, 2012.
[35]
A. Spink. Multitasking information behavior and information task switching: an exploratory study. J. Documentation, 60(4): 336--351, 2004.
[36]
B. Tan, X. Shen and C. Zhai. Mining long-term search history to improve search accuracy. KDD '06, 718--723, 2006.
[37]
J. Teevan, E. Adar, R. Jones and M.A.S. Potts. Information re-retrieval: Repeat queries in Yahoo's logs. SIGIR '07, 151--158, 2007.
[38]
E.G. Toms, L. Freund, R. Kopak and J.C. Bartlett. The effect of task domain on search. CASON'03, 303--312, 2003.
[39]
R.W. White, P. Bailey and L. Chen. Predicting user interests from contextual information. SIGIR '09, 363--370, 2009.
[40]
R.W. White and S.M. Drucker. Investigating behavioral variability in Web search. WWW '07, 21--30, 2007. R.W. White, S.T. Dumais, and J. Teevan. 2009. Characterizing the influence of domain expertise on Web search behavior. WSDM '10, 132--141.
[41]
B. Xiang, D. Jiang, J. Pei, X. Sun, E. Chen, and H. Li. Context-aware ranking in Web search. SIGIR'10, 451--458, 2010.

Cited By

View all
  • (2024)Advancing the Search Frontier with AI AgentsCommunications of the ACM10.1145/3655615Online publication date: 20-Aug-2024
  • (2024)Stopped yet Completed: Exploring the Relationships between Session-stopping Reasons, Information Types, and Cognitive Activities in Cross-Session SearchesProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638304(119-129)Online publication date: 10-Mar-2024
  • (2023)Taking Search to TaskProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578288(1-13)Online publication date: 19-Mar-2023
  • Show More Cited By

Index Terms

  1. Search, interrupted: understanding and predicting search task continuation

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        SIGIR '12: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
        August 2012
        1236 pages
        ISBN:9781450314725
        DOI:10.1145/2348283
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 12 August 2012

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. personalization
        2. search behavior
        3. search session analysis

        Qualifiers

        • Research-article

        Conference

        SIGIR '12
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 792 of 3,983 submissions, 20%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)24
        • Downloads (Last 6 weeks)2
        Reflects downloads up to 08 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Advancing the Search Frontier with AI AgentsCommunications of the ACM10.1145/3655615Online publication date: 20-Aug-2024
        • (2024)Stopped yet Completed: Exploring the Relationships between Session-stopping Reasons, Information Types, and Cognitive Activities in Cross-Session SearchesProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638304(119-129)Online publication date: 10-Mar-2024
        • (2023)Taking Search to TaskProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578288(1-13)Online publication date: 19-Mar-2023
        • (2023)Predictive Behavior Modeling Through Web Graphs: Enhancing Next Page Prediction Using Dynamic Link Repository2023 IEEE International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT)10.1109/WI-IAT59888.2023.00068(415-420)Online publication date: 26-Oct-2023
        • (2023)A Topicality Relevance-Aware Intent Model for Web SearchIEEE Access10.1109/ACCESS.2023.328982011(65739-65748)Online publication date: 2023
        • (2023)Contextualizing Session Resuming Reasons with Tasks Involving Expected Cross-session SearchesInformation for a Better World: Normality, Virtuality, Physicality, Inclusivity10.1007/978-3-031-28032-0_32(406-422)Online publication date: 13-Mar-2023
        • (2022)Want or Need: Why Would Users Expect to Conduct Cross-Session Searches?Proceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505829(327-331)Online publication date: 14-Mar-2022
        • (2022) Intertwining Search and Non‐Search Activities during Cross‐Session Search Tasks Proceedings of the Association for Information Science and Technology10.1002/pra2.71059:1(738-740)Online publication date: 14-Oct-2022
        • (2021)Task Intelligence for Search and RecommendationSynthesis Lectures on Information Concepts, Retrieval, and Services10.2200/S01103ED1V01Y202105ICR07413:3(1-160)Online publication date: 9-Jun-2021
        • (2021)Contrastive Learning of User Behavior Sequence for Context-Aware Document RankingProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482243(2780-2791)Online publication date: 26-Oct-2021
        • Show More Cited By

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media