Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3209978.3210004acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

A Click Sequence Model for Web Search

Published: 27 June 2018 Publication History

Abstract

Getting a better understanding of user behavior is important for advancing information retrieval systems. Existing work focuses on modeling and predicting single interaction events, such as clicks. In this paper, we for the first time focus on modeling and predicting sequences of interaction events. And in particular, sequences of clicks. We formulate the problem of click sequence prediction and propose a click sequence model (CSM) that aims to predict the order in which a user will interact with search engine results. CSM is based on a neural network that follows the encoder-decoder architecture. The encoder computes contextual embeddings of the results. The decoder predicts the sequence of positions of the clicked results. It uses an attention mechanism to extract necessary information about the results at each timestep. We optimize the parameters of CSM by maximizing the likelihood of observed click sequences. We test the effectiveness of CSM on three new tasks: (i) predicting click sequences, (ii) predicting the number of clicks, and (iii) predicting whether or not a user will interact with the results in the order these results are presented on a search engine result page (SERP). Also, we show that CSM achieves state-of-the-art results on a standard click prediction task, where the goal is to predict an unordered set of results a user will click on.

References

[1]
Eugene Agichtein, Eric Brill, and Susan Dumais . 2006. Improving web search ranking by incorporating user behavior information SIGIR. ACM, 19--26.
[2]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio . 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014).
[3]
Yoshua Bengio, Patrice Simard, and Paolo Frasconi . 1994. Learning long-term dependencies with gradient descent is difficult. IEEE transactions on neural networks Vol. 5, 2 (1994), 157--166.
[4]
Alexey Borisov, Ilya Markov, Maarten de Rijke, and Pavel Serdyukov . 2016 a. A context-aware time model for web search. In SIGIR. ACM, 205--214.
[5]
Alexey Borisov, Ilya Markov, Maarten de Rijke, and Pavel Serdyukov . 2016 b. A neural click model for web search. In WWW. International World Wide Web Conferences Steering Committee, 531--541.
[6]
Huanhuan Cao, Daxin Jiang, Jian Pei, Qi He, Zhen Liao, Enhong Chen, and Hang Li . 2008. Context-aware query suggestion by mining click-through and session data KDD. ACM, 875--883.
[7]
Olivier Chapelle, Thorsten Joachims, Filip Radlinski, and Yisong Yue . 2012. Large-scale validation and analysis of interleaved search evaluation. TOIS, Vol. 30, 1 (2012), 6.
[8]
Olivier Chapelle and Ya Zhang . 2009. A dynamic bayesian network click model for web search ranking WWW. ACM, 1--10.
[9]
Aleksandr Chuklin, Ilya Markov, and Maarten de Rijke . 2015. Click Models for Web Search. Morgan & Claypool.
[10]
Nick Craswell, Onno Zoeter, Michael Taylor, and Bill Ramsey . 2008. An experimental comparison of click position-bias models WSDM. ACM, 87--94.
[11]
Fernando Diaz, Ryen White, Georg Buscher, and Dan Liebling . 2013. Robust models of mouse movement on dynamic web search results pages CIKM. ACM, 1451--1460.
[12]
Georges E. Dupret and Benjamin Piwowarski . 2008. A user browsing model to predict search engine click data from past observations. SIGIR. ACM, 331--338.
[13]
Steve Fox, Kuldeep Karnawat, Mark Mydland, Susan Dumais, and Thomas White . 2005. Evaluating implicit measures to improve web search. TOIS, Vol. 23, 2 (2005), 147--168.
[14]
Alex Graves . 2012. Sequence transduction with recurrent neural networks. arXiv preprint arXiv:1211.3711 (2012).
[15]
Artem Grotov, Aleksandr Chuklin, Ilya Markov, Luka Stout, Finde Xumara, and Maarten de Rijke . 2015. A comparative study of click models for web search CLEF. Springer, 78--90.
[16]
Fan Guo, Chao Liu, Anitha Kannan, Tom Minka, Michael Taylor, Yi-Min Wang, and Christos Faloutsos . 2009 b. Click chain model in web search. In WWW. ACM, 11--20.
[17]
Fan Guo, Chao Liu, and Yi Min Wang . 2009 a. Efficient multiple-click models in web search. In WSDM. ACM, 124--131.
[18]
Ahmed Hassan . 2012. A semi-supervised approach to modeling web search satisfaction SIGIR. ACM, 275--284.
[19]
Ahmed Hassan, Ryen W. White, Susan T. Dumais, and Yi-Min Wang . 2014. Struggling or Exploring?: Disambiguating Long Search Sessions WSDM. ACM, 53--62.
[20]
Katja Hofmann, Shimon Whiteson, and Maarten de Rijke . 2012. Estimating interleaved comparison outcomes from historical click data CIKM. ACM, 1779--1783.
[21]
Katja Hofmann, Shimon Whiteson, and Maarten de Rijke . 2013. Balancing exploration and exploitation in listwise and pairwise online learning to rank for information retrieval. Information Retrieval Journal Vol. 16, 1 (2013), 63--90.
[22]
Jeff Huang, Ryen W. White, and Susan Dumais . 2011. No clicks, no problem: Using cursor movements to understand and improve search SIGCHI. ACM, 1225--1234.
[23]
Bouke Huurnink, Laura Hollink, Wietske van den Heuvel, and Maarten de Rijke . 2010. Search behavior of media professionals at an audiovisual archive: A transaction log analysis. JASIST, Vol. 61, 6 (June . 2010), 1180--1197.
[24]
Herve Jegou, Matthijs Douze, and Cordelia Schmid . 2011. Product quantization for nearest neighbor search. IEEE transactions on pattern analysis and machine intelligence, Vol. 33, 1 (2011), 117--128.
[25]
Jyun-Yu Jiang, Yen-Yu Ke, Pao-Yu Chien, and Pu-Jen Cheng . 2014. Learning user reformulation behavior for query auto-completion SIGIR. ACM, 445--454.
[26]
Thorsten Joachims . 2002. Optimizing Search Engines Using Clickthrough Data. KDD. ACM, 133--142.
[27]
Youngho Kim, Ahmed Hassan, Ryen W White, and Imed Zitouni . 2014. Modeling dwell time to predict click-level satisfaction WSDM. ACM, 193--202.
[28]
Diederik Kingma and Jimmy Ba . 2015. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2015).
[29]
Julia Kiseleva and Maarten de Rijke . 2017. Evaluating personal assistants on mobile devices. CAIR. ACM.
[30]
Elad Kravi, Ido Guy, Avihai Mejer, David Carmel, Yoelle Maarek, Dan Pelleg, and Gilad Tsur . 2016. One query, many clicks: Analysis of queries with multiple clicks by the same user CIKM. ACM, 1423--1432.
[31]
Yanen Li, Anlei Dong, Hongning Wang, Hongbo Deng, Yi Chang, and ChengXiang Zhai . 2014. A two-dimensional click model for query auto-completion SIGIR. ACM, 455--464.
[32]
Chao Liu, Ryen W White, and Susan Dumais . 2010. Understanding web browsing behaviors through weibull analysis of dwell time SIGIR. ACM, 379--386.
[33]
Yiqun Liu, Xiaohui Xie, Chao Wang, Jian-Yun Nie, Min Zhang, and Shaoping Ma . 2016. Time-aware click model. TOIS, Vol. 35, 3 (2016), 16:1--16:24.
[34]
Marius Muja and David G Lowe . 2009. Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP, Vol. 2, 331--340 (2009), 2.
[35]
Doug Oard and Jinmook Kim . 1998. Implicit feedback for recommender systems. In Proceedings of the AAAI Workshop on Recommender Systems. AAAI.
[36]
Daan Odijk, Ryen W. White, Ahmed Hassan Awadallah, and Susan T. Dumais . 2015. Struggling and Success in Web Search. In CIKM. ACM, 1551--1560.
[37]
Neil O'Hare, Paloma de Juan, Rossano Schifanella, Yunlong He, Dawei Yin, and Yi Chang . 2016. Leveraging user interaction signals for web image search SIGIR. ACM, 559--568.
[38]
Razvan Pascanu, Caglar Gulcehre, Kyunghyun Cho, and Yoshua Bengio . 2013 a. How to construct deep recurrent neural networks. arXiv preprint arXiv:1312.6026 (2013).
[39]
Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio . 2013 b. On the difficulty of training recurrent neural networks ICML. 1310--1318.
[40]
Aju Thalappillil Scaria, Rose Marie Philip, Robert West, and Jure Leskovec . 2014. The last click: Why users give up information network navigation WSDM. ACM, 213--222.
[41]
Anne Schuth, Katja Hofmann, and Filip Radlinski . 2015. Predicting Search Satisfaction Metrics with Interleaved Comparisons SIGIR. ACM, 463--472.
[42]
Anne Schuth, Harrie Oosterhuis, Shimon Whiteson, and Maarten de Rijke . 2016. Multileave gradient descent for fast online learning to rank WSDM. ACM, 457--466.
[43]
Chao Wang, Yiqun Liu, Meng Wang, Ke Zhou, Jian-yun Nie, and Shaoping Ma . 2015. Incorporating non-sequential behavior into click models SIGIR. ACM, 283--292.
[44]
Kuansan Wang, Nikolas Gloy, and Xiaolong Li . 2010. Inferring search behaviors using partially observable Markov (POM) model WSDM. ACM, 211--220.
[45]
Yue Wang, Dawei Yin, Luo Jie, Pengyuan Wang, Makoto Yamada, Yi Chang, and Qiaozhu Mei . 2016. Beyond ranking: Optimizing whole-page presentation WSDM. ACM, 103--112.
[46]
Ryen W. White . 2016. Interactions with Search Systems. Cambridge University Press.
[47]
Kyle Williams and Imed Zitouni . 2017. Does that mean you're happy?: RNN-based modeling of user interaction sequences to detect good abandonment. In CIKM. ACM, 727--736.
[48]
Wei Wu, Hang Li, and Jun Xu . 2013. Learning query and document similarities from click-through bipartite graph with metadata WSDM. ACM, 687--696.
[49]
Xiaohui Xie, Jiaxin Mao, Maarten de Rijke, Ruizhe Zhang, Min Zhang, and Shaoping Ma . 2018. Constructing an interaction behavior model for web image search SIGIR. ACM.
[50]
Danqing Xu, Yiqun Liu, Min Zhang, Shaoping Ma, and Liyun Ru . 2012. Incorporating revisiting behaviors into click models WSDM. ACM, 303--312.
[51]
Wanhong Xu, Eren Manavoglu, and Erick Cantu-Paz . 2010. Temporal click model for sponsored search. In SIGIR. ACM, 106--113.
[52]
Yandex . 2014. Personalized Web Search Challenge. https://www.kaggle.com/c/yandex-personalized-web-search-challenge. (2014).
[53]
Yuyu Zhang, Hanjun Dai, Chang Xu, Jun Feng, Taifeng Wang, Jiang Bian, Bin Wang, and Tie-Yan Liu . 2014. Sequential click prediction for sponsored search with recurrent neural networks AAAI. AAAI Press, 1369--1375.

Cited By

View all
  • (2024)A topic relevance-aware click model for web searchJournal of Intelligent & Fuzzy Systems10.3233/JIFS-23689446:4(8961-8974)Online publication date: 18-Apr-2024
  • (2024)Neural Click Models for Recommender SystemsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657939(2553-2558)Online publication date: 10-Jul-2024
  • (2024)A personalized ranking method based on inverse reinforcement learning in search enginesEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108915136:PAOnline publication date: 1-Oct-2024
  • Show More Cited By

Index Terms

  1. A Click Sequence Model for Web Search

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '18: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval
    June 2018
    1509 pages
    ISBN:9781450356572
    DOI:10.1145/3209978
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 June 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. click model
    2. user behavior
    3. web search

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    SIGIR '18
    Sponsor:

    Acceptance Rates

    SIGIR '18 Paper Acceptance Rate 86 of 409 submissions, 21%;
    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)14
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 03 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A topic relevance-aware click model for web searchJournal of Intelligent & Fuzzy Systems10.3233/JIFS-23689446:4(8961-8974)Online publication date: 18-Apr-2024
    • (2024)Neural Click Models for Recommender SystemsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657939(2553-2558)Online publication date: 10-Jul-2024
    • (2024)A personalized ranking method based on inverse reinforcement learning in search enginesEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108915136:PAOnline publication date: 1-Oct-2024
    • (2024)Improving searcher struggle detection via the reversal theoryDiscover Computing10.1007/s10791-024-09492-z27:1Online publication date: 19-Dec-2024
    • (2024)Probabilistic graph model and neural network perspective of click models for web searchKnowledge and Information Systems10.1007/s10115-024-02145-z66:10(5829-5873)Online publication date: 6-Jun-2024
    • (2024)Generative Agents Navigating Digital LibrariesSustainability and Empowerment in the Context of Digital Libraries10.1007/978-981-96-0865-2_14(171-188)Online publication date: 4-Dec-2024
    • (2023)Understanding or Manipulation: Rethinking Online Performance Gains of Modern Recommender SystemsACM Transactions on Information Systems10.1145/363786942:4(1-32)Online publication date: 15-Dec-2023
    • (2023)Towards Sequential Counterfactual Learning to RankProceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region10.1145/3624918.3625325(122-128)Online publication date: 26-Nov-2023
    • (2023)Evaluating the Robustness of Click Models to Policy Distributional ShiftACM Transactions on Information Systems10.1145/356908641:4(1-28)Online publication date: 22-Mar-2023
    • (2023)An Offline Metric for the Debiasedness of Click ModelsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591639(558-568)Online publication date: 19-Jul-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media