Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Constructing Click Model for Mobile Search with Viewport Time

Published: 26 September 2019 Publication History

Abstract

A series of click models has been proposed to extract accurate and unbiased relevance feedback from valuable yet noisy click-through data in search logs. Previous works have shown that users search behavior in mobile and desktop scenarios are rather different in many aspects, therefore, the click models designed for desktop search may not be effective in the mobile context. To address this problem, we propose two novel click models for mobile search: (1) Mobile Click Model (MCM), which models click necessity bias and examination satisfaction bias; (2) Viewport Time Click Model (VTCM), which further extends MCM by utilizing the viewport time. Extensive experiments on large-scale real mobile search logs show that: (1) MCM and VTCM outperform existing models in predicting users’ clicks and estimating result relevance; (2) MCM and VTCM can extract richer information, such as the click necessity of search results and the probability of user satisfaction, from mobile click logs; (3) By modeling the viewport time distributions of heterogeneous results, VTCM can bring a significant improvement over MCM in click prediction and relevance estimation tasks. Our proposed click models can help better understand user behavior patterns in mobile search and improve the ranking performance of mobile search engines.

References

[1]
Alexey Borisov, Ilya Markov, Maarten de Rijke, and Pavel Serdyukov. 2016. A neural click model for web search. In Proceedings of the WWW’16. International World Wide Web Conferences Steering Committee, 531--541.
[2]
Olivier Chapelle, Donald Metlzer, Ya Zhang, and Pierre Grinspan. 2009. Expected reciprocal rank for graded relevance. In Proceedings of the CIKM’09. ACM, 621--630.
[3]
Olivier Chapelle and Ya Zhang. 2009. A dynamic Bayesian network click model for web search ranking. In Proceedings of the WWW’09. ACM, 1--10.
[4]
Danqi Chen, Weizhu Chen, Haixun Wang, Zheng Chen, and Qiang Yang. 2012. Beyond ten blue links: Enabling user click modeling in federated web search. In Proceedings of the WSDM’12. ACM, 463--472.
[5]
Aleksandr Chuklin and Maarten de Rijke. 2016. Incorporating clicks, attention, and satisfaction into a search engine result page evaluation model. In Proceedings of the CIKM’16. ACM, 175--184.
[6]
Aleksandr Chuklin, Ilya Markov, and Maarten de Rijke. 2015. Click models for web search. Synth. Lect. Inform. Conc., Retr., Serv. 7, 3 (2015), 1--115.
[7]
Aleksandr Chuklin, Pavel Serdyukov, and Maarten De Rijke. 2013. Using intent information to model user behavior in diversified search. In Proceedings of the ECIR’13. Springer, 1--13.
[8]
Nick Craswell, Onno Zoeter, Michael Taylor, and Bill Ramsey. 2008. An experimental comparison of click position-bias models. In Proceedings of the WSDM’08. ACM, 87--94.
[9]
Georges E. Dupret and Benjamin Piwowarski. 2008. A user browsing model to predict search engine click data from past observations. In Proceedings of the SIGIR’08. ACM, 331--338.
[10]
Joseph L. Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychol. Bull. 76, 5 (1971), 378.
[11]
Laura A. Granka, Thorsten Joachims, and Geri Gay. 2004. Eye-tracking analysis of user behavior in WWW search. In Proceedings of the SIGIR’04. ACM, 478--479.
[12]
Fan Guo, Chao Liu, and Yi Min Wang. 2009. Efficient multiple-click models in web search. In Proceedings of the WSDM’09. ACM, 124--131.
[13]
Qi Guo, Haojian Jin, Dmitry Lagun, Shuai Yuan, and Eugene Agichtein. 2013. Mining touch interaction data on mobile devices to predict web search result relevance. In Proceedings of the SIGIR’13. ACM, 153--162.
[14]
Morgan Harvey and Matthew Pointon. 2017. Searching on the go: The effects of fragmented attention on mobile Web search tasks. In Proceedings of the SIGIR’17. ACM, 155--164.
[15]
Jeff Huang, Ryen W. White, Georg Buscher, and Kuansan Wang. 2012. Improving searcher models using mouse cursor activity. In Proceedings of the SIGIR’12. ACM, 195--204.
[16]
Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated gain-based evaluation of IR techniques. ACM Trans. Inform. Syst. 20, 4 (2002), 422--446.
[17]
Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2005. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the SIGIR’05. ACM, 154--161.
[18]
Maryam Kamvar and Shumeet Baluja. 2006. A large scale study of wireless search behavior: Google mobile search. In Proceedings of the SIGCHI’06. ACM, 701--709.
[19]
Maryam Kamvar, Melanie Kellar, Rajan Patel, and Ya Xu. 2009. Computers and iphones and mobile phones, oh my!: A logs-based comparison of search users on different devices. In Proceedings of the WWW’09. ACM, 801--810.
[20]
Jaewon Kim, Paul Thomas, Ramesh Sankaranarayana, Tom Gedeon, and Hwan-Jin Yoon. 2015. Eye-tracking analysis of user behavior and performance in web search on large and small screens. J. Assoc. Inform. Sci. Technol. 66, 3 (2015), 526--544.
[21]
Klaus Krippendorff. 1970. Estimating the reliability, systematic error and random error of interval data. Educat. Psychol. Meas. 30, 1 (1970), 61--70.
[22]
Dmitry Lagun, Chih-Hung Hsieh, Dale Webster, and Vidhya Navalpakkam. 2014. Towards better measurement of attention and satisfaction in mobile search. In Proceedings of the SIGIR’14. ACM, 113--122.
[23]
Dmitry Lagun, Donal McMahon, and Vidhya Navalpakkam. 2016. Understanding mobile searcher attention with rich ad formats. In Proceedings of the CIKM’16. ACM, 599--608.
[24]
J. Richard Landis and Gary G. Koch. 1977. The measurement of observer agreement for categorical data. Biometrics 33, 1 (1977), 159--174.
[25]
Yiqun Liu, Xiaohui Xie, Chao Wang, Jian-Yun Nie, Min Zhang, and Shaoping Ma. 2016. Time-aware click model. ACM Trans. Inform. Syst. 35, 3 (Dec. 2016), 16:1--16:24.
[26]
Zeyang Liu, Yiqun Liu, Ke Zhou, Min Zhang, and Shaoping Ma. 2015. Influence of vertical result in web search examination. In Proceedings of the SIGIR’15. ACM, 193--202.
[27]
Zeyang Liu, Jiaxin Mao, Chao Wang, Qingyao Ai, Yiqun Liu, and Jian-Yun Nie. 2017. Enhancing click models with mouse movement information. Inform. Retr. J. 20, 1 (2017), 53--80.
[28]
Cheng Luo, Yiqun Liu, Tetsuya Sakai, Fan Zhang, Min Zhang, and Shaoping Ma. 2017. Evaluating mobile search with height-biased gain. In Proceedings of the SIGIR’17. ACM, 435--444.
[29]
Jiaxin Mao, Yiqun Liu, Noriko Kando, Cheng Luo, Min Zhang, and Shaoping Ma. 2018. Investigating result usefulness in mobile search. In Proceedings of the ECIR’18. Springer, 223--236.
[30]
Jiaxin Mao, Cheng Luo, Min Zhang, and Shaoping Ma. 2018. Constructing click models for mobile search. In Proceedings of the SIGIR’18. ACM, 775--784.
[31]
Vidhya Navalpakkam, LaDawn Jentzsch, Rory Sayres, Sujith Ravi, Amr Ahmed, and Alex Smola. 2013. Measurement and modeling of eye-mouse behavior in the presence of nonlinear page layouts. In Proceedings of the WWW’13. ACM, 953--964.
[32]
Kevin Ong, Kalervo Järvelin, Mark Sanderson, and Falk Scholer. 2017. Using information scent to understand mobile and desktop Web search behavior. In Proceedings of the SIGIR’17. ACM, 295--304.
[33]
Matthew Richardson, Ewa Dominowska, and Robert Ragno. 2007. Predicting clicks: Estimating the click-through rate for new ads. In Proceedings of the WWW’07. ACM, 521--530.
[34]
Tetsuya Sakai. 2007. Alternatives to bpref. In Proceedings of the SIGIR’07. ACM, 71--78.
[35]
Yang Song, Hao Ma, Hongning Wang, and Kuansan Wang. 2013. Exploring and exploiting user search behavior on mobile and tablet devices to improve search relevance. In Proceedings of the WWW’13. ACM, 1201--1212.
[36]
Manisha Verma and Emine Yilmaz. 2016. Characterizing relevance on mobile and desktop. In Proceedings of the ECIR’16. Springer, 212--223.
[37]
Chao Wang, Yiqun Liu, Meng Wang, Ke Zhou, Jian-yun Nie, and Shaoping Ma. 2015. Incorporating non-sequential behavior into click models. In Proceedings of the SIGIR’15. ACM, 283--292.
[38]
Chao Wang, Yiqun Liu, Min Zhang, Shaoping Ma, Meihong Zheng, Jing Qian, and Kuo Zhang. 2013. Incorporating vertical results into search click models. In Proceedings of the SIGIR’13. ACM, 503--512.
[39]
Xiaochuan Wang, Ning Su, Zexue He, Yiqun Liu, and Shaoping Ma. 2018. A large-scale study of mobile search examination behavior. In Proceedings of the SIGIR’18. ACM, 1129--1132.
[40]
Kyle Williams, Julia Kiseleva, Aidan C. Crook, Imed Zitouni, Ahmed Hassan Awadallah, and Madian Khabsa. 2016. Detecting good abandonment in mobile search. In Proceedings of the WWW’16. 495--505.
[41]
Kyle Williams, Julia Kiseleva, Aidan C. Crook, Imed Zitouni, Ahmed Hassan Awadallah, and Madian Khabsa. 2016. Is this your final answer?: Evaluating the effect of answers on good abandonment in mobile search. In Proceedings of the SIGIR’16. ACM, 889--892.
[42]
Wan-Ching Wu, Diane Kelly, and Avneesh Sud. 2014. Using information scent and need for cognition to understand online search behavior. In Proceedings of the SIGIR’14. ACM, 557--566.
[43]
Jeonghee Yi, Farzin Maghoul, and Jan Pedersen. 2008. Deciphering mobile search patterns: A study of Yahoo! mobile search queries. In Proceedings of the WWW’08. ACM, 257--266.

Cited By

View all
  • (2024)Node-personalized multi-graph convolutional networks for recommendationNeural Networks10.1016/j.neunet.2024.106169173(106169)Online publication date: May-2024
  • (2023)A Passage-Level Reading Behavior Model for Mobile SearchProceedings of the ACM Web Conference 202310.1145/3543507.3583343(3236-3246)Online publication date: 30-Apr-2023
  • (2023)Behavior Modeling for Point of Interest SearchProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591955(1843-1847)Online publication date: 19-Jul-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems
ACM Transactions on Information Systems  Volume 37, Issue 4
October 2019
299 pages
ISSN:1046-8188
EISSN:1558-2868
DOI:10.1145/3357218
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2019
Accepted: 01 July 2019
Revised: 01 June 2019
Received: 01 October 2018
Published in TOIS Volume 37, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Click model
  2. mobile search
  3. viewport time
  4. web search

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • Natural Science Foundation of China
  • National Key Research and Development Program of China

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)29
  • Downloads (Last 6 weeks)1
Reflects downloads up to 30 Aug 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Node-personalized multi-graph convolutional networks for recommendationNeural Networks10.1016/j.neunet.2024.106169173(106169)Online publication date: May-2024
  • (2023)A Passage-Level Reading Behavior Model for Mobile SearchProceedings of the ACM Web Conference 202310.1145/3543507.3583343(3236-3246)Online publication date: 30-Apr-2023
  • (2023)Behavior Modeling for Point of Interest SearchProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591955(1843-1847)Online publication date: 19-Jul-2023
  • (2023)An Offline Metric for the Debiasedness of Click ModelsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591639(558-568)Online publication date: 19-Jul-2023
  • (2023)An F-shape Click Model for Information Retrieval on Multi-block Mobile PagesProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3570365(1057-1065)Online publication date: 27-Feb-2023
  • (2023)A review of deep learning in dentistryNeurocomputing10.1016/j.neucom.2023.126629(126629)Online publication date: Jul-2023
  • (2022)LBDProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602690(33400-33413)Online publication date: 28-Nov-2022
  • (2022)Evaluating the Robustness of Click Models to Policy Distributional ShiftACM Transactions on Information Systems10.1145/356908641:4(1-28)Online publication date: 29-Oct-2022
  • (2022)Scalar is Not EnoughProceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3534678.3539468(136-145)Online publication date: 14-Aug-2022
  • (2021)Investigating User Behavior in Legal Case RetrievalProceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3404835.3462876(962-972)Online publication date: 11-Jul-2021
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media