research-article

Mining touch interaction data on mobile devices to predict web search result relevance

Authors:

Eugene AgichteinAuthors Info & Claims

SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

Pages 153 - 162

https://doi.org/10.1145/2484028.2484100

Published: 28 July 2013 Publication History

Abstract

Fine-grained search interactions in the desktop setting, such as mouse cursor movements and scrolling, have been shown valuable for understanding user intent, attention, and their preferences for Web search results. As web search on smart phones and tablets becomes increasingly popular, previously validated desktop interaction models have to be adapted for the available touch interactions such as pinching and swiping, and for the different device form factors. In this paper, we present, to our knowledge, the first in-depth study of modeling interactions on touch-enabled device for improving Web search ranking. In particular, we evaluate a variety of touch interactions on a smart phone as implicit relevance feedback, and compare them with the corresponding fine-grained interactions on a desktop computer with mouse and keyboard as the primary input devices. Our experiments are based on a dataset collected from two user studies with 56 users in total, using a specially instrumented version of a popular mobile browser to capture the interaction data. We report a detailed analysis of the similarities and differences of fine-grained search interactions between the desktop and the smart phone modalities, and identify novel patterns of touch interactions indicative of result relevance. Finally, we demonstrate significant improvements to search ranking quality by mining touch interaction data.

References

[1]

E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. SIGIR '06, pages 19--26, 2006.

Digital Library

[2]

J.-w. Ahn, P. Brusilovsky, D. He, J. Grady, and Q. Li. Personalized web exploration with task models. In Proceeding of the 17th international conference on World Wide Web, WWW '08, pages 1--10, 2008.

Digital Library

[3]

R. Biedert, A. Dengel, G. Buscher, and A. Vartan. Reading and estimating gaze on smart phones. ETRA '12, pages 385--388, New York, NY, USA, 2012. ACM.

Digital Library

[4]

L. Breiman. Bagging predictors. Mach. Learn., 24(2):123--140, Aug. 1996.

Digital Library

[5]

G. Buscher, A. Dengel, and L. van Elst. Query expansion using gaze-based feedback on the subdocument level. SIGIR '08, pages 387--394, 2008.

Digital Library

[6]

G. Buscher, R. W. White, S. Dumais, and J. Huang. Large-scale analysis of individual and task differences in search result page examination strategies. WSDM '12, pages 373--382, 2012.

Digital Library

[7]

K. Church and N. Oliver. Understanding mobile web and mobile search use in today's dynamic mobile landscape. In Proc. of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, 2011.

Digital Library

[8]

K. Church and B. Smyth. Understanding the intent behind mobile information needs. In Proceedings of the 14th international conference on Intelligent user interfaces, IUI '09, pages 247--256, 2009.

Digital Library

[9]

M. Claypool, P. Le, M. Wased, and D. Brown. Implicit interest indicators. IUI '01, pages 33--40, 2001.

Digital Library

[10]

H. A. Feild, J. Allan, and R. Jones. Predicting searcher frustration. SIGIR '10, pages 34--41.

Digital Library

[11]

S. Fox, K. Karnawat, M. Mydland, S. Dumais, and T. White. Evaluating implicit measures to improve web search. ACM Transactions on Information Systems, 23(2), 2005.

Digital Library

[12]

G. Golovchinsky, M. N. Price, and B. N. Schilit. From reading to retrieval: freeform ink annotations as queries. SIGIR '99, pages 19--25.

Digital Library

[13]

Q. Guo and E. Agichtein. Exploring mouse movements for inferring query intent. SIGIR '08, pages 707--708, 2008.

Digital Library

[14]

Q. Guo and E. Agichtein. Ready to buy or just browsing?: detecting web searcher goals from interaction data. SIGIR '10, pages 130--137, 2010.

Digital Library

[15]

Q. Guo and E. Agichtein. Towards predicting web searcher gaze position from mouse movements. CHI EA '10, pages 3601--3606, 2010.

Digital Library

[16]

Q. Guo and E. Agichtein. Beyond dwell time: estimating document relevance from cursor movements and other post-click searcher behavior. WWW '12, 2012.

Digital Library

[17]

Q. Guo, S. Yuan, and E. Agichtein. Detecting success in mobile search from interaction. SIGIR '11, 2011.

Digital Library

[18]

A. Hassan, R. Jones, and K. L. Klinkner. Beyond dcg: user behavior as a predictor of a successful search. WSDM '10, pages 221--230.

Digital Library

[19]

A. Hassan, Y. Song, and L.-w. He. A task level user satisfaction metric and its application on improving relevance estimation. CIKM '11, 2011.

Digital Library

[20]

J. Huang and A. M. Diriye. Web user interaction mining from touch-enabled mobile devices. HCIR '12, 2012.

[21]

J. Huang, R. White, and G. Buscher. User see, user point: gaze and cursor alignment in web search. CHI '12, pages 1341--1350, 2012.

Digital Library

[22]

J. Huang, R. W. White, G. Buscher, and K. Wang. Improving searcher models using mouse cursor activity. SIGIR '12, pages 195--204, 2012.

Digital Library

[23]

J. Huang, R. W. White, and S. Dumais. No clicks, no problem: using cursor movements to understand and improve search. CHI '11, pages 1225--1234, 2011.

Digital Library

[24]

K. Järvelin and J. Kekäläinen. Ir evaluation methods for retrieving highly relevant documents. SIGIR '00, pages 41--48, 2000.

Digital Library

[25]

T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Trans. Inf. Syst., 25(2), 2007.

Digital Library

[26]

M. Kamvar, M. Kellar, R. Patel, and Y. Xu. Computers and iphones and mobile phones, oh my!: a logs-based comparison of search users on different devices. WWW '09, pages 801--810, 2009.

Digital Library

[27]

D. Kelly and N. J. Belkin. Reading time, scrolling and interaction: exploring implicit sources of user preferences for relevance feedback. SIGIR '01, pages 408--409, 2001.

Digital Library

[28]

D. Kelly and N. J. Belkin. Display time as implicit feedback: understanding task effects. SIGIR '04, pages 377--384, 2004.

Digital Library

[29]

M. Melucci and R. W. White. Discovering hidden contextual factors for implicit feedback. In CIR'07, pages 1--1, 2007.

[30]

M. Morita and Y. Shinoda. Information filtering based on user behavior analysis and best match text retrieval. SIGIR '94, pages 272--281, 1994.

Digital Library

[31]

V. Navalpakkam and E. Churchill. Mouse tracking: measuring and predicting users' experience of web-based content. CHI '12, pages 2963--2972, 2012.

Digital Library

[32]

R. Rafter and B. Smyth. Passive profiling from server logs in an online recruitment environment. In Proc. of ITWP, 2001.

[33]

K. Rodden, X. Fu, A. Aula, and I. Spiro. Eye-mouse coordination patterns on web search results pages. CHI EA '08, pages 2997--3002, 2008.

Digital Library

[34]

R. W. White and G. Buscher. Text selections as implicit relevance feedback. SIGIR '12, pages 1151--1152, 2012.

Digital Library

[35]

R. W. White and S. T. Dumais. Characterizing and predicting search engine switching behavior. CIKM '09, 2009.

Digital Library

[36]

R. W. White and D. Kelly. A study on the effects of personalization and task information on implicit feedback performance. CIKM '06, pages 297--306, 2006.

Digital Library

Cited By

Stone SChapman C(2023)Unconscious Frustration: Dynamically Assessing User Experience using Eye and Mouse TrackingProceedings of the ACM on Human-Computer Interaction10.1145/35911377:ETRA(1-17)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591137
Wu ZMao JXu KSong DHuang H(2023)A Passage-Level Reading Behavior Model for Mobile SearchProceedings of the ACM Web Conference 202310.1145/3543507.3583343(3236-3246)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543507.3583343
Fu LLin JLiu WTang RZhang WZhang RYu YChua TLauw HSi LTerzi ETsaparas P(2023)An F-shape Click Model for Information Retrieval on Multi-block Mobile PagesProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3570365(1057-1065)Online publication date: 27-Feb-2023
https://dl.acm.org/doi/10.1145/3539597.3570365
Show More Cited By

Index Terms

Mining touch interaction data on mobile devices to predict web search result relevance
1. Information systems
  1. Information retrieval

Recommendations

Towards estimating web search result relevance from touch interactions on mobile devices
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Fine-grained search interactions such as mouse cursor movements and scrolling have been shown to be valuable for modeling user attention and preferences of Web search results, in the desktop setting. However, users increasingly search the Web on touch-...
Detecting Good Abandonment in Mobile Search
WWW '16: Proceedings of the 25th International Conference on World Wide Web

Web search queries for which there are no clicks are referred to as abandoned queries and are usually considered as leading to user dissatisfaction. However, there are many cases where a user may not click on any search result page (SERP) but still be ...
In-Car Touch Screen Interaction: Comparing Standard, Finger-Specific and Multi-Finger Interaction
PerDis '15: Proceedings of the 4th International Symposium on Pervasive Displays

In this paper, we explore a novel interaction technique for the automotive domain, distinguishing between different fingers when interacting with a touch screen, and compare it against standard and multi-finger gesture interaction. We conducted a pilot ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

July 2013

1188 pages

ISBN:9781450320344

DOI:10.1145/2484028

General Chairs:
Gareth J.F. Jones
Dublin City University, Ireland
,
Páraic Sheridan
Dublin City University, Ireland
,
Program Chairs:
Diane Kelly
University of North Carolina, Chapel Hill, USA
,
Maarten de Rijke
University of Amsterdam, The Netherlands
,
Tetsuya Sakai
Microsoft Research Asia, China

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGIR '13

Sponsor:

SIGIR

SIGIR '13: The 36th International ACM SIGIR conference on research and development in Information Retrieval

July 28 - August 1, 2013

Dublin, Ireland

Acceptance Rates

SIGIR '13 Paper Acceptance Rate 73 of 366 submissions, 20%;

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

69
Total Citations
View Citations
1,046
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)5

Reflects downloads up to

Other Metrics

View Author Metrics

Citations

Cited By

Stone SChapman C(2023)Unconscious Frustration: Dynamically Assessing User Experience using Eye and Mouse TrackingProceedings of the ACM on Human-Computer Interaction10.1145/35911377:ETRA(1-17)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591137
Wu ZMao JXu KSong DHuang H(2023)A Passage-Level Reading Behavior Model for Mobile SearchProceedings of the ACM Web Conference 202310.1145/3543507.3583343(3236-3246)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543507.3583343
Fu LLin JLiu WTang RZhang WZhang RYu YChua TLauw HSi LTerzi ETsaparas P(2023)An F-shape Click Model for Information Retrieval on Multi-block Mobile PagesProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3570365(1057-1065)Online publication date: 27-Feb-2023
https://dl.acm.org/doi/10.1145/3539597.3570365
Davis KSpape MRuotsalo T(2023)Contradicted by the Brain: Predicting Individual and Group Preferences via Brain-Computer InterfacingIEEE Transactions on Affective Computing10.1109/TAFFC.2022.322588514:4(3094-3105)Online publication date: 1-Oct-2023
https://doi.org/10.1109/TAFFC.2022.3225885
Olugbade THe LMaiolino PHeylen DBianchi-Berthouze N(2023)Touch Technology in Affective Human–, Robot–, and Virtual–Human Interactions: A SurveyProceedings of the IEEE10.1109/JPROC.2023.3272780111:10(1333-1354)Online publication date: Oct-2023
https://doi.org/10.1109/JPROC.2023.3272780
Bhatele PBedekar M(2023)Survey on Smartphone Sensors and User Intent in Smartphone Usage2023 IEEE 8th International Conference for Convergence in Technology (I2CT)10.1109/I2CT57861.2023.10126192(1-9)Online publication date: 7-Apr-2023
https://doi.org/10.1109/I2CT57861.2023.10126192
Li QZeng HPeng ZMa X(2021)Understanding Players’ Interaction Patterns with Mobile Game App UI via VisualizationsProceedings of the Ninth International Symposium of Chinese CHI10.1145/3490355.3490357(9-21)Online publication date: 16-Oct-2021
https://dl.acm.org/doi/10.1145/3490355.3490357
Jin HShen HJain MKumar SHong J(2021)Lean Privacy Review: Collecting Users’ Privacy Concerns of Data Practices at a Low CostACM Transactions on Computer-Human Interaction10.1145/346391028:5(1-55)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3463910
Zhuo YChen JRao GLuo QWang YYang HQian DQian X(2021)Distributed Graph Processing System and Processing-in-memory Architecture with Precise Loop-carried Dependency GuaranteeACM Transactions on Computer Systems10.1145/345368137:1-4(1-37)Online publication date: 1-Jul-2021
https://dl.acm.org/doi/10.1145/3453681
Rashid AFarooq MAbid AUmer TBashir AZikria Y(2021)Social media intention mining for sustainable information systems: categories, taxonomy, datasets and challengesComplex & Intelligent Systems10.1007/s40747-021-00342-99:3(2773-2799)Online publication date: 5-Apr-2021
https://doi.org/10.1007/s40747-021-00342-9
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents