Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1978942.1979125acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

No clicks, no problem: using cursor movements to understand and improve search

Published: 07 May 2011 Publication History

Abstract

Understanding how people interact with search engines is important in improving search quality. Web search engines typically analyze queries and clicked results, but these actions provide limited signals regarding search interaction. Laboratory studies often use richer methods such as gaze tracking, but this is impractical at Web scale. In this paper, we examine mouse cursor behavior on search engine results pages (SERPs), including not only clicks but also cursor movements and hovers over different page regions. We: (i) report an eye-tracking study showing that cursor position is closely related to eye gaze, especially on SERPs; (ii) present a scalable approach to capture cursor movements, and an analysis of search result examination behavior evident in these large-scale cursor data; and (iii) describe two applications (estimating search result relevance and distinguishing good from bad abandonment) that demonstrate the value of capturing cursor data. Our findings help us better understand how searchers use cursors on SERPs and can help design more effective search systems. Our scalable cursor tracking method may also be useful in non-search settings.

Supplementary Material

index.html (index.html)
Slides from the presentation
Audio only (1979125.mp3)
Video (1979125.mp4)

References

[1]
E. Arroyo, T. Selker, and W. Wei. Usability tool for analysis of web designs using mouse tracks. Ext. Ab-stracts CHI '06, 484--489.
[2]
A. Aula, P. Majaranta and K-J. Raiha. 2005. Eye-tracking reveals personal styles for search result evaluation. Proc. INTERACT '05, 1058--1061.
[3]
G. Buscher, E. Cutrell., and M. R. Morris. What do you see when you're surfing? Using eye tracking to predict salient regions of web pages. Proc. CHI '09, 21--30.
[4]
G. Buscher, A. Dengel, and L. van Elst. Eye movements as implicit relevance feedback. Ext. Abstracts CHI '08, 2291--2996.
[5]
G. Buscher, S. Dumais, and E. Cutrell. The good, the bad, and the random: An eye-tracking study of ad quality in web search. Proc. SIGIR '10, 42--49.
[6]
M. C. Chen, J. R. Anderson, and M. H. Sohn. What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing. Ext. Abstracts CHI '01, 281--282.
[7]
M. Claypool, P. Le, M. Wased, and D. Brown. Implicit interest indicators. Proc. IUI '01, 33--40.
[8]
N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. Proc. WSDM '08, 87--94.
[9]
E. Cutrell and Z. Guan. What are you looking for?: An eye-tracking study of information usage in web search. Proc. CHI '07, 407--416.
[10]
S. Dumais, G. Buscher, and E. Cutrell. Individual dif-ferences in gaze patterns for web search. Proc. IIiX '10, 185--194.
[11]
J. Goecks and J. Shavlik. Learning users' interests by unobtrusively observing their normal behavior. Proc. IUI '00, 129--132.
[12]
Q. Guo and E. Agichtein. Exploring mouse movements for inferring query intent. Proc. SIGIR '10, 707--708.
[13]
Q. Guo and E. Agichtein. Ready to buy or just browsing? Detecting web searcher goals from interaction data. Proc. SIGIR '10, 130--137.
[14]
Q. Guo and E. Agichtein. Towards predicting web searcher gaze position from mouse movements. Ext. Abstracts CHI '10, 3601--3606.
[15]
Y. Hijikata. Implicit user profiling for on demand relevance feedback. Proc. IUI '04, 198--205.
[16]
J. Huang and A. Kazeykina. Optimal strategies for re-viewing search results. Proc. AAAI '10, 1321--1326.
[17]
R. J. Jagacinski, D. W. Repperger, M. S. Moran, S. L. Ward, and B. Glass. Fitts' law and the microstructure of rapid discrete movements. J. Exp. Psychol. {Hum. Percept.}, 1980, 6(2), 309--320.
[18]
T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay. Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search. ACM Trans. Inform. Syst., 25(2), 2007.
[19]
R. Kohavi, R. Longbotham, D. Sommerfield, and R. M. Henne. Controlled experiments on the Web: Survey and practical guide. Data Mining and Knowledge Discovery, 18(1), 2009, 140--181.
[20]
J. Li, S. Huffman, and A. Tokuda. Good abandonment in mobile and PC internet search. Proc. SIGIR '09, 43--50.
[21]
C. Liu and C. Chung. Detecting mouse movement with repeated visit patterns for retrieving noticed knowledge components on web pages. IEICE Trans. Inform. & Syst., 2007, E90-D(10), 1687--1696.
[22]
L. Lorigo, B. Pan, H. Hembrooke, T. Joachims, L. Granka, and G. Gay. The influence of task and gender on search and evaluation behavior using Google. Inform. Process. Manage., 42(4), 2006, 1123--1131.
[23]
F. Mueller and A. Lockerd. Cheese: Tracking mouse movement activity on websites, a tool for user modeling. Ext. Abstracts CHI '01, 279--280.
[24]
G. Pass, A. Chowdhury, and C. Torgeson. 2006. A picture of search. Proc. InfoScale '06, 1.
[25]
K. Rodden and X. Fu. Exploring how mouse move-ments relate to eye movements on web search results pages. Workshop on Web Information Seeking and In-teraction at SIGIR '07, 29--32.
[26]
K. Rodden, X. Fu, A. Aula, and I. Spiro. Eye-mouse coordination patterns on web search results pages. Ext. Abstracts CHI '08, 2997--3002.
[27]
B. Shapira, M. Taieb-Maimon, and A. Moskowitz. Study of the usefulness of known and new implicit indicators and their optimal combination for accurate inference of users interests. Proc. SAC '06, 1118--1119.
[28]
K. Wang, T. Walker, and Z. Zheng. PSkip: Estimating relevance ranking quality from web search click-through data. Proc. KDD '09, 1355--1364.

Cited By

View all
  • (2024)Detecting Respondent Burden in Online Surveys: How Different Sources of Question Difficulty Influence Cursor MovementsSocial Science Computer Review10.1177/08944393241247425Online publication date: 25-Apr-2024
  • (2024)AnnoRank: A Comprehensive Web-Based Framework for Collecting Annotations and Assessing RankingsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679174(5400-5404)Online publication date: 21-Oct-2024
  • (2024)The Influence of Presentation and Performance on User SatisfactionProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638335(77-86)Online publication date: 10-Mar-2024
  • Show More Cited By

Index Terms

  1. No clicks, no problem: using cursor movements to understand and improve search
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      May 2011
      3530 pages
      ISBN:9781450302289
      DOI:10.1145/1978942
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 07 May 2011

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. clicks
      2. cursor movements
      3. implicit feedback
      4. web search

      Qualifiers

      • Research-article

      Conference

      CHI '11
      Sponsor:

      Acceptance Rates

      CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;
      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)118
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 25 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Detecting Respondent Burden in Online Surveys: How Different Sources of Question Difficulty Influence Cursor MovementsSocial Science Computer Review10.1177/08944393241247425Online publication date: 25-Apr-2024
      • (2024)AnnoRank: A Comprehensive Web-Based Framework for Collecting Annotations and Assessing RankingsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679174(5400-5404)Online publication date: 21-Oct-2024
      • (2024)The Influence of Presentation and Performance on User SatisfactionProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638335(77-86)Online publication date: 10-Mar-2024
      • (2024)Stranger Danger? Investor Behavior and Incentives on Cryptocurrency Copy-Trading PlatformsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642715(1-20)Online publication date: 11-May-2024
      • (2024)Visualisations with semantic iconsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103343191:COnline publication date: 1-Nov-2024
      • (2024)Readability of online government information about welfare rights and benefits: the Israeli caseUniversal Access in the Information Society10.1007/s10209-024-01167-2Online publication date: 5-Nov-2024
      • (2023)Integrating Gaze and Mouse Via Joint Cross-Attention Fusion Net for Students' Activity Recognition in E-learningProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108767:3(1-35)Online publication date: 27-Sep-2023
      • (2023)A Data-Driven Analysis of Behaviors in Data Curation ProcessesACM Transactions on Information Systems10.1145/356741941:3(1-35)Online publication date: 7-Feb-2023
      • (2023)Client‐side energy and GHGs assessment of advertising and tracking in the news websitesJournal of Industrial Ecology10.1111/jiec.1337627:2(548-561)Online publication date: 9-Jan-2023
      • (2023)Mouse tracking and consumer experience: exploring the associations between mouse movements, consumer emotions, brand awareness and purchase intentBehaviour & Information Technology10.1080/0144929X.2023.223502443:10(1924-1937)Online publication date: 13-Jul-2023
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media