research-article

Linking search tasks with low-level eye movement patterns

Authors:

Michael J. Cole,

Nicholas J. Belkin,

Xiangmin ZhangAuthors Info & Claims

ECCE '10: Proceedings of the 28th Annual European Conference on Cognitive Ergonomics

Pages 109 - 116

https://doi.org/10.1145/1962300.1962323

Published: 25 August 2010 Publication History

Abstract

Motivation -- On-the-task detection of the task type and task attributes can benefit personalization and adaptation of information systems.

Research approach -- A web-based information search experiment was conducted with 32 participants using a multi-stream logging system. The realistic tasks were related directly to the backgrounds of the participants and were of distinct task types.

Findings/Design -- We report on a relationship between task and individual reading behaviour. Specifically we show that transitions between scanning and reading behaviour in eye movement patterns are an implicit indicator of the current task.

Research limitations/Implications -- This work suggests it is plausible to infer the type of information task from eye movement patterns. One limitation is a lack of knowledge about the general reading model differences across different types of tasks in the population. Although this is an experimental study we argue it can be generalized to real world text-oriented information search tasks.

Originality/Value -- This research presents a new methodology to model user information search task behaviour. It suggests promise for detection of information task type based on patterns of eye movements.

Take away message -- With increasingly complex computer interaction, knowledge about the type of information task can be valuable for system personalization. Modelling the reading/scanning patterns of eye movements can allow inference about the task type and task attributes.

References

[1]

Belkin, N. (2008) Some(what) grand challenges for information retrieval. SIGIR Forum 42(1), 47--54.

Digital Library

[2]

Bierig, R., Cole., M.J., & Gwizdka, J. (2009). A user-centered experiment and logging framework for interactive information retrieval. In N.J. Belkin, R. Bierig, G. Buscher, L. van Elst, J. Gwizdka, J. Jose, et al. (Eds), CEUR Workshop Proceedings: 512. Proceedings of the SIGIR 2009 Workshop on Understanding the User: Logging and interpreting user interactions in information search and retrieval, UIIR'2009 (pp. 8--11). Aachen, Germany: CEUR Workshop Proceedings.

[3]

Buscher, G., Dengel, A., & Van Elst, L. (2008) Eye movements as implicit relevance feedback. In Proceedings of CHI '08 (Florence, Italy, 2008), ACM, pp. 2991--2998.

Digital Library

[4]

Buscher, G., Dengel, A., & Van Elst, L. (2008) Query expansion using gaze-based feedback on the subdocument level. In Proceedings of SIGIR '08 (Singapore, July 2008), ACM, pp. 387--394.

Digital Library

[5]

Byström, K., & Jäärvelin, K. (1995) Task complexity affects information seeking and use. Information Processing and Management 31(2), 191--213.

Digital Library

[6]

Conati, C., Merton, C., Muldner, K., & Ternes, D. (2005) Exploring eye tracking to increase bandwidth in user modeling. In Proceedings of User Modeling 2005 (Edinburgh, Scotland, July 2005), L. Ardissomo, P. Brna, & A. Mitrovic, Eds., Springer-Verlag, pp. 357--366.

Digital Library

[7]

Farzan, R., & Brusilovsky, P. (2009) Social navigation support for information seeking. In UMAP 2009, Springer, pp. 66--77.

Digital Library

[8]

Findlay, J., & Gilchrist, I. (2003) Active vision: The psychology of looking and seeing. Oxford University Press, New York, 2003.

[9]

Granka, L., Joachims, T., & Gay, G. (2004) Eye-tracking analysis of user behavior in WWW search. In Proceedings of SIGIR '04 (Sheffield, UK, July 2004), ACM, New York, pp. 478--479.

Digital Library

[10]

Guan, Z., & Cutrell, E. (2007) An eye tracking study of the effect of target rank on web search. In Proceedings of CHI '07 (San Jose, CA, USA, May 2007), ACM, p. 420.

Digital Library

[11]

Hayhoe, M.M., Droll, J., & Mennie, N. (2007) Learning where to look. In R.P.G. van Gompel, M.H. Fischer, W.S. Murray, & R.L. Hill, (Eds.) Eye movements: A window on mind and brain, ch. 30, pp. 642--659 Elsevier, New York.

[12]

Kelly, D., & Belkin, N.J. (2004) Display time as implicit feedback: understanding task effects. In Proceedings of SIGIR '04 (Sheffield, UK, July 2004), ACM New York pp. 377--384.

Digital Library

[13]

Li, Y. (2009) Exploring the relationships between work task and search task in information search. Journal of the American Society for Information Science and Technology, 60(2), 275--291.

Digital Library

[14]

Liu, J. & Belkin, N.J. (2010) Personalizing Information Retrieval for Multi-Session Tasks: The Roles of Task Stage and Task Type, In Proceedings of SIGIR '10 (Geneva, Switzerland, July 2010), ACM, New York.

Digital Library

[15]

Lorigo, L., Haridasan, M., Bryniarsodttir, H., Xia, L., Joachims, T., Gay, G., Granka, L., Pellacini, F., & Pan, B. (2008) Eye tracking and online search: Lessons learned and challenges ahead. Journal of the American Society for Information Science and Technology, 59(7), 1041--1052.

Digital Library

[16]

Oliveira, F.T., Aula, A., & Russell, D.M. (2009) Discriminating the relevance of web search results with measures of pupil size. In Proceedings of CHI '09 (Boston, MA, USA, April 2009), ACM, pp. 2209--2212.

Digital Library

[17]

Rayner, K., & Fischer, M. (1996) Mindless reading revisited: Eye movements during reading and scanning are different. Perception & Psychophysics 58(5), 734--747.

[18]

Rayner, K., Li, X., Williams, C.C., Cave, K.R., & Well, A. (2007) Eye movements during information processing tasks: Individual differences and cultural effects. Vision Research 50(21), 2714--2726.

[19]

Rayner, K., Reichle, E.D., & Pollatsek, A. (1998) Eye movement control in reading: An overview and model. In G. Underwood (Ed) Eye guidance in reading and scene perception, pp. 243--268, Elsevier, Oxford.

[20]

Rayner, K., Smith, T.J., Malcomb, G.L., & Henderson, J.M. (2009) Eye movements and visual encoding during scene perception. Psychological Science 20 (1), 6--10.

[21]

Rayner, K., White, S., Kambe, G., Miller, B., & Liversedge, S. (2003) On the processing of meaning from parafoveal vision during eye fixations in reading. In R. Radach, J. Hyona, & F. H. Deubel (Eds.) The mind's eye: Cognitive and applied aspects of eye movement research, pp. 213--234 Elsevier. New York.

[22]

Reichle, E.D., Pollatsek, A., & Rayner, K. (2006) E--Z Reader: A cognitive-control, serial-attention model of eye-movement behavior during reading. Cognitive Systems Research 7(1), 4--22.

Digital Library

[23]

Reingold, E., & Rayner, K. (2006) Examining the word identification stages hypothesized by the EZ Reader model. Psychological Science 17(9), 742--746.

[24]

Sherman, C. (2005) A new f-word for Google search results. Search Engine Watch.

[25]

Terai, H., Saito, H., Egusa, Y., Takaku, M., Miwa, M., & Kando, N. (2008) Differences between informational and transactional tasks in information seeking on the web. In Proceedings of IIiX '08 (London, UK, October 2008), ACM New York, pp. 152--159.

Digital Library

[26]

Torralba, A., Oliva, A., Castelhano, M., & Henderson, J.M. (2006) Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review 113 (4), 766--786.

[27]

Triesch, J., Ballard, D.H., Hayhoe, M.M., & Sullivan, B.T. (2003) What you see is what you need. Journal of Vision 3(1), 86--94.

[28]

White, R.W., & Kelly, D. (2006) A study on the effects of personalization and task information on implicit feedback performance. In Proceedings of CIKM '06 (Arlington, Virginia, USA, November 2006), ACM, New York, pp. 297--306.

Digital Library

Cited By

Taieb-Maimon MRomanovski-Chernik ALast MLitvak MElhadad M(2023)Mining Eye-Tracking Data for Text SummarizationInternational Journal of Human–Computer Interaction10.1080/10447318.2023.222782740:17(4887-4905)Online publication date: 21-Jul-2023
https://doi.org/10.1080/10447318.2023.2227827
Liu JLiu CBelkin N(2020)Personalization in text information retrievalJournal of the Association for Information Science and Technology10.1002/asi.2423471:3(349-369)Online publication date: 28-Jan-2020
https://dl.acm.org/doi/10.1002/asi.24234
Bilal DHuang L(2019)Readability and word complexity of SERPs snippets and web pages on children’s search queriesAslib Journal of Information Management10.1108/AJIM-05-2018-0124Online publication date: Mar-2019
https://doi.org/10.1108/AJIM-05-2018-0124
Show More Cited By

Index Terms

Linking search tasks with low-level eye movement patterns
1. Human-centered computing
  1. Accessibility
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction paradigms
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Using hidden Markov model to uncover processing states from eye movements in information search tasks

We study how processing states alternate during information search tasks. Inference is carried out with a discriminative hidden Markov model (dHMM) learned from eye movement data, measured in an experiment consisting of three task types: (i) simple word ...
Extended tasks elicit complex eye movement patterns
ETRA '00: Proceedings of the 2000 symposium on Eye tracking research & applications

Visual perception is an inherently complex task, yet the bulk of studies in the past were undertaken with subjects performing relatively simple tasks under reduced laboratory conditions. In the research reported here, we examined subjects' oculomotor ...
Predicting observer's task from eye movement patterns during motion image analysis
ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Predicting an observer's tasks from eye movements during several viewing tasks has been investigated by several authors. This contribution adds task prediction from eye movements tasks occurring during motion image analysis: Explore, Observe, Search, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ECCE '10: Proceedings of the 28th Annual European Conference on Cognitive Ergonomics

August 2010

380 pages

ISBN:9781605589466

DOI:10.1145/1962300

General Chairs:
Mark Neerincx
TNO Human Factors/Delft University of Technology, The Netherlands
,
Willem-Paul Brinkman
Delft University of Technology, The Netherlands

Copyright © 2010 Authors.

Sponsors

TNO: Netherlands Organization for Applied Scientific Research
EACE: European Association of Cognitive Ergonomics

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 August 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Institute of Museum and Library Services

Conference

ECCE '10

Sponsor:

TNO
EACE

ECCE '10: European Conference on Cognitive Ergonomics

August 25 - 27, 2010

Delft, Netherlands

Acceptance Rates

Overall Acceptance Rate 56 of 91 submissions, 62%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
186
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Taieb-Maimon MRomanovski-Chernik ALast MLitvak MElhadad M(2023)Mining Eye-Tracking Data for Text SummarizationInternational Journal of Human–Computer Interaction10.1080/10447318.2023.222782740:17(4887-4905)Online publication date: 21-Jul-2023
https://doi.org/10.1080/10447318.2023.2227827
Liu JLiu CBelkin N(2020)Personalization in text information retrievalJournal of the Association for Information Science and Technology10.1002/asi.2423471:3(349-369)Online publication date: 28-Jan-2020
https://dl.acm.org/doi/10.1002/asi.24234
Bilal DHuang L(2019)Readability and word complexity of SERPs snippets and web pages on children’s search queriesAslib Journal of Information Management10.1108/AJIM-05-2018-0124Online publication date: Mar-2019
https://doi.org/10.1108/AJIM-05-2018-0124
Wittek PLiu YDarányi SGedeon TLim I(2016)Risk and Ambiguity in Information Seeking: Eye Gaze Patterns Reveal Contextual Behavior in Dealing with UncertaintyFrontiers in Psychology10.3389/fpsyg.2016.017907Online publication date: 17-Nov-2016
https://doi.org/10.3389/fpsyg.2016.01790
Jayarathna SShipman FKelly DCapra RBelkin NTeevan JVakkari P(2016)Rationale and Architecture for Incorporating Human Oculomotor Plant Features in User Interest ModelingProceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval10.1145/2854946.2854992(281-284)Online publication date: 13-Mar-2016
https://dl.acm.org/doi/10.1145/2854946.2854992
Sloan MYang HWang J(2015)A term-based methodology for query reformulation understandingInformation Retrieval Journal10.1007/s10791-015-9251-518:2(145-165)Online publication date: 6-Mar-2015
https://doi.org/10.1007/s10791-015-9251-5
Liu YBierig RElsweiler DLudwig BAzzopardi LWilson M(2014)A review of users' search contexts for lifelogging system designProceedings of the 5th Information Interaction in Context Symposium10.1145/2637002.2637040(271-274)Online publication date: 26-Aug-2014
https://dl.acm.org/doi/10.1145/2637002.2637040
Jiang JHe DAllan JGeva STrotman ABruza PClarke CJärvelin K(2014)Searching, browsing, and clicking in a search sessionProceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval10.1145/2600428.2609633(607-616)Online publication date: 3-Jul-2014
https://dl.acm.org/doi/10.1145/2600428.2609633
Clark MRuthven IHolt PSong DWatt S(2014)You have e-mail, what happens next? Tracking the eyes for genreInformation Processing and Management: an International Journal10.1016/j.ipm.2013.08.00550:1(175-198)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1016/j.ipm.2013.08.005
Cole MGwizdka JLiu CBelkin NZhang X(2013)Inferring user knowledge level from eye movement patternsInformation Processing and Management: an International Journal10.1016/j.ipm.2012.08.00449:5(1075-1091)Online publication date: 1-Sep-2013
https://dl.acm.org/doi/10.1016/j.ipm.2012.08.004
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents