Article

A minimal model for predicting visual search in human-computer interaction

Authors:

Tim Halverson,

Anthony J. HornofAuthors Info & Claims

CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 431 - 434

https://doi.org/10.1145/1240624.1240693

Published: 29 April 2007 Publication History

Get Access

Abstract

Visual search is an important part of human-computer interaction. It is critical that we build theory about how people visually search displays in order to better support the users' visual capabilities and limitations in everyday tasks. One way of building such theory is through computational cognitive modeling. The ultimate promise for cognitive modeling in HCI it to provide the science base needed for predictive interface analysis tools. This paper discusses computational cognitive modeling of the perceptual, strategic, and oculomotor processes people used in a visual search task. This work refines and rounds out previously reported cognitive modeling and eye tracking analysis. A revised "minimal model" of visual search is presented that explains a variety of eye movement data better than the original model. The revised model uses a parsimonious strategy that is not tied to a particular visual structure or feature beyond the location of objects. Three characteristics of the minimal strategy are discussed in detail.

References

[1]

Brumby, D. P., & Howes, A. (in press). Strategies for Guiding Interactive Search: An Empirical Investigation into the Consequences of Label Relevance for Assessment and Selection. Human-Computer Interaction.

Google Scholar

[2]

Halverson, T., & Hornof, A. J. (2004). Explaining Eye Movements in the Visual Search of Varying Density Layouts. In Proc. ICCM 2004, Lawrence Erlbaum Associates, 124--129.

Google Scholar

[3]

Hooge, I. T. C., & Erkelens, C. J. (1996). Control of fixation duration in a simple search task. Perception and Psychophysics, 58, 969--976.

Crossref

Google Scholar

[4]

Hornof, A. J. (2004). Cognitive Strategies for the Visual Search of Hierarchical Computer Displays. Human-Computer Interaction, 19(3), 183--223.

Digital Library

Google Scholar

[5]

Hornof, A. J., & Halverson, T. (2003). Cognitive strategies and eye movements for searching hierarchical computer displays. In Proc. CHI 2003, ACM Press, 249--256.

Digital Library

Google Scholar

[6]

John, B. E., Prevas, K., Salvucci, D. D., & Koedinger, K. (2004). Predictive Human Performance Modeling Made Easy. In Proc. CHI 2004, ACM, 455--462.

Digital Library

Google Scholar

[7]

Kieras, D. E., & Meyer, D. E. (1997). An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Human-Computer Interaction, 12(4), 391--438.

Digital Library

Google Scholar

[8]

Koostra, G., Nederveen, A., & de Boer, B. (2006). On the Bottom-Up and Top-Down Influences of Eye Movements. In Proc. Proc. CogSci 2006, Lawrence Erlbaum Associates, 2538.

Google Scholar

[9]

Motter, B. C., & Belky, E. J. (1998). The guidance of eye movements during active visual search. Vision Research, 38(12), 1905--1815.

Crossref

Google Scholar

[10]

Peterson, M. S., Kramer, A. F., Wang, R. F., Irwin, D. E., & McCarley, J. S. (2001). Visual search has memory. Psychological Science, 12(4), 287--292.

Crossref

Google Scholar

[11]

St. Amant, R., & Ritter, F. E. (2004). Automated GOMS-to-ACT-R Model Generation. In Proc. ICCM 2004, Lawrence Earlbaum, 26--31.

Google Scholar

[12]

Wolfe, J. M. (1994). Guided Search 2.0: A revised model of visual search. Psychonomic Bulletin and Review, 1(2), 202--238.

Google Scholar

Cited By

View all

Mondal SYang ZAhn SSamaras DZelinsky GHoai M(2023)Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human Attention2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00145(1441-1450)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00145
Zhou LZhou TKhan SSun HShen JShao L(2022)Weakly Supervised Visual Saliency PredictionIEEE Transactions on Image Processing10.1109/TIP.2022.315806431(3111-3124)Online publication date: 2022
https://doi.org/10.1109/TIP.2022.3158064
Jin SYin JFu CZhang XLiu T(2020)Modeling Angle-Based Pointing Tasks in Augmented Reality InterfacesIEEE Access10.1109/ACCESS.2020.30319578(192597-192607)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3031957
Show More Cited By

Index Terms

A minimal model for predicting visual search in human-computer interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
      1. Cognitive robotics
    2. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Cognitive strategies and eye movements for searching hierarchical computer displays
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This research investigates the cognitive strategies and eye movements that people use to search for a known item in a hierarchical computer display. Computational cognitive models were built to simulate the visual-perceptual and oculomotor processing ...
Integrating models of human-computer visual interaction
CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems

Predicting visual search behavior in human-computer interaction is a challenging problem. It is important for predictive modeling of human-computer interaction to integrate the visual search strategies identified in individual models in order to predict ...
The persistent visual store as the locus of fixation memory in visual search tasks

Experiments on visual search have demonstrated the existence of a relatively large and reliable memory for which objects have been fixated; an indication of this memory is that revisits (fixations on previously fixated objects) typically comprise only ...

Comments

Information & Contributors

Information

Published In

CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2007

1654 pages

ISBN:9781595935939

DOI:10.1145/1240624

General Chair:
Mary Beth Rosson
The Pennsylvania State University, USA
,
Program Chair:
David Gilmore
Intel, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI07

Sponsor:

CHI07: CHI Conference on Human Factors in Computing Systems

April 28 - May 3, 2007

California, San Jose, USA

Acceptance Rates

CHI '07 Paper Acceptance Rate 182 of 840 submissions, 22%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
1,199
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 17 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Mondal SYang ZAhn SSamaras DZelinsky GHoai M(2023)Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human Attention2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00145(1441-1450)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00145
Zhou LZhou TKhan SSun HShen JShao L(2022)Weakly Supervised Visual Saliency PredictionIEEE Transactions on Image Processing10.1109/TIP.2022.315806431(3111-3124)Online publication date: 2022
https://doi.org/10.1109/TIP.2022.3158064
Jin SYin JFu CZhang XLiu T(2020)Modeling Angle-Based Pointing Tasks in Augmented Reality InterfacesIEEE Access10.1109/ACCESS.2020.30319578(192597-192607)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3031957
Ohn-Bar EGuerreiro JKitani KAsakawa C(2018)Variability in Reactions to Instructional Guidance during Smartphone-Based Assisted Navigation of Blind UsersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/32649412:3(1-25)Online publication date: 18-Sep-2018
https://dl.acm.org/doi/10.1145/3264941
Al-Samarraie HSarsam SAlzahrani AAlalwan N(2018)Personality and individual differencesCognition, Technology and Work10.1007/s10111-018-0470-620:3(337-349)Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1007/s10111-018-0470-6
Chen LWang FPu PDíaz Agudo BGoel A(2017)Investigating users’ eye movement behavior in critiquing-based recommender systemsAI Communications10.3233/AIC-17073730:3-4(207-222)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.3233/AIC-170737
Chen XBailly GBrumby DOulasvirta AHowes ABegole BKim JInkpen KWoo W(2015)The Emergence of Interactive BehaviorProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems10.1145/2702123.2702483(4217-4226)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702123.2702483
Kacorri HHarper AHuenerfauth M(2013)Comparing native signers' perception of American Sign Language animations and videos via eye trackingProceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/2513383.2513441(1-8)Online publication date: 21-Oct-2013
https://dl.acm.org/doi/10.1145/2513383.2513441
Jay CBrown AHarper S(2013)Predicting whether users view dynamic content on the world wide webACM Transactions on Computer-Human Interaction10.1145/2463579.246358020:2(1-33)Online publication date: 27-May-2013
https://dl.acm.org/doi/10.1145/2463579.2463580
Thimbleby H(2013)Action graphs and user performance analysisInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2012.10.01471:3(276-302)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1016/j.ijhcs.2012.10.014
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Cognitive strategies and eye movements for searching hierarchical computer displays

Integrating models of human-computer visual interaction

The persistent visual store as the locus of fixation memory in visual search tasks

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Cognitive strategies and eye movements for searching hierarchical computer displays

Integrating models of human-computer visual interaction

The persistent visual store as the locus of fixation memory in visual search tasks

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations