article

Visual search and mouse-pointing in labeled versus unlabeled two-dimensional visual hierarchies

Editor: Jonathan Grudin Author:

Anthony J. HornofAuthors Info & Claims

ACM Transactions on Computer-Human Interaction (TOCHI), Volume 8, Issue 3

Pages 171 - 197

https://doi.org/10.1145/502907.502908

Published: 01 September 2001 Publication History

Abstract

An experiment investigates (1) how the physical structure of a computer screen layout affects visual search and (2) how people select a found target object with a mouse. Two structures are examined---labeled visual hierarchies (groups of objects with one label per group) and unlabeled visual hierarchies (groups without labels). Search and selection times were separated by imposing a point-completion deadline that discouraged participants from moving the mouse until they found the target. The observed search times indicate that labeled visual hierarchies can be searched much more efficiently than unlabeled visual hierarchies, and suggest that people use a fundamentally different strategy for each of the two structures. The results have implications for screen layout design and cognitive modeling of visual search. The observed mouse-pointing times suggest that people use a slower and more accurate speed-accuracy operating characteristic to select a target with a mouse when visual distractors are present, which suggests that Fitts' law coefficients derived from standard mouse-pointing experiments may under-predict mouse-pointing times for typical human-computer interactions. The observed mouse-pointing times also demonstrate that mouse movement times for a two-dimensional pointing task can be most-accurately predicted by setting the w in Fitts' law to the width of the target along the line of approach.

References

[1]

ABRAMS, R. A., MEYER,D.E.,AND KORNBLUM, S. 1990. Eye-hand coordination: Oculomotor control in rapid aimed limb movements. J. Exper. Psychol.: Human Perception Perform. 16, 2, 248-267.

[2]

ANDERSON,J.R.AND LEBIERE, C. (Eds.). 1998. The Atomic Components of Thought. Erlbaum, Hillsdale, NJ.

[3]

ANDERSON, J. R., MATESSA, M., AND LEBIERE, C. 1997. ACT-R: A theory of higher level cognition and its relation to visual attention. Human-Comput. Interaction, 12, 4, 439-462. Apple Computer INC. 1999. iMac User's Guide. Apple Computer, Inc., Cupertino, CA.

[4]

BIGUER, B., JANNEROD, M., AND PRABLANC, C. 1985. The role of position of gaze in movement accuracy. In Attention and Performance XI. M. I. Posner and O. S. M. Marin (Eds.), Erlbaum, Hillsdale, NJ, 407-424.

[5]

BURNS, C. M. 2000. Navigation strategies with ecological displays. Int. J. Human-Comput. Stud. 52, 111-129.

[6]

BURNS,M.J.,WARREN,D.L.,AND RUDISILL, M. 1986. Formatting space-related displays to optimize expert and nonexpert user performance. In Proceedings of the CHI '86 Conference, ACM, New York, NY.

[7]

BYRNE, M. D. 2001. ACT-R/PM and menu selection: Applying a cognitive architecture to HCI. Int. J. Human-Comput. Stud. 55, 41-84.

[8]

BYRNE,M.D.,ANDERSON, J. R., DOUGLASS,S.,AND MATESSA, M. 1999. Eye tracking the visual search of click-down menus. In Proceedings of the CHI 99 Conference, ACM, New York, NY, 402-409.

[9]

CARD, S. K. 1982. User perceptual mechanisms in the search of computer command menus. In Proceedings of the CHI '82 Conference, ACM, New York, NY, 190-196.

[10]

CARD, S. K., ENGLISH,W.K.,AND BURR, B. J. 1978. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics 21, 601-613.

[11]

CARD, S. K., MORAN,T.P.,AND NEWELL, A. 1983. The Psychology of Human-Computer Interaction. Erlbaum, Hillsdale, NJ.

[12]

EPPS, B. W. 1986. Comparison of six cursor control devices based on Fitts' law models. In Proceedings of the Human Factors Society 30th Annual Meeting. Human Factors Society, Santa Monica, CA, 327-331.

[13]

FITTS, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exper. Psychol. 47, 6, 381-391.

[14]

FURNAS,G.W.,LANDAUER, T. K., GOMEZ,L.M.,AND DUMAIS, S. T. 1987. The vocabulary problem in human-system communication. Commun. ACM 30 (Nov.), 964-971.

[15]

GALITZ, W. O. 1996. The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques. John Wiley, New York.

[16]

GILLAN,D.J.,HOLDEN, K., ADAM, S., RUDISILL, M., AND MAGEE, L. 1990. How does Fitts' law fit pointing and dragging? In Proceedings of the CHI '90 Conference, ACM, New York, NY, 227-234.

[17]

GRAY,W.D.AND BOEHM-DAVIS, D. A. 2000. Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. J. Exper. Psychol. Appl. 6,4, 322-335.

[18]

HAN, S. H., JORNA,G.C.,MILLER,R.H.,AND TAN, K. C. 1990. A comparison of four input devices for the Macintosh interface. In Proceedings of the Human Factors Society 34th Annual Meeting, Human Factors Society, Santa Monica, CA, 267-271.

[19]

HORNOF, A. J. 1999. Computational models of the perceptual, cognitive, and motor processes involved in the visual search of pull-down menus and computer screens. Ph.D. dissertation, University of Michigan, Ann Arbor.

[20]

HORNOF,A.J.AND KIERAS, D. E. 1997. Cognitive modeling reveals menu search is both random and systematic. In Proceedings of the ACM CHI 97: Conference on Human Factors in Computing Systems, ACM, New York, NY, 107-114.

[21]

HORNOF,A.J.AND KIERAS, D. E. 1999. Cognitive modeling demonstrates how people use anticipated location knowledge of menu items. In Proceedings of ACM CHI 99: Conference on Human Factors in Computing Systems, ACM, New York, NY, 410-417.

[22]

KIERAS,D.E.AND MEYER, D. E. 1997. An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Human-Comput. Interaction 12, 4, 391-438.

[23]

LOHSE, G. L. 1993. A cognitive model for understanding graphical perception. Human-Comput. Interaction 8, 353-388.

[24]

MACKENZIE, I. S. 1991. Fitts' law as a performance model in human-computer interaction. Ph.D. dissertation, University of Toronto. http://www.yorku.ca/faculty/academic/mack/phd.html.

[25]

MACKENZIE, I. S. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-Comput. Interaction 7, 91-139.

[26]

MACKENZIE,I.S.AND BUXTON, W. 1992. Extending Fitts' law to two-dimensional tasks. In Proceedings of the CHI '92 Conference, ACM, New York, NY, 219-226.

[27]

MCDONALD, J. E., STONE,J.D.,AND LIEBELT, L. S. 1983. Searching for items in menus: The effects of organization and type of target. In Proceedings of the Human Factors Society 27th Annual Meeting, Human Factors Society, Santa Monica, CA, 834-837.

[28]

MEEGAN,D.V.AND TIPPER, S. P. 1999. Visual search and target-directed action. J. Exper. Psychol. Human Perception Perform. 25, 5, 1347-1362.

[29]

MULLET,K.AND SANO, D. 1995. Designing Visual Interfaces: Communication Oriented Techniques. Prentice Hall, Englewood Cliffs, NJ.

[30]

NILSEN, E. L. 1991. Perceptual-motor control in human-computer interaction. Tech. Rep. and Ph.D. dissertation 37, Univ. of Michigan, Ann Arbor.

[31]

NORMAN, K. L. 1991. The Psychology of Menu Selection: Designing Cognitive Control of the Human/ Computer Interface. Ablex, Norwood, NJ.

[32]

PAAP,K.R.AND COOKE, N. J. 1997. Design of menus. In Handbook of Human Computer Interaction (2nd ed.), M. Helander, T. K. Landauer, and P. Prabhu (Eds.), North-Holland, Amsterdam, 533- 572.

[33]

PIROLLI,P.AND CARD, S. K. 1999. Information foraging. Psychol. Rev. 106, 643-675.

[34]

ROSENBAUM, D. A. 1991. Human Motor Control. Academic Press, New York, NY.

[35]

SEARS,A.AND SHNEIDERMAN, B. 1994. Split menus: Effectively using selection frequency to organizemenus. ACM Trans. Comput. Human Interaction 1, 1, 27-51.

[36]

SOMBERG,B.L.AND PICARDI, M. C. 1983. Locus of the information familiarity effect in the search of computer menus. In Proceedings of the Human Factors Society 27th Annual Meeting, Human Factors Society, Santa Monica, CA, 826-830.

[37]

STAGGERS, N. 1993. Impact of screen density on clinical nurses' computer task performance and subjective screen satisfaction. Int. J. Man-Mach. Stud. 39, 775-792.

[38]

THACKER, P. P. 1986. Tabular displays: A human factors study. Ph.D. dissertation. Rice Univ., Houston, TX.

[39]

TREISMAN, A. 1982. Perceptual grouping and attention in visual search for features and for objects. J. Exper. Psychol. Human Perception Perform. 8, 2, 194-214.

[40]

TULLIS, T. S. 1988. A system for evaluating screen formats: research and application. In Advances in Human-Computer Interaction (Vol. 2), R. Hartson and D. Hix (Eds.), Ablex, Norwood, NJ, 214- 286.

[41]

TULLIS, T. S. 1997. Screen design. In Handbook of Human-Computer Interaction (2nd ed.), M. Helander, T. K. Landauer, and P. Prabhu (Eds.), North-Holland, Amsterdam, 503-531.

[42]

WALKER, N., MEYER,D.E.,AND SMELLCER, J. B. 1993. Spatial and temporal characteristics of rapid cursor-positioning movements with electromechanical mice in human-computer interaction. Human Factors 35 3, 431-458.

[43]

WELFORD, A. T. 1968. Fundamentals of Skill. Methuen, London.

[44]

WILLIAMS,R.AND TOLLET, J. 1998. The Non-Designer's Web Book. Peachpit Press, Berkeley, CA.

Cited By

Shi DCui WHuang DZhang HCao N(2023)Reverse-engineering information presentations: recovering hierarchical grouping from layouts of visual elementsVisual Intelligence10.1007/s44267-023-00010-11:1Online publication date: 15-Jun-2023
https://doi.org/10.1007/s44267-023-00010-1
Moriuchi EMoriyoshi N(2023) A cross‐cultural study on online reviews and decision making: An eye‐tracking approach Journal of Consumer Behaviour10.1002/cb.216523:1(156-170)Online publication date: 28-Apr-2023
https://doi.org/10.1002/cb.2165
Lucchese ADigiesi SMummolo C(2022)Analytical-stochastic model of motor difficulty for three-dimensional manipulation tasksPLOS ONE10.1371/journal.pone.027630817:10(e0276308)Online publication date: 19-Oct-2022
https://doi.org/10.1371/journal.pone.0276308
Show More Cited By

Index Terms

Visual search and mouse-pointing in labeled versus unlabeled two-dimensional visual hierarchies
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
  2. Interaction design

Recommendations

Effects of mouse pointing on learning from labeled and unlabeled split-attention materials: An eye-tracking study
Abstract
Learning from mutually referring but spatially separated text and picture (i.e., split-attention materials) is cognitively demanding. We investigated whether mouse pointing could support learning from split-attention materials in which ...
Highlights
- Effects of mouse pointing on learning from split-attention examples were studied.
Effect of Bezel Presence and Width on Visual Search
PerDis '14: Proceedings of The International Symposium on Pervasive Displays

We investigate how the presence and width of interior bezels impacts visual search performance across tiled displays. In spite of a potential benefit from structured segmentation, we do not find significant differences in visual search time, and note a ...
Subtle cueing for visual search in augmented reality
ISMAR '12: Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

Visual search in augmented reality environments is an important task that can be facilitated through different cueing methods. Current cueing methods rely on explicit cueing, which can potentially reduce visual search performance. In comparison, this ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 8, Issue 3

September 2001

95 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/502907

Editor:
Jonathan Grudin
Microsoft Research

Issue’s Table of Contents

Copyright © 2001 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2001

Published in TOCHI Volume 8, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
1,667
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)2

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shi DCui WHuang DZhang HCao N(2023)Reverse-engineering information presentations: recovering hierarchical grouping from layouts of visual elementsVisual Intelligence10.1007/s44267-023-00010-11:1Online publication date: 15-Jun-2023
https://doi.org/10.1007/s44267-023-00010-1
Moriuchi EMoriyoshi N(2023) A cross‐cultural study on online reviews and decision making: An eye‐tracking approach Journal of Consumer Behaviour10.1002/cb.216523:1(156-170)Online publication date: 28-Apr-2023
https://doi.org/10.1002/cb.2165
Lucchese ADigiesi SMummolo C(2022)Analytical-stochastic model of motor difficulty for three-dimensional manipulation tasksPLOS ONE10.1371/journal.pone.027630817:10(e0276308)Online publication date: 19-Oct-2022
https://doi.org/10.1371/journal.pone.0276308
Lucchese ADigiesi SAkbaş KMummolo C(2021)An Agent-Specific Stochastic Model of Generalized Reaching Task DifficultyApplied Sciences10.3390/app1110433011:10(4330)Online publication date: 11-May-2021
https://doi.org/10.3390/app11104330
Eide SPoljac ASandnes F(2021)Image Search Versus Text Search Revisited: A Simple Experiment Using a Kahoot QuizUniversal Access in Human-Computer Interaction. Design Methods and User Experience10.1007/978-3-030-78092-0_12(186-196)Online publication date: 24-Jul-2021
https://dl.acm.org/doi/10.1007/978-3-030-78092-0_12
Zhang YHornof AQvarfordt PHansen D(2014)Easy post-hoc spatial recalibration of eye tracking dataProceedings of the Symposium on Eye Tracking Research and Applications10.1145/2578153.2578166(95-98)Online publication date: 26-Mar-2014
https://dl.acm.org/doi/10.1145/2578153.2578166
Liu BCao LTang YZhong M(2014)Visual Search on E-commerce Category Navigation: A Multi-language StudyCross-Cultural Design10.1007/978-3-319-07308-8_45(470-481)Online publication date: 2014
https://doi.org/10.1007/978-3-319-07308-8_45
Malacria SBailly GHarrison JCockburn AGutwin CMackay WBrewster SBødker S(2013)Promoting Hotkey use through rehearsal with ExposeHKProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2470654.2470735(573-582)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2470654.2470735
Samp KMackay WBrewster SBødker S(2013)Designing graphical menus for novices and expertsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2470654.2466432(3159-3168)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2470654.2466432
Shoemaker GTsukitani TKitamura YBooth K(2012)Two-Part Models Capture the Impact of Gain on Pointing PerformanceACM Transactions on Computer-Human Interaction10.1145/2395131.239513519:4(1-34)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1145/2395131.2395135
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents