research-article

An intuitive model of perceptual grouping for HCI design

Authors:

Ruth Rosenholtz,

Nathaniel R. Twarog,

Nadja Schinkel-Bielefeld,

Martin WattenbergAuthors Info & Claims

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1331 - 1340

https://doi.org/10.1145/1518701.1518903

Published: 04 April 2009 Publication History

Abstract

Understanding and exploiting the abilities of the human visual system is an important part of the design of usable user interfaces and information visualizations. Good design enables quick, easy and veridical perception of key components of that design. An important facet of human vision is its ability to seemingly effortlessly perform "perceptual organization; it transforms individual feature estimates into perception of coherent regions, structures, and objects. We perceive regions grouped by proximity and feature similarity, grouping of curves by good continuation, and grouping of regions of coherent texture. In this paper, we discuss a simple model for a broad range of perceptual grouping phenomena. It takes as input an arbitrary image, and returns a structure describing the predicted visual organization of the image. We demonstrate that this model can capture aspects of traditional design rules, and predicts visual percepts in classic perceptual grouping displays.

References

[1]

Wertheimer, M. Laws of Organization in Perceptual Forms. Harcourt Brace Jovanovich, London, 1938.

[2]

Koffka, K. Principles of Gestalt Psychology. Hartcourt, New York, 1935.

[3]

Ware, C. Information Visualization: Perception for Design. Elsevier, San Francisco, 2004.

Digital Library

[4]

Kosslyn, S. M. Understanding charts and graphs. Applied Cognitive Psychology, 3 (1989), 185--225.

[5]

Tufte, E. R. The Visual Display of Quantitative Information. Graphics Press, CT, 1983.

Digital Library

[6]

Cleveland, W. The Elements of Graphing Data. Wadsworth, Monterey, CA, 1980.

Digital Library

[7]

Mackinlay, J. D. Applying a theory of graphical presentation to the graphic design of user interfaces. In Proc. SIGGRAPH (UIST) (1988), ACM Press, 179--189.

Digital Library

[8]

Tullis, T. S. A computer-based tool for evaluating alphanumeric displays. INTERACT 84 (1984), 719--723.

[9]

Vincent, L. Current topics in applied morphological image analysis. In Kendall, W. S. et al., eds., Current Trends in Stochastic Geometry and Its Applications. Chapman&Hall, 1997.

[10]

Shneiderman, B., Chimera, R., Jog, N., Stimart, R.,&White, D. Evaluating spatial and texture style of displays. In MacDonald, L. W. and Lowe, A. C., eds., Display Systems: Design and Applications. John Wiley&Sons, Chichester, U.K., 1997.

[11]

Saund, E. Symbolic construction of a 2-D scale-space image. IEEE Trans. Pattern Analysis&Machine Intelligence, 12, 8 (1990), 817--830.

Digital Library

[12]

Healey, C.G., Booth, K.S.,&Enns, J.T. Harnessing preattentive processes for multivariate data visualization. Proc. Graphics Interface '93 (1993), 107--117.

[13]

Shi, J.&Malik, J. Normalized cuts and image segmentations. IEEE Conf. on Computer Vision and Pattern Recognition ( 1997), 731--737.

Digital Library

[14]

Field, D. J., Hayes, A.,&Hess, R. F. Contour integration by the human visual system: evidence for a local association field. Vision Research, 33 (1993), 173--193.

[15]

Parent, P.&Zucker, S. W. Trace inference, curvature consistency, and curve detection. IEEE Trans. Pattern Analysis&Machine Intelligence, 2, 8 (1989), 823--839.

Digital Library

[16]

Mumford, D. Elastica and computer vision. In Algebraic Geometry and Its Applications. Springer-Verlag, NY, 1994.

[17]

Grossberg, S.&Mingolla, E. Neural dynamics of perceptual grouping: textures, boundaries, and emergent segmentations. Perception&Psychophysics, 38 (1985), 141--171.

[18]

Duda, R. O.&Hart, P. E. Pattern Classification. Wiley, NY, 1973.

Digital Library

[19]

Ohlander, R., Price, K.,&Reddy, R. Picture segmentation by a recursive region splitting method. Computer Graphics and Image Processing, 8 (1978), 313--333.

[20]

Witkin, A. P. Scale-space filtering. Proc. 8th Int. Conf. on Artificial Intelligence (1983), 1019--1022.

[21]

Koenderink, J. J. The structure of images. Biological Cybernetics, 50 (1984), 363--370.

[22]

Lindeberg, T. Scale-Space Theory in Computer Vision. Kluwer Academic, Dordrecht, Netherlands, 1994.

Digital Library

[23]

Wattenberg, M.&Fisher, D. A model of multi-scale perceptual organization in information graphics. Infovis 2003 ( 2003), 123--133.

Digital Library

[24]

Palmer, S. E. Hierarchical structure in perceptual representation. Cognitive Psychology, 9 (1977), 441--474.

[25]

Navon, D. Forest before trees: The precedence of global features in visual perception. Cognitive Psychology, 9 (1977), 353--383.

[26]

Martin, D., Fowlkes, C.,&Malik, J. Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Trans. Pattern Analysis and Machine Intelligence, 26, 5 (2004), 530--549.

Digital Library

[27]

Malik, J.&Perona, P. A computational model of texture segmentation. Proc. Computer Vision and Pattern Recognition (1989), 326--332.

[28]

Rosenholtz, R. Significantly different textures: A computational model of pre-attentive texture segmentation. Proc. Europ. Conf. Computer Vision (2000), 197--211.

Digital Library

[29]

Perona, P.&Malik, J. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Analysis&Machine Intelligence, 12 (1990), 629--639.

Digital Library

[30]

Geman, S.&Geman, D. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Analysis&Machine Intelligence, 6 (1984), 721--741.

Digital Library

[31]

Tomasi, C.&Manduchi, R. Bilateral filtering for gray and color images. IEEE Int. Conf. on Computer Vision (1998), 839--846.

Digital Library

[32]

Durand, F.&Dorsey, J. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. on Graphics, 21, 3 (2002), 257--266.

Digital Library

[33]

Paris, S.&Durand, F. A fast approximation of the bi-lateral filter using a signal processing approach. Proc. European Conf. Computer Vision (2006), 568--580.

Digital Library

[34]

Julesz, B. A theory of preattentive texture discrimination based on the first order statistics of textons. Biological Cybernetics, 41 (1981), 131--138.

[35]

Beck, J. Textural segmentation, second-order statistics,&textural elements. Biol. Cybern., 48 (1983), 125--130.

Digital Library

[36]

Voorhees, H.&Poggio, T. Computing texture boundaries from images. Nature, 333 (1988), 364--367.

[37]

Li, Z. Pre-attentive segmentation in the primary visual cortex. Spatial Vision, 13 (2000), 25--50.

[38]

Helmholtz, H. Handbook of Physiological Optics. Vol. 3, The Perceptions of Vision. Optical Society of America, Rochester, 1925.

[39]

Paris, S.&Durand, F. A topological approach to hierarchical segmentation using mean shift. IEEE Conf. Computer Vision&Pattern Recognition (2007), 1--8.

[40]

Ruzon, M. A.&Tomasi, C. Edge, junction and corner detection using color distributions. IEEE Trans. Pattern Analysis&Mach. Intell., 23, 11 (2001), 1281--1295.

Digital Library

[41]

Geisler, W. S., Perry, J. S., Super, B. J.,&Gallogly, D. P. Edge co-occurrence in natural images predicts contour grouping performance. Vision Research, 41 (2001), 711--724.

[42]

Estrada, F. J.&Elder, J. H. Multi-scale contour extraction based on natural image statistics. IEEE Conf. Computer Vision&Pattern Recognition Workshop (2006), 183--190.

Digital Library

[43]

Schinkel-Bielefeld, N. Contour integration models predicting human behavior. University of Bremen, 2007. http://nbn-resolving.de/urn:nbn:de:gbv:46diss000-108845.

[44]

Mahamud, S., Williams, L. R.,&Thornber, K. K. Segmentation of multiple salient contours from real images. IEEE Trans. on Pattern Analysis&Machine Intelligence, 25 (2003), 433--444.

Digital Library

[45]

Ren, X., Fowlkes, C.,&Malik, J. Figure/ground assignment in natural images. Proc. European Conf. on Computer Vision (2006), 614--627.

Digital Library

[46]

C.I.E. Recommendations on uniform color spaces, color difference equations, psychometric color terms. Supp. No. 2 to CIE publ. 15 (E.-1.3.1) 1971/(TC-1.3.) (1978).

[47]

Comanciu, D.&Meer, P. Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Analysis&Machine Intelligence, 24 (2002), 603--619.

Digital Library

[48]

Freeman, W. T.&Adelson, E. H. The design and use of steerable filters. IEEE Trans. Pattern Analysis&Machine Intelligence, 13 (1991), 891--906.

Digital Library

[49]

Landy, M. S.&Bergen, J. R. Texture segregation and orientation gradient. Vis. Research, 31 (1991), 679--691.

[50]

Marr, D. and Hildreth, E. C. Theory of edge detection. Proc. Royal Society, London B, 207 (1980), 187--217.

[51]

Logan, G. The CODE theory of visual attention: An integration of space-based and object-based attention. Psychological Review, 103, 4 (1996), 603--649.

[52]

Watt, R., Ledgeway, T., and Dakin, S. C. Families of models for Gabor paths demonstrate the importance of spatial adjacency. Journal of Vision, 8, 7 (2008), 1--19. htp://journalofvision.org/8/7/23/.

Cited By

Zhu JHuang DWang CCheng MLi JHu HGeng XGuo B(2024)Unsupervised Graphic Layout Grouping with Transformers2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00107(1020-1029)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00107
Wang CMiniukovich ARen X(2024)An interpretable metric of visual aesthetics for GUI designBehaviour & Information Technology10.1080/0144929X.2024.2325030(1-15)Online publication date: 29-Feb-2024
https://doi.org/10.1080/0144929X.2024.2325030
Deng DCui WMeng XXu MLiao YZhang HWu Y(2023)Revisiting the Design Patterns of Composite VisualizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.321356529:12(5406-5421)Online publication date: Dec-2023
https://doi.org/10.1109/TVCG.2022.3213565
Show More Cited By

Index Terms

An intuitive model of perceptual grouping for HCI design
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Cortical circuits for top-down control of perceptual grouping
Abstract
A fundamental characteristic of human visual perception is the ability to group together disparate elements in a scene and treat them as a single unit. The mechanisms by which humans create such groupings remain unknown, but grouping ...
On the Distribution of Saliency

Detecting salient structures is a basic task in perceptual organization. Saliency algorithms typically mark edge-points with some saliency measure, which grows with the length and smoothness of the curve on which these edge-points lie. Here, we propose ...
Video Shot Characterization Using Principles of Perceptual Prominence and Perceptual Grouping in Spatio–Temporal Domain

We present a novel approach for applying perceptual grouping principles to the spatio-temporal domain of video. Our perceptual grouping scheme, applied on blobs, makes use of a specified spatio-temporal coherence model. The grouping scheme identifies ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2009

2426 pages

ISBN:9781605582467

DOI:10.1145/1518701

General Chairs:
Dan R. Olsen
Brigham Young University
,
Richard B. Arthur
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
1,124
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)2

Reflects downloads up to 27 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhu JHuang DWang CCheng MLi JHu HGeng XGuo B(2024)Unsupervised Graphic Layout Grouping with Transformers2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00107(1020-1029)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00107
Wang CMiniukovich ARen X(2024)An interpretable metric of visual aesthetics for GUI designBehaviour & Information Technology10.1080/0144929X.2024.2325030(1-15)Online publication date: 29-Feb-2024
https://doi.org/10.1080/0144929X.2024.2325030
Deng DCui WMeng XXu MLiao YZhang HWu Y(2023)Revisiting the Design Patterns of Composite VisualizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.321356529:12(5406-5421)Online publication date: Dec-2023
https://doi.org/10.1109/TVCG.2022.3213565
Shi DCui WHuang DZhang HCao N(2023)Reverse-engineering information presentations: recovering hierarchical grouping from layouts of visual elementsVisual Intelligence10.1007/s44267-023-00010-11:1Online publication date: 15-Jun-2023
https://doi.org/10.1007/s44267-023-00010-1
Wu XBeer J(2021)Usability Evaluation of Telepresence Interfaces for Older AdultsProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118132165117265:1(591-595)Online publication date: 12-Nov-2021
https://doi.org/10.1177/1071181321651172
Peng PYang KLi Y(2021)A computational model for gestalt proximity principle on dot patterns and beyondJournal of Vision10.1167/jov.21.5.2321:5(23)Online publication date: 20-May-2021
https://doi.org/10.1167/jov.21.5.23
Peters BKriegeskorte N(2021)Capturing the objects of vision with neural networksNature Human Behaviour10.1038/s41562-021-01194-65:9(1127-1144)Online publication date: 20-Sep-2021
https://doi.org/10.1038/s41562-021-01194-6
Wu XNix LBrummett AAguillon COltman DBeer J(2021)The design, development, and evaluation of telepresence interfaces for aging adultsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2021.102695156:COnline publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1016/j.ijhcs.2021.102695
Sibrel SRathore RLessard LSchloss K(2020)The relation between color and spatial structure for interpreting colormap data visualizationsJournal of Vision10.1167/jov.20.12.720:12(7)Online publication date: 17-Nov-2020
https://doi.org/10.1167/jov.20.12.7
Goh DTan ALee JBoll SEbrahimi TGurrin CJain RJalali LMeyer JO'Connor N(2017)Gamification of Heel Raise Plantarflexion PhysiotherapyProceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care10.1145/3132635.3132638(35-43)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3132635.3132638
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents