research-article

Global Filter: Augmenting Images to Support Seeing the “Big Picture” for People with Local Interference

Authors:

LouAnne E. Boyd,

Jazette Johnson,

Franceli Cibrian,

Eliza Delpizzo-Cheng,

Gillian HayesAuthors Info & Claims

ACM Transactions on Computer-Human Interaction, Volume 30, Issue 3

Article No.: 45, Pages 1 - 28

https://doi.org/10.1145/3571812

Published: 10 June 2023 Publication History

Abstract

Some neurodivergent people prioritize visual details over the “big picture”. While excellent attention to detail has many advantages, some contexts require the rapid integration of global and local information. A local processing style can be so strong that local details interfere with the fluid integration of global information required for processing of information rapidly displayed on user interfaces. This disconnect between context of an interaction and processing style can be termed local interference. Personalization of visual stimuli can promote a more accessible computing experience. We describe how technological interventions can support shifting of visual attention from local to global features to make them more accessible. We present two empirical studies. One study with one autistic adult revealed a significant shift in eye gaze fixation, and the other study with 20 autistic children revealed filters that visually emphasize primary aspects encouraged more global comments about the image content.

References

[1]

M. Ahissar and S. Hochstein. 2004. The reverse hierarchy theory of visual perceptual learning. Trends in Cognitive Sciences 8, 10 (Oct. 2004), 457–464. DOI:

[2]

M. B. Almourad and E. Bataineh. 2020. Visual attention toward human face recognizing for autism spectrum disorder and normal developing children: An eye tracking study. In Proceedings of the 2020 6th International Conference on E-Business and Applications (New York, NY, USA, Feb. 2020), 99–104.

Digital Library

[3]

D. R. Badcock et al. 2005. Interactions between luminance and contrast signals in global form detection. Vision Research 45, 7 (Mar. 2005), 881–889. DOI:

[4]

M. Bar. 2004. Visual objects in context. Nature Reviews Neuroscience 5, 8 (Aug. 2004), 617–629. DOI:

[5]

S. Baron-Cohen et al. 2009. Talent in autism: Hyper-systemizing, hyper-attention to detail and sensory hypersensitivity. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1522 (May 2009), 1377–1383. DOI:

[6]

S. Baron-Cohen and M. V. Lombardo. 2017. Autism and talent: The cognitive and neural basis of systemizing. Dialogues in Clinical Neuroscience 19, 4 (Dec. 2017), 345–353. DOI:

[7]

C. Becchio et al. 2010. Perception of shadows in children with autism spectrum disorders. PLOS ONE 5, 5 (May 2010), e10582. DOI:

[8]

A. Benavoli et al. Should We Really Use Post-Hoc Tests Based on Mean-Ranks? 10.

[9]

L. Bouvet et al. 2011. Global precedence effect in audition and vision: Evidence for similar cognitive styles across modalities. Acta Psychologica 138, 2 (Oct. 2011), 329–335. DOI:

[10]

L. E. Boyd et al. 2017. Evaluating an iPad game to address overselectivity in preliterate AAC users with minimal verbal behavior. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, Oct. 2017), 240–249.

Digital Library

[11]

J. Christie et al. 2012. Global versus local processing: seeing the left side of the forest and the right side of the trees. Frontiers in Human Neuroscience 6, (Feb. 2012). DOI:

[12]

E. Courchesne and K. Pierce. 2005. Why the frontal cortex in autism might be talking only to itself: Local over-connectivity but long-distance disconnection. Current Opinion in Neurobiology 15, 2 (Apr. 2005), 225–230. DOI:

[13]

J. Davidoff et al. 2008. Local and global processing: Observations from a remote culture. Cognition 108, 3 (Sep. 2008), 702–709. DOI:

[14]

W. V. Dube and K. M. Wilkinson. 2014. The potential influence of “Stimulus Overselectivity” in AAC: Information from Eye-tracking and behavioral studies of attention. Augmentative and Alternative Communication (Baltimore, Md. : 1985) 30, 2 (Jun. 2014), 172–185. DOI:

[15]

S. Eraslan et al. 2021. “Keep it simple!”: An eye-tracking study for exploring complexity and distinguishability of web pages for people with autism. Universal Access in the Information Society 20, 1 (Mar. 2021), 69–84. DOI:

Digital Library

[16]

S. Eraslan et al. 2019. Web users with autism: Eye tracking evidence for differences. Behaviour & Information Technology 38, 7 (Jul. 2019), 678–700. DOI:

[17]

G. R. Fink et al. 1997. Neural mechanisms involved in the processing of global and local aspects of hierarchically organized visual stimuli. Brain 120, 10 (Oct. 1997), 1779–1791. DOI:

[18]

J. W. de Fockert and A. Cooper. 2014. Higher levels of depression are associated with reduced global bias in visual processing. Cognition and Emotion 28, 3 (Apr. 2014), 541–549. DOI:

[19]

N. E. V. Foster et al. 2016. Effects of age and attention on auditory global–local processing in children with autism spectrum disorder. Journal of Autism and Developmental Disorders 46, 4 (Apr. 2016), 1415–1428. DOI:

[20]

J. M. Foxton et al. 2003. Reading skills are related to global, but not local, acoustic pattern perception. Nature Neuroscience 6, (2003), 343–344.

[21]

S. Franceschini et al. 2017. A different vision of dyslexia: Local precedence on global perception. Scientific Reports 7, 1 (Dec. 2017), 17462. DOI:

[22]

J. B. Ganz et al. 2015. Impact of PECS tablet computer app on receptive identification of pictures given a verbal stimulus. Developmental Neurorehabilitation 18, 2 (Mar. 2015), 82–87. DOI:

[23]

B. A. Gargaro et al. 2018. Attentional mechanisms in autism, ADHD, and Autism-ADHD using a local–global paradigm. Journal of Attention Disorders 22, 14 (Dec. 2018), 1320–1332. DOI:

[24]

L. Graham. 2008. Gestalt theory in interactive media design. Journal of Humanitites and Social Science 2, 1 (2008).

[25]

Great jobs for detail-oriented people. Retrieved from https://www.monster.com/career-advice/article/detail-oriented-jobs-0916 Accessed: 2022-05-05.

[26]

T. F. Gross. 2005. Global–Local precedence in the perception of facial age and emotional expression by children with autism and other developmental disabilities. Journal of Autism and Developmental Disorders 35, 6 (Nov. 2005), 773. DOI:

[27]

Q. Guillon et al. 2014. Visual social attention in autism spectrum disorder: Insights from eye tracking studies. Neuroscience & Biobehavioral Reviews 42, (May 2014), 279–297. DOI:

[28]

R. Hübner and G. Volberg. 2005. The integration of object levels and their content: A theory of global/local processing and related hemispheric differences. Journal of Experimental Psychology: Human Perception and Performance 31, 3 (2005), 520–541. DOI:

[29]

H. C. Hughes et al. 1996. Global precedence, spatial frequency channels, and the statistics of natural images. Journal of Cognitive Neuroscience 8, 3 (Jul. 1996), 197–230. DOI:

Digital Library

[30]

H. C. Hughes et al. 1990. Global versus local processing in the absence of low spatial frequencies. Journal of Cognitive Neuroscience 2, 3 (Jul. 1990), 272–282. DOI:

Digital Library

[31]

K. K. Imbir. 2019. Does reading words differing in arousal load influence local vs. global scope of perception? Roczniki Psychologiczne 22, 3 (2019), 277–297. DOI:

[32]

T. Jolliffe and S. Baron-Cohen. 2000. Linguistic processing in high-functioning adults with autism or Asperger's syndrome. Is global coherence impaired? Psychological Medicine 30, 5 (Sep. 2000), 1169–1187. DOI:

[33]

E. Kalay et al. 2020. Authentic leadership outcomes in detail-oriented occupations: Commitment, role-stress, and intentions to leave. Journal of Management & Organization 26, 5 (Sep. 2020), 832–849. DOI:

[34]

D. A. Kaliukhovich et al. 2021. Visual preference for biological motion in children and adults with autism spectrum disorder: An eye-tracking study. Journal of Autism and Developmental Disorders 51, 7 (Jul. 2021), 2369–2380. DOI:

[35]

M. Katagiri et al. 2013. Individuals with asperger's disorder exhibit difficulty in switching attention from a local level to a global level. Journal of Autism and Developmental Disorders 43, 2 (Feb. 2013), 395–403. DOI:

[36]

K. Kihara and Y. Takeda. 2019. The role of low-spatial frequency components in the processing of deceptive faces: A study using artificial face models. Frontiers in Psychology 10, (2019), 1468. DOI:

[37]

A. Klin et al. 2002. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Archives of General Psychiatry 59, 9 (Sep. 2002), 809–816. DOI:

[38]

K. Koldewyn et al. 2013. Global/Local processing in autism: Not a disability, but a disinclination. Journal of Autism and Developmental Disorders 43, 10 (Oct. 2013), 2329–2340. DOI:

[39]

J. Light et al. 2019. Designing effective AAC displays for individuals with developmental or acquired disabilities: State of the science and future research directions. Augmentative and Alternative Communication, 35, 1 (2019), 42–55.

[40]

E. O. Lillie et al. 2011. The n-of-1 clinical trial: the ultimate strategy for individualizing medicine? Personalized Medicine 8, 2 (Mar. 2011), 161–173. DOI:

[41]

Y. Lu and H. Guo. 1999. Background removal in image indexing and retrieval. In Proceedings 10th International Conference on Image Analysis and Processing (Sep. 1999), 933–938.

[42]

K. Mack et al. 2021. What Do We Mean by “Accessibility Research”? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (New York, NY, May 2021), 1–18.

Digital Library

[43]

E. Milne and M. Szczerbinski. 2009. Global and local perceptual style, field-independence, and central coherence: An attempt at concept validation. Advances in Cognitive Psychology 5, (Apr. 2009), 1–26. DOI:

[44]

A. Muth et al. 2014. Visuo-Spatial performance in autism: A meta-analysis. Journal of Autism and Developmental Disorders 44, 12 (Dec. 2014), 3245–3263. DOI:

[45]

D. Navon. 1969. Forest before trees: The precedence of global features in visual perception. Perception and Psychophysics 5, (1969), 197–200.

[46]

D. Navon. 1981. The forest revisited: More on global precedence. Psychological Research 43, 1 (Jul. 1981), 1–32. DOI:

[47]

A. Oliva and P. G. Schyns. 1997. Coarse blobs or fine edges? Evidence that information diagnosticity changes the perception of complex visual stimuli. Cognitive Psychology 34, 1 (Oct. 1997), 72–107. DOI:

[48]

A. Oliva and A. Torralba. 2002. Scene-Centered description from spatial envelope properties. Biologically Motivated Computer Vision (Berlin, 2002), 263–272.

[49]

K. S. Papadopoulos and D. B. Goudiras. 2005. Accessibility assistance for visually-impaired people in digital texts. British Journal of Visual Impairment 23, 2 (May 2005), 75–83. DOI:

[50]

E. A. Papagiannopoulou et al. 2014. A systematic review and meta-analysis of eye-tracking studies in children with autism spectrum disorders. Social Neuroscience 9, 6 (Nov. 2014), 610–632. DOI:

[51]

F. H. Previc. 1990. Functional specialization in the lower and upper visual fields in humans: Its ecological origins and neurophysiological implications. Behavioral and Brain Sciences 13, 3 (Sep. 1990), 519–542. DOI:

[52]

G. Rance et al. 2014. The use of listening devices to ameliorate auditory deficit in children with autism. The Journal of Pediatrics 164, 2 (Feb. 2014), 352–357. DOI:

[53]

L. Rello and R. Baeza-Yates. 2016. The effect of font type on screen readability by people with dyslexia. ACM Transactions on Accessible Computing 8, 4 (May 2016), 1–33. DOI:

Digital Library

[54]

L. Rello and J. P. Bigham. 2017. Good background colors for readers: A study of people with and without dyslexia. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, 2017), 72–80.

Digital Library

[55]

N. J. Rinehart et al. 2000. Atypical interference of local detail on global processing in high- functioning autism and asperger's disorder. The Journal of Child Psychology and Psychiatry and Allied Disciplines 41, 6 (Sep. 2000), 769–778.

[56]

C. E. Robertson and S. Baron-Cohen. 2017. Sensory perception in autism. Nature Reviews Neuroscience 18, 11 (Nov. 2017), 671–684. DOI:

[57]

O. Rubinsten and A. Henik. 2006. Double dissociation of functions in developmental dyslexia and dyscalculia. Journal of Educational Psychology 98, 4 (2006), 854–867. DOI:

[58]

A. Shah and U. Frith. 1983. An islet of ability in autistic children: A research note. Journal of Child Psychology and Psychiatry 24, 4 (1983), 613–620. DOI:

[59]

D. J. Sheskin. 2003. Handbook of Parametric and Nonparametric Statistical Procedures: Third Edition Chapman and Hall/CRC.

[60]

D. Smith et al. 2015. Visual integration in autism. Frontiers in Human Neuroscience 9, (2015).

[61]

Y. Song and Y. Hakoda. 2015. Lack of global precedence and global-to-local interference without local processing deficit: A robust finding in children with attention-deficit/hyperactivity disorder under different visual angles of the Navon task. Neuropsychology 29, 6 (2015), 888–894. DOI:

[62]

G. Soroor et al. 2021. Priming global processing strategy improves the perceptual performance of children with autism spectrum disorders. Journal of Autism and Developmental Disorders (Apr. 2021). DOI:

[63]

R. A. Stevenson et al. 2018. Seeing the forest and the trees: Default local processing in individuals with high autistic traits does not come at the expense of global attention. Journal of Autism and Developmental Disorders 48, 4 (Apr. 2018), 1382–1396. DOI:

[64]

S. E. Taylor. 1991. Asymmetrical effects of positive and negative events: The mobilization-minimization hypothesis. Psychological Bulletin 110, 1 (1991), 67–85. DOI:

[65]

R. Van der Hallen et al. 2015. Global processing takes time: A meta-analysis on local–global visual processing in ASD. Psychological Bulletin 141, 3 (2015), 549.

[66]

S. Wang et al. 2015. Atypical visual saliency in autism spectrum disorder quantified through model-based eye tracking. Neuron 88, 3 (Nov. 2015), 604–616. DOI:

[67]

X. WANG. 2017. BEING SOCIAL IN ISOCIAL: A Case Study of Youth with Autism Spectrum Disorder Learning Social Competence in 3D Collaborative Virtual Learning Environment American Academic Press.

[68]

J. Xu et al. 2014. Predicting human gaze beyond pixels. Journal of Vision 14, 1 (Jan. 2014), 28–28. DOI:

[69]

V. Yaneva et al. 2015. Accessible texts for autism: An eye-tracking study. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS ’15 (Lisbon, Portugal, 2015), 49–57.

Digital Library

[70]

V. Yanulevskaya et al. 2013. A proto-object-based computational model for visual saliency. Journal of Vision 13, 13 (Nov. 2013), 27. DOI:

[71]

I. Yovel et al. 2005. Who sees trees before forest?: The obsessive-compulsive style of visual attention. Psychological Science 16, 2 (Feb. 2005), 123–129. DOI:

Cited By

Hong JLanglotz TSutton JRegenbrecht H(2024)Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision AugmentationsACM Transactions on Computer-Human Interaction10.1145/363469931:2(1-26)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3634699

Index Terms

Global Filter: Augmenting Images to Support Seeing the “Big Picture” for People with Local Interference
1. Human-centered computing
  1. Accessibility

Recommendations

Combining Eye Tracking and Verbal Response to Understand the Impact of a Global Filter
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Visual attention guides the integration of two streams: the global, that rapidly processes the scene; and the local, that processes details. For people with autism, the integration of these two streams can be disrupted by the tendency to privilege ...
Toward digital image processing and eye tracking to promote visual attention for people with autism
UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

Visual attention is guided by the integration of two streams: the global, that rapidly processes the scene, and the local, that processes details. For people with autism, the integration of these two streams can be disrupted by the tendency to privilege ...
vrSensory: Designing Inclusive Virtual Games with Neurodiverse Children
CHI PLAY '19 Extended Abstracts: Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts

We explore virtual environments and accompanying interaction styles to enable inclusive play. In designing games for three neurodiverse children, we explore how designing for sensory diversity can be understood through a formal game design framework. Our ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 30, Issue 3

June 2023

544 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/3604411

Editors:
Kristina Höök
KTH Royal Institute of Technology, Sweden
,
Kasper Hornbæk
University of Copenhagen, Denmark

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 June 2023

Online AM: 02 December 2022

Accepted: 21 October 2022

Revised: 17 May 2022

Received: 06 June 2021

Published in TOCHI Volume 30, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Chapman University Institutional Review Board
Microsoft Ada Lovelace fellowship for the Jazette Johnson

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
328
Total Downloads

Downloads (Last 12 months)186
Downloads (Last 6 weeks)11

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hong JLanglotz TSutton JRegenbrecht H(2024)Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision AugmentationsACM Transactions on Computer-Human Interaction10.1145/363469931:2(1-26)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3634699

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents