-
On the contrast-dependence of crowding
Authors:
A Rodriguez,
R Granger
Abstract:
Visual clutter affects our ability to see: objects that would be identifiable on their own, may become unrecognizable when presented close together ("crowding") -- but the psychophysical characteristics of crowding have resisted simplification. Image properties initially thought to produce crowding have paradoxically yielded unexpected results, e.g., adding flanking objects can ameliorate crowding…
▽ More
Visual clutter affects our ability to see: objects that would be identifiable on their own, may become unrecognizable when presented close together ("crowding") -- but the psychophysical characteristics of crowding have resisted simplification. Image properties initially thought to produce crowding have paradoxically yielded unexpected results, e.g., adding flanking objects can ameliorate crowding (Manassi, Sayim et al., 2012; Herzog, Sayim et al., 2015; Pachai, Doerig et al., 2016). The resulting theory revisions have been sufficiently complex and specialized as to make it difficult to discern what principles may underlie the observed phenomena. A generalized formulation of simple visual contrast energy is presented, arising from straightforward analyses of center and surround neurons in the early visual stream. Extant contrast measures, such as RMS contrast, are easily shown to fall out as reduced special cases. The new generalized contrast energy metric surprisingly predicts the principal findings of a broad range of crowding studies. These early crowding phenomena may thus be said to arise predominantly from contrast, or are, at least, severely confounded by contrast effects. (These findings may be distinct from accounts of other, likely downstream, "configural" or "semantic" instances of crowding, suggesting at least two separate forms of crowding that may resist unification.) The new fundamental contrast energy formulation provides a candidate explanatory framework that addresses multiple psychophysical phenomena beyond crowding.
△ Less
Submitted 4 December, 2020;
originally announced December 2020.
-
Towards a perceptual distance metric for auditory stimuli
Authors:
Sarah Oh,
Elijah FW Bowen,
Antonio Rodriguez,
Damian Sowinski,
Eva Childers,
Annemarie Brown,
Laura Ray,
Richard Granger
Abstract:
Although perceptual (dis)similarity between sensory stimuli seems akin to distance, measuring the Euclidean distance between vector representations of auditory stimuli is a poor estimator of subjective dissimilarity. In hearing, nonlinear response patterns, interactions between stimulus components, temporal effects, and top-down modulation transform the information contained in incoming frequency-…
▽ More
Although perceptual (dis)similarity between sensory stimuli seems akin to distance, measuring the Euclidean distance between vector representations of auditory stimuli is a poor estimator of subjective dissimilarity. In hearing, nonlinear response patterns, interactions between stimulus components, temporal effects, and top-down modulation transform the information contained in incoming frequency-domain stimuli in a way that seems to preserve some notion of distance, but not that of familiar Euclidean space. This work proposes that transformations applied to auditory stimuli during hearing can be modeled as a function mapping stimulus points to their representations in a perceptual space, inducing a Riemannian distance metric. A dataset was collected in a subjective listening experiment, the results of which were used to explore approaches (biologically inspired, data-driven, and combinations thereof) to approximating the perceptual map. Each of the proposed measures achieved comparable or stronger correlations with subjective ratings (r ~ 0.8) compared to state-of-the-art audio quality measures.
△ Less
Submitted 30 October, 2020;
originally announced November 2020.
-
Visual stream connectivity predicts assessments of image quality
Authors:
Elijah Bowen,
Antonio Rodriguez,
Damian Sowinski,
Richard Granger
Abstract:
Some biological mechanisms of early vision are comparatively well understood, but they have yet to be evaluated for their ability to accurately predict and explain human judgments of image similarity. From well-studied simple connectivity patterns in early vision, we derive a novel formalization of the psychophysics of similarity, showing the differential geometry that provides accurate and explan…
▽ More
Some biological mechanisms of early vision are comparatively well understood, but they have yet to be evaluated for their ability to accurately predict and explain human judgments of image similarity. From well-studied simple connectivity patterns in early vision, we derive a novel formalization of the psychophysics of similarity, showing the differential geometry that provides accurate and explanatory accounts of perceptual similarity judgments. These predictions then are further improved via simple regression on human behavioral reports, which in turn are used to construct more elaborate hypothesized neural connectivity patterns. Both approaches outperform standard successful measures of perceived image fidelity from the literature, as well as providing explanatory principles of similarity perception.
△ Less
Submitted 16 August, 2020;
originally announced August 2020.
-
Toward the quantification of cognition
Authors:
Richard Granger
Abstract:
The machinery of the human brain -- analog, probabilistic, embodied -- can be characterized computationally, but what machinery confers what computational powers? Any such system can be abstractly cast in terms of two computational components: a finite state machine carrying out computational steps, whether via currents, chemistry, or mechanics; plus a set of allowable memory operations, typically…
▽ More
The machinery of the human brain -- analog, probabilistic, embodied -- can be characterized computationally, but what machinery confers what computational powers? Any such system can be abstractly cast in terms of two computational components: a finite state machine carrying out computational steps, whether via currents, chemistry, or mechanics; plus a set of allowable memory operations, typically formulated in terms of an information store that can be read from and written to, whether via synaptic change, state transition, or recurrent activity. Probing these mechanisms for their information content, we can capture the difference in computational power that various systems are capable of. Most human cognitive abilities, from perception to action to memory, are shared with other species; we seek to characterize those (few) capabilities that are ubiquitously present among humans and absent from other species. Three realms of formidable constraints -- a) measurable human cognitive abilities, b) measurable allometric anatomic brain characteristics, and c) measurable features of specific automata and formal grammars -- illustrate remarkably sharp restrictions on human abilities, unexpectedly confining human cognition to a specific class of automata ("nested stack"), which are markedly below Turing machines.
△ Less
Submitted 12 August, 2020;
originally announced August 2020.
-
The differential geometry of perceptual similarity
Authors:
Antonio M Rodriguez,
Richard Granger
Abstract:
Human similarity judgments are inconsistent with Euclidean, Hamming, Mahalanobis, and the majority of measures used in the extensive literatures on similarity and dissimilarity. From intrinsic properties of brain circuitry, we derive principles of perceptual metrics, showing their conformance to Riemannian geometry. As a demonstration of their utility, the perceptual metrics are shown to outperfor…
▽ More
Human similarity judgments are inconsistent with Euclidean, Hamming, Mahalanobis, and the majority of measures used in the extensive literatures on similarity and dissimilarity. From intrinsic properties of brain circuitry, we derive principles of perceptual metrics, showing their conformance to Riemannian geometry. As a demonstration of their utility, the perceptual metrics are shown to outperform JPEG compression. Unlike machine-learning approaches, the outperformance uses no statistics, and no learning. Beyond the incidental application to compression, the metrics offer broad explanatory accounts of empirical perceptual findings such as Tverskys triangle inequality violations, contradictory human judgments of identical stimuli such as speech sounds, and a broad range of other phenomena on percepts and concepts that may initially appear unrelated. The findings constitute a set of fundamental principles underlying perceptual similarity.
△ Less
Submitted 25 September, 2017; v1 submitted 31 July, 2017;
originally announced August 2017.
-
Derivation of a novel efficient supervised learning algorithm from cortical-subcortical loops
Authors:
Ashok Chandrashekar,
Richard Granger
Abstract:
Although brain circuits presumably carry out useful perceptual algorithms, few instances of derived biological methods have been found to compete favorably against algorithms that have been engineered for specific applications. We forward a novel analysis of function of cortico-striatal loops, which constitute more than 80% of the human brain, thus likely underlying a broad range of cognitive func…
▽ More
Although brain circuits presumably carry out useful perceptual algorithms, few instances of derived biological methods have been found to compete favorably against algorithms that have been engineered for specific applications. We forward a novel analysis of function of cortico-striatal loops, which constitute more than 80% of the human brain, thus likely underlying a broad range of cognitive functions. We describe a family of operations performed by the derived method, including a nonstandard method for supervised classification, which may underlie some forms of cortically-dependent associative learning. The novel supervised classifier is compared against widely-used algorithms for classification, including support vector machines (SVM) and k-nearest neighbor methods, achieving corresponding classification rates --- at a fraction of the time and space costs. This represents an instance of a biologically-derived algorithm comparing favorably against widely used machine learning methods on well-studied tasks.
△ Less
Submitted 28 April, 2017;
originally announced May 2017.
-
How brains are built: Principles of computational neuroscience
Authors:
Richard Granger
Abstract:
'If I cannot build it, I do not understand it.' So said Nobel laureate Richard Feynman, and by his metric, we understand a bit about physics, less about chemistry, and almost nothing about biology.
When we fully understand a phenomenon, we can specify its entire sequence of events, causes, and effects so completely that it is possible to fully simulate it, with all its internal mechanisms intact…
▽ More
'If I cannot build it, I do not understand it.' So said Nobel laureate Richard Feynman, and by his metric, we understand a bit about physics, less about chemistry, and almost nothing about biology.
When we fully understand a phenomenon, we can specify its entire sequence of events, causes, and effects so completely that it is possible to fully simulate it, with all its internal mechanisms intact. Achieving that level of understanding is rare. It is commensurate with constructing a full design for a machine that could serve as a stand-in for the thing being studied. To understand a phenomenon sufficiently to fully simulate it is to understand it computationally.
'Computation' does not refer to computers per se. Rather, it refers to the underlying principles and methods that make them work. As Turing Award recipient Edsger Dijkstra said, computational science 'is no more about computers than astronomy is about telescopes.' Computational science is the study of the hidden rules underlying complex phenomena from physics to psychology.
Computational neuroscience, then, has the aim of understanding brains sufficiently well to be able to simulate their functions, thereby subsuming the twin goals of science and engineering: deeply understanding the inner workings of our brains, and being able to construct simulacra of them. As simple robots today substitute for human physical abilities, in settings from factories to hospitals, so brain engineering will construct stand-ins for our mental abilities, and possibly even enable us to fix our brains when they break.
△ Less
Submitted 28 March, 2017;
originally announced April 2017.
-
The grammar of mammalian brain capacity
Authors:
A Rodriguez,
R Granger
Abstract:
Uniquely human abilities may arise from special-purpose brain circuitry, or from concerted general capacity increases due to our outsized brains. We forward a novel hypothesis of the relation between computational capacity and brain size, linking mathematical formalisms of grammars with the allometric increases in cortical-subcortical ratios that arise in large brains. In sum, i) thalamocortical l…
▽ More
Uniquely human abilities may arise from special-purpose brain circuitry, or from concerted general capacity increases due to our outsized brains. We forward a novel hypothesis of the relation between computational capacity and brain size, linking mathematical formalisms of grammars with the allometric increases in cortical-subcortical ratios that arise in large brains. In sum, i) thalamocortical loops compute formal grammars; ii) successive cortical regions describe grammar rewrite rules of increasing size; iii) cortical-subcortical ratios determine the quantity of stacks in single-stack pushdown grammars; iii) quantitative increase of stacks yields grammars with qualitatively increased computational power. We arrive at the specific conjecture that human brain capacity is equivalent to that of indexed grammars, far short of full Turing-computable (recursively enumerable) systems. The work provides a candidate explanatory account of a range of existing human and animal data, addressing longstanding questions of how repeated similar brain algorithms can be successfully applied to apparently dissimilar computational tasks (e.g., perceptual versus cognitive, phonological versus syntactic); and how quantitative increases to brains can confer qualitative changes to their computational repertoire.
△ Less
Submitted 4 December, 2016;
originally announced December 2016.
