-
Comparing fine-grained and coarse-grained object detection for ecology
Authors:
Jess Tam,
Justin Kay
Abstract:
Computer vision applications are increasingly popular for wildlife monitoring tasks. While some studies focus on the monitoring of a single species, such as a particular endangered species, others monitor larger functional groups, such as predators. In our study, we used camera trap images collected in north-western New South Wales, Australia, to investigate how model results were affected by comb…
▽ More
Computer vision applications are increasingly popular for wildlife monitoring tasks. While some studies focus on the monitoring of a single species, such as a particular endangered species, others monitor larger functional groups, such as predators. In our study, we used camera trap images collected in north-western New South Wales, Australia, to investigate how model results were affected by combining multiple species in single classes, and whether the addition of negative samples can improve model performance. We found that species that benefited the most from merging into a single class were mainly species that look alike morphologically, i.e. macropods. Whereas species that looked distinctively different gave mixed results when merged, e.g. merging pigs and goats together as non-native large mammals. We also found that adding negative samples improved model performance marginally in most instances, and recommend conducting a more comprehensive study to explore whether the marginal gains were random or consistent. We suggest that practitioners could classify morphologically similar species together as a functional group or higher taxonomic group to draw ecological inferences. Nevertheless, whether to merge classes or not will depend on the ecological question to be explored.
△ Less
Submitted 6 May, 2024;
originally announced July 2024.
-
A comparison of partial information decompositions using data from real and simulated layer 5b pyramidal cells
Authors:
Jim W. Kay,
Jan M. Schulz,
W. A. Phillips
Abstract:
Partial information decomposition allows the joint mutual information between an output and a set of inputs to be divided into components that are synergistic or shared or unique to each input. We consider five different decompositions and compare their results on data from layer 5b pyramidal cells in two different studies. The first study was of the amplification of somatic action potential outpu…
▽ More
Partial information decomposition allows the joint mutual information between an output and a set of inputs to be divided into components that are synergistic or shared or unique to each input. We consider five different decompositions and compare their results on data from layer 5b pyramidal cells in two different studies. The first study was of the amplification of somatic action potential output by apical dendritic input and its regulation by dendritic inhibition. We find that two of the decompositions produce much larger estimates of synergy and shared information than the others, as well as large levels of unique misinformation. When within-neuron differences in the components are examined, the five methods produce more similar results for all but the shared information component, for which two methods produce a different statistical conclusion from the others. There are some differences in the expression of unique information asymmetry among the methods. It is significantly larger, on average, under dendritic inhibition. Three of the methods support a previous conclusion that apical amplification is reduced by dendritic inhibition. The second study used a detailed compartmental model to produce action potentials for many combinations of the numbers of basal and apical synaptic inputs. Two analyses of decompositions are conducted on subsets of the data. In the first, the decompositions reveal a bifurcation in unique information asymmetry. For three of the methods this suggests that apical drive switches to basal drive as the strength of the basal input increases, while the other two show changing mixtures of information and misinformation. Decompositions produced using the second set of subsets show that all five decompositions provide support for properties of cooperative context-sensitivity - to varying extents.
△ Less
Submitted 13 June, 2022;
originally announced June 2022.
-
StimDust: A mm-scale implantable wireless precision neural stimulator with ultrasonic power and communication
Authors:
David K. Piech,
Benjamin C. Johnson,
Konlin Shen,
M. Meraj Ghanbari,
Ka Yiu Li,
Ryan M. Neely,
Joshua E. Kay,
Jose M. Carmena,
Michel M. Maharbiz,
Rikky Muller
Abstract:
Neural stimulation is a powerful technique for modulating physiological functions and for writing information into the nervous system as part of brain-machine interfaces. Current clinically approved neural stimulators require batteries and are many cubic centimetres in size -- typically much larger than their intended targets. We present a complete wireless neural stimulation system consisting of…
▽ More
Neural stimulation is a powerful technique for modulating physiological functions and for writing information into the nervous system as part of brain-machine interfaces. Current clinically approved neural stimulators require batteries and are many cubic centimetres in size -- typically much larger than their intended targets. We present a complete wireless neural stimulation system consisting of a 1.7 mm3 wireless, batteryless, leadless implantable stimulator (the "mote"), an ultrasonic wireless link for power and bi-directional communication, and a hand-held external transceiver. The mote consists of a piezoceramic transducer, an energy storage capacitor, and a stimulator integrated circuit (IC). The IC harvests ultrasonic power with high efficiency, decodes stimulation parameter downlink data, and generates current-controlled stimulation pulses. Stimulation parameters are time-encoded on the fly through the wireless link rather than being programmed and stored on the mote, reducing power consumption and on-chip memory requirements and enabling complex stimulation protocols with high-temporal resolution and low-latency feedback for use in closed-loop stimulation. Uplink data indicates whether the mote is currently stimulating; it is encoded by the mote via backscatter modulation and is demodulated at the external transceiver. We show that the mote operates at an acoustic intensity that is 7.8% of the FDA limit for diagnostic ultrasound and characterize the acoustic wireless link's robustness to expected real-world misalignment. We demonstrate the in vivo performance of the system with motes acutely implanted with a cuff on the sciatic nerve of anesthetized rats and show highly repeatable stimulation across a wide range of physiological responses.
△ Less
Submitted 14 February, 2020; v1 submitted 19 July, 2018;
originally announced July 2018.
-
Contrasting information theoretic decompositions of modulatory and arithmetic interactions in neural information processing systems
Authors:
Jim W. Kay,
William A. Phillips
Abstract:
Biological and artificial neural systems are composed of many local processors, and their capabilities depend upon the transfer function that relates each local processor's outputs to its inputs. This paper uses a recent advance in the foundations of information theory to study the properties of local processors that use contextual input to amplify or attenuate transmission of information about th…
▽ More
Biological and artificial neural systems are composed of many local processors, and their capabilities depend upon the transfer function that relates each local processor's outputs to its inputs. This paper uses a recent advance in the foundations of information theory to study the properties of local processors that use contextual input to amplify or attenuate transmission of information about their driving inputs. This advance enables the information transmitted by processors with two distinct inputs to be decomposed into those components unique to each input, that shared between the two inputs, and that which depends on both though it is in neither, i.e. synergy. The decompositions that we report here show that contextual modulation has information processing properties that contrast with those of all four simple arithmetic operators, that it can take various forms, and that the form used in our previous studies of artificial neural nets composed of local processors with both driving and contextual inputs is particularly well-suited to provide the distinctive capabilities of contextual modulation under a wide range of conditions. We argue that the decompositions reported here could be compared with those obtained from empirical neurobiological and psychophysical data under conditions thought to reflect contextual modulation. That would then shed new light on the underlying processes involved. Finally, we suggest that such decompositions could aid the design of context-sensitive machine learning algorithms.
△ Less
Submitted 15 March, 2018;
originally announced March 2018.
-
Exact partial information decompositions for Gaussian systems based on dependency constraints
Authors:
James W. Kay,
Robin A. A. Ince
Abstract:
The Partial Information Decomposition (PID) [arXiv:1004.2515] provides a theoretical framework to characterize and quantify the structure of multivariate information sharing. A new method (Idep) has recently been proposed for computing a two-predictor PID over discrete spaces. [arXiv:1709.06653] A lattice of maximum entropy probability models is constructed based on marginal dependency constraints…
▽ More
The Partial Information Decomposition (PID) [arXiv:1004.2515] provides a theoretical framework to characterize and quantify the structure of multivariate information sharing. A new method (Idep) has recently been proposed for computing a two-predictor PID over discrete spaces. [arXiv:1709.06653] A lattice of maximum entropy probability models is constructed based on marginal dependency constraints, and the unique information that a particular predictor has about the target is defined as the minimum increase in joint predictor-target mutual information when that particular predictor-target marginal dependency is constrained. Here, we apply the Idep approach to Gaussian systems, for which the marginally constrained maximum entropy models are Gaussian graphical models. Closed form solutions for the Idep PID are derived for both univariate and multivariate Gaussian systems. Numerical and graphical illustrations are provided, together with practical and theoretical comparisons of the Idep PID with the minimum mutual information PID (Immi). [arXiv:1411.2832] In particular, it is proved that the Immi method generally produces larger estimates of redundancy and synergy than does the Idep method. In discussion of the practical examples, the PIDs are complemented by the use of deviance tests for the comparison of Gaussian graphical models.
△ Less
Submitted 6 March, 2018;
originally announced March 2018.
-
Partial Information Decomposition as a Unified Approach to the Specification of Neural Goal Functions
Authors:
Michael Wibral,
Viola Priesemann,
Jim W. Kay,
Joseph T. Lizier,
William A. Phillips
Abstract:
In many neural systems anatomical motifs are present repeatedly, but despite their structural similarity they can serve very different tasks. A prime example for such a motif is the canonical microcircuit of six-layered neo-cortex, which is repeated across cortical areas, and is involved in a number of different tasks (e.g.sensory, cognitive, or motor tasks). This observation has spawned interest…
▽ More
In many neural systems anatomical motifs are present repeatedly, but despite their structural similarity they can serve very different tasks. A prime example for such a motif is the canonical microcircuit of six-layered neo-cortex, which is repeated across cortical areas, and is involved in a number of different tasks (e.g.sensory, cognitive, or motor tasks). This observation has spawned interest in finding a common underlying principle, a 'goal function', of information processing implemented in this structure. By definition such a goal function, if universal, cannot be cast in processing-domain specific language (e.g. 'edge filtering', 'working memory'). Thus, to formulate such a principle, we have to use a domain-independent framework. Information theory offers such a framework. However, while the classical framework of information theory focuses on the relation between one input and one output (Shannon's mutual information), we argue that neural information processing crucially depends on the combination of \textit{multiple} inputs to create the output of a processor. To account for this, we use a very recent extension of Shannon Information theory, called partial information decomposition (PID). PID allows to quantify the information that several inputs provide individually (unique information), redundantly (shared information) or only jointly (synergistic information) about the output. First, we review the framework of PID. Then we apply it to reevaluate and analyze several earlier proposals of information theoretic neural goal functions (predictive coding, infomax, coherent infomax, efficient coding). We find that PID allows to compare these goal functions in a common framework, and also provides a versatile approach to design new goal functions from first principles. Building on this, we design and analyze a novel goal function, called 'coding with synergy'. [...]
△ Less
Submitted 3 October, 2015;
originally announced October 2015.
-
Memory and self-induced shocks in an evolutionary population competing for limited resources
Authors:
Roland Kay,
Neil F. Johnson
Abstract:
We present a detailed discussion of the role played by memory, and the nature of self-induced shocks, in an evolutionary population competing for limited resources. Our study builds on a previously introduced multi-agent system [Phys. Rev. Lett 82, 3360 (1999)] which has attracted significant attention in the literature. This system exhibits self-segregation of the population based on the `gene'…
▽ More
We present a detailed discussion of the role played by memory, and the nature of self-induced shocks, in an evolutionary population competing for limited resources. Our study builds on a previously introduced multi-agent system [Phys. Rev. Lett 82, 3360 (1999)] which has attracted significant attention in the literature. This system exhibits self-segregation of the population based on the `gene' value p (where 0<=p<=1), transitions to `frozen' populations as a function of the global resource level, and self-induced large changes which spontaneously arise as the dynamical system evolves. We find that the large, macroscopic self-induced shocks which arise, are controlled by microscopic changes within extreme subgroups of the population (i.e. subgroups with `gene' values p~0 and p~1).
△ Less
Submitted 21 December, 2003;
originally announced December 2003.
