Showing 1–7 of 7 results for author: Pereira, F

Reliability and predictability of phenotype information from functional connectivity in large imaging datasets

Authors: Jessica Dafflon, Dustin Moraczewski, Eric Earl, Dylan M. Nielson, Gabriel Loewinger, Patrick McClure, Adam G. Thomas, Francisco Pereira

Abstract: One of the central objectives of contemporary neuroimaging research is to create predictive models that can disentangle the connection between patterns of functional connectivity across the entire brain and various behavioral traits. Previous studies have shown that models trained to predict behavioral features from the individual's functional connectivity have modest to poor performance. In this… ▽ More One of the central objectives of contemporary neuroimaging research is to create predictive models that can disentangle the connection between patterns of functional connectivity across the entire brain and various behavioral traits. Previous studies have shown that models trained to predict behavioral features from the individual's functional connectivity have modest to poor performance. In this study, we trained models that predict observable individual traits (phenotypes) and their corresponding singular value decomposition (SVD) representations - herein referred to as latent phenotypes from resting state functional connectivity. For this task, we predicted phenotypes in two large neuroimaging datasets: the Human Connectome Project (HCP) and the Philadelphia Neurodevelopmental Cohort (PNC). We illustrate the importance of regressing out confounds, which could significantly influence phenotype prediction. Our findings reveal that both phenotypes and their corresponding latent phenotypes yield similar predictive performance. Interestingly, only the first five latent phenotypes were reliably identified, and using just these reliable phenotypes for predicting phenotypes yielded a similar performance to using all latent phenotypes. This suggests that the predictable information is present in the first latent phenotypes, allowing the remainder to be filtered out without any harm in performance. This study sheds light on the intricate relationship between functional connectivity and the predictability and reliability of phenotypic information, with potential implications for enhancing predictive modeling in the realm of neuroimaging research. △ Less

Submitted 30 April, 2024; originally announced May 2024.

Mid-Infrared Photothermal-Fluorescence in Situ Hybridization for Functional Analysis and Genetic Identification of Single Cells

Authors: Yeran Bai, Zhongyue Guo, Fátima C. Pereira, Michael Wagner, Ji-Xin Cheng

Abstract: Simultaneous identification and metabolic analysis of microbes with single-cell resolution and high throughput is necessary to answer the question of "who eats what, when, and where" in complex microbial communities. Here, we present a mid-infrared photothermal-fluorescence in situ hybridization (MIP-FISH) platform that enables direct bridging of genotype and phenotype. Through multiple improvemen… ▽ More Simultaneous identification and metabolic analysis of microbes with single-cell resolution and high throughput is necessary to answer the question of "who eats what, when, and where" in complex microbial communities. Here, we present a mid-infrared photothermal-fluorescence in situ hybridization (MIP-FISH) platform that enables direct bridging of genotype and phenotype. Through multiple improvements of MIP imaging, the sensitive detection of isotopically-labelled compounds incorporated into proteins of individual bacterial cells became possible, while simultaneous detection of FISH labelling with rRNA-targeted probes enabled the identification of the analyzed cells. In proof-of-concept experiments, we showed that the clear spectral red shift in the protein amide I region due to incorporation of $^{13}$C atoms originating from $^{13}$C-labelled-glucose can be exploited by MIP-FISH to discriminate and identify $^{13}$C-labelled bacterial cells within a complex human gut microbiome sample. The presented methods open new opportunities for single-cell structure-function analyses for microbiology. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Brazilian COVID-19 data streaming

Authors: Nívea B. da Silva, Luis Iván O. Valencia, Fábio M. H. S. Filho, Andressa C. S. Ferreira, Felipe A. C. Pereira, Guilherme L. de Oliveira, Paloma F. Oliveira, Moreno S. Rodrigues, Pablo I. P. Ramos, Juliane F. Oliveira

Abstract: We collected individualized (unidentifiable) and aggregated openly available data from various sources related to suspected/confirmed SARS-CoV-2 infections, vaccinations, non-pharmaceutical government interventions, human mobility, and levels of population inequality in Brazil. In addition, a data structure allowing real-time data collection, curation, integration, and extract-transform-load proce… ▽ More We collected individualized (unidentifiable) and aggregated openly available data from various sources related to suspected/confirmed SARS-CoV-2 infections, vaccinations, non-pharmaceutical government interventions, human mobility, and levels of population inequality in Brazil. In addition, a data structure allowing real-time data collection, curation, integration, and extract-transform-load processes for different objectives was developed. The granularity of this dataset (state- and municipality-wide) enables its application to individualized and ecological epidemiological studies, statistical, mathematical, and computational modeling, data visualization as well as the scientific dissemination of information on the COVID-19 pandemic in Brazil. △ Less

Submitted 10 May, 2022; originally announced May 2022.

Comments: 12 pages, 6 figures, 2 tables

Mental representations of objects reflect the ways in which we interact with them

Authors: Ka Chun Lam, Francisco Pereira, Maryam Vaziri-Pashkam, Kristin Woodard, Emalie McMahon

Abstract: In order to interact with objects in our environment, humans rely on an understanding of the actions that can be performed on them, as well as their properties. When considering concrete motor actions, this knowledge has been called the object affordance. Can this notion be generalized to any type of interaction that one can have with an object? In this paper we introduce a method to represent obj… ▽ More In order to interact with objects in our environment, humans rely on an understanding of the actions that can be performed on them, as well as their properties. When considering concrete motor actions, this knowledge has been called the object affordance. Can this notion be generalized to any type of interaction that one can have with an object? In this paper we introduce a method to represent objects in a space where each dimension corresponds to a broad mode of interaction, based on verb selectional preferences in text corpora. This object embedding makes it possible to predict human judgments of verb applicability to objects better than a variety of alternative approaches. Furthermore, we show that the dimensions in this space can be used to predict categorical and functional dimensions in a state-of-the-art mental representation of objects, derived solely from human judgements of object similarity. These results suggest that interaction knowledge accounts for a large part of mental representations of objects. △ Less

Submitted 11 May, 2021; v1 submitted 22 June, 2020; originally announced July 2020.

Comments: 17 pages, 13 figures, 6 tables

MSC Class: 68U15 ACM Class: J.4; I.5.4; I.2.7

Improving the Interpretability of fMRI Decoding using Deep Neural Networks and Adversarial Robustness

Authors: Patrick McClure, Dustin Moraczewski, Ka Chun Lam, Adam Thomas, Francisco Pereira

Abstract: Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what input information is used by the DNN in the process, something important in both cognitive neuroscience and clinical applications. A saliency map is a common approa… ▽ More Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what input information is used by the DNN in the process, something important in both cognitive neuroscience and clinical applications. A saliency map is a common approach for producing interpretable visualizations of the relative importance of input features for a prediction. However, methods for creating maps often fail due to DNNs being sensitive to input noise, or by focusing too much on the input and too little on the model. It is also challenging to evaluate how well saliency maps correspond to the truly relevant input information, as ground truth is not always available. In this paper, we review a variety of methods for producing gradient-based saliency maps, and present a new adversarial training method we developed to make DNNs robust to input noise, with the goal of improving interpretability. We introduce two quantitative evaluation procedures for saliency map methods in fMRI, applicable whenever a DNN or linear model is being trained to decode some information from imaging data. We evaluate the procedures using a synthetic dataset where the complex activation structure is known, and on saliency maps produced for DNN and linear models for task decoding in the Human Connectome Project (HCP) dataset. Our key finding is that saliency maps produced with different methods vary widely in interpretability, in both in synthetic and HCP fMRI data. Strikingly, even when DNN and linear models decode at comparable levels of performance, DNN saliency maps score higher on interpretability than linear model saliency maps (derived via weights or gradient). Finally, saliency maps produced with our adversarial training method outperform those from other methods. △ Less

Submitted 17 December, 2020; v1 submitted 23 April, 2020; originally announced April 2020.

Revealing interpretable object representations from human behavior

Authors: Charles Y. Zheng, Francisco Pereira, Chris I. Baker, Martin N. Hebart

Abstract: To study how mental object representations are related to behavior, we estimated sparse, non-negative representations of objects using human behavioral judgments on images representative of 1,854 object categories. These representations predicted a latent similarity structure between objects, which captured most of the explainable variance in human behavioral judgments. Individual dimensions in th… ▽ More To study how mental object representations are related to behavior, we estimated sparse, non-negative representations of objects using human behavioral judgments on images representative of 1,854 object categories. These representations predicted a latent similarity structure between objects, which captured most of the explainable variance in human behavioral judgments. Individual dimensions in the low-dimensional embedding were found to be highly reproducible and interpretable as conveying degrees of taxonomic membership, functionality, and perceptual attributes. We further demonstrated the predictive power of the embeddings for explaining other forms of human behavior, including categorization, typicality judgments, and feature ratings, suggesting that the dimensions reflect human conceptual representations of objects beyond the specific task. △ Less

Submitted 9 January, 2019; originally announced January 2019.

Comments: Accepted in ICLR 2019

Can Complex Collective Behaviour Be Generated Through Randomness, Memory and a Pinch of Luck?

Authors: Pedro M. F. Pereira

Abstract: Machine Learning techniques have been used to teach computer programs how to play games as complicated as Chess and Go. These were achieved using powerful tools such as Neural Networks and Parallel Computing on Supercomputers. In this paper, we define a model of populational growth and evolution based on the idea of Reinforcement Learning, but using only the 3 sources stated in the title processed… ▽ More Machine Learning techniques have been used to teach computer programs how to play games as complicated as Chess and Go. These were achieved using powerful tools such as Neural Networks and Parallel Computing on Supercomputers. In this paper, we define a model of populational growth and evolution based on the idea of Reinforcement Learning, but using only the 3 sources stated in the title processed on a low-tier laptop. The model correctly predicts the development of a population around food sources and their migration in search of a new one when the known ones become saturated. Additionally, we compared our model to a pure random one and the population number was fitted to a logistic function for two interesting evolutions of the system. △ Less

Submitted 29 November, 2017; originally announced November 2017.