-
Highly Accurate Disease Diagnosis and Highly Reproducible Biomarker Identification with PathFormer
Authors:
Zehao Dong,
Qihang Zhao,
Philip R. O. Payne,
Michael A Province,
Carlos Cruchaga,
Muhan Zhang,
Tianyu Zhao,
Yixin Chen,
Fuhai Li
Abstract:
Biomarker identification is critical for precise disease diagnosis and understanding disease pathogenesis in omics data analysis, like using fold change and regression analysis. Graph neural networks (GNNs) have been the dominant deep learning model for analyzing graph-structured data. However, we found two major limitations of existing GNNs in omics data analysis, i.e., limited-prediction (diagno…
▽ More
Biomarker identification is critical for precise disease diagnosis and understanding disease pathogenesis in omics data analysis, like using fold change and regression analysis. Graph neural networks (GNNs) have been the dominant deep learning model for analyzing graph-structured data. However, we found two major limitations of existing GNNs in omics data analysis, i.e., limited-prediction (diagnosis) accuracy and limited-reproducible biomarker identification capacity across multiple datasets. The root of the challenges is the unique graph structure of biological signaling pathways, which consists of a large number of targets and intensive and complex signaling interactions among these targets. To resolve these two challenges, in this study, we presented a novel GNN model architecture, named PathFormer, which systematically integrate signaling network, priori knowledge and omics data to rank biomarkers and predict disease diagnosis. In the comparison results, PathFormer outperformed existing GNN models significantly in terms of highly accurate prediction capability ( 30% accuracy improvement in disease diagnosis compared with existing GNN models) and high reproducibility of biomarker ranking across different datasets. The improvement was confirmed using two independent Alzheimer's Disease (AD) and cancer transcriptomic datasets. The PathFormer model can be directly applied to other omics data analysis studies.
△ Less
Submitted 11 February, 2024;
originally announced February 2024.
-
An Explainable Geometric-Weighted Graph Attention Network for Identifying Functional Networks Associated with Gait Impairment
Authors:
Favour Nerrise,
Qingyu Zhao,
Kathleen L. Poston,
Kilian M. Pohl,
Ehsan Adeli
Abstract:
One of the hallmark symptoms of Parkinson's Disease (PD) is the progressive loss of postural reflexes, which eventually leads to gait difficulties and balance problems. Identifying disruptions in brain function associated with gait impairment could be crucial in better understanding PD motor progression, thus advancing the development of more effective and personalized therapeutics. In this work,…
▽ More
One of the hallmark symptoms of Parkinson's Disease (PD) is the progressive loss of postural reflexes, which eventually leads to gait difficulties and balance problems. Identifying disruptions in brain function associated with gait impairment could be crucial in better understanding PD motor progression, thus advancing the development of more effective and personalized therapeutics. In this work, we present an explainable, geometric, weighted-graph attention neural network (xGW-GAT) to identify functional networks predictive of the progression of gait difficulties in individuals with PD. xGW-GAT predicts the multi-class gait impairment on the MDS Unified PD Rating Scale (MDS-UPDRS). Our computational- and data-efficient model represents functional connectomes as symmetric positive definite (SPD) matrices on a Riemannian manifold to explicitly encode pairwise interactions of entire connectomes, based on which we learn an attention mask yielding individual- and group-level explainability. Applied to our resting-state functional MRI (rs-fMRI) dataset of individuals with PD, xGW-GAT identifies functional connectivity patterns associated with gait impairment in PD and offers interpretable explanations of functional subnetworks associated with motor impairment. Our model successfully outperforms several existing methods while simultaneously revealing clinically-relevant connectivity patterns. The source code is available at https://github.com/favour-nerrise/xGW-GAT .
△ Less
Submitted 24 July, 2023;
originally announced July 2023.
-
Joint Graph Convolution for Analyzing Brain Structural and Functional Connectome
Authors:
Yueting Li,
Qingyue Wei,
Ehsan Adeli,
Kilian M. Pohl,
Qingyu Zhao
Abstract:
The white-matter (micro-)structural architecture of the brain promotes synchrony among neuronal populations, giving rise to richly patterned functional connections. A fundamental problem for systems neuroscience is determining the best way to relate structural and functional networks quantified by diffusion tensor imaging and resting-state functional MRI. As one of the state-of-the-art approaches…
▽ More
The white-matter (micro-)structural architecture of the brain promotes synchrony among neuronal populations, giving rise to richly patterned functional connections. A fundamental problem for systems neuroscience is determining the best way to relate structural and functional networks quantified by diffusion tensor imaging and resting-state functional MRI. As one of the state-of-the-art approaches for network analysis, graph convolutional networks (GCN) have been separately used to analyze functional and structural networks, but have not been applied to explore inter-network relationships. In this work, we propose to couple the two networks of an individual by adding inter-network edges between corresponding brain regions, so that the joint structure-function graph can be directly analyzed by a single GCN. The weights of inter-network edges are learnable, reflecting non-uniform structure-function coupling strength across the brain. We apply our Joint-GCN to predict age and sex of 662 participants from the public dataset of the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) based on their functional and micro-structural white-matter networks. Our results support that the proposed Joint-GCN outperforms existing multi-modal graph learning approaches for analyzing structural and functional networks.
△ Less
Submitted 27 October, 2022;
originally announced November 2022.
-
Unresolved excess accumulation of myelin-derived cholesterol contributes to scar formation after spinal cord injury
Authors:
Bolin Zheng,
Yijing He,
Qing Zhao,
Xu Zhu,
Shuai Yin,
Huiyi Yang,
Zhaojie Wang,
Liming Cheng
Abstract:
Background: Spinal cord injury triggers complex pathological cascades, resulting in destructive tissue damage and incomplete tissue repair. Scar formation is generally considered as a barrier for regeneration in central nervous system (CNS), while the intrinsic mechanism of scar-forming after spinal cord injury has not been completed deciphered. Methods: We assessed cholesterol hemostasis in spina…
▽ More
Background: Spinal cord injury triggers complex pathological cascades, resulting in destructive tissue damage and incomplete tissue repair. Scar formation is generally considered as a barrier for regeneration in central nervous system (CNS), while the intrinsic mechanism of scar-forming after spinal cord injury has not been completed deciphered. Methods: We assessed cholesterol hemostasis in spinal cord lesions and injured peripheral nerves using confocal reflection microscopy and real-time PCR analyses. The involvement of the proteins, which were predicted to promote cholesterol efflux in spinal cord lesions, were assessed with Liver X receptor (LXR) agonist and Apolipoprotein E (APOE) deficiency. The role of reverse cholesterol transport (RCT) in cholesterol clearance was examined in APOE KO mice injured sciatic nerves and myelin-overloaded macrophages in vitro. Finally, we determined the consequence of excess cholesterol accumulation in CNS by transplantation of myelin into neonatal spinal cord lesions. Results: We found that excess cholesterol accumulates in phagocytes and is inefficiently removed in spinal cord lesions in young-adult mice. Interestingly, we observed that excessive cholesterol also accumulates in injured peripheral nerves, but is subsequently removed by RCT. Meanwhile, preventing RCT led to macrophage accumulation and fibrosis in injured peripheral nerves. Furthermore, the neonatal mouse spinal cord lesions are devoid of myelin-derived lipids, and able to heal without excess cholesterol accumulation. We found that transplantation of myelin into neonatal lesions disrupts healing with excessive cholesterol accumulation, persistent macrophage activation and fibrosis, indicating myelin-derived cholesterol plays a critical role in impaired wound healing.
△ Less
Submitted 20 September, 2022;
originally announced September 2022.
-
Artificial Intelligence Enables Real-Time and Intuitive Control of Prostheses via Nerve Interface
Authors:
Diu Khue Luu,
Anh Tuan Nguyen,
Ming Jiang,
Markus W. Drealan,
Jian Xu,
Tong Wu,
Wing-kin Tam,
Wenfeng Zhao,
Brian Z. H. Lim,
Cynthia K. Overstreet,
Qi Zhao,
Jonathan Cheng,
Edward W. Keefer,
Zhi Yang
Abstract:
Objective: The next generation prosthetic hand that moves and feels like a real hand requires a robust neural interconnection between the human minds and machines. Methods: Here we present a neuroprosthetic system to demonstrate that principle by employing an artificial intelligence (AI) agent to translate the amputee's movement intent through a peripheral nerve interface. The AI agent is designed…
▽ More
Objective: The next generation prosthetic hand that moves and feels like a real hand requires a robust neural interconnection between the human minds and machines. Methods: Here we present a neuroprosthetic system to demonstrate that principle by employing an artificial intelligence (AI) agent to translate the amputee's movement intent through a peripheral nerve interface. The AI agent is designed based on the recurrent neural network (RNN) and could simultaneously decode six degree-of-freedom (DOF) from multichannel nerve data in real-time. The decoder's performance is characterized in motor decoding experiments with three human amputees. Results: First, we show the AI agent enables amputees to intuitively control a prosthetic hand with individual finger and wrist movements up to 97-98% accuracy. Second, we demonstrate the AI agent's real-time performance by measuring the reaction time and information throughput in a hand gesture matching task. Third, we investigate the AI agent's long-term uses and show the decoder's robust predictive performance over a 16-month implant duration. Conclusion & significance: Our study demonstrates the potential of AI-enabled nerve technology, underling the next generation of dexterous and intuitive prosthetic hands.
△ Less
Submitted 16 March, 2022;
originally announced March 2022.
-
ezcox: An R/CRAN Package for Cox Model Batch Processing and Visualization
Authors:
Shixiang Wang,
Xue-Song Liu,
Jianfeng Li,
Qi Zhao
Abstract:
Cox analysis is a common clinical data analysis technique to link valuable variables to clinical outcomes including dead and relapse. In the omics era, Cox model batch processing is a basic strategy for screening clinically relevant variables, biomarker discovery and gene signature identification. However, all such analyses have been implemented with homebrew code in research community, thus lack…
▽ More
Cox analysis is a common clinical data analysis technique to link valuable variables to clinical outcomes including dead and relapse. In the omics era, Cox model batch processing is a basic strategy for screening clinically relevant variables, biomarker discovery and gene signature identification. However, all such analyses have been implemented with homebrew code in research community, thus lack of transparency and reproducibility. Here, we present ezcox, the first R/CRAN package for Cox model batch processing and visualization. ezcox is an open source R package under GPL-3 license and it is free available at https://github.com/ShixiangWang/ezcox and https://cran.r-project.org/package=ezcox.
△ Less
Submitted 27 October, 2021;
originally announced October 2021.
-
Longitudinal Correlation Analysis for Decoding Multi-Modal Brain Development
Authors:
Qingyu Zhao,
Ehsan Adeli,
Kilian M. Pohl
Abstract:
Starting from childhood, the human brain restructures and rewires throughout life. Characterizing such complex brain development requires effective analysis of longitudinal and multi-modal neuroimaging data. Here, we propose such an analysis approach named Longitudinal Correlation Analysis (LCA). LCA couples the data of two modalities by first reducing the input from each modality to a latent repr…
▽ More
Starting from childhood, the human brain restructures and rewires throughout life. Characterizing such complex brain development requires effective analysis of longitudinal and multi-modal neuroimaging data. Here, we propose such an analysis approach named Longitudinal Correlation Analysis (LCA). LCA couples the data of two modalities by first reducing the input from each modality to a latent representation based on autoencoders. A self-supervised strategy then relates the two latent spaces by jointly disentangling two directions, one in each space, such that the longitudinal changes in latent representations along those directions are maximally correlated between modalities. We applied LCA to analyze the longitudinal T1-weighted and diffusion-weighted MRIs of 679 youths from the National Consortium on Alcohol and Neurodevelopment in Adolescence. Unlike existing approaches that focus on either cross-sectional or single-modal modeling, LCA successfully unraveled coupled macrostructural and microstructural brain development from morphological and diffusivity features extracted from the data. A retesting of LCA on raw 3D image volumes of those subjects successfully replicated the findings from the feature-based analysis. Lastly, the developmental effects revealed by LCA were inline with the current understanding of maturational patterns of the adolescent brain.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
Review of Machine-Learning Methods for RNA Secondary Structure Prediction
Authors:
Qi Zhao,
Zheng Zhao,
Xiaoya Fan,
Zhengwei Yuan,
Qian Mao,
Yudong Yao
Abstract:
Secondary structure plays an important role in determining the function of non-coding RNAs. Hence, identifying RNA secondary structures is of great value to research. Computational prediction is a mainstream approach for predicting RNA secondary structure. Unfortunately, even though new methods have been proposed over the past 40 years, the performance of computational prediction methods has stagn…
▽ More
Secondary structure plays an important role in determining the function of non-coding RNAs. Hence, identifying RNA secondary structures is of great value to research. Computational prediction is a mainstream approach for predicting RNA secondary structure. Unfortunately, even though new methods have been proposed over the past 40 years, the performance of computational prediction methods has stagnated in the last decade. Recently, with the increasing availability of RNA structure data, new methods based on machine-learning technologies, especially deep learning, have alleviated the issue. In this review, we provide a comprehensive overview of RNA secondary structure prediction methods based on machine-learning technologies and a tabularized summary of the most important methods in this field. The current pending issues in the field of RNA secondary structure prediction and future trends are also discussed.
△ Less
Submitted 31 August, 2020;
originally announced September 2020.
-
MODMA dataset: a Multi-modal Open Dataset for Mental-disorder Analysis
Authors:
Hanshu Cai,
Yiwen Gao,
Shuting Sun,
Na Li,
Fuze Tian,
Han Xiao,
Jianxiu Li,
Zhengwu Yang,
Xiaowei Li,
Qinglin Zhao,
Zhenyu Liu,
Zhijun Yao,
Minqiang Yang,
Hong Peng,
Jing Zhu,
Xiaowei Zhang,
Guoping Gao,
Fang Zheng,
Rui Li,
Zhihua Guo,
Rong Ma,
Jing Yang,
Lan Zhang,
Xiping Hu,
Yumin Li
, et al. (1 additional authors not shown)
Abstract:
According to the World Health Organization, the number of mental disorder patients, especially depression patients, has grown rapidly and become a leading contributor to the global burden of disease. However, the present common practice of depression diagnosis is based on interviews and clinical scales carried out by doctors, which is not only labor-consuming but also time-consuming. One important…
▽ More
According to the World Health Organization, the number of mental disorder patients, especially depression patients, has grown rapidly and become a leading contributor to the global burden of disease. However, the present common practice of depression diagnosis is based on interviews and clinical scales carried out by doctors, which is not only labor-consuming but also time-consuming. One important reason is due to the lack of physiological indicators for mental disorders. With the rising of tools such as data mining and artificial intelligence, using physiological data to explore new possible physiological indicators of mental disorder and creating new applications for mental disorder diagnosis has become a new research hot topic. However, good quality physiological data for mental disorder patients are hard to acquire. We present a multi-modal open dataset for mental-disorder analysis. The dataset includes EEG and audio data from clinically depressed patients and matching normal controls. All our patients were carefully diagnosed and selected by professional psychiatrists in hospitals. The EEG dataset includes not only data collected using traditional 128-electrodes mounted elastic cap, but also a novel wearable 3-electrode EEG collector for pervasive applications. The 128-electrodes EEG signals of 53 subjects were recorded as both in resting state and under stimulation; the 3-electrode EEG signals of 55 subjects were recorded in resting state; the audio data of 52 subjects were recorded during interviewing, reading, and picture description. We encourage other researchers in the field to use it for testing their methods of mental-disorder analysis.
△ Less
Submitted 4 March, 2020; v1 submitted 20 February, 2020;
originally announced February 2020.
-
Effect of protein binding on exposure of unbound and total mycophenolic acid: a population pharmacokinetic analysis in Chinese adult kidney transplant recipients
Authors:
Changcheng Sheng,
Qun Zhao,
Wanjie Niu,
Xiaoyan Qiu,
Ming Zhang,
Zheng Jiao
Abstract:
AIMS A population pharmacokinetic (PK) analysis was performed to: (1) characterise the PK of unbound and total mycophenolic acid (MPA) and its 7-O-mycophenolic acid glucuronide (MPAG) metabolite, and (2) identify the clinically significant covariates that cause variability in the dose-exposure relationship to facilitate dose optimisation. METHODS A total of 740 unbound MPA (uMPA), 741 total MPA (t…
▽ More
AIMS A population pharmacokinetic (PK) analysis was performed to: (1) characterise the PK of unbound and total mycophenolic acid (MPA) and its 7-O-mycophenolic acid glucuronide (MPAG) metabolite, and (2) identify the clinically significant covariates that cause variability in the dose-exposure relationship to facilitate dose optimisation. METHODS A total of 740 unbound MPA (uMPA), 741 total MPA (tMPA) and 734 total MPAG (tMPAG) concentration-time data from 58 Chinese kidney transplant patients were analysed using a nonlinear mixed-effect model. The influence of covariates was tested using a stepwise procedure. RESULTS The PK of unbound MPA and MPAG were characterised by a two- and one-compartment model with first-order elimination, respectively. Apparent clearance of uMPA (CLuMPA/F) was estimated to be 852 L/h with a relative standard error (RSE) of 7.1%. The tMPA and uMPA were connected using a linear protein binding model, in which the protein binding rate constant (kB) increased non-linearly with the serum albumin (ALB) concentration. The estimated kB was 53.4 /h (RSE, 2.3%) for patients with ALB of 40 g/L. In addition, model-based simulation showed that changes in ALB substantially affected tMPA but not uMPA exposure. CONCLUSIONS The established model adequately described the population PK characteristics of the uMPA, tMPA, and MPAG. The estimated CLuMPA/F and unbound fraction of MPA (FUMPA) in Chinese kidney transplant recipients were comparable to those published previously in Caucasians. We recommend monitoring uMPA instead of tMPA to optimise mycophenolate mofetil (MMF) dosing for patients with lower ALB levels.
△ Less
Submitted 20 December, 2019;
originally announced December 2019.
-
Double Generalized Linear Model Reveals Those with High Intelligence are More Similar in Cortical Thickness
Authors:
Qi Zhao,
Lingli Zhang,
Chun Shen,
Jie Zhang,
Jianfeng Feng
Abstract:
Most studies indicate that intelligence (g) is positively correlated with cortical thickness. However, the interindividual variability of cortical thickness has not been taken into account. In this study, we aimed to identify the association between intelligence and cortical thickness in adolescents from both the group's mean and dispersion point of view, utilizing the structural brain imaging fro…
▽ More
Most studies indicate that intelligence (g) is positively correlated with cortical thickness. However, the interindividual variability of cortical thickness has not been taken into account. In this study, we aimed to identify the association between intelligence and cortical thickness in adolescents from both the group's mean and dispersion point of view, utilizing the structural brain imaging from the Adolescent Brain and Cognitive Development (ABCD) Consortium, the largest cohort in early adolescents around 10 years old. The mean and dispersion parameters of cortical thickness and their association with intelligence were estimated using double generalized linear models(DGLM). We found that for the mean model part, the thickness of the frontal lobe like superior frontal gyrus was negatively related to intelligence, while the surface area was most positively associated with intelligence in the frontal lobe. In the dispersion part, intelligence was negatively correlated with the dispersion of cortical thickness in widespread areas, but not with the surface area. These results suggested that people with higher IQ are more similar in cortical thickness, which may be related to less differentiation or heterogeneity in cortical columns.
△ Less
Submitted 22 November, 2019; v1 submitted 6 June, 2019;
originally announced June 2019.
-
Custom Edge-Element FEM Solver and its Application to Eddy-Current Simulation of Realistic 2M-Element Human Brain Phantom
Authors:
Wuliang Yin,
Mingyang Lu,
Jiawei Tang,
Qian Zhao,
Zhijie Zhang,
Kai Li,
Yan Han,
Anthony Peyton
Abstract:
Extensive research papers of three-dimensional computational techniques are widely used for the investigation of human brain pathophysiology. Eddy current analyzing could provide an indication of conductivity change within a biological body. A significant obstacle to current trend analyses is the development of a numerically stable and efficiency-finite element scheme that performs well at low fre…
▽ More
Extensive research papers of three-dimensional computational techniques are widely used for the investigation of human brain pathophysiology. Eddy current analyzing could provide an indication of conductivity change within a biological body. A significant obstacle to current trend analyses is the development of a numerically stable and efficiency-finite element scheme that performs well at low frequency and does not require a large number of degrees of freedom. Here, a custom finite element method (FEM) solver based on edge elements is proposed using the weakly coupled theory, which separates the solution into two steps. First, the background field (the magnetic vector potential on each edge) is calculated and stored. Then, the electric scalar potential on each node is obtained by FEM based on Galerkin formulations. Consequently, the electric field and eddy current distribution in the object can be obtained. This solver is more efficient than typical commercial solvers since it reduces the vector eddy current equation to a scalar one, and reduces the meshing domain to just the eddy current region. It can therefore tackle complex eddy current calculations for models with much larger numbers of elements, such as those encountered in eddy current computation in biological tissues. An example is presented with a realistic human brain mesh of 2 million elements. In addition, with this solver, the equivalent magnetic field induced from the excitation coil is applied, and therefore there is no need to mesh the excitation coil. In combination, these significantly increase the efficiency of the solver.
△ Less
Submitted 30 May, 2019;
originally announced June 2019.
-
AI Neurotechnology for Aging Societies -- Task-load and Dementia EEG Digital Biomarker Development Using Information Geometry Machine Learning Methods
Authors:
Tomasz M. Rutkowski,
Qibin Zhao,
Masao S. Abe,
Mihoko Otake
Abstract:
Dementia and especially Alzheimer's disease (AD) are the most common causes of cognitive decline in elderly people. A spread of the above mentioned mental health problems in aging societies is causing a significant medical and economic burden in many countries around the world. According to a recent World Health Organization (WHO) report, it is approximated that currently, worldwide, about 47 mill…
▽ More
Dementia and especially Alzheimer's disease (AD) are the most common causes of cognitive decline in elderly people. A spread of the above mentioned mental health problems in aging societies is causing a significant medical and economic burden in many countries around the world. According to a recent World Health Organization (WHO) report, it is approximated that currently, worldwide, about 47 million people live with a dementia spectrum of neurocognitive disorders. This number is expected to triple by 2050, which calls for possible application of AI-based technologies to support an early screening for preventive interventions and a subsequent mental wellbeing monitoring as well as maintenance with so-called digital-pharma or beyond a pill therapeutical approaches. This paper discusses our attempt and preliminary results of brainwave (EEG) techniques to develop digital biomarkers for dementia progress detection and monitoring. We present an information geometry-based classification approach for automatic EEG-derived event related responses (ERPs) discrimination of low versus high task-load auditory or tactile stimuli recognition, of which amplitude and latency variabilities are similar to those in dementia. The discussed approach is a step forward to develop AI, and especially machine learning (ML) approaches, for the subsequent application to mild-cognitive impairment (MCI) and AD diagnostics.
△ Less
Submitted 30 November, 2018;
originally announced November 2018.
-
Prediction of treatment outcome for autism from structure of the brain based on sure independence screening
Authors:
Juntang Zhuang,
Nicha C. Dvornek,
Qingyu Zhao,
Xiaoxiao Li,
Pamela Ventola,
James S. Duncan
Abstract:
Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder, and behavioral treatment interventions have shown promise for young children with ASD. However, there is limited progress in understanding the effect of each type of treatment. In this project, we aim to detect structural changes in the brain after treatment and select structural features associated with treatment outcomes. T…
▽ More
Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder, and behavioral treatment interventions have shown promise for young children with ASD. However, there is limited progress in understanding the effect of each type of treatment. In this project, we aim to detect structural changes in the brain after treatment and select structural features associated with treatment outcomes. The difficulty in building large databases of patients who have received specific treatments and the high dimensionality of medical image analysis problems are the challenges in this work. To select predictive features and build accurate models, we use the sure independence screening (SIS) method. SIS is a theoretically and empirically validated method for ultra-high dimensional general linear models, and it achieves both predictive accuracy and correct feature selection by iterative feature selection. Compared with step-wise feature selection methods, SIS removes multiple features in each iteration and is computationally efficient. Compared with other linear models such as elastic-net regression, support vector regression (SVR) and partial least squares regression (PSLR), SIS achieves higher accuracy. We validated the superior performance of SIS in various experiments: First, we extract brain structural features from FreeSurfer, including cortical thickness, surface area, mean curvature and cortical volume. Next, we predict different measures of treatment outcomes based on structural features. We show that SIS achieves the highest correlation between prediction and measurements in all tasks. Furthermore, we report regions selected by SIS as biomarkers for ASD.
△ Less
Submitted 25 February, 2019; v1 submitted 17 October, 2018;
originally announced October 2018.
-
Finding any Waldo: zero-shot invariant and efficient visual search
Authors:
Mengmi Zhang,
Jiashi Feng,
Keng Teck Ma,
Joo Hwee Lim,
Qi Zhao,
Gabriel Kreiman
Abstract:
Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work has focused…
▽ More
Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work has focused on searching for perfect matches of a target after extensive category-specific training. Here we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes.
△ Less
Submitted 17 July, 2018;
originally announced July 2018.
-
Brain-Computer Interface with Corrupted EEG Data: A Tensor Completion Approach
Authors:
Jordi Sole-Casals,
Cesar F. Caiafa,
Qibin Zhao,
Adrzej Cichocki
Abstract:
One of the current issues in Brain-Computer Interface is how to deal with noisy Electroencephalography measurements organized as multidimensional datasets. On the other hand, recently, significant advances have been made in multidimensional signal completion algorithms that exploit tensor decomposition models to capture the intricate relationship among entries in a multidimensional signal. We prop…
▽ More
One of the current issues in Brain-Computer Interface is how to deal with noisy Electroencephalography measurements organized as multidimensional datasets. On the other hand, recently, significant advances have been made in multidimensional signal completion algorithms that exploit tensor decomposition models to capture the intricate relationship among entries in a multidimensional signal. We propose to use tensor completion applied to EEG data for improving the classification performance in a motor imagery BCI system with corrupted measurements. Noisy measurements are considered as unknowns that are inferred from a tensor decomposition model. We evaluate the performance of four recently proposed tensor completion algorithms plus a simple interpolation strategy, first with random missing entries and then with missing samples constrained to have a specific structure (random missing channels), which is a more realistic assumption in BCI Applications. We measured the ability of these algorithms to reconstruct the tensor from observed data. Then, we tested the classification accuracy of imagined movement in a BCI experiment with missing samples. We show that for random missing entries, all tensor completion algorithms can recover missing samples increasing the classification performance compared to a simple interpolation approach. For the random missing channels case, we show that tensor completion algorithms help to reconstruct missing channels, significantly improving the accuracy in the classification of motor imagery, however, not at the same level as clean data. Tensor completion algorithms are useful in real BCI applications. The proposed strategy could allow using motor imagery BCI systems even when EEG data is highly affected by missing channels and/or samples, avoiding the need of new acquisitions in the calibration stage.
△ Less
Submitted 26 July, 2018; v1 submitted 13 June, 2018;
originally announced June 2018.
-
A new method for protein structure reconstruction from NOESY distances
Authors:
Z. Li,
S. Li,
X. Wei,
X. Peng,
Q. Zhao
Abstract:
Protein structure reconstruction from Nuclear Magnetic Resonance (NMR) experiments largely relies on computational algorithms. Recently, some effective low-rank matrix completion (MC) methods, such as ASD and ScaledASD, have been successfully applied to image processing, which inspires us to apply the methods to reconstruct protein structures. In this paper, we present an efficient method to deter…
▽ More
Protein structure reconstruction from Nuclear Magnetic Resonance (NMR) experiments largely relies on computational algorithms. Recently, some effective low-rank matrix completion (MC) methods, such as ASD and ScaledASD, have been successfully applied to image processing, which inspires us to apply the methods to reconstruct protein structures. In this paper, we present an efficient method to determine protein structures based on experimental NMR NOESY distances. ScaledASD algorithm is used in the method with several post-procedures including chirality refinement, distance lower (upper) bound refinement, force field-based energy minimization (EM) and water refinement. By comparing several metrics in the conformation evaluation on our results with Protein Data Bank (PDB) structures, we conclude that our method is consistent with the popularly used methods. In particular, our results show higher validities in Procheck dihedral angles G-factor. Furthermore, we compare our calculation results with PDB structures by examining the structural similarity to X-ray crystallographic structures in a special dataset. The software and its MATLAB source codes are available in https://github.com/xubiaopeng/PRASD
△ Less
Submitted 20 September, 2018; v1 submitted 29 May, 2018;
originally announced May 2018.
-
Two-stage frequency recognition method based on correlated component analysis for SSVEP-based BCI
Authors:
Yangsong Zhang,
Erwei Yin,
Fali Li,
Yu Zhang,
Toshihisa Tanaka,
Qibin Zhao,
Yan Cui,
Peng Xu,
Dezhong Yao,
Daqing Guo
Abstract:
Canonical correlation analysis (CCA) is a state-of-the-art method for frequency recognition in steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems. Various extended methods have been developed, and among such methods, a combination method of CCA and individual-template-based CCA (IT-CCA) has achieved excellent performance. However, CCA requires the canonical v…
▽ More
Canonical correlation analysis (CCA) is a state-of-the-art method for frequency recognition in steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems. Various extended methods have been developed, and among such methods, a combination method of CCA and individual-template-based CCA (IT-CCA) has achieved excellent performance. However, CCA requires the canonical vectors to be orthogonal, which may not be a reasonable assumption for EEG analysis. In the current study, we propose using the correlated component analysis (CORRCA) rather than CCA to implement frequency recognition. CORRCA can relax the constraint of canonical vectors in CCA, and generate the same projection vector for two multichannel EEG signals. Furthermore, we propose a two-stage method based on the basic CORRCA method (termed TSCORRCA). Evaluated on a benchmark dataset of thirty-five subjects, the experimental results demonstrate that CORRCA significantly outperformed CCA, and TSCORRCA obtained the best performance among the compared methods. This study demonstrates that CORRCA-based methods have great potential for implementing high-performance SSVEP-based BCI systems.
△ Less
Submitted 1 July, 2018; v1 submitted 7 May, 2018;
originally announced May 2018.
