G-MIND: an end-to-end multimodal imaging-genetics framework for biomarker identification and disease classification

Sayan Ghosal; Qiang Chen; Giulio Pergola; Aaron L. Goldman; William Ulrich; Karen F. Berman; Giuseppe Blasi; Leonardo Fazio; Antonio Rampino; Alessandro Bertolino; Daniel R. Weinberger; Venkata S. Mattay; Archana Venkataraman

doi:10.1117/12.2581127

15 February 2021 G-MIND: an end-to-end multimodal imaging-genetics framework for biomarker identification and disease classification

Sayan Ghosal, Qiang Chen, Giulio Pergola, Aaron L. Goldman, William Ulrich, Karen F. Berman, Giuseppe Blasi, Leonardo Fazio, Antonio Rampino, Alessandro Bertolino, Daniel R. Weinberger, Venkata S. Mattay, Archana Venkataraman

Author Affiliations +

Proceedings Volume 11596, Medical Imaging 2021: Image Processing; 115960C (2021) https://doi.org/10.1117/12.2581127
Event: SPIE Medical Imaging, 2021, Online Only

Abstract

We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. Our model consists of an encoder, a decoder and a classifier. The encoder learns a non-linear subspace shared between the input data modalities. The classifier and the decoder act as regularizers to ensure that the low-dimensional encoding captures predictive differences between patients and controls. We use a learnable dropout layer to extract interpretable biomarkers from the data, and our unique training strategy can easily accommodate missing data modalities across subjects. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data. Using 10-fold cross validation, we demonstrate that our model achieves better classification accuracy than baseline methods, and that this performance generalizes to a second dataset collected at a different site. In an exploratory analysis we further show that the biomarkers identified by our model are closely associated with the well-documented deficits in schizophrenia.

Conference Presentation

Citation Download Citation

Sayan Ghosal, Qiang Chen, Giulio Pergola, Aaron L. Goldman, William Ulrich, Karen F. Berman, Giuseppe Blasi, Leonardo Fazio, Antonio Rampino, Alessandro Bertolino, Daniel R. Weinberger, Venkata S. Mattay, and Archana Venkataraman "G-MIND: an end-to-end multimodal imaging-genetics framework for biomarker identification and disease classification", Proc. SPIE 11596, Medical Imaging 2021: Image Processing, 115960C (15 February 2021); https://doi.org/10.1117/12.2581127

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE