-
Distributed Stochastic Optimization of a Neural Representation Network for Time-Space Tomography Reconstruction
Authors:
K. Aditya Mohan,
Massimiliano Ferrucci,
Chuck Divin,
Garrett A. Stevenson,
Hyojin Kim
Abstract:
4D time-space reconstruction of dynamic events or deforming objects using X-ray computed tomography (CT) is an extremely ill-posed inverse problem. Existing approaches assume that the object remains static for the duration of several tens or hundreds of X-ray projection measurement images (reconstruction of consecutive limited-angle CT scans). However, this is an unrealistic assumption for many in…
▽ More
4D time-space reconstruction of dynamic events or deforming objects using X-ray computed tomography (CT) is an extremely ill-posed inverse problem. Existing approaches assume that the object remains static for the duration of several tens or hundreds of X-ray projection measurement images (reconstruction of consecutive limited-angle CT scans). However, this is an unrealistic assumption for many in-situ experiments that causes spurious artifacts and inaccurate morphological reconstructions of the object. To solve this problem, we propose to perform a 4D time-space reconstruction using a distributed implicit neural representation (DINR) network that is trained using a novel distributed stochastic training algorithm. Our DINR network learns to reconstruct the object at its output by iterative optimization of its network parameters such that the measured projection images best match the output of the CT forward measurement model. We use a continuous time and space forward measurement model that is a function of the DINR outputs at a sparsely sampled set of continuous valued object coordinates. Unlike existing state-of-the-art neural representation architectures that forward and back propagate through dense voxel grids that sample the object's entire time-space coordinates, we only propagate through the DINR at a small subset of object coordinates in each iteration resulting in an order-of-magnitude reduction in memory and compute for training. DINR leverages distributed computation across several compute nodes and GPUs to produce high-fidelity 4D time-space reconstructions even for extremely large CT data sizes. We use both simulated parallel-beam and experimental cone-beam X-ray CT datasets to demonstrate the superior performance of our approach.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstruction
Authors:
Jiaming Liu,
Rushil Anirudh,
Jayaraman J. Thiagarajan,
Stewart He,
K. Aditya Mohan,
Ulugbek S. Kamilov,
Hyojin Kim
Abstract:
Limited-Angle Computed Tomography (LACT) is a non-destructive evaluation technique used in a variety of applications ranging from security to medicine. The limited angle coverage in LACT is often a dominant source of severe artifacts in the reconstructed images, making it a challenging inverse problem. We present DOLCE, a new deep model-based framework for LACT that uses a conditional diffusion mo…
▽ More
Limited-Angle Computed Tomography (LACT) is a non-destructive evaluation technique used in a variety of applications ranging from security to medicine. The limited angle coverage in LACT is often a dominant source of severe artifacts in the reconstructed images, making it a challenging inverse problem. We present DOLCE, a new deep model-based framework for LACT that uses a conditional diffusion model as an image prior. Diffusion models are a recent class of deep generative models that are relatively easy to train due to their implementation as image denoisers. DOLCE can form high-quality images from severely under-sampled data by integrating data-consistency updates with the sampling updates of a diffusion model, which is conditioned on the transformed limited-angle data. We show through extensive experimentation on several challenging real LACT datasets that, the same pre-trained DOLCE model achieves the SOTA performance on drastically different types of images. Additionally, we show that, unlike standard LACT reconstruction methods, DOLCE naturally enables the quantification of the reconstruction uncertainty by generating multiple samples consistent with the measured data.
△ Less
Submitted 22 November, 2022;
originally announced November 2022.
-
Iterative Reconstruction of the Electron Density and Effective Atomic Number using a Non-Linear Forward Model
Authors:
K. Aditya Mohan,
Kyle M. Champley,
Albert W. Reed,
Steven M. Glenn,
Harry E. Martz Jr
Abstract:
For material identification, characterization, and quantification, it is useful to estimate system-independent material properties that do not depend on the detailed specifications of the X-ray computed tomography (CT) system such as spectral response. System independent rho-e and Z-e (SIRZ) refers to a suite of methods for estimating the system independent material properties of electron density,…
▽ More
For material identification, characterization, and quantification, it is useful to estimate system-independent material properties that do not depend on the detailed specifications of the X-ray computed tomography (CT) system such as spectral response. System independent rho-e and Z-e (SIRZ) refers to a suite of methods for estimating the system independent material properties of electron density, rho-e, and effective atomic number, Z-e, of an object scanned using dual-energy X-ray CT (DECT). The current state-of-the-art approach, SIRZ-2, makes certain approximations that lead to inaccurate estimates for large atomic numbered (Z-e) materials. In this paper, we present an extension, SIRZ-3, which iteratively reconstructs the unknown rho-e and Z-e while avoiding the limiting approximations made by SIRZ-2. Unlike SIRZ-2, this allows SIRZ-3 to accurately reconstruct rho-e and Z-e even at large values of Z-e. SIRZ-3 relies on the use of a new non-linear differentiable forward measurement model that expresses the DECT measurement data as a direct analytical function of rho-e and Z-e. Leveraging this new forward model, we use an iterative optimization algorithm to reconstruct (or solve for) rho-e and Z-e directly from the DECT data. Compared to SIRZ-2, we show that the magnitude of performance improvement using SIRZ-3 increases with increasing values for Z-e.
△ Less
Submitted 31 March, 2022;
originally announced April 2022.
-
Mixture Model Framework for Traumatic Brain Injury Prognosis Using Heterogeneous Clinical and Outcome Data
Authors:
Alan D. Kaplan,
Qi Cheng,
K. Aditya Mohan,
Lindsay D. Nelson,
Sonia Jain,
Harvey Levin,
Abel Torres-Espin,
Austin Chou,
J. Russell Huie,
Adam R. Ferguson,
Michael McCrea,
Joseph Giacino,
Shivshankar Sundaram,
Amy J. Markowitz,
Geoffrey T. Manley
Abstract:
Prognoses of Traumatic Brain Injury (TBI) outcomes are neither easily nor accurately determined from clinical indicators. This is due in part to the heterogeneity of damage inflicted to the brain, ultimately resulting in diverse and complex outcomes. Using a data-driven approach on many distinct data elements may be necessary to describe this large set of outcomes and thereby robustly depict the n…
▽ More
Prognoses of Traumatic Brain Injury (TBI) outcomes are neither easily nor accurately determined from clinical indicators. This is due in part to the heterogeneity of damage inflicted to the brain, ultimately resulting in diverse and complex outcomes. Using a data-driven approach on many distinct data elements may be necessary to describe this large set of outcomes and thereby robustly depict the nuanced differences among TBI patients' recovery. In this work, we develop a method for modeling large heterogeneous data types relevant to TBI. Our approach is geared toward the probabilistic representation of mixed continuous and discrete variables with missing values. The model is trained on a dataset encompassing a variety of data types, including demographics, blood-based biomarkers, and imaging findings. In addition, it includes a set of clinical outcome assessments at 3, 6, and 12 months post-injury. The model is used to stratify patients into distinct groups in an unsupervised learning setting. We use the model to infer outcomes using input data, and show that the collection of input data reduces uncertainty of outcomes over a baseline approach. In addition, we quantify the performance of a likelihood scoring technique that can be used to self-evaluate the extrapolation risk of prognosis on unseen patients.
△ Less
Submitted 20 July, 2021; v1 submitted 22 December, 2020;
originally announced December 2020.
-
AutoAtlas: Neural Network for 3D Unsupervised Partitioning and Representation Learning
Authors:
K. Aditya Mohan,
Alan D. Kaplan
Abstract:
We present a novel neural network architecture called AutoAtlas for fully unsupervised partitioning and representation learning of 3D brain Magnetic Resonance Imaging (MRI) volumes. AutoAtlas consists of two neural network components: one neural network to perform multi-label partitioning based on local texture in the volume, and a second neural network to compress the information contained within…
▽ More
We present a novel neural network architecture called AutoAtlas for fully unsupervised partitioning and representation learning of 3D brain Magnetic Resonance Imaging (MRI) volumes. AutoAtlas consists of two neural network components: one neural network to perform multi-label partitioning based on local texture in the volume, and a second neural network to compress the information contained within each partition. We train both of these components simultaneously by optimizing a loss function that is designed to promote accurate reconstruction of each partition, while encouraging spatially smooth and contiguous partitioning, and discouraging relatively small partitions. We show that the partitions adapt to the subject specific structural variations of brain tissue while consistently appearing at similar spatial locations across subjects. AutoAtlas also produces very low dimensional features that represent local texture of each partition. We demonstrate prediction of metadata associated with each subject using the derived feature representations and compare the results to prediction using features derived from FreeSurfer anatomical parcellation. Since our features are intrinsically linked to distinct partitions, we can then map values of interest, such as partition-specific feature importance scores onto the brain for visualization.
△ Less
Submitted 11 November, 2021; v1 submitted 29 October, 2020;
originally announced October 2020.
-
Extreme Few-view CT Reconstruction using Deep Inference
Authors:
Hyojin Kim,
Rushil Anirudh,
K. Aditya Mohan,
Kyle Champley
Abstract:
Reconstruction of few-view x-ray Computed Tomography (CT) data is a highly ill-posed problem. It is often used in applications that require low radiation dose in clinical CT, rapid industrial scanning, or fixed-gantry CT. Existing analytic or iterative algorithms generally produce poorly reconstructed images, severely deteriorated by artifacts and noise, especially when the number of x-ray project…
▽ More
Reconstruction of few-view x-ray Computed Tomography (CT) data is a highly ill-posed problem. It is often used in applications that require low radiation dose in clinical CT, rapid industrial scanning, or fixed-gantry CT. Existing analytic or iterative algorithms generally produce poorly reconstructed images, severely deteriorated by artifacts and noise, especially when the number of x-ray projections is considerably low. This paper presents a deep network-driven approach to address extreme few-view CT by incorporating convolutional neural network-based inference into state-of-the-art iterative reconstruction. The proposed method interprets few-view sinogram data using attention-based deep networks to infer the reconstructed image. The predicted image is then used as prior knowledge in the iterative algorithm for final reconstruction. We demonstrate effectiveness of the proposed approach by performing reconstruction experiments on a chest CT dataset.
△ Less
Submitted 11 October, 2019;
originally announced October 2019.
-
Improving Limited Angle CT Reconstruction with a Robust GAN Prior
Authors:
Rushil Anirudh,
Hyojin Kim,
Jayaraman J. Thiagarajan,
K. Aditya Mohan,
Kyle M. Champley
Abstract:
Limited angle CT reconstruction is an under-determined linear inverse problem that requires appropriate regularization techniques to be solved. In this work we study how pre-trained generative adversarial networks (GANs) can be used to clean noisy, highly artifact laden reconstructions from conventional techniques, by effectively projecting onto the inferred image manifold. In particular, we use a…
▽ More
Limited angle CT reconstruction is an under-determined linear inverse problem that requires appropriate regularization techniques to be solved. In this work we study how pre-trained generative adversarial networks (GANs) can be used to clean noisy, highly artifact laden reconstructions from conventional techniques, by effectively projecting onto the inferred image manifold. In particular, we use a robust version of the popularly used GAN prior for inverse problems, based on a recent technique called corruption mimicking, that significantly improves the reconstruction quality. The proposed approach operates in the image space directly, as a result of which it does not need to be trained or require access to the measurement model, is scanner agnostic, and can work over a wide range of sensing scenarios.
△ Less
Submitted 29 January, 2020; v1 submitted 3 October, 2019;
originally announced October 2019.
-
Lose The Views: Limited Angle CT Reconstruction via Implicit Sinogram Completion
Authors:
Rushil Anirudh,
Hyojin Kim,
Jayaraman J. Thiagarajan,
K. Aditya Mohan,
Kyle Champley,
Timo Bremer
Abstract:
Computed Tomography (CT) reconstruction is a fundamental component to a wide variety of applications ranging from security, to healthcare. The classical techniques require measuring projections, called sinograms, from a full 180$^\circ$ view of the object. This is impractical in a limited angle scenario, when the viewing angle is less than 180$^\circ$, which can occur due to different factors incl…
▽ More
Computed Tomography (CT) reconstruction is a fundamental component to a wide variety of applications ranging from security, to healthcare. The classical techniques require measuring projections, called sinograms, from a full 180$^\circ$ view of the object. This is impractical in a limited angle scenario, when the viewing angle is less than 180$^\circ$, which can occur due to different factors including restrictions on scanning time, limited flexibility of scanner rotation, etc. The sinograms obtained as a result, cause existing techniques to produce highly artifact-laden reconstructions. In this paper, we propose to address this problem through implicit sinogram completion, on a challenging real world dataset containing scans of common checked-in luggage. We propose a system, consisting of 1D and 2D convolutional neural networks, that operates on a limited angle sinogram to directly produce the best estimate of a reconstruction. Next, we use the x-ray transform on this reconstruction to obtain a "completed" sinogram, as if it came from a full 180$^\circ$ measurement. We feed this to standard analytical and iterative reconstruction techniques to obtain the final reconstruction. We show with extensive experimentation that this combined strategy outperforms many competitive baselines. We also propose a measure of confidence for the reconstruction that enables a practitioner to gauge the reliability of a prediction made by our network. We show that this measure is a strong indicator of quality as measured by the PSNR, while not requiring ground truth at test time. Finally, using a segmentation experiment, we show that our reconstruction preserves the 3D structure of objects effectively.
△ Less
Submitted 11 July, 2018; v1 submitted 28 November, 2017;
originally announced November 2017.
