-
Enhance the Image: Super Resolution using Artificial Intelligence in MRI
Authors:
Ziyu Li,
Zihan Li,
Haoxiang Li,
Qiuyun Fan,
Karla L. Miller,
Wenchuan Wu,
Akshay S. Chaudhari,
Qiyuan Tian
Abstract:
This chapter provides an overview of deep learning techniques for improving the spatial resolution of MRI, ranging from convolutional neural networks, generative adversarial networks, to more advanced models including transformers, diffusion models, and implicit neural representations. Our exploration extends beyond the methodologies to scrutinize the impact of super-resolved images on clinical an…
▽ More
This chapter provides an overview of deep learning techniques for improving the spatial resolution of MRI, ranging from convolutional neural networks, generative adversarial networks, to more advanced models including transformers, diffusion models, and implicit neural representations. Our exploration extends beyond the methodologies to scrutinize the impact of super-resolved images on clinical and neuroscientific assessments. We also cover various practical topics such as network architectures, image evaluation metrics, network loss functions, and training data specifics, including downsampling methods for simulating low-resolution images and dataset selection. Finally, we discuss existing challenges and potential future directions regarding the feasibility and reliability of deep learning-based MRI super-resolution, with the aim to facilitate its wider adoption to benefit various clinical and neuroscientific applications.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Self-navigated 3D diffusion MRI using an optimized CAIPI sampling and structured low-rank reconstruction
Authors:
Ziyu Li,
Karla L. Miller,
Xi Chen,
Mark Chiew,
Wenchuan Wu
Abstract:
3D multi-slab acquisitions are an appealing approach for diffusion MRI because they are compatible with the imaging regime delivering optimal SNR efficiency. In conventional 3D multi-slab imaging, shot-to-shot phase variations caused by motion pose challenges due to the use of multi-shot k-space acquisition. Navigator acquisition after each imaging echo is typically employed to correct phase varia…
▽ More
3D multi-slab acquisitions are an appealing approach for diffusion MRI because they are compatible with the imaging regime delivering optimal SNR efficiency. In conventional 3D multi-slab imaging, shot-to-shot phase variations caused by motion pose challenges due to the use of multi-shot k-space acquisition. Navigator acquisition after each imaging echo is typically employed to correct phase variations, which prolongs scan time and increases the specific absorption rate (SAR). The aim of this study is to develop a highly efficient, self-navigated method to correct for phase variations in 3D multi-slab diffusion MRI without explicitly acquiring navigators. The sampling of each shot is carefully designed to intersect with the central kz plane of each slab, and the multi-shot sampling is optimized for self-navigation performance while retaining decent reconstruction quality. The central kz intersections from all shots are jointly used to reconstruct a 2D phase map for each shot using a structured low-rank constrained reconstruction that leverages the redundancy in shot and coil dimensions. The phase maps are used to eliminate the shot-to-shot phase inconsistency in the final 3D multi-shot reconstruction. We demonstrate the method's efficacy using retrospective simulations and prospectively acquired in-vivo experiments at 1.22 mm and 1.09 mm isotropic resolutions. Compared to conventional navigated 3D multi-slab imaging, the proposed self-navigated method achieves comparable image quality while shortening the scan time by 31.7% and improving the SNR efficiency by 15.5%. The proposed method produces comparable quality of DTI and white matter tractography to conventional navigated 3D multi-slab acquisition with a much shorter scan time.
△ Less
Submitted 11 January, 2024;
originally announced January 2024.
-
Hybrid-space reconstruction with add-on distortion correction for simultaneous multi-slab diffusion MRI
Authors:
Jieying Zhang,
Simin Liu,
Erpeng Dai,
Xin Shao,
Ziyu Li,
Karla L. Miller,
Wenchuan Wu,
Hua Guo
Abstract:
Purpose: This study aims to propose a model-based reconstruction algorithm for simultaneous multi-slab diffusion MRI acquired with blipped-CAIPI gradients (blipped-SMSlab), which can also incorporate distortion correction.
Methods: We formulate blipped-SMSlab in a 4D k-space with kz gradients for the intra-slab slice encoding and km (blipped-CAIPI) gradients for the inter-slab encoding. Because…
▽ More
Purpose: This study aims to propose a model-based reconstruction algorithm for simultaneous multi-slab diffusion MRI acquired with blipped-CAIPI gradients (blipped-SMSlab), which can also incorporate distortion correction.
Methods: We formulate blipped-SMSlab in a 4D k-space with kz gradients for the intra-slab slice encoding and km (blipped-CAIPI) gradients for the inter-slab encoding. Because kz and km gradients share the same physical axis, the blipped-CAIPI gradients introduce phase interference in the z-km domain while motion induces phase variations in the kz-m domain. Thus, our previous k-space-based reconstruction would need multiple steps to transform data back and forth between k-space and image space for phase correction. Here we propose a model-based hybrid-space reconstruction algorithm to correct the phase errors simultaneously. Moreover, the proposed algorithm is combined with distortion correction, and jointly reconstructs data acquired with the blip-up/down acquisition to reduce the g-factor penalty.
Results: The blipped-CAIPI-induced phase interference is corrected by the hybrid-space reconstruction. Blipped-CAIPI can reduce the g-factor penalty compared to the non-blipped acquisition in the basic reconstruction. Additionally, the joint reconstruction simultaneously corrects the image distortions and improves the 1/g-factors by around 50%. Furthermore, through the joint reconstruction, SMSlab acquisitions without the blipped-CAIPI gradients also show comparable correction performance with blipped-SMSlab.
Conclusion: The proposed model-based hybrid-space reconstruction can reconstruct blipped-SMSlab diffusion MRI successfully. Its extension to a joint reconstruction of the blip-up/down acquisition can correct EPI distortions and further reduce the g-factor penalty compared with the separate reconstruction.
△ Less
Submitted 30 March, 2023; v1 submitted 28 March, 2023;
originally announced March 2023.
-
First on-sky demonstration of spatial Linear Dark Field Control with the vector-Apodizing Phase Plate at Subaru/SCExAO
Authors:
S. P. Bos,
K. L. Miller,
J. Lozi,
O. Guyon,
D. S. Doelman,
S. Vievard,
A. Sahoo,
V. Deo,
N. Jovanovic,
F. Martinache,
T. Currie,
F. Snik
Abstract:
One of the key noise sources that currently limits high-contrast imaging observations for exoplanet detection is quasi-static speckles. Quasi-static speckles originate from slowly evolving non-common path aberrations (NCPA). The purpose of this work is to present a proof-of-concept on-sky demonstration of spatial Linear Dark Field Control (LDFC). The ultimate goal of LDFC is to stabilize the point…
▽ More
One of the key noise sources that currently limits high-contrast imaging observations for exoplanet detection is quasi-static speckles. Quasi-static speckles originate from slowly evolving non-common path aberrations (NCPA). The purpose of this work is to present a proof-of-concept on-sky demonstration of spatial Linear Dark Field Control (LDFC). The ultimate goal of LDFC is to stabilize the point spread function (PSF) by addressing NCPA using the science image as additional wavefront sensor. We combined spatial LDFC with the Asymmetric Pupil vector-Apodizing Phase Plate (APvAPP) on the Subaru Coronagraphic Extreme Adaptive Optics system at the Subaru Telescope. In this paper, we report the results of the first successful proof-of-principle LDFC on-sky tests. We present results from two types of cases: (1) correction of instrumental errors and atmospheric residuals plus artificially induced static aberrations introduced on the deformable mirror and (2) correction of only atmospheric residuals and instrumental aberrations. When introducing artificial static wavefront aberrations on the DM, we find that LDFC can improve the raw contrast by a factor of $3$--$7$ over the dark hole. In these tests, the residual wavefront error decreased by $\sim$50 nm RMS, from $\sim$90 nm to $\sim40$ nm RMS. In the case with only residual atmospheric wavefront errors and instrumental aberrations, we show that LDFC is able to suppress evolving aberrations that have timescales of $<0.1$--$0.4$ Hz. We find that the power at $10^{-2}$ Hz is reduced by a factor of $\sim$20, 7, and 4 for spatial frequency bins at 2.5, 5.5, and 8.5 $λ/D$, respectively. The results presented in this work show that LDFC is a promising technique for enabling the high-contrast imaging goals of the upcoming generation of extremely large telescopes.
△ Less
Submitted 11 June, 2021;
originally announced June 2021.
-
New concepts in vector-Apodizing Phase Plate coronagraphy
Authors:
Steven P. Bos,
David S. Doelman,
Kelsey L. Miller,
Frans Snik
Abstract:
The vector-Apodizing Phase Plate (vAPP) is a pupil-plane coronagraph that manipulates phase to create dark holes in the stellar PSF. The phase is induced on the circular polarization states through the inherently achromatic geometric phase by spatially varying the fast axis orientation of a half-wave liquid-crystal layer. The two polarized PSFs can be separated, either by a quarter-wave plate (QWP…
▽ More
The vector-Apodizing Phase Plate (vAPP) is a pupil-plane coronagraph that manipulates phase to create dark holes in the stellar PSF. The phase is induced on the circular polarization states through the inherently achromatic geometric phase by spatially varying the fast axis orientation of a half-wave liquid-crystal layer. The two polarized PSFs can be separated, either by a quarter-wave plate (QWP) followed by a polarizing beamsplitter (PBS) for broadband operation, or a polarization sensitive grating (PSG) for narrowband or IFS operation. Here we present new vAPP concepts that lift the restrictions of previous designs and report on their performance. We demonstrated that the QWP+PBS combination puts tight tolerances on the components to prevent leakage of non-coronagraphic light into the dark-hole. We present a new broadband design using an innovative two-stage patterned liquid-crystal element system based on multi-color holography, alleviating the leakage problem and relaxing manufacturing tolerances. Furthermore, we have shown that focal-plane wavefront sensing (FPWFS) can be integrated into the vAPP by an asymmetric pupil. However, such vAPPs suffer from a reduced throughput and have only been demonstrated with a PSG in narrowband operation. We present advanced designs that maintain throughput and enable phase and amplitude wavefront sensing. We also present broadband vAPP FPWFS designs and outline a broadband FPWFS algorithm. Finally, previous dual-beam vAPP designs for sensitive polarimetry with one-sided dark holes were very complex. We show new dual-beam designs that significantly reduce the complexity.
△ Less
Submitted 7 January, 2021; v1 submitted 1 December, 2020;
originally announced December 2020.
-
Focal-plane wavefront sensing with the vector Apodizing Phase Plate
Authors:
Steven P. Bos,
David S. Doelman,
Julien Lozi,
Olivier Guyon,
Christoph U. Keller,
Kelsey L. Miller,
Nemanja Jovanovic,
Frantz Martinache,
Frans Snik
Abstract:
In this article we show that the vector-Apodizing Phase Plate (vAPP) coronagraph can be designed such that the coronagraphic point spread functions (PSFs) can act as a wavefront sensor to measure and correct the (quasi-)static aberrations, without dedicated wavefront sensing holograms nor modulation by the deformable mirror. The absolute wavefront retrieval is performed with a non-linear algorithm…
▽ More
In this article we show that the vector-Apodizing Phase Plate (vAPP) coronagraph can be designed such that the coronagraphic point spread functions (PSFs) can act as a wavefront sensor to measure and correct the (quasi-)static aberrations, without dedicated wavefront sensing holograms nor modulation by the deformable mirror. The absolute wavefront retrieval is performed with a non-linear algorithm. The focal-plane wavefront sensing (FPWFS) performance of the vAPP and the algorithm are evaluated with numerical simulations, to test various photon and read noise levels, the sensitivity to the 100 lowest Zernike modes and the maximum wavefront error (WFE) that can be accurately estimated in one iteration. We apply these methods to the vAPP within SCExAO, first with the internal source and subsequently on-sky. In idealised simulations we show that for $10^7$ photons the root-mean-square (RMS) WFE can be reduced to $\simλ/1000$, which is 1 nm RMS in the context of the SCExAO system. We find that the maximum WFE that can be corrected in one iteration is $\simλ/8$ RMS or $\sim$200 nm RMS (SCExAO). Furthermore, we demonstrate the SCExAO vAPP capabilities by measuring and controlling the lowest 30 Zernike modes with the internal source and on-sky. On-sky, we report a raw contrast improvement of a factor $\sim$2 between 2 and 4 $λ/D$ after 5 iterations of closed-loop correction. When artificially introducing 150 nm RMS WFE, the algorithm corrects it within 5 iterations of closed-loop operation. FPWFS with the vAPP's coronagraphic PSFs is a powerful technique since it integrates coronagraphy and wavefront sensing, eliminating the need for additional probes and thus resulting in a $100\%$ science duty cycle and maximum throughput for the target.
△ Less
Submitted 18 September, 2019;
originally announced September 2019.
-
Characterization of deformable mirrors for the MagAO-X project
Authors:
Kyle Van Gorkom,
Kelsey L. Miller,
Jared R. Males,
Olivier Guyon,
Alexander T. Rodack,
Jennifer Lumbres,
Justin M. Knight
Abstract:
The MagAO-X instrument is an upgrade of the Magellan AO system that will introduce extreme adaptive optics capabilities for high-contrast imaging at visible and near-infrared wavelengths. A central component of this system is a 2040-actuator microelectromechanical (MEMS) deformable mirror (DM) from Boston Micromachines Corp. (BMC) that will operate at 3.63 kHz for high-order wavefront control. Two…
▽ More
The MagAO-X instrument is an upgrade of the Magellan AO system that will introduce extreme adaptive optics capabilities for high-contrast imaging at visible and near-infrared wavelengths. A central component of this system is a 2040-actuator microelectromechanical (MEMS) deformable mirror (DM) from Boston Micromachines Corp. (BMC) that will operate at 3.63 kHz for high-order wavefront control. Two additional DMs from ALPAO will perform low-order and non-common-path science-arm wavefront correction. The accuracy of the wavefront correction is limited by our ability to command these DMs to a desired shape, which requires a careful characterization of each DM surface. We have developed a characterization pipeline that uses a Zygo Verifire Interferometer to measure the surface response and a Karhunen-Loève transform to remove noise from our measurements. We present our progress in the characterization process and the results of our pipeline applied to an ALPAO DM97 and a BMC Kilo-DM, demonstrating the ability to drive the DMs to a flat of $\lesssim$ 2nm and $\lesssim$ 4nm RMS in our beam footprint on the University of Arizona Wavefront Control (UAWFC) testbed.
△ Less
Submitted 11 July, 2018;
originally announced July 2018.
-
PEAR: PEriodic And fixed Rank separation for fast fMRI
Authors:
Lior Weizman,
Karla L. Miller,
Mark Chiew,
Yonina C. Eldar
Abstract:
In functional MRI (fMRI), faster acquisition via undersampling of data can improve the spatial-temporal resolution trade-off and increase statistical robustness through increased degrees-of-freedom. High quality reconstruction of fMRI data from undersampled measurements requires proper modeling of the data. We present an fMRI reconstruction approach based on modeling the fMRI signal as a sum of pe…
▽ More
In functional MRI (fMRI), faster acquisition via undersampling of data can improve the spatial-temporal resolution trade-off and increase statistical robustness through increased degrees-of-freedom. High quality reconstruction of fMRI data from undersampled measurements requires proper modeling of the data. We present an fMRI reconstruction approach based on modeling the fMRI signal as a sum of periodic and fixed rank components, for improved reconstruction from undersampled measurements. We decompose the fMRI signal into a component which a has fixed rank and a component consisting of a sum of periodic signals which is sparse in the temporal Fourier domain. Data reconstruction is performed by solving a constrained problem that enforces a fixed, moderate rank on one of the components, and a limited number of temporal frequencies on the other. Our approach is coined PEAR - PEriodic And fixed Rank separation for fast fMRI.
Experimental results include purely synthetic simulation, a simulation with real timecourses and retrospective undersampling of a real fMRI dataset. Evaluation was performed both quantitatively and visually versus ground truth, comparing PEAR to two additional recent methods for fMRI reconstruction from undersampled measurements. Results demonstrate PEAR's improvement in estimating the timecourses and activation maps versus the methods compared against at acceleration ratios of R=8,16 (for simulated data) and R=6.66,10 (for real data). PEAR results in reconstruction with higher fidelity than when using a fixed-rank based model or a conventional Low-rank+Sparse algorithm. We have shown that splitting the functional information between the components leads to better modeling of fMRI, over state-of-the-art methods.
△ Less
Submitted 15 June, 2017;
originally announced June 2017.
-
The effect of realistic geometries on the susceptibility-weighted MR signal in white matter
Authors:
Tianyou Xu,
Sean Foxley,
Michiel Kleinnijenhuis,
Way Cherng Chen,
Karla L Miller
Abstract:
Purpose: To investigate the effect of realistic microstructural geometry on the susceptibility-weighted magnetic resonance (MR) signal in white matter (WM), with application to demyelination.
Methods: Previous work has modeled susceptibility-weighted signals under the assumption that axons are cylindrical. In this work, we explore the implications of this assumption by considering the effect of…
▽ More
Purpose: To investigate the effect of realistic microstructural geometry on the susceptibility-weighted magnetic resonance (MR) signal in white matter (WM), with application to demyelination.
Methods: Previous work has modeled susceptibility-weighted signals under the assumption that axons are cylindrical. In this work, we explore the implications of this assumption by considering the effect of more realistic geometries. A three-compartment WM model incorporating relevant properties based on literature was used to predict the MR signal. Myelinated axons were modeled with several cross-sectional geometries of increasing realism: nested circles, warped/elliptical circles and measured axonal geometries from electron micrographs. Signal simulations from the different microstructural geometries were compared to measured signals from a Cuprizone mouse model with varying degrees of demyelination.
Results: Results from simulation suggest that axonal geometry affects the MR signal. Predictions with realistic models were significantly different compared to circular models under the same microstructural tissue properties, for simulations with and without diffusion.
Conclusion: The geometry of axons affects the MR signal significantly. Literature estimates of myelin susceptibility, which are based on fitting biophysical models to the MR signal, are likely to be biased by the assumed geometry, as will any derived microstructural properties.
△ Less
Submitted 8 March, 2017;
originally announced March 2017.
