-
Hyperspectral Reconstruction of Skin Through Fusion of Scattering Transform Features
Authors:
Wojciech Czaja,
Jeremiah Emidih,
Brandon Kolstoe,
Richard G. Spencer
Abstract:
Hyperspectral imagery (HSI) is an established technique with an array of applications, but its use is limited due to both practical and technical issues associated with spectral devices. The goal of the ICASSP 2024 'Hyper-Skin' Challenge is to extract skin HSI from matching RGB images and an infrared band. To address this problem we propose a model using features of the scattering transform - a ty…
▽ More
Hyperspectral imagery (HSI) is an established technique with an array of applications, but its use is limited due to both practical and technical issues associated with spectral devices. The goal of the ICASSP 2024 'Hyper-Skin' Challenge is to extract skin HSI from matching RGB images and an infrared band. To address this problem we propose a model using features of the scattering transform - a type of convolutional neural network with predefined filters. Our model matches and inverts those features, rather than the pixel values, reducing the complexity of matching while grouping similar features together, resulting in an improved learning process.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Inversion of the Laplace Transform of Point Masses
Authors:
Michael McKenna,
Hrushikesh N. Mhaskar,
Richard G. Spencer
Abstract:
Motivated by applications in magnetic resonance relaxometry, we consider the following problem: Given samples of a function $t\mapsto \sum_{k=1}^K A_k\exp(-tλ_k)$, where $K\ge 2$ is an integer, $A_k\in\mathbb{R}$, $λ_k>0$ for $k=1,\cdots, K$, determine $K$, $A_k$'s and $λ_k$'s. Our approach is to transform this function into another function of the same form where $λ_k$'s are replaced by $iλ_k$. F…
▽ More
Motivated by applications in magnetic resonance relaxometry, we consider the following problem: Given samples of a function $t\mapsto \sum_{k=1}^K A_k\exp(-tλ_k)$, where $K\ge 2$ is an integer, $A_k\in\mathbb{R}$, $λ_k>0$ for $k=1,\cdots, K$, determine $K$, $A_k$'s and $λ_k$'s. Our approach is to transform this function into another function of the same form where $λ_k$'s are replaced by $iλ_k$. For this purpose, we study the least square approximation using polynomials weighted by the Gaussian weight, and use the fact that Hermite functions are eigenfunctions of the Fourier transform. We provide a detailed analysis of the effect of noise in the data.
△ Less
Submitted 6 February, 2024;
originally announced February 2024.
-
The Galactic Center with Roman
Authors:
Sean K. Terry,
Matthew W. Hosek Jr.,
Jessica R. Lu,
Casey Lam,
Natasha Abrams,
Arash Bahramian,
Richard Barry,
Jean-Phillipe Beaulieu,
Aparna Bhattacharya,
Devin Chu,
Anna Ciurlo,
Will Clarkson,
Tuan Do,
Kareem El-Badry,
Ryan Felton,
Matthew Freeman,
Abhimat Gautam,
Andrea Ghez,
Daniel Huber,
Jason Hunt,
Macy Huston,
Tharindu Jayasinghe,
Naoki Koshimoto,
Madeline Lucey,
Florian Peißker
, et al. (9 additional authors not shown)
Abstract:
We advocate for a Galactic center (GC) field to be added to the Galactic Bulge Time Domain Survey (GBTDS). The new field would yield high-cadence photometric and astrometric measurements of an unprecedented ${\sim}$3.3 million stars toward the GC. This would enable a wide range of science cases, such as finding star-compact object binaries that may ultimately merge as LISA-detectable gravitational…
▽ More
We advocate for a Galactic center (GC) field to be added to the Galactic Bulge Time Domain Survey (GBTDS). The new field would yield high-cadence photometric and astrometric measurements of an unprecedented ${\sim}$3.3 million stars toward the GC. This would enable a wide range of science cases, such as finding star-compact object binaries that may ultimately merge as LISA-detectable gravitational wave sources, constraining the mass function of stars and compact objects in different environments, detecting populations of microlensing and transiting exoplanets, studying stellar flares and variability in young and old stars, and monitoring accretion onto the central supermassive black hole. In addition, high-precision proper motions and parallaxes would open a new window into the large-scale dynamics of stellar populations at the GC, yielding insights into the formation and evolution of galactic nuclei and their co-evolution with the growth of the supermassive black hole. We discuss the possible trade-offs between the notional GBTDS and the addition of a GC field with either an optimal or minimal cadence. Ultimately, the addition of a GC field to the GBTDS would dramatically increase the science return of Roman and provide a legacy dataset to study the mid-plane and innermost regions of our Galaxy.
△ Less
Submitted 21 June, 2023;
originally announced June 2023.
-
Emergence of the SVD as an interpretable factorization in deep learning for inverse problems
Authors:
Shashank Sule,
Richard G. Spencer,
Wojciech Czaja
Abstract:
Within the framework of deep learning we demonstrate the emergence of the singular value decomposition (SVD) of the weight matrix as a tool for interpretation of neural networks (NN) when combined with the descrambling transformation--a recently-developed technique for addressing interpretability in noisy parameter estimation neural networks \cite{amey2021neural}. By considering the averaging effe…
▽ More
Within the framework of deep learning we demonstrate the emergence of the singular value decomposition (SVD) of the weight matrix as a tool for interpretation of neural networks (NN) when combined with the descrambling transformation--a recently-developed technique for addressing interpretability in noisy parameter estimation neural networks \cite{amey2021neural}. By considering the averaging effect of the data passed to the descrambling minimization problem, we show that descrambling transformations--in the large data limit--can be expressed in terms of the SVD of the NN weights and the input autocorrelation matrix. Using this fact, we show that within the class of noisy parameter estimation problems the SVD may be the structure through which trained networks encode a signal model. We substantiate our theoretical findings with empirical evidence from both linear and non-linear signal models. Our results also illuminate the connections between a mathematical theory of semantic development \cite{saxe2019mathematical} and neural network interpretability.
△ Less
Submitted 8 August, 2023; v1 submitted 18 January, 2023;
originally announced January 2023.
-
Solution of Non-negative Least Squares Inverse Problems Using a Span of Regularized Solutions, with Application to Magnetic Resonance Relaxometry
Authors:
Chuan Bi,
Miao-jung Yvonne Ou,
Mustapha Bouhrara,
Richard G. Spencer
Abstract:
We present a fundamentally new regularization method for the solution of the Fredholm integral equation of the first kind, in which we incorporate solutions corresponding to a range of Tikhonov regularizers into the end result. This method identifies solutions within a much larger function space, spanned by this set of regularized solutions, than is available to conventional regularizaton methods.…
▽ More
We present a fundamentally new regularization method for the solution of the Fredholm integral equation of the first kind, in which we incorporate solutions corresponding to a range of Tikhonov regularizers into the end result. This method identifies solutions within a much larger function space, spanned by this set of regularized solutions, than is available to conventional regularizaton methods. Each of these solutions is regularized to a different extent. In effect, we combine the stability of solutions with greater degrees of regularization with the resolution of those that are less regularized. In contrast, current methods involve selection of a single, or in some cases several, regularization parameters that define an optimal degree of regularization. Because the identified solution is within the span of a set of differently-regularized solutions, we call this method \textit{span of regularizations}, or SpanReg. We demonstrate the performance of SpanReg through a non-negative least squares analysis employing a Gaussian basis, and demonstrate the improved recovery of bimodal Gaussian distribution functions as compared to conventional methods. We also demonstrate that this method exhibits decreased dependence of the end result on the optimality of regularization parameter selection. We further illustrate the method with an application to myelin water fraction mapping in the human brain from experimental magnetic resonance imaging relaxometry data. We expect SpanReg to be widely applicable as an effective new method for regularization of inverse problems.
△ Less
Submitted 20 January, 2022; v1 submitted 18 February, 2021;
originally announced February 2021.
-
A Novel Extension to Fuzzy Connectivity for Body Composition Analysis: Applications in Thigh, Brain, and Whole Body Tissue Segmentation
Authors:
Ismail Irmakci,
Sarfaraz Hussein,
Aydogan Savran,
Rita R. Kalyani,
David Reiter,
Chee W. Chia,
Kenneth W. Fishbein,
Richard G. Spencer,
Luigi Ferrucci,
Ulas Bagci
Abstract:
Magnetic resonance imaging (MRI) is the non-invasive modality of choice for body tissue composition analysis due to its excellent soft tissue contrast and lack of ionizing radiation. However, quantification of body composition requires an accurate segmentation of fat, muscle and other tissues from MR images, which remains a challenging goal due to the intensity overlap between them. In this study,…
▽ More
Magnetic resonance imaging (MRI) is the non-invasive modality of choice for body tissue composition analysis due to its excellent soft tissue contrast and lack of ionizing radiation. However, quantification of body composition requires an accurate segmentation of fat, muscle and other tissues from MR images, which remains a challenging goal due to the intensity overlap between them. In this study, we propose a fully automated, data-driven image segmentation platform that addresses multiple difficulties in segmenting MR images such as varying inhomogeneity, non-standardness, and noise, while producing high-quality definition of different tissues. In contrast to most approaches in the literature, we perform segmentation operation by combining three different MRI contrasts and a novel segmentation tool which takes into account variability in the data. The proposed system, based on a novel affinity definition within the fuzzy connectivity (FC) image segmentation family, prevents the need for user intervention and reparametrization of the segmentation algorithms. In order to make the whole system fully automated, we adapt an affinity propagation clustering algorithm to roughly identify tissue regions and image background. We perform a thorough evaluation of the proposed algorithm's individual steps as well as comparison with several approaches from the literature for the main application of muscle/fat separation. Furthermore, whole-body tissue composition and brain tissue delineation were conducted to show the generalization ability of the proposed system. This new automated platform outperforms other state-of-the-art segmentation approaches both in accuracy and efficiency.
△ Less
Submitted 14 October, 2018;
originally announced October 2018.
