-
Stability Enhancement of LCL-Type Grid-Following Inverters Using Capacitor Voltage Active Damping
Authors:
Naser Souri,
Ali Mehrizi-Sani,
Kambiz Tehrani
Abstract:
An LCL filter offers superior attenuation for high-frequency harmonics for three-phase grid-following inverters compared to LC and L filters. However, it also introduces an inherent resonance peak, which can lead to power quality issues or even instability of the inverter control system. Active damping (AD) is widely employed to effectively mitigate this resonance. Capacitor voltage feedback (CVF)…
▽ More
An LCL filter offers superior attenuation for high-frequency harmonics for three-phase grid-following inverters compared to LC and L filters. However, it also introduces an inherent resonance peak, which can lead to power quality issues or even instability of the inverter control system. Active damping (AD) is widely employed to effectively mitigate this resonance. Capacitor voltage feedback (CVF) and capacitor current feedback (CCF) are effective AD methods for LCL resonance damping. CVF is preferred due to its lower sensor requirement compared to CCF. However, a derivative term appears in the active damping loop, which introduces high-frequency noise into the system. This paper proposes a noise-immune approach by replacing the derivative term with a discrete function suitable for digital implementation. The LCL resonance can be damped effectively, resulting in enhanced stability of the inverter control system. Simulation results verify the proposed effectiveness of the method with grid inductance variation and weak grid conditions
△ Less
Submitted 8 April, 2024;
originally announced April 2024.
-
Homodyned K-Distribution Parameter Estimation in Quantitative Ultrasound: Autoencoder and Bayesian Neural Network Approaches
Authors:
Ali K. Z. Tehrani,
Guy Cloutier,
An Tang,
Ivan M. Rosado-Mendez,
Hassan Rivaz
Abstract:
Quantitative ultrasound (QUS) analyzes the ultrasound backscattered data to find the properties of scatterers that correlate with the tissue microstructure. Statistics of the envelope of the backscattered radiofrequency (RF) data can be utilized to estimate several QUS parameters. Different distributions have been proposed to model envelope data. The homodyned K-distribution (HK distribution) is o…
▽ More
Quantitative ultrasound (QUS) analyzes the ultrasound backscattered data to find the properties of scatterers that correlate with the tissue microstructure. Statistics of the envelope of the backscattered radiofrequency (RF) data can be utilized to estimate several QUS parameters. Different distributions have been proposed to model envelope data. The homodyned K-distribution (HK distribution) is one of the most comprehensive distributions that can model ultrasound backscattered envelope data under diverse scattering conditions (varying scatterer number density and coherent scattering). The scatterer clustering parameter (alpha) and the ratio of the coherent to diffuse scattering power (k) are the parameters of this distribution that have been used extensively for tissue characterization in diagnostic ultrasound. The estimation of these two parameters (which we refer to as HK parameters) is done using optimization algorithms in which statistical features such as the envelope point-wise signalto-noise ratio (SNR), skewness, kurtosis, and the log-based moments have been utilized as input to such algorithms. The optimization methods minimize the difference between features and their theoretical value from the HK model. We propose that the true value of these statistical features is a hyperplane that covers a small portion of the feature space. In this paper, we follow two approaches to reduce the effect of sample features' error. We propose a model projection neural network based on denoising autoencoders to project the noisy features into this space based on this assumption. We also investigate if the noise distribution can be learned by the deep estimators. We compare the proposed methods with conventional methods using simulations, an experimental phantom, and data from an in vivo animal model of hepatic steatosis. A demo code are available online at http://code.sonography.ai
△ Less
Submitted 19 January, 2024;
originally announced January 2024.
-
Exploiting Mechanics-Based Priors for Lateral Displacement Estimation in Ultrasound Elastography
Authors:
Md Ashikuzzaman,
Ali K. Z. Tehrani,
Hassan Rivaz
Abstract:
Tracking the displacement between the pre- and post-deformed radio-frequency (RF) frames is a pivotal step of ultrasound elastography, which depicts tissue mechanical properties to identify pathologies. Due to ultrasound's poor ability to capture information pertaining to the lateral direction, the existing displacement estimation techniques fail to generate an accurate lateral displacement or str…
▽ More
Tracking the displacement between the pre- and post-deformed radio-frequency (RF) frames is a pivotal step of ultrasound elastography, which depicts tissue mechanical properties to identify pathologies. Due to ultrasound's poor ability to capture information pertaining to the lateral direction, the existing displacement estimation techniques fail to generate an accurate lateral displacement or strain map. The attempts made in the literature to mitigate this well-known issue suffer from one of the following limitations: 1) Sampling size is substantially increased, rendering the method computationally and memory expensive. 2) The lateral displacement estimation entirely depends on the axial one, ignoring data fidelity and creating large errors. This paper proposes exploiting the effective Poisson's ratio (EPR)-based mechanical correspondence between the axial and lateral strains along with the RF data fidelity and displacement continuity to improve the lateral displacement and strain estimation accuracies. We call our techniques MechSOUL (Mechanically-constrained Second-Order Ultrasound eLastography) and L1-MechSOUL (L1-norm-based MechSOUL), which optimize L2- and L1-norm-based penalty functions, respectively. Extensive validation experiments with simulated, phantom, and in vivo datasets demonstrate that MechSOUL and L1-MechSOUL's lateral strain and EPR estimation abilities are substantially superior to those of the recently-published elastography techniques. We have published the MATLAB codes of MechSOUL and L1-MechSOUL at http://code.sonography.ai.
△ Less
Submitted 31 May, 2023;
originally announced May 2023.
-
A deep learning approach for patchless estimation of ultrasound quantitative parametric image with uncertainty measurement
Authors:
Ali K. Z. Tehrani,
Ivan M. Rosado-Mendez,
Hayley Whitson,
Hassan Rivaz
Abstract:
Quantitative ultrasound (QUS) aims to find properties of scatterers which are related to the tissue microstructure. Among different QUS parameters, scatterer number density has been found to be a reliable biomarker for detecting different abnormalities. The homodyned K-distribution (HK-distribution) is a model for the probability density function of the ultrasound echo amplitude that can model dif…
▽ More
Quantitative ultrasound (QUS) aims to find properties of scatterers which are related to the tissue microstructure. Among different QUS parameters, scatterer number density has been found to be a reliable biomarker for detecting different abnormalities. The homodyned K-distribution (HK-distribution) is a model for the probability density function of the ultrasound echo amplitude that can model different scattering scenarios but requires a large number of samples to be estimated reliably. Parametric images of HK-distribution parameters can be formed by dividing the envelope data into small overlapping patches and estimating parameters within the patches independently. This approach imposes two limiting constraints, the HK-distribution parameters are assumed to be constant within each patch, and each patch requires enough independent samples. In order to mitigate those problems, we employ a deep learning approach to estimate parametric images of scatterer number density (related to HK-distribution shape parameter) without patching. Furthermore, an uncertainty map of the network's prediction is quantified to provide insight about the confidence of the network about the estimated HK parameter values.
△ Less
Submitted 24 February, 2023;
originally announced February 2023.
-
Lateral Strain Imaging using Self-supervised and Physically Inspired Constraints in Unsupervised Regularized Elastography
Authors:
Ali K. Z. Tehrani,
Md Ashikuzzaman,
Hassan Rivaz
Abstract:
Convolutional Neural Networks (CNN) have shown promising results for displacement estimation in UltraSound Elastography (USE). Many modifications have been proposed to improve the displacement estimation of CNNs for USE in the axial direction. However, the lateral strain, which is essential in several downstream tasks such as the inverse problem of elasticity imaging, remains a challenge. The late…
▽ More
Convolutional Neural Networks (CNN) have shown promising results for displacement estimation in UltraSound Elastography (USE). Many modifications have been proposed to improve the displacement estimation of CNNs for USE in the axial direction. However, the lateral strain, which is essential in several downstream tasks such as the inverse problem of elasticity imaging, remains a challenge. The lateral strain estimation is complicated since the motion and the sampling frequency in this direction are substantially lower than the axial one, and a lack of carrier signal in this direction. In computer vision applications, the axial and the lateral motions are independent. In contrast, the tissue motion pattern in USE is governed by laws of physics which link the axial and lateral displacements. In this paper, inspired by Hooke's law, we first propose Physically Inspired ConsTraint for Unsupervised Regularized Elastography (PICTURE), where we impose a constraint on the Effective Poisson's ratio (EPR) to improve the lateral strain estimation. In the next step, we propose self-supervised PICTURE (sPICTURE) to further enhance the strain image estimation. Extensive experiments on simulation, experimental phantom and in vivo data demonstrate that the proposed methods estimate accurate axial and lateral strain maps.
△ Less
Submitted 16 December, 2022;
originally announced December 2022.
-
Homodyned K-distribution: parameter estimation and uncertainty quantification using Bayesian neural networks
Authors:
Ali K. Z. Tehrani,
Ivan M. Rosado-Mendez,
Hassan Rivaz
Abstract:
Quantitative ultrasound (QUS) allows estimating the intrinsic tissue properties. Speckle statistics are the QUS parameters that describe the first order statistics of ultrasound (US) envelope data. The parameters of Homodyned K-distribution (HK-distribution) are the speckle statistics that can model the envelope data in diverse scattering conditions. However, they require a large amount of data to…
▽ More
Quantitative ultrasound (QUS) allows estimating the intrinsic tissue properties. Speckle statistics are the QUS parameters that describe the first order statistics of ultrasound (US) envelope data. The parameters of Homodyned K-distribution (HK-distribution) are the speckle statistics that can model the envelope data in diverse scattering conditions. However, they require a large amount of data to be estimated reliably. Consequently, finding out the intrinsic uncertainty of the estimated parameters can help us to have a better understanding of the estimated parameters. In this paper, we propose a Bayesian Neural Network (BNN) to estimate the parameters of HK-distribution and quantify the uncertainty of the estimator.
△ Less
Submitted 31 October, 2022;
originally announced November 2022.
-
Infusing known operators in convolutional neural networks for lateral strain imaging in ultrasound elastography
Authors:
Ali K. Z. Tehrani,
Hassan Rivaz
Abstract:
Convolutional Neural Networks (CNN) have been employed for displacement estimation in ultrasound elastography (USE). High-quality axial strains (derivative of the axial displacement in the axial direction) can be estimated by the proposed networks. In contrast to axial strain, lateral strain, which is highly required in Poisson's ratio imaging and elasticity reconstruction, has a poor quality. The…
▽ More
Convolutional Neural Networks (CNN) have been employed for displacement estimation in ultrasound elastography (USE). High-quality axial strains (derivative of the axial displacement in the axial direction) can be estimated by the proposed networks. In contrast to axial strain, lateral strain, which is highly required in Poisson's ratio imaging and elasticity reconstruction, has a poor quality. The main causes include low sampling frequency, limited motion, and lack of phase information in the lateral direction. Recently, physically inspired constraint in unsupervised regularized elastography (PICTURE) has been proposed. This method took into account the range of the feasible lateral strain defined by the rules of physics of motion and employed a regularization strategy to improve the lateral strains. Despite the substantial improvement, the regularization was only applied during the training; hence it did not guarantee during the test that the lateral strain is within the feasible range. Furthermore, only the feasible range was employed, other constraints such as incompressibility were not investigated. In this paper, we address these two issues and propose kPICTURE in which two iterative algorithms were infused into the network architecture in the form of known operators to ensure the lateral strain is within the feasible range and impose incompressibility during the test phase.
△ Less
Submitted 7 July, 2023; v1 submitted 31 October, 2022;
originally announced November 2022.
-
X-ray properties of early-type stars in the Tarantula Nebula from T-ReX
Authors:
Paul A Crowther,
Patrick S Broos,
Leisa K Townsley,
Andy M T Pollock,
Katie A Tehrani,
Marc Gagne
Abstract:
We reassess the historical $L_{X}/L_{Bol}$ relation for early-type stars from a comparison between T-ReX, the Chandra ACIS X-ray survey of the Tarantula Nebula in the LMC, and contemporary spectroscopic analysis of massive stars obtained primarily from VLT/FLAMES, VLT/MUSE and HST/STIS surveys. For 107 sources in common (some host to multiple stars), the majority of which are bolometrically lumino…
▽ More
We reassess the historical $L_{X}/L_{Bol}$ relation for early-type stars from a comparison between T-ReX, the Chandra ACIS X-ray survey of the Tarantula Nebula in the LMC, and contemporary spectroscopic analysis of massive stars obtained primarily from VLT/FLAMES, VLT/MUSE and HST/STIS surveys. For 107 sources in common (some host to multiple stars), the majority of which are bolometrically luminous (40% exceed $10^6 L_{\odot}$), we find an average $\log L_{X} /L_{Bol} = -6.90 \pm 0.65$. Excluding extreme systems Mk 34 (WN5h+WN5h), R140a (WC4+WN6+) and VFTS 399 (O9 IIIn+?), plus four WR sources with anomalously hard X-ray components (R130, R134, R135, Mk 53) and 10 multiple sources within the spatially crowded core of R136a, $\log L_{X}/L_{Bol} = -7.00 \pm 0.49$, in good agreement with Galactic OB stars. No difference is found between single and binary systems, nor between O, Of/WN and WR stars, although there does appear to be a trend towards harder X-ray emission from O dwarfs, through O (super)giants, Of/WN stars and WR stars. The majority of known OB stars in the Tarantula are not detected in the T-ReX point source catalogue, so we have derived upper limits for all undetected OB stars for which log $L_{Bol}/L_{\odot} \geq 5.0$. A survival analysis using detected and upper-limit log $L_{X}/L_{Bol}$ values indicates no significant difference between luminous O stars in the LMC and the Carina Nebula. This analysis suggests that metallicity does not strongly influence $L_{X}/L_{Bol}$. Plasma temperatures for single, luminous O stars in the Tarantula ($\overline{kT_{m}}=1.0$ keV) are higher than counterparts in Carina ($\overline{kT_{m}}=0.5$ keV).
△ Less
Submitted 21 July, 2022; v1 submitted 18 July, 2022;
originally announced July 2022.
-
Deep Estimation of Speckle Statistics Parametric Images
Authors:
Ali K. Z. Tehrani,
Ivan M. Rosado-Mendez,
Hassan Rivaz
Abstract:
Quantitative Ultrasound (QUS) provides important information about the tissue properties. QUS parametric image can be formed by dividing the envelope data into small overlapping patches and computing different speckle statistics such as parameters of the Nakagami and Homodyned K-distributions (HK-distribution). The calculated QUS parametric images can be erroneous since only a few independent samp…
▽ More
Quantitative Ultrasound (QUS) provides important information about the tissue properties. QUS parametric image can be formed by dividing the envelope data into small overlapping patches and computing different speckle statistics such as parameters of the Nakagami and Homodyned K-distributions (HK-distribution). The calculated QUS parametric images can be erroneous since only a few independent samples are available inside the patches. Another challenge is that the envelope samples inside the patch are assumed to come from the same distribution, an assumption that is often violated given that the tissue is usually not homogenous. In this paper, we propose a method based on Convolutional Neural Networks (CNN) to estimate QUS parametric images without patching. We construct a large dataset sampled from the HK-distribution, having regions with random shapes and QUS parameter values. We then use a well-known network to estimate QUS parameters in a multi-task learning fashion. Our results confirm that the proposed method is able to reduce errors and improve border definition in QUS parametric images.
△ Less
Submitted 8 June, 2022;
originally announced June 2022.
-
Physically Inspired Constraint for Unsupervised Regularized Ultrasound Elastography
Authors:
Ali K. Z. Tehrani,
Hassan Rivaz
Abstract:
Displacement estimation is a critical step of virtually all Ultrasound Elastography (USE) techniques. Two main features make this task unique compared to the general optical flow problem: the high-frequency nature of ultrasound radio-frequency (RF) data and the governing laws of physics on the displacement field. Recently, the architecture of the optical flow networks has been modified to be able…
▽ More
Displacement estimation is a critical step of virtually all Ultrasound Elastography (USE) techniques. Two main features make this task unique compared to the general optical flow problem: the high-frequency nature of ultrasound radio-frequency (RF) data and the governing laws of physics on the displacement field. Recently, the architecture of the optical flow networks has been modified to be able to use RF data. Also, semi-supervised and unsupervised techniques have been employed for USE by considering prior knowledge of displacement continuity in the form of the first- and second-derivative regularizers. Despite these attempts, no work has considered the tissue compression pattern, and displacements in axial and lateral directions have been assumed to be independent. However, tissue motion pattern is governed by laws of physics in USE, rendering the axial and the lateral displacements highly correlated. In this paper, we propose Physically Inspired ConsTraint for Unsupervised Regularized Elastography (PICTURE), where we impose constraints on the Poisson's ratio to improve lateral displacement estimates. Experiments on phantom and in vivo data show that PICTURE substantially improves the quality of the lateral displacement estimation.
△ Less
Submitted 11 June, 2022; v1 submitted 5 June, 2022;
originally announced June 2022.
-
Bi-Directional Semi-Supervised Training of Convolutional Neural Networks for Ultrasound Elastography Displacement Estimation
Authors:
Ali K. Z. Tehrani,
Mostafa Sharifzadeh,
Emad Boctor,
Hassan Rivaz
Abstract:
The performance of ultrasound elastography (USE) heavily depends on the accuracy of displacement estimation. Recently, Convolutional Neural Networks (CNN) have shown promising performance in optical flow estimation and have been adopted for USE displacement estimation. Networks trained on computer vision images are not optimized for USE displacement estimation since there is a large gap between th…
▽ More
The performance of ultrasound elastography (USE) heavily depends on the accuracy of displacement estimation. Recently, Convolutional Neural Networks (CNN) have shown promising performance in optical flow estimation and have been adopted for USE displacement estimation. Networks trained on computer vision images are not optimized for USE displacement estimation since there is a large gap between the computer vision images and the high-frequency Radio Frequency (RF) ultrasound data. Many researchers tried to adopt the optical flow CNNs to USE by applying transfer learning to improve the performance of CNNs for USE. However, the ground truth displacement in real ultrasound data is unknown, and simulated data exhibits a domain shift compared to the real data and is also computationally expensive to generate. To resolve this issue, semi-supervised methods have been proposed wherein the networks pre-trained on computer vision images are fine-tuned using real ultrasound data. In this paper, we employ a semi-supervised method by exploiting the first and second-order derivatives of the displacement field for the regularization. We also modify the network structure to estimate both forward and backward displacements, and propose to use consistency between the forward and backward strains as an additional regularizer to further enhance the performance. We validate our method using several experimental phantom and in vivo data. We also show that the network fine-tuned by our proposed method using experimental phantom data performs well on in vivo data similar to the network fine-tuned on in vivo data. Our results also show that the proposed method outperforms current deep learning methods and is comparable to computationally expensive optimization-based algorithms.
△ Less
Submitted 31 January, 2022;
originally announced January 2022.
-
Robust Scatterer Number Density Segmentation of Ultrasound Images
Authors:
Ali K. Z. Tehrani,
Ivan M. Rosado-Mendez,
Hassan Rivaz
Abstract:
Quantitative UltraSound (QUS) aims to reveal information about the tissue microstructure using backscattered echo signals from clinical scanners. Among different QUS parameters, scatterer number density is an important property that can affect estimation of other QUS parameters. Scatterer number density can be classified into high or low scatterer densities. If there are more than 10 scatterers in…
▽ More
Quantitative UltraSound (QUS) aims to reveal information about the tissue microstructure using backscattered echo signals from clinical scanners. Among different QUS parameters, scatterer number density is an important property that can affect estimation of other QUS parameters. Scatterer number density can be classified into high or low scatterer densities. If there are more than 10 scatterers inside the resolution cell, the envelope data is considered as Fully Developed Speckle (FDS) and otherwise, as Under Developed Speckle (UDS). In conventional methods, the envelope data is divided into small overlapping windows (a strategy here we refer to as patching), and statistical parameters such as SNR and skewness are employed to classify each patch of envelope data. However, these parameters are system dependent meaning that their distribution can change by the imaging settings and patch size. Therefore, reference phantoms which have known scatterer number density are imaged with the same imaging settings to mitigate system dependency. In this paper, we aim to segment regions of ultrasound data without any patching. A large dataset is generated which has different shapes of scatterer number density and mean scatterer amplitude using a fast simulation method. We employ a convolutional neural network (CNN) for the segmentation task and investigate the effect of domain shift when the network is tested on different datasets with different imaging settings. Nakagami parametric image is employed for the multi-task learning to improve the performance. Furthermore, inspired by the reference phantom methods in QUS, A domain adaptation stage is proposed which requires only two frames of data from FDS and UDS classes. We evaluate our method for different experimental phantoms and in vivo data.
△ Less
Submitted 16 January, 2022;
originally announced January 2022.
-
Ultrasound Domain Adaptation Using Frequency Domain Analysis
Authors:
Mostafa Sharifzadeh,
Ali K. Z. Tehrani,
Habib Benali,
Hassan Rivaz
Abstract:
A common issue in exploiting simulated ultrasound data for training neural networks is the domain shift problem, where the trained models on synthetic data are not generalizable to clinical data. Recently, Fourier Domain Adaptation (FDA) has been proposed in the field of computer vision to tackle the domain shift problem by replacing the magnitude of the low-frequency spectrum of a synthetic sampl…
▽ More
A common issue in exploiting simulated ultrasound data for training neural networks is the domain shift problem, where the trained models on synthetic data are not generalizable to clinical data. Recently, Fourier Domain Adaptation (FDA) has been proposed in the field of computer vision to tackle the domain shift problem by replacing the magnitude of the low-frequency spectrum of a synthetic sample (source) with a real sample (target). This method is attractive in ultrasound imaging given that two important differences between synthetic and real ultrasound data are caused by unknown values of attenuation and speed of sound (SOS) in real tissues. Attenuation leads to slow variations in the amplitude of the B-mode image, and SOS mismatch creates aberration and subsequent blurring. As such, both domain shifts cause differences in the low-frequency components of the envelope data, which are replaced in the proposed method. We demonstrate that applying the FDA method to the synthetic data, simulated by Field II, obtains an 3.5\% higher Dice similarity coefficient for a breast lesion segmentation task.
△ Less
Submitted 21 September, 2021;
originally announced September 2021.
-
Ultrasound Scatterer Density Classification Using Convolutional Neural Networks by Exploiting Patch Statistics
Authors:
Ali K. Z. Tehrani,
Mina Amiri,
Ivan M. Rosado-Mendez,
Timothy J. Hall,
Hassan Rivaz
Abstract:
Quantitative ultrasound (QUS) can reveal crucial information on tissue properties such as scatterer density. If the scatterer density per resolution cell is above or below 10, the tissue is considered as fully developed speckle (FDS) or low-density scatterers (LDS), respectively. Conventionally, the scatterer density has been classified using estimated statistical parameters of the amplitude of ba…
▽ More
Quantitative ultrasound (QUS) can reveal crucial information on tissue properties such as scatterer density. If the scatterer density per resolution cell is above or below 10, the tissue is considered as fully developed speckle (FDS) or low-density scatterers (LDS), respectively. Conventionally, the scatterer density has been classified using estimated statistical parameters of the amplitude of backscattered echoes. However, if the patch size is small, the estimation is not accurate. These parameters are also highly dependent on imaging settings. In this paper, we propose a convolutional neural network (CNN) architecture for QUS, and train it using simulation data. We further improve the network performance by utilizing patch statistics as additional input channels. We evaluate the network using simulation data, experimental phantoms and in vivo data. We also compare our proposed network with different classic and deep learning models, and demonstrate its superior performance in classification of tissues with different scatterer density values. The results also show that the proposed network is able to work with different imaging parameters with no need for a reference phantom. This work demonstrates the potential of CNNs in classifying scatterer density in ultrasound images.
△ Less
Submitted 4 December, 2020;
originally announced December 2020.
-
PPL Bench: Evaluation Framework For Probabilistic Programming Languages
Authors:
Sourabh Kulkarni,
Kinjal Divesh Shah,
Nimar Arora,
Xiaoyan Wang,
Yucen Lily Li,
Nazanin Khosravani Tehrani,
Michael Tingley,
David Noursi,
Narjes Torabi,
Sepehr Akhavan Masouleh,
Eric Lippert,
Erik Meijer
Abstract:
We introduce PPL Bench, a new benchmark for evaluating Probabilistic Programming Languages (PPLs) on a variety of statistical models. The benchmark includes data generation and evaluation code for a number of models as well as implementations in some common PPLs. All of the benchmark code and PPL implementations are available on Github. We welcome contributions of new models and PPLs and as well a…
▽ More
We introduce PPL Bench, a new benchmark for evaluating Probabilistic Programming Languages (PPLs) on a variety of statistical models. The benchmark includes data generation and evaluation code for a number of models as well as implementations in some common PPLs. All of the benchmark code and PPL implementations are available on Github. We welcome contributions of new models and PPLs and as well as improvements in existing PPL implementations. The purpose of the benchmark is two-fold. First, we want researchers as well as conference reviewers to be able to evaluate improvements in PPLs in a standardized setting. Second, we want end users to be able to pick the PPL that is most suited for their modeling application. In particular, we are interested in evaluating the accuracy and speed of convergence of the inferred posterior. Each PPL only needs to provide posterior samples given a model and observation data. The framework automatically computes and plots growth in predictive log-likelihood on held out data in addition to reporting other common metrics such as effective sample size and $\hat{r}$.
△ Less
Submitted 17 October, 2020;
originally announced October 2020.
-
Semi-Supervised Training of Optical Flow Convolutional Neural Networks in Ultrasound Elastography
Authors:
Ali K. Z. Tehrani,
Morteza Mirzaei,
Hassan Rivaz
Abstract:
Convolutional Neural Networks (CNN) have been found to have great potential in optical flow problems thanks to an abundance of data available for training a deep network. The displacement estimation step in UltraSound Elastography (USE) can be viewed as an optical flow problem. Despite the high performance of CNNs in optical flow, they have been rarely used for USE due to unique challenges that bo…
▽ More
Convolutional Neural Networks (CNN) have been found to have great potential in optical flow problems thanks to an abundance of data available for training a deep network. The displacement estimation step in UltraSound Elastography (USE) can be viewed as an optical flow problem. Despite the high performance of CNNs in optical flow, they have been rarely used for USE due to unique challenges that both input and output of USE networks impose. Ultrasound data has much higher high-frequency content compared to natural images. The outputs are also drastically different, where displacement values in USE are often smooth without sharp motions or discontinuities. The general trend is currently to use pre-trained networks and fine-tune them on a small simulation ultrasound database. However, realistic ultrasound simulation is computationally expensive. Also, the simulation techniques do not model complex motions, nonlinear and frequency-dependent acoustics, and many sources of artifact in ultrasound imaging. Herein, we propose an unsupervised fine-tuning technique which enables us to employ a large unlabeled dataset for fine-tuning of a CNN optical flow network. We show that the proposed unsupervised fine-tuning method substantially improves the performance of the network and reduces the artifacts generated by networks trained on computer vision databases.
△ Less
Submitted 2 July, 2020;
originally announced July 2020.
-
Newtonian Monte Carlo: single-site MCMC meets second-order gradient methods
Authors:
Nimar S. Arora,
Nazanin Khosravani Tehrani,
Kinjal Divesh Shah,
Michael Tingley,
Yucen Lily Li,
Narjes Torabi,
David Noursi,
Sepehr Akhavan Masouleh,
Eric Lippert,
Erik Meijer
Abstract:
Single-site Markov Chain Monte Carlo (MCMC) is a variant of MCMC in which a single coordinate in the state space is modified in each step. Structured relational models are a good candidate for this style of inference. In the single-site context, second order methods become feasible because the typical cubic costs associated with these methods is now restricted to the dimension of each coordinate.…
▽ More
Single-site Markov Chain Monte Carlo (MCMC) is a variant of MCMC in which a single coordinate in the state space is modified in each step. Structured relational models are a good candidate for this style of inference. In the single-site context, second order methods become feasible because the typical cubic costs associated with these methods is now restricted to the dimension of each coordinate. Our work, which we call Newtonian Monte Carlo (NMC), is a method to improve MCMC convergence by analyzing the first and second order gradients of the target density to determine a suitable proposal density at each point. Existing first order gradient-based methods suffer from the problem of determining an appropriate step size. Too small a step size and it will take a large number of steps to converge, while a very large step size will cause it to overshoot the high density region. NMC is similar to the Newton-Raphson update in optimization where the second order gradient is used to automatically scale the step size in each dimension. However, our objective is to find a parameterized proposal density rather than the maxima.
As a further improvement on existing first and second order methods, we show that random variables with constrained supports don't need to be transformed before taking a gradient step. We demonstrate the efficiency of NMC on a number of different domains. For statistical models where the prior is conjugate to the likelihood, our method recovers the posterior quite trivially in one step. However, we also show results on fairly large non-conjugate models, where NMC performs better than adaptive first order methods such as NUTS or other inexact scalable inference methods such as Stochastic Variational Inference or bootstrapping.
△ Less
Submitted 15 January, 2020;
originally announced January 2020.
-
Weighing Melnick 34: the most massive binary system known
Authors:
Katie A. Tehrani,
Paul A. Crowther,
Joachim M. Bestenlehner,
Stuart P. Littlefair,
A. M. T. Pollock,
Richard J. Parker,
Olivier Schnurr
Abstract:
Here we confirm Melnick 34, an X-ray bright star in the 30 Doradus region of the Large Magellanic Cloud, as an SB2 binary comprising WN5h+WN5h components. We present orbital solutions using 26 epochs of VLT/UVES spectra and 22 epochs of archival Gemini/GMOS spectra. Radial-velocity monitoring and automated template fitting methods both reveal a similar high eccentricity system with a mass ratio cl…
▽ More
Here we confirm Melnick 34, an X-ray bright star in the 30 Doradus region of the Large Magellanic Cloud, as an SB2 binary comprising WN5h+WN5h components. We present orbital solutions using 26 epochs of VLT/UVES spectra and 22 epochs of archival Gemini/GMOS spectra. Radial-velocity monitoring and automated template fitting methods both reveal a similar high eccentricity system with a mass ratio close to unity, and an orbital period in agreement with the 155.1 +/- 1 day X-ray light curve period previously derived by Pollock et al. Our favoured solution derived an eccentricity of 0.68 +/- 0.02 and mass ratio of 0.92 +/- 0.07, giving minimum masses of Ma_sin^{3}(i) = 65 +/- 7 Msun and Mb_sin^{3}(i) = 60 +/- 7 Msun. Spectral modelling using WN5h templates with CMFGEN reveals temperatures of T ~53 kK for each component and luminosities of log(La/Lsun) = 6.43 +/- 0.08 and log(Lb/Lsun) = 6.37 +/- 0.08, from which BONNSAI evolutionary modelling gives masses of Ma = 139 (+21,-18) Msun and Mb = 127 (+17,-17) Msun and ages of ~0.6 Myrs. Spectroscopic and dynamic masses would agree if Mk34 has an inclination of i ~50°, making Mk34 the most massive binary known and an excellent candidate for investigating the properties of colliding wind binaries. Within 2-3 Myrs, both components of Mk34 are expected to evolve to stellar mass black holes which, assuming the binary system survives, would make Mk34 a potential binary black hole merger progenitor and gravitational wave source.
△ Less
Submitted 15 January, 2019;
originally announced January 2019.
-
The 155-day X-ray cycle of the very massive Wolf-Rayet star Melnick 34 in the Large Magellanic Cloud
Authors:
A. M. T. Pollock,
P. A. Crowther,
K. Tehrani,
Patrick S. Broos,
Leisa K. Townsley
Abstract:
The Wolf-Rayet star Mk 34 was observed more than 50 times as part of the deep T-ReX Chandra ACIS-I X-ray imaging survey of the Tarantula Nebula in the Large Magellanic Cloud conducted between 2014 May and 2016 January. Its brightness showed one bright maximum and repeated faint minima which help define an X-ray recurrence time of $155.1\pm0.1$ days that is probably the orbital period of an eccentr…
▽ More
The Wolf-Rayet star Mk 34 was observed more than 50 times as part of the deep T-ReX Chandra ACIS-I X-ray imaging survey of the Tarantula Nebula in the Large Magellanic Cloud conducted between 2014 May and 2016 January. Its brightness showed one bright maximum and repeated faint minima which help define an X-ray recurrence time of $155.1\pm0.1$ days that is probably the orbital period of an eccentric binary system. The maximum immediately precedes the minimum in the folded X-ray light curve as confirmed by new Swift XRT observations. Notwithstanding its extreme median luminosity of $1.2\times10^{35}\mathrm{erg}~\mathrm{s}^{-1}$, which makes it over an order of magnitude brighter than comparable stars in the Milky Way, Mk 34 is almost certainly a colliding-wind binary system. Its spectrum shows phase-related changes of luminosity and absorption that are probably related to the orbital dynamics of two of the most massive stars known.
△ Less
Submitted 2 March, 2018;
originally announced March 2018.
-
Revealing the nebular properties and Wolf-Rayet population of IC10 with Gemini/GMOS
Authors:
Katie Tehrani,
Paul A. Crowther,
Isabelle Archer
Abstract:
We present a deep imaging and spectroscopic survey of the Local Group irregular galaxy IC10 using Gemini North and GMOS to unveil its global Wolf-Rayet (WR) population. We obtain a star formation rate (SFR) of 0.045 +/- 0.023 Msun/yr, for IC10 from the nebular Halpha luminosity, which is comparable to the SMC. We also present a revised nebular oxygen abundance of log(O/H) + 12 = 8.40 +/- 0.04, com…
▽ More
We present a deep imaging and spectroscopic survey of the Local Group irregular galaxy IC10 using Gemini North and GMOS to unveil its global Wolf-Rayet (WR) population. We obtain a star formation rate (SFR) of 0.045 +/- 0.023 Msun/yr, for IC10 from the nebular Halpha luminosity, which is comparable to the SMC. We also present a revised nebular oxygen abundance of log(O/H) + 12 = 8.40 +/- 0.04, comparable to the LMC. It has previously been suggested that for IC10 to follow the WR subtype-metallicity dependance seen in other Local Group galaxies, a large WN population awaits discovery. Our search revealed 3 new WN stars, and 6 candidates awaiting confirmation, providing little evidence to support this claim. The new global WR star total of 29 stars is consistent with the LMC population when scaled to the reduced SFR of IC10. For spectroscopically confirmed WR stars, the WC/WN ratio is lowered to 1.0, however including all potential candidates, and assuming those unconfirmed to be WN stars, would reduce the ratio to ~0.7. We attribute the high WC/WN ratio to the high star formation surface density of IC10 relative to the Magellanic Clouds, which enhances the frequency of high mass stars capable of producing WC stars.
△ Less
Submitted 11 August, 2017;
originally announced August 2017.
