Showing 51–90 of 90 results for author: Niethammer, M

Spin-controlled generation of indistinguishable and distinguishable photons from silicon vacancy centres in silicon carbide

Authors: Naoya Morioka, Charles Babin, Roland Nagy, Izel Gediz, Erik Hesselmeier, Di Liu, Matthew Joliffe, Matthias Niethammer, Durga Dasari, Vadim Vorobyov, Roman Kolesov, Rainer Stöhr, Jawad Ul-Hassan, Nguyen Tien Son, Takeshi Ohshima, Péter Udvarhelyi, Gergő Thiering, Adam Gali, Jörg Wrachtrup, Florian Kaiser

Abstract: Quantum systems combining indistinguishable photon generation and spin-based quantum information processing are essential for remote quantum applications and networking. However, identification of suitable systems in scalable platforms remains a challenge. Here, we investigate the silicon vacancy centre in silicon carbide and demonstrate controlled emission of indistinguishable and distinguishable… ▽ More Quantum systems combining indistinguishable photon generation and spin-based quantum information processing are essential for remote quantum applications and networking. However, identification of suitable systems in scalable platforms remains a challenge. Here, we investigate the silicon vacancy centre in silicon carbide and demonstrate controlled emission of indistinguishable and distinguishable photons via coherent spin manipulation. Using strong off-resonant excitation and collecting photons from the ultra-stable zero-phonon line optical transitions, we show a two-photon interference contrast close to 90% in Hong-Ou-Mandel type experiments. Further, we exploit the system's intimate spin-photon relation to spin-control the colour and indistinguishability of consecutively emitted photons. Our results provide a deep insight into the system's spin-phonon-photon physics and underline the potential of the industrially compatible silicon carbide platform for measurement-based entanglement distribution and photonic cluster state generation. Additional coupling to quantum registers based on recently demonstrated coupled individual nuclear spins would further allow for high-level network-relevant quantum information processing, such as error correction and entanglement purification. △ Less

Submitted 10 January, 2020; v1 submitted 8 January, 2020; originally announced January 2020.

Comments: Manuscript and Methods: 21 pages, 4 figures Supplementary Information: 18 pages, 6 figures, 1 table

Journal ref: Nature Communications 11, 2516 (2020)

Joint and individual analysis of breast cancer histologic images and genomic covariates

Authors: Iain Carmichael, Benjamin C. Calhoun, Katherine A. Hoadley, Melissa A. Troester, Joseph Geradts, Heather D. Couture, Linnea Olsson, Charles M. Perou, Marc Niethammer, Jan Hannig, J. S. Marron

Abstract: A key challenge in modern data analysis is understanding connections between complex and differing modalities of data. For example, two of the main approaches to the study of breast cancer are histopathology (analyzing visual characteristics of tumors) and genetics. While histopathology is the gold standard for diagnostics and there have been many recent breakthroughs in genetics, there is little… ▽ More A key challenge in modern data analysis is understanding connections between complex and differing modalities of data. For example, two of the main approaches to the study of breast cancer are histopathology (analyzing visual characteristics of tumors) and genetics. While histopathology is the gold standard for diagnostics and there have been many recent breakthroughs in genetics, there is little overlap between these two fields. We aim to bridge this gap by developing methods based on Angle-based Joint and Individual Variation Explained (AJIVE) to directly explore similarities and differences between these two modalities. Our approach exploits Convolutional Neural Networks (CNNs) as a powerful, automatic method for image feature extraction to address some of the challenges presented by statistical analysis of histopathology image data. CNNs raise issues of interpretability that we address by developing novel methods to explore visual modes of variation captured by statistical algorithms (e.g. PCA or AJIVE) applied to CNN features. Our results provide many interpretable connections and contrasts between histopathology and genetics. △ Less

Submitted 13 April, 2020; v1 submitted 1 December, 2019; originally announced December 2019.

VoteNet+ : An Improved Deep Learning Label Fusion Method for Multi-atlas Segmentation

Authors: Zhipeng Ding, Xu Han, Marc Niethammer

Abstract: In this work, we improve the performance of multi-atlas segmentation (MAS) by integrating the recently proposed VoteNet model with the joint label fusion (JLF) approach. Specifically, we first illustrate that using a deep convolutional neural network to predict atlas probabilities can better distinguish correct atlas labels from incorrect ones than relying on image intensity difference as is typic… ▽ More In this work, we improve the performance of multi-atlas segmentation (MAS) by integrating the recently proposed VoteNet model with the joint label fusion (JLF) approach. Specifically, we first illustrate that using a deep convolutional neural network to predict atlas probabilities can better distinguish correct atlas labels from incorrect ones than relying on image intensity difference as is typical in JLF. Motivated by this finding, we propose VoteNet+, an improved deep network to locally predict the probability of an atlas label to differs from the label of the target image. Furthermore, we show that JLF is more suitable for the VoteNet framework as a label fusion method than plurality voting. Lastly, we use Platt scaling to calibrate the probabilities of our new model. Results on LPBA40 3D MR brain images show that our proposed method can achieve better performance than VoteNet. △ Less

Submitted 13 January, 2020; v1 submitted 1 November, 2019; originally announced November 2019.

Comments: Accepted by ISBI-2020

Deep Message Passing on Sets

Authors: Yifeng Shi, Junier Oliva, Marc Niethammer

Abstract: Modern methods for learning over graph input data have shown the fruitfulness of accounting for relationships among elements in a collection. However, most methods that learn over set input data use only rudimentary approaches to exploit intra-collection relationships. In this work we introduce Deep Message Passing on Sets (DMPS), a novel method that incorporates relational learning for sets. DMPS… ▽ More Modern methods for learning over graph input data have shown the fruitfulness of accounting for relationships among elements in a collection. However, most methods that learn over set input data use only rudimentary approaches to exploit intra-collection relationships. In this work we introduce Deep Message Passing on Sets (DMPS), a novel method that incorporates relational learning for sets. DMPS not only connects learning on graphs with learning on sets via deep kernel learning, but it also bridges message passing on sets and traditional diffusion dynamics commonly used in denoising models. Based on these connections, we develop two new blocks for relational learning on sets: the set-denoising block and the set-residual block. The former is motivated by the connection between message passing on general graphs and diffusion-based denoising models, whereas the latter is inspired by the well-known residual network. In addition to demonstrating the interpretability of our model by learning the true underlying relational structure experimentally, we also show the effectiveness of our approach on both synthetic and real-world datasets by achieving results that are competitive with or outperform the state-of-the-art. △ Less

Submitted 21 September, 2019; originally announced September 2019.

Comments: 11 pages, 8 figures

Deep Multi-View Learning via Task-Optimal CCA

Authors: Heather D. Couture, Roland Kwitt, J. S. Marron, Melissa Troester, Charles M. Perou, Marc Niethammer

Abstract: Canonical Correlation Analysis (CCA) is widely used for multimodal data analysis and, more recently, for discriminative tasks such as multi-view learning; however, it makes no use of class labels. Recent CCA methods have started to address this weakness but are limited in that they do not simultaneously optimize the CCA projection for discrimination and the CCA projection itself, or they are linea… ▽ More Canonical Correlation Analysis (CCA) is widely used for multimodal data analysis and, more recently, for discriminative tasks such as multi-view learning; however, it makes no use of class labels. Recent CCA methods have started to address this weakness but are limited in that they do not simultaneously optimize the CCA projection for discrimination and the CCA projection itself, or they are linear only. We address these deficiencies by simultaneously optimizing a CCA-based and a task objective in an end-to-end manner. Together, these two objectives learn a non-linear CCA projection to a shared latent space that is highly correlated and discriminative. Our method shows a significant improvement over previous state-of-the-art (including deep supervised approaches) for cross-view classification, regularization with a second view, and semi-supervised learning on real data. △ Less

Submitted 17 July, 2019; originally announced July 2019.

Connectivity-Optimized Representation Learning via Persistent Homology

Authors: Christoph Hofer, Roland Kwitt, Mandar Dixit, Marc Niethammer

Abstract: We study the problem of learning representations with controllable connectivity properties. This is beneficial in situations when the imposed structure can be leveraged upstream. In particular, we control the connectivity of an autoencoder's latent space via a novel type of loss, operating on information from persistent homology. Under mild conditions, this loss is differentiable and we present a… ▽ More We study the problem of learning representations with controllable connectivity properties. This is beneficial in situations when the imposed structure can be leveraged upstream. In particular, we control the connectivity of an autoencoder's latent space via a novel type of loss, operating on information from persistent homology. Under mild conditions, this loss is differentiable and we present a theoretical analysis of the properties induced by the loss. We choose one-class learning as our upstream task and demonstrate that the imposed structure enables informed parameter selection for modeling the in-class distribution via kernel density estimators. Evaluated on computer vision data, these one-class models exhibit competitive performance and, in a low sample size regime, outperform other methods by a large margin. Notably, our results indicate that a single autoencoder, trained on auxiliary (unlabeled) data, yields a mapping into latent space that can be reused across datasets for one-class learning. △ Less

Submitted 21 June, 2019; originally announced June 2019.

Electrical charge state manipulation of single silicon vacancies in a silicon carbide quantum optoelectronic device

Authors: Matthias Widmann, Matthias Niethammer, Dmitry Yu. Fedyanin, Igor A. Khramtsov, Torsten Rendler, Ian D. Booker, Jawad Ul Hassan, Naoya Morioka, Yu-Chen Chen, Ivan G. Ivanov, Nguyen Tien Son, Takeshi Ohshima, Michel Bockstedte, Adam Gali, Cristian Bonato, Sang-Yun Lee, Jörg Wrachtrup

Abstract: Colour centres with long-lived spins are established platforms for quantum sensing and quantum information applications. Colour centres exist in different charge states, each of them with distinct optical and spin properties. Application to quantum technology requires the capability to access and stabilize charge states for each specific task. Here, we investigate charge state manipulation of indi… ▽ More Colour centres with long-lived spins are established platforms for quantum sensing and quantum information applications. Colour centres exist in different charge states, each of them with distinct optical and spin properties. Application to quantum technology requires the capability to access and stabilize charge states for each specific task. Here, we investigate charge state manipulation of individual silicon vacancies in silicon carbide, a system which has recently shown a unique combination of long spin coherence time and ultrastable spin-selective optical transitions. In particular, we demonstrate charge state switching through the bias applied to the colour centre in an integrated silicon carbide opto-electronic device. We show that the electronic environment defined by the doping profile and the distribution of other defects in the device plays a key role for charge state control. Our experimental results and numerical modeling evidence that control of these complex interactions can, under certain conditions, enhance the photon emission rate. These findings open the way for deterministic control over the charge state of spin-active colour centres for quantum technology and provide novel techniques for monitoring doping profiles and voltage sensing in microscopic devices. △ Less

Submitted 23 June, 2019; v1 submitted 13 June, 2019; originally announced June 2019.

Region-specific Diffeomorphic Metric Mapping

Authors: Zhengyang Shen, François-Xavier Vialard, Marc Niethammer

Abstract: We introduce a region-specific diffeomorphic metric mapping (RDMM) registration approach. RDMM is non-parametric, estimating spatio-temporal velocity fields which parameterize the sought-for spatial transformation. Regularization of these velocity fields is necessary. However, while existing non-parametric registration approaches, e.g., the large displacement diffeomorphic metric mapping (LDDMM) m… ▽ More We introduce a region-specific diffeomorphic metric mapping (RDMM) registration approach. RDMM is non-parametric, estimating spatio-temporal velocity fields which parameterize the sought-for spatial transformation. Regularization of these velocity fields is necessary. However, while existing non-parametric registration approaches, e.g., the large displacement diffeomorphic metric mapping (LDDMM) model, use a fixed spatially-invariant regularization our model advects a spatially-varying regularizer with the estimated velocity field, thereby naturally attaching a spatio-temporal regularizer to deforming objects. We explore a family of RDMM registration approaches: 1) a registration model where regions with separate regularizations are pre-defined (e.g., in an atlas space), 2) a registration model where a general spatially-varying regularizer is estimated, and 3) a registration model where the spatially-varying regularizer is obtained via an end-to-end trained deep learning (DL) model. We provide a variational derivation of RDMM, show that the model can assure diffeomorphic transformations in the continuum, and that LDDMM is a particular instance of RDMM. To evaluate RDMM performance we experiment 1) on synthetic 2D data and 2) on two 3D datasets: knee magnetic resonance images (MRIs) of the Osteoarthritis Initiative (OAI) and computed tomography images (CT) of the lung. Results show that our framework achieves state-of-the-art image registration performance, while providing additional information via a learned spatio-temoporal regularizer. Further, our deep learning approach allows for very fast RDMM and LDDMM estimations. Our code will be open-sourced. Code is available at https://github.com/uncbiag/registration. △ Less

Submitted 8 November, 2019; v1 submitted 31 May, 2019; originally announced June 2019.

Comments: Accepted by NeurIPS 2019

ACM Class: I.2.10; I.3.5

Graph Filtration Learning

Authors: Christoph D. Hofer, Florian Graf, Bastian Rieck, Marc Niethammer, Roland Kwitt

Abstract: We propose an approach to learning with graph-structured data in the problem domain of graph classification. In particular, we present a novel type of readout operation to aggregate node features into a graph-level representation. To this end, we leverage persistent homology computed via a real-valued, learnable, filter function. We establish the theoretical foundation for differentiating through… ▽ More We propose an approach to learning with graph-structured data in the problem domain of graph classification. In particular, we present a novel type of readout operation to aggregate node features into a graph-level representation. To this end, we leverage persistent homology computed via a real-valued, learnable, filter function. We establish the theoretical foundation for differentiating through the persistent homology computation. Empirically, we show that this type of readout operation compares favorably to previous techniques, especially when the graph connectivity structure is informative for the learning problem. △ Less

Submitted 17 May, 2021; v1 submitted 27 May, 2019; originally announced May 2019.

Metric Learning for Image Registration

Authors: Marc Niethammer, Roland Kwitt, Francois-Xavier Vialard

Abstract: Image registration is a key technique in medical image analysis to estimate deformations between image pairs. A good deformation model is important for high-quality estimates. However, most existing approaches use ad-hoc deformation models chosen for mathematical convenience rather than to capture observed data variation. Recent deep learning approaches learn deformation models directly from data.… ▽ More Image registration is a key technique in medical image analysis to estimate deformations between image pairs. A good deformation model is important for high-quality estimates. However, most existing approaches use ad-hoc deformation models chosen for mathematical convenience rather than to capture observed data variation. Recent deep learning approaches learn deformation models directly from data. However, they provide limited control over the spatial regularity of transformations. Instead of learning the entire registration approach, we learn a spatially-adaptive regularizer within a registration model. This allows controlling the desired level of regularity and preserving structural properties of a registration model. For example, diffeomorphic transformations can be attained. Our approach is a radical departure from existing deep learning approaches to image registration by embedding a deep learning model in an optimization-based registration algorithm to parameterize and data-adapt the registration model itself. △ Less

Submitted 20 April, 2019; originally announced April 2019.

Comments: 12 pages

VoteNet: A Deep Learning Label Fusion Method for Multi-Atlas Segmentation

Authors: Zhipeng Ding, Xu Han, Marc Niethammer

Abstract: Deep learning (DL) approaches are state-of-the-art for many medical image segmentation tasks. They offer a number of advantages: they can be trained for specific tasks, computations are fast at test time, and segmentation quality is typically high. In contrast, previously popular multi-atlas segmentation (MAS) methods are relatively slow (as they rely on costly registrations) and even though sophi… ▽ More Deep learning (DL) approaches are state-of-the-art for many medical image segmentation tasks. They offer a number of advantages: they can be trained for specific tasks, computations are fast at test time, and segmentation quality is typically high. In contrast, previously popular multi-atlas segmentation (MAS) methods are relatively slow (as they rely on costly registrations) and even though sophisticated label fusion strategies have been proposed, DL approaches generally outperform MAS. In this work, we propose a DL-based label fusion strategy (VoteNet) which locally selects a set of reliable atlases whose labels are then fused via plurality voting. Experiments on 3D brain MRI data show that by selecting a good initial atlas set MAS with VoteNet significantly outperforms a number of other label fusion strategies as well as a direct DL segmentation approach. We also provide an experimental analysis of the upper performance bound achievable by our method. While unlikely achievable in practice, this bound suggests room for further performance improvements. Lastly, to address the runtime disadvantage of standard MAS, all our results make use of a fast DL registration approach. △ Less

Submitted 30 May, 2019; v1 submitted 18 April, 2019; originally announced April 2019.

DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentation

Authors: Zhenlin Xu, Marc Niethammer

Abstract: Deep convolutional neural networks (CNNs) are state-of-the-art for semantic image segmentation, but typically require many labeled training samples. Obtaining 3D segmentations of medical images for supervised training is difficult and labor intensive. Motivated by classical approaches for joint segmentation and registration we therefore propose a deep learning framework that jointly learns network… ▽ More Deep convolutional neural networks (CNNs) are state-of-the-art for semantic image segmentation, but typically require many labeled training samples. Obtaining 3D segmentations of medical images for supervised training is difficult and labor intensive. Motivated by classical approaches for joint segmentation and registration we therefore propose a deep learning framework that jointly learns networks for image registration and image segmentation. In contrast to previous work on deep unsupervised image registration, which showed the benefit of weak supervision via image segmentations, our approach can use existing segmentations when available and computes them via the segmentation network otherwise, thereby providing the same registration benefit. Conversely, segmentation network training benefits from the registration, which essentially provides a realistic form of data augmentation. Experiments on knee and brain 3D magnetic resonance (MR) images show that our approach achieves large simultaneous improvements of segmentation and registration accuracy (over independently trained networks) and allows training high-quality models with very limited training data. Specifically, in a one-shot-scenario (with only one manually labeled image) our approach increases Dice scores (%) over an unsupervised registration network by 2.7 and 1.8 on the knee and brain images respectively. △ Less

Submitted 25 July, 2019; v1 submitted 17 April, 2019; originally announced April 2019.

Comments: To appear in MICCAI 2019

Coherent electrical readout of defect spins in 4H-SiC by photo-ionization at ambient conditions

Authors: Matthias Niethammer, Matthias Widmann, Torsten Rendler, Naoya Morioka, Yu-Chen Chen, Rainer Stöhr, Jawad Ul Hassan, Shinobu Onoda, Takeshi Ohshima, Sang-Yun Lee, Amlan Mukherjee, Junichi Isoya, Nguyen Tien Son, Jörg Wrachtrup

Abstract: Quantum technology relies on proper hardware, enabling coherent quantum state control as well as efficient quantum state readout. In this regard, wide-bandgap semiconductors are an emerging material platform with scalable wafer fabrication methods, hosting several promising spin-active point defects. Conventional readout protocols for such defect spins rely on fluorescence detection and are limite… ▽ More Quantum technology relies on proper hardware, enabling coherent quantum state control as well as efficient quantum state readout. In this regard, wide-bandgap semiconductors are an emerging material platform with scalable wafer fabrication methods, hosting several promising spin-active point defects. Conventional readout protocols for such defect spins rely on fluorescence detection and are limited by a low photon collection efficiency. Here, we demonstrate a photo-electrical detection technique for electron spins of silicon vacancy ensembles in the 4H polytype of silicon carbide (SiC). Further, we show coherent spin state control, proving that this electrical readout technique enables detection of coherent spin motion. Our readout works at ambient conditions, while other electrical readout approaches are often limited to low temperatures or high magnetic fields. Considering the excellent maturity of SiC electronics with the outstanding coherence properties of SiC defects the approach presented here holds promises for scalability of future SiC quantum devices. △ Less

Submitted 28 March, 2019; originally announced March 2019.

Journal ref: Nature Communications vol 10, 5569 (2019)

Networks for Joint Affine and Non-parametric Image Registration

Authors: Zhengyang Shen, Xu Han, Zhenlin Xu, Marc Niethammer

Abstract: We introduce an end-to-end deep-learning framework for 3D medical image registration. In contrast to existing approaches, our framework combines two registration methods: an affine registration and a vector momentum-parameterized stationary velocity field (vSVF) model. Specifically, it consists of three stages. In the first stage, a multi-step affine network predicts affine transform parameters. I… ▽ More We introduce an end-to-end deep-learning framework for 3D medical image registration. In contrast to existing approaches, our framework combines two registration methods: an affine registration and a vector momentum-parameterized stationary velocity field (vSVF) model. Specifically, it consists of three stages. In the first stage, a multi-step affine network predicts affine transform parameters. In the second stage, we use a Unet-like network to generate a momentum, from which a velocity field can be computed via smoothing. Finally, in the third stage, we employ a self-iterable map-based vSVF component to provide a non-parametric refinement based on the current estimate of the transformation map. Once the model is trained, a registration is completed in one forward pass. To evaluate the performance, we conducted longitudinal and cross-subject experiments on 3D magnetic resonance images (MRI) of the knee of the Osteoarthritis Initiative (OAI) dataset. Results show that our framework achieves comparable performance to state-of-the-art medical image registration approaches, but it is much faster, with a better control of transformation regularity including the ability to produce approximately symmetric transformations, and combining affine and non-parametric registration. △ Less

Submitted 20 March, 2019; originally announced March 2019.

Comments: Accepted to CVPR 2019

Laser writing of scalable single colour centre in silicon carbide

Authors: Yu-Chen Chen, Patrick S. Salter, Matthias Niethammer, Matthias Widmann, Florian Kaiser, Roland Nagy, Naoya Morioka, Charles Babin, J ürgen Erlekampf, Patrick Berwian, Martin Booth, J örg Wrachtrup

Abstract: Single photon emitters in silicon carbide (SiC) are attracting attention as quantum photonic systems. However, to achieve scalable devices it is essential to generate single photon emitters at desired locations on demand. Here we report the controlled creation of single silicon vacancy ($V_{Si}$) centres in 4H-SiC using laser writing without any post-annealing process. Due to the aberration correc… ▽ More Single photon emitters in silicon carbide (SiC) are attracting attention as quantum photonic systems. However, to achieve scalable devices it is essential to generate single photon emitters at desired locations on demand. Here we report the controlled creation of single silicon vacancy ($V_{Si}$) centres in 4H-SiC using laser writing without any post-annealing process. Due to the aberration correction in the writing apparatus and the non-annealing process, we generate single $V_{Si}$ centres with yields up to 30%, located within about 80 nm of the desired position in the transverse plane. We also investigated the photophysics of the laser writing $V_{Si}$ centres and conclude that there are about 16 photons involved in the laser writing $V_{Si}$ centres process. Our results represent a powerful tool in fabrication of single $V_{Si}$ centres in SiC for quantum technologies and provide further insights into laser writing defects in dielectric materials. △ Less

Submitted 11 December, 2018; originally announced December 2018.

High-fidelity spin and optical control of single silicon vacancy centres in silicon carbide

Authors: Roland Nagy, Matthias Niethammer, Matthias Widmann, Yu-Chen Chen, Péter Udvarhelyi, Cristian Bonato, Jawad Ul Hassan, Robin Karhu, Ivan G. Ivanov, Nguyen Tien Son, Jeronimo R. Maze, Takeshi Ohshima, Öney O. Soykal, Ádám Gali, Sang-Yun Lee, Florian Kaiser, Jörg Wrachtrup

Abstract: Optically interfaced spins in the solid promise scalable quantum networks. Robust and reliable optical properties have so far been restricted to systems with inversion symmetry. Here, we release this stringent constraint by demonstrating outstanding optical and spin properties of single silicon vacancy centres in silicon carbide. Despite the lack of inversion symmetry, the system's particular wave… ▽ More Optically interfaced spins in the solid promise scalable quantum networks. Robust and reliable optical properties have so far been restricted to systems with inversion symmetry. Here, we release this stringent constraint by demonstrating outstanding optical and spin properties of single silicon vacancy centres in silicon carbide. Despite the lack of inversion symmetry, the system's particular wave function symmetry decouples its optical properties from magnetic and electric fields, as well as from local strain. This provides a high-fidelity spin-to-photon interface with exceptionally stable and narrow optical transitions, low inhomogeneous broadening, and a large fraction of resonantly emitted photons. Further, the weak spin-phonon coupling results in electron spin coherence times comparable with nitrogen-vacancy centres in diamond. This allows us to demonstrate coherent hyperfine coupling to single nuclear spins, which can be exploited as qubit memories. Our findings promise quantum network applications using integrated semiconductor-based spin-to-photon interfaces. △ Less

Submitted 24 October, 2018; originally announced October 2018.

Comments: Main text: 16 pages, 4 figures. Supplementary information: 16 pages, 4 figures

Journal ref: Nature Communications 10, 1954 (2019)

Robust and efficient control of spin probes in a complex (biological) environment. Towards sensing of fast temperature fluctuations

Authors: Philipp Konzelmann, Torsten Rendler, Ville Bergholm, Andrea Zappe, Veronika Pfannenstill, Marwa Garsi, Florestan Ziem, Matthias Niethammer, Matthias Widmann, Sang-Yun Lee, Philipp Neumann, Jörg Wrachtrup

Abstract: We present an optimized scheme for nanoscale measurements of temperature in a complex environment using the nitrogen-vacancy center in nanodiamonds. To this end we combine a Ramsey measurement utilized to temperature determination with advanced optimal control theory. We test our new design on single nitrogen-vacancy centers in bulk diamond and fixed nanodiamonds, achieving better readout signal t… ▽ More We present an optimized scheme for nanoscale measurements of temperature in a complex environment using the nitrogen-vacancy center in nanodiamonds. To this end we combine a Ramsey measurement utilized to temperature determination with advanced optimal control theory. We test our new design on single nitrogen-vacancy centers in bulk diamond and fixed nanodiamonds, achieving better readout signal than with common soft or hard microwave control pulses. We demonstrate temperature readout using rotating nanodiamonds in an agarose matrix. Our method opens the way to measure temperature fluctuations in complex biological environment. The used principle however, is universal and not restricted to temperature sensing. △ Less

Submitted 13 August, 2018; originally announced August 2018.

Comments: 29 pages

Multiple Instance Learning for Heterogeneous Images: Training a CNN for Histopathology

Authors: Heather D. Couture, J. S. Marron, Charles M. Perou, Melissa A. Troester, Marc Niethammer

Abstract: Multiple instance (MI) learning with a convolutional neural network enables end-to-end training in the presence of weak image-level labels. We propose a new method for aggregating predictions from smaller regions of the image into an image-level classification by using the quantile function. The quantile function provides a more complete description of the heterogeneity within each image, improvin… ▽ More Multiple instance (MI) learning with a convolutional neural network enables end-to-end training in the presence of weak image-level labels. We propose a new method for aggregating predictions from smaller regions of the image into an image-level classification by using the quantile function. The quantile function provides a more complete description of the heterogeneity within each image, improving image-level classification. We also adapt image augmentation to the MI framework by randomly selecting cropped regions on which to apply MI aggregation during each epoch of training. This provides a mechanism to study the importance of MI learning. We validate our method on five different classification tasks for breast tumor histology and provide a visualization method for interpreting local image classifications that could lead to future insights into tumor heterogeneity. △ Less

Submitted 13 June, 2018; originally announced June 2018.

An Extended Volume of Fluid Method and its Application to Single Bubbles Rising in a Viscoelastic Liquid

Authors: Matthias Niethammer, Günter Brenn, Holger Marschall, Dieter Bothe

Abstract: An extended volume of fluid method is developed for two-phase direct numerical simulations of systems with one viscoelastic and one Newtonian phase. A complete set of governing equations is derived by conditional volume-averaging of the local instantaneous bulk equations and interface jump conditions. The homogeneous mixture model is applied for the closure of the volume-averaged equations. An add… ▽ More An extended volume of fluid method is developed for two-phase direct numerical simulations of systems with one viscoelastic and one Newtonian phase. A complete set of governing equations is derived by conditional volume-averaging of the local instantaneous bulk equations and interface jump conditions. The homogeneous mixture model is applied for the closure of the volume-averaged equations. An additional interfacial stress term arises in this volume-averaged formulation which requires special treatment in the finite-volume discretization on a general unstructured mesh. A novel numerical scheme is proposed for the second-order accurate finite-volume discretization of the interface stress term. We demonstrate that this scheme allows for a consistent treatment of the interface stress and the surface tension force in the pressure equation of the segregated solution approach. Because of the high Weissenberg number problem, an appropriate stabilization approach is applied to the constitutive equation of the viscoelastic phase to increase the robustness of the method at higher fluid elasticity. Direct numerical simulations of the transient motion of a bubble rising in a quiescent viscoelastic fluid are performed for the purpose of experimental code validation. The well-known jump discontinuity in the terminal bubble rise velocity when the bubble volume exceeds a critical value is captured by the method. The formulation of the interfacial stress together with the novel scheme for its discretization is found crucial for the quantitatively correct prediction of the jump discontinuity in the terminal bubble rise velocity. △ Less

Submitted 11 June, 2018; originally announced June 2018.

Journal ref: J. Comput. Phys. 387 (2019) 326-355

Testing Alignment of Node Attributes with Network Structure Through Label Propagation

Authors: Natalie Stanley, Marc Niethammer, Peter J. Mucha

Abstract: Attributed network data is becoming increasingly common across fields, as we are often equipped with information about nodes in addition to their pairwise connectivity patterns. This extra information can manifest as a classification, or as a multidimensional vector of features. Recently developed methods that seek to extend community detection approaches to attributed networks have explored how t… ▽ More Attributed network data is becoming increasingly common across fields, as we are often equipped with information about nodes in addition to their pairwise connectivity patterns. This extra information can manifest as a classification, or as a multidimensional vector of features. Recently developed methods that seek to extend community detection approaches to attributed networks have explored how to most effectively combine connectivity and attribute information to identify quality communities. These methods often rely on some assumption of the dependency relationships between attributes and connectivity. In this work, we seek to develop a statistical test to assess whether node attributes align with network connectivity. The objective is to quantitatively evaluate whether nodes with similar connectivity patterns also have similar attributes. To address this problem, we use a node sampling and label propagation approach. We apply our method to several synthetic examples that explore how network structure and attribute characteristics affect the empirical p-value computed by our method. Finally, we apply the test to a network generated from a single cell mass cytometry (CyTOF) dataset and show that our test can identify markers associated with distinct sub populations of single cells. △ Less

Submitted 18 May, 2018; originally announced May 2018.

Stochastic Block Models with Multiple Continuous Attributes

Authors: Natalie Stanley, Thomas Bonacci, Roland Kwitt, Marc Niethammer, Peter J. Mucha

Abstract: The stochastic block model (SBM) is a probabilistic model for community structure in networks. Typically, only the adjacency matrix is used to perform SBM parameter inference. In this paper, we consider circumstances in which nodes have an associated vector of continuous attributes that are also used to learn the node-to-community assignments and corresponding SBM parameters. While this assumption… ▽ More The stochastic block model (SBM) is a probabilistic model for community structure in networks. Typically, only the adjacency matrix is used to perform SBM parameter inference. In this paper, we consider circumstances in which nodes have an associated vector of continuous attributes that are also used to learn the node-to-community assignments and corresponding SBM parameters. While this assumption is not realistic for every application, our model assumes that the attributes associated with the nodes in a network's community can be described by a common multivariate Gaussian model. In this augmented, attributed SBM, the objective is to simultaneously learn the SBM connectivity probabilities with the multivariate Gaussian parameters describing each community. While there are recent examples in the literature that combine connectivity and attribute information to inform community detection, our model is the first augmented stochastic block model to handle multiple continuous attributes. This provides the flexibility in biological data to, for example, augment connectivity information with continuous measurements from multiple experimental modalities. Because the lack of labeled network data often makes community detection results difficult to validate, we highlight the usefulness of our model for two network prediction tasks: link prediction and collaborative filtering. As a result of fitting this attributed stochastic block model, one can predict the attribute vector or connectivity patterns for a new node in the event of the complementary source of information (connectivity or attributes, respectively). We also highlight two biological examples where the attributed stochastic block model provides satisfactory performance in the link prediction and collaborative filtering tasks. △ Less

Submitted 7 March, 2018; originally announced March 2018.

Fast Predictive Simple Geodesic Regression

Authors: Zhipeng Ding, Greg Fleishman, Xiao Yang, Paul Thompson, Roland Kwitt, Marc Niethammer

Abstract: Deformable image registration and regression are important tasks in medical image analysis. However, they are computationally expensive, especially when analyzing large-scale datasets that contain thousands of images. Hence, cluster computing is typically used, making the approaches dependent on such computational infrastructure. Even larger computational resources are required as study sizes incr… ▽ More Deformable image registration and regression are important tasks in medical image analysis. However, they are computationally expensive, especially when analyzing large-scale datasets that contain thousands of images. Hence, cluster computing is typically used, making the approaches dependent on such computational infrastructure. Even larger computational resources are required as study sizes increase. This limits the use of deformable image registration and regression for clinical applications and as component algorithms for other image analysis approaches. We therefore propose using a fast predictive approach to perform image registrations. In particular, we employ these fast registration predictions to approximate a simplified geodesic regression model to capture longitudinal brain changes. The resulting method is orders of magnitude faster than the standard optimization-based regression model and hence facilitates large-scale analysis on a single graphics processing unit (GPU). We evaluate our results on 3D brain magnetic resonance images (MRI) from the ADNI datasets. △ Less

Submitted 15 November, 2017; originally announced November 2017.

Comments: 19 pages, 10 figures, 13 tables

Brain Extraction from Normal and Pathological Images: A Joint PCA/Image-Reconstruction Approach

Authors: Xu Han, Roland Kwitt, Stephen Aylward, Spyridon Bakas, Bjoern Menze, Alexander Asturias, Paul Vespa, John Van Horn, Marc Niethammer

Abstract: Brain extraction from images is a common pre-processing step. Many approaches exist, but they are frequently only designed to perform brain extraction from images without strong pathologies. Extracting the brain from images with strong pathologies, for example, the presence of a tumor or of a traumatic brain injury, is challenging. In such cases, tissue appearance may deviate from normal tissue an… ▽ More Brain extraction from images is a common pre-processing step. Many approaches exist, but they are frequently only designed to perform brain extraction from images without strong pathologies. Extracting the brain from images with strong pathologies, for example, the presence of a tumor or of a traumatic brain injury, is challenging. In such cases, tissue appearance may deviate from normal tissue and violates algorithmic assumptions for these approaches; hence, the brain may not be correctly extracted. This paper proposes a brain extraction approach which can explicitly account for pathologies by jointly modeling normal tissue and pathologies. Specifically, our model uses a three-part image decomposition: (1) normal tissue appearance is captured by principal component analysis, (2) pathologies are captured via a total variation term, and (3) non-brain tissue is captured by a sparse term. Decomposition and image registration steps are alternated to allow statistical modeling in a fixed atlas space. As a beneficial side effect, the model allows for the identification of potential pathologies and the reconstruction of a quasi-normal image in atlas space. We demonstrate the effectiveness of our method on four datasets: the IBSR and LPBA40 datasets which show normal images, the BRATS dataset containing images with brain tumors and a dataset containing clinical TBI images. We compare the performance with other popular models: ROBEX, BEaST, MASS, BET, BSE and a recently proposed deep learning approach. Our model performs better than these competing methods on all four datasets. Specifically, our model achieves the best median (97.11) and mean (96.88) Dice scores over all datasets. The two best performing competitors, ROBEX and MASS, achieve scores of 96.23/95.62 and 96.67/94.25 respectively. Hence, our approach is an effective method for high quality brain extraction on a wide variety of images. △ Less

Submitted 30 April, 2018; v1 submitted 15 November, 2017; originally announced November 2017.

Multidimensional classification of hippocampal shape features discriminates Alzheimer's disease and mild cognitive impairment from normal aging

Authors: Emilie Gerardin, Gaël Chételat, Marie Chupin, Rémi Cuingnet, Béatrice Desgranges, Ho-Sung Kim, Marc Niethammer, Bruno Dubois, Stéphane Lehéricy, Line Garnero, Francis Eustache, Olivier Colliot

Abstract: We describe a new method to automatically discriminate between patients with Alzheimer's disease (AD) or mild cognitive impairment (MCI) and elderly controls, based on multidimensional classification of hippocampal shape features. This approach uses spherical harmonics (SPHARM) coefficients to model the shape of the hippocampi, which are segmented from magnetic resonance images (MRI) using a fully… ▽ More We describe a new method to automatically discriminate between patients with Alzheimer's disease (AD) or mild cognitive impairment (MCI) and elderly controls, based on multidimensional classification of hippocampal shape features. This approach uses spherical harmonics (SPHARM) coefficients to model the shape of the hippocampi, which are segmented from magnetic resonance images (MRI) using a fully automatic method that we previously developed. SPHARM coefficients are used as features in a classification procedure based on support vector machines (SVM). The most relevant features for classification are selected using a bagging strategy. We evaluate the accuracy of our method in a group of 23 patients with AD (10 males, 13 females, age $\pm$ standard-deviation (SD) = 73 $\pm$ 6 years, mini-mental score (MMS) = 24.4 $\pm$ 2.8), 23 patients with amnestic MCI (10 males, 13 females, age $\pm$ SD = 74 $\pm$ 8 years, MMS = 27.3 $\pm$ 1.4) and 25 elderly healthy controls (13 males, 12 females, age $\pm$ SD = 64 $\pm$ 8 years), using leave-one-out cross-validation. For AD vs controls, we obtain a correct classification rate of 94%, a sensitivity of 96%, and a specificity of 92%. For MCI vs controls, we obtain a classification rate of 83%, a sensitivity of 83%, and a specificity of 84%. This accuracy is superior to that of hippocampal volumetry and is comparable to recently published SVM-based whole-brain classification methods, which relied on a different strategy. This new method may become a useful tool to assist in the diagnosis of Alzheimer's disease. △ Less

Submitted 19 July, 2017; originally announced July 2017.

Comments: Data used in the preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database

Journal ref: NeuroImage, 47 (4), pp.1476-86, 2009

Deep Learning with Topological Signatures

Authors: Christoph Hofer, Roland Kwitt, Marc Niethammer, Andreas Uhl

Abstract: Inferring topological and geometrical information from data can offer an alternative perspective on machine learning problems. Methods from topological data analysis, e.g., persistent homology, enable us to obtain such information, typically in the form of summary representations of topological features. However, such topological signatures often come with an unusual structure (e.g., multisets of… ▽ More Inferring topological and geometrical information from data can offer an alternative perspective on machine learning problems. Methods from topological data analysis, e.g., persistent homology, enable us to obtain such information, typically in the form of summary representations of topological features. However, such topological signatures often come with an unusual structure (e.g., multisets of intervals) that is highly impractical for most machine learning techniques. While many strategies have been proposed to map these topological signatures into machine learning compatible representations, they suffer from being agnostic to the target learning task. In contrast, we propose a technique that enables us to input topological signatures to deep neural networks and learn a task-optimal representation during training. Our approach is realized as a novel input layer with favorable theoretical properties. Classification experiments on 2D object shapes and social network graphs demonstrate the versatility of the approach and, in case of the latter, we even outperform the state-of-the-art by a large margin. △ Less

Submitted 16 February, 2018; v1 submitted 13 July, 2017; originally announced July 2017.

Quantum properties of dichroic silicon vacancies in silicon carbide

Authors: Roland Nagy, Matthias Widmann, Matthias Niethammer, Durga B. R. Dasari, Ilja Gerhardt, Öney O. Soykal, Marina Radulaski, Takeshi Ohshima, Jelena Vučković, Nguyen Tien Son, Ivan G. Ivanov, Sophia E. Economou, Cristian Bonato, Sang-Yun Lee, Jörg Wrachtrup

Abstract: The controlled generation and manipulation of atom-like defects in solids has a wide range of applications in quantum technology. Although various defect centres have displayed promise as either quantum sensors, single photon emitters or light-matter interfaces, the search for an ideal defect with multi-functional ability remains open. In this spirit, we investigate here the optical and spin prope… ▽ More The controlled generation and manipulation of atom-like defects in solids has a wide range of applications in quantum technology. Although various defect centres have displayed promise as either quantum sensors, single photon emitters or light-matter interfaces, the search for an ideal defect with multi-functional ability remains open. In this spirit, we investigate here the optical and spin properties of the V1 defect centre, one of the silicon vacancy defects in the 4H polytype of silicon carbide (SiC). The V1 centre in 4H-SiC features two well-distinguishable sharp optical transitions and a unique S=3/2 electronic spin, which holds promise to implement a robust spin-photon interface. Here, we investigate the V1 defect at low temperatures using optical excitation and magnetic resonance techniques. The measurements, which are performed on ensemble, as well as on single centres, prove that this centre combines coherent optical emission, with up to 40% of the radiation emitted into the zero-phonon line (ZPL), a strong optical spin signal and long spin coherence time. These results single out the V1 defect in SiC as a promising system for spin-based quantum technologies. △ Less

Submitted 16 March, 2018; v1 submitted 10 July, 2017; originally announced July 2017.

Journal ref: Phys. Rev. Applied 9, 034022 (2018)

Compressing networks with super nodes

Authors: Natalie Stanley, Roland Kwitt, Marc Niethammer, Peter J. Mucha

Abstract: Community detection is a commonly used technique for identifying groups in a network based on similarities in connectivity patterns. To facilitate community detection in large networks, we recast the network to be partitioned into a smaller network of 'super nodes', each super node comprising one or more nodes in the original network. To define the seeds of our super nodes, we apply the 'CoreHD' r… ▽ More Community detection is a commonly used technique for identifying groups in a network based on similarities in connectivity patterns. To facilitate community detection in large networks, we recast the network to be partitioned into a smaller network of 'super nodes', each super node comprising one or more nodes in the original network. To define the seeds of our super nodes, we apply the 'CoreHD' ranking from dismantling and decycling. We test our approach through the analysis of two common methods for community detection: modularity maximization with the Louvain algorithm and maximum likelihood optimization for fitting a stochastic block model. Our results highlight that applying community detection to the compressed network of super nodes is significantly faster while successfully producing partitions that are more aligned with the local network connectivity, more stable across multiple (stochastic) runs within and between community detection algorithms, and overlap well with the results obtained using the full network. △ Less

Submitted 13 June, 2017; originally announced June 2017.

Efficient Registration of Pathological Images: A Joint PCA/Image-Reconstruction Approach

Authors: Xu Han, Xiao Yang, Stephen Aylward, Roland Kwitt, Marc Niethammer

Abstract: Registration involving one or more images containing pathologies is challenging, as standard image similarity measures and spatial transforms cannot account for common changes due to pathologies. Low-rank/Sparse (LRS) decomposition removes pathologies prior to registration; however, LRS is memory-demanding and slow, which limits its use on larger data sets. Additionally, LRS blurs normal tissue re… ▽ More Registration involving one or more images containing pathologies is challenging, as standard image similarity measures and spatial transforms cannot account for common changes due to pathologies. Low-rank/Sparse (LRS) decomposition removes pathologies prior to registration; however, LRS is memory-demanding and slow, which limits its use on larger data sets. Additionally, LRS blurs normal tissue regions, which may degrade registration performance. This paper proposes an efficient alternative to LRS: (1) normal tissue appearance is captured by principal component analysis (PCA) and (2) blurring is avoided by an integrated model for pathology removal and image reconstruction. Results on synthetic and BRATS 2015 data demonstrate its utility. △ Less

Submitted 31 March, 2017; originally announced April 2017.

Comments: Accepted as a conference paper for ISBI 2017

Quicksilver: Fast Predictive Image Registration - a Deep Learning Approach

Authors: Xiao Yang, Roland Kwitt, Martin Styner, Marc Niethammer

Abstract: This paper introduces Quicksilver, a fast deformable image registration method. Quicksilver registration for image-pairs works by patch-wise prediction of a deformation model based directly on image appearance. A deep encoder-decoder network is used as the prediction model. While the prediction strategy is general, we focus on predictions for the Large Deformation Diffeomorphic Metric Mapping (LDD… ▽ More This paper introduces Quicksilver, a fast deformable image registration method. Quicksilver registration for image-pairs works by patch-wise prediction of a deformation model based directly on image appearance. A deep encoder-decoder network is used as the prediction model. While the prediction strategy is general, we focus on predictions for the Large Deformation Diffeomorphic Metric Mapping (LDDMM) model. Specifically, we predict the momentum-parameterization of LDDMM, which facilitates a patch-wise prediction strategy while maintaining the theoretical properties of LDDMM, such as guaranteed diffeomorphic mappings for sufficiently strong regularization. We also provide a probabilistic version of our prediction network which can be sampled during the testing time to calculate uncertainties in the predicted deformations. Finally, we introduce a new correction network which greatly increases the prediction accuracy of an already existing prediction network. We show experimental results for uni-modal atlas-to-image as well as uni- / multi- modal image-to-image registrations. These experiments demonstrate that our method accurately predicts registrations obtained by numerical optimization, is very fast, achieves state-of-the-art registration results on four standard validation datasets, and can jointly learn an image similarity measure. Quicksilver is freely available as an open-source software. △ Less

Submitted 19 July, 2017; v1 submitted 31 March, 2017; originally announced March 2017.

Comments: Add new discussions

Fast Predictive Multimodal Image Registration

Authors: Xiao Yang, Roland Kwitt, Martin Styner, Marc Niethammer

Abstract: We introduce a deep encoder-decoder architecture for image deformation prediction from multimodal images. Specifically, we design an image-patch-based deep network that jointly (i) learns an image similarity measure and (ii) the relationship between image patches and deformation parameters. While our method can be applied to general image registration formulations, we focus on the Large Deformatio… ▽ More We introduce a deep encoder-decoder architecture for image deformation prediction from multimodal images. Specifically, we design an image-patch-based deep network that jointly (i) learns an image similarity measure and (ii) the relationship between image patches and deformation parameters. While our method can be applied to general image registration formulations, we focus on the Large Deformation Diffeomorphic Metric Mapping (LDDMM) registration model. By predicting the initial momentum of the shooting formulation of LDDMM, we preserve its mathematical properties and drastically reduce the computation time, compared to optimization-based approaches. Furthermore, we create a Bayesian probabilistic version of the network that allows evaluation of registration uncertainty via sampling of the network at test time. We evaluate our method on a 3D brain MRI dataset using both T1- and T2-weighted images. Our experiments show that our method generates accurate predictions and that learning the similarity measure leads to more consistent registrations than relying on generic multimodal image similarity measures, such as mutual information. Our approach is an order of magnitude faster than optimization-based LDDMM. △ Less

Submitted 31 March, 2017; originally announced March 2017.

Comments: Accepted as a conference paper for ISBI 2017

A numerical stabilization framework for viscoelastic fluid flow using the finite volume method on general unstructured meshes

Authors: Matthias Niethammer, Holger Marschall, Christian Kunkelmann, Dieter Bothe

Abstract: A robust finite volume method for viscoelastic flow analysis on general unstructured meshes is developed. It is built upon a general-purpose stabilization framework for high Weissenberg number flows. The numerical framework provides full combinatorial flexibility between different kinds of rheological models on the one hand, and effective stabilization methods on the other hand. A special emphasis… ▽ More A robust finite volume method for viscoelastic flow analysis on general unstructured meshes is developed. It is built upon a general-purpose stabilization framework for high Weissenberg number flows. The numerical framework provides full combinatorial flexibility between different kinds of rheological models on the one hand, and effective stabilization methods on the other hand. A special emphasis is put on the velocity-stress-coupling on co-located computational grids. Using special face interpolation techniques, a semi-implicit stress interpolation correction is proposed to correct the cell-face interpolation of the stress in the divergence operator of the momentum balance. Investigating the entry-flow problem of the 4:1 contraction benchmark, we demonstrate that the numerical methods are robust over a wide range of Weissenberg numbers and significantly alleviate the high Weissenberg number problem. The accuracy of the results is evaluated in a detailed mesh convergence study. △ Less

Submitted 8 February, 2017; originally announced February 2017.

MSC Class: 65M08; 76M12; 76A05; 76A10 ACM Class: J.2; G.1.8; D.1.5

Journal ref: Int. J. Numer. Meth. Fluids 86 (2018), 131-166

Probabilistic Diffeomorphic Registration: Representing Uncertainty

Authors: Demian Wassermann, Matt Toews, Marc Niethammer, William Wells Iii

Abstract: This paper presents a novel mathematical framework for representing uncertainty in large deformation diffeomorphic image registration. The Bayesian posterior distribution over the deformations aligning a moving and a fixed image is approximated via a variational formulation. A stochastic differential equation (SDE) modeling the deformations as the evolution of a time-varying velocity field leads t… ▽ More This paper presents a novel mathematical framework for representing uncertainty in large deformation diffeomorphic image registration. The Bayesian posterior distribution over the deformations aligning a moving and a fixed image is approximated via a variational formulation. A stochastic differential equation (SDE) modeling the deformations as the evolution of a time-varying velocity field leads to a prior density over deformations in the form of a Gaussian process. This permits estimating the full posterior distribution in order to represent uncertainty, in contrast to methods in which the posterior is approximated via Monte Carlo sampling or maximized in maximum a-posteriori (MAP) estimation. The frame-work is demonstrated in the case of landmark-based image registration, including simulated data and annotated pre and intra-operative 3D images. △ Less

Submitted 12 January, 2017; originally announced January 2017.

Journal ref: Biomedical Image Registration, 2014, London, United Kingdom. pp.72 - 82, 2014

Scalable Quantum Photonics with Single Color Centers in Silicon Carbide

Authors: Marina Radulaski, Matthias Widmann, Matthias Niethammer, Jingyuan Linda Zhang, Sang-Yun Lee, Torsten Rendler, Konstantinos G. Lagoudakis, Nguyen Tien Son, Erik Janzén, Takeshi Ohshima, Jörg Wrachtrup, Jelena Vučković

Abstract: Silicon carbide is a promising platform for single photon sources, quantum bits (qubits) and nanoscale sensors based on individual color centers. Towards this goal, we develop a scalable array of nanopillars incorporating single silicon vacancy centers in 4H-SiC, readily available for efficient interfacing with free-space objective and lensed-fibers. A commercially obtained substrate is irradiated… ▽ More Silicon carbide is a promising platform for single photon sources, quantum bits (qubits) and nanoscale sensors based on individual color centers. Towards this goal, we develop a scalable array of nanopillars incorporating single silicon vacancy centers in 4H-SiC, readily available for efficient interfacing with free-space objective and lensed-fibers. A commercially obtained substrate is irradiated with 2 MeV electron beams to create vacancies. Subsequent lithographic process forms 800 nm tall nanopillars with 400-1,400 nm diameters. We obtain high collection efficiency, up to 22 kcounts/s optical saturation rates from a single silicon vacancy center, while preserving the single photon emission and the optically induced electron-spin polarization properties. Our study demonstrates silicon carbide as a readily available platform for scalable quantum photonics architecture relying on single photon sources and qubits. △ Less

Submitted 25 February, 2017; v1 submitted 8 December, 2016; originally announced December 2016.

Comments: 18 pages, 8 figures

Journal ref: Nano Letters 17 (3), 1782-1786 (2017)

AGA: Attribute Guided Augmentation

Authors: Mandar Dixit, Roland Kwitt, Marc Niethammer, Nuno Vasconcelos

Abstract: We consider the problem of data augmentation, i.e., generating artificial samples to extend a given corpus of training data. Specifically, we propose attributed-guided augmentation (AGA) which learns a mapping that allows to synthesize data such that an attribute of a synthesized sample is at a desired value or strength. This is particularly interesting in situations where little data with no attr… ▽ More We consider the problem of data augmentation, i.e., generating artificial samples to extend a given corpus of training data. Specifically, we propose attributed-guided augmentation (AGA) which learns a mapping that allows to synthesize data such that an attribute of a synthesized sample is at a desired value or strength. This is particularly interesting in situations where little data with no attribute annotation is available for learning, but we have access to a large external corpus of heavily annotated samples. While prior works primarily augment in the space of images, we propose to perform augmentation in feature space instead. We implement our approach as a deep encoder-decoder architecture that learns the synthesis function in an end-to-end manner. We demonstrate the utility of our approach on the problems of (1) one-shot object recognition in a transfer-learning setting where we have no prior knowledge of the new classes, as well as (2) object-based one-shot scene recognition. As external data, we leverage 3D depth and pose information from the SUN RGB-D dataset. Our experiments show that attribute-guided augmentation of high-level CNN features considerably improves one-shot recognition performance on both problems. △ Less

Submitted 26 August, 2017; v1 submitted 8 December, 2016; originally announced December 2016.

Comments: CVPR 2017

Fast Predictive Image Registration

Authors: Xiao Yang, Roland Kwitt, Marc Niethammer

Abstract: We present a method to predict image deformations based on patch-wise image appearance. Specifically, we design a patch-based deep encoder-decoder network which learns the pixel/voxel-wise mapping between image appearance and registration parameters. Our approach can predict general deformation parameterizations, however, we focus on the large deformation diffeomorphic metric mapping (LDDMM) regis… ▽ More We present a method to predict image deformations based on patch-wise image appearance. Specifically, we design a patch-based deep encoder-decoder network which learns the pixel/voxel-wise mapping between image appearance and registration parameters. Our approach can predict general deformation parameterizations, however, we focus on the large deformation diffeomorphic metric mapping (LDDMM) registration model. By predicting the LDDMM momentum-parameterization we retain the desirable theoretical properties of LDDMM, while reducing computation time by orders of magnitude: combined with patch pruning, we achieve a 1500x/66x speed up compared to GPU-based optimization for 2D/3D image registration. Our approach has better prediction accuracy than predicting deformation or velocity fields and results in diffeomorphic transformations. Additionally, we create a Bayesian probabilistic version of our network, which allows evaluation of deformation field uncertainty through Monte Carlo sampling using dropout at test time. We show that deformation uncertainty highlights areas of ambiguous deformations. We test our method on the OASIS brain image dataset in 2D and 3D. △ Less

Submitted 8 July, 2016; originally announced July 2016.

Vector magnetometry using silicon vacancies in 4H-SiC at ambient conditions

Authors: Matthias Niethammer, Matthias Widmann, Sang-Yun Lee, Pontus Stenberg, Olof Kordina, Takeshi Ohshima, Nguyen Tien Son, Erik Janzén, Jörg Wrachtrup

Abstract: Point defects in solids promise precise measurements of various quantities. Especially magnetic field sensing using the spin of point defects has been of great interest recently. When optical readout of spin states is used, point defects achieve optical magnetic imaging with high spatial resolution at ambient conditions. Here, we demonstrate that genuine optical vector magnetometry can be realized… ▽ More Point defects in solids promise precise measurements of various quantities. Especially magnetic field sensing using the spin of point defects has been of great interest recently. When optical readout of spin states is used, point defects achieve optical magnetic imaging with high spatial resolution at ambient conditions. Here, we demonstrate that genuine optical vector magnetometry can be realized using the silicon vacancy in SiC, which has an uncommon S=3/2 spin. To this end, we develop and experimentally test sensing protocols based on a reference field approach combined with multi frequency spin excitation. Our works suggest that the silicon vacancy in an industry-friendly platform, SiC, has potential for various magnetometry applications at ambient conditions. △ Less

Submitted 20 September, 2016; v1 submitted 3 June, 2016; originally announced June 2016.

Journal ref: Phys. Rev. Applied 6, 034001 (2016)

Vector magnetometry based on S=3/2 electronic spins

Authors: Sang-Yun Lee, Matthias Niethammer, Jörg Wrachtrup

Abstract: Electronic spin systems with S>1/2 provide an efficient method for DC vector magnetometry, since the conventional electron spin resonance spectra at a given magnetic field reflect not only the field strength but also orientation in the presence of strong spin-spin interactions. S=1 spins, e.g. the nitrogen-vacancy centers in diamond, have been intensively investigated for such a purpose. In this r… ▽ More Electronic spin systems with S>1/2 provide an efficient method for DC vector magnetometry, since the conventional electron spin resonance spectra at a given magnetic field reflect not only the field strength but also orientation in the presence of strong spin-spin interactions. S=1 spins, e.g. the nitrogen-vacancy centers in diamond, have been intensively investigated for such a purpose. In this report, we compare S=1 and S=3/2 spins, and discuss how one can apply general principles for the use of high spin systems as a vector magnetometer to the S=3/2 spin systems. We find analytical solutions which allow a reconstruction of the magnetic field strength and polar angle using the observed resonance transitions if an uniaxial symmetry exists for the spin-spin interaction as in S=1 systems. We also find that an ambiguity of determining the field parameters may arise due to the unique properties of S=3/2 systems, and present solutions for it utilizing additional transitions in the low-field region. The electronic spins of the silicon vacancy in silicon carbide will be introduced as a model for the S=3/2 DC vector magnetometer and the practical usage of it, including the magic-angle spinning type method, will be presented too. △ Less

Submitted 1 September, 2015; v1 submitted 26 May, 2015; originally announced May 2015.

Journal ref: Phys. Rev. B 92, 115201 (2015)

Parametric Regression on the Grassmannian

Authors: Yi Hong, Nikhil Singh, Roland Kwitt, Nuno Vasconcelos, Marc Niethammer

Abstract: We address the problem of fitting parametric curves on the Grassmann manifold for the purpose of intrinsic parametric regression. As customary in the literature, we start from the energy minimization formulation of linear least-squares in Euclidean spaces and generalize this concept to general nonflat Riemannian manifolds, following an optimal-control point of view. We then specialize this idea to… ▽ More We address the problem of fitting parametric curves on the Grassmann manifold for the purpose of intrinsic parametric regression. As customary in the literature, we start from the energy minimization formulation of linear least-squares in Euclidean spaces and generalize this concept to general nonflat Riemannian manifolds, following an optimal-control point of view. We then specialize this idea to the Grassmann manifold and demonstrate that it yields a simple, extensible and easy-to-implement solution to the parametric regression problem. In fact, it allows us to extend the basic geodesic model to (1) a time-warped variant and (2) cubic splines. We demonstrate the utility of the proposed solution on different vision problems, such as shape regression as a function of age, traffic-speed estimation and crowd-counting from surveillance video clips. Most notably, these problems can be conveniently solved within the same framework without any specifically-tailored steps along the processing pipeline. △ Less

Submitted 14 May, 2015; originally announced May 2015.

Comments: 14 pages, 11 figures

Active Mean Fields for Probabilistic Image Segmentation: Connections with Chan-Vese and Rudin-Osher-Fatemi Models

Authors: Marc Niethammer, Kilian M. Pohl, Firdaus Janoos, William M. Wells III

Abstract: Segmentation is a fundamental task for extracting semantically meaningful regions from an image. The goal of segmentation algorithms is to accurately assign object labels to each image location. However, image-noise, shortcomings of algorithms, and image ambiguities cause uncertainty in label assignment. Estimating the uncertainty in label assignment is important in multiple application domains, s… ▽ More Segmentation is a fundamental task for extracting semantically meaningful regions from an image. The goal of segmentation algorithms is to accurately assign object labels to each image location. However, image-noise, shortcomings of algorithms, and image ambiguities cause uncertainty in label assignment. Estimating the uncertainty in label assignment is important in multiple application domains, such as segmenting tumors from medical images for radiation treatment planning. One way to estimate these uncertainties is through the computation of posteriors of Bayesian models, which is computationally prohibitive for many practical applications. On the other hand, most computationally efficient methods fail to estimate label uncertainty. We therefore propose in this paper the Active Mean Fields (AMF) approach, a technique based on Bayesian modeling that uses a mean-field approximation to efficiently compute a segmentation and its corresponding uncertainty. Based on a variational formulation, the resulting convex model combines any label-likelihood measure with a prior on the length of the segmentation boundary. A specific implementation of that model is the Chan-Vese segmentation model (CV), in which the binary segmentation task is defined by a Gaussian likelihood and a prior regularizing the length of the segmentation boundary. Furthermore, the Euler-Lagrange equations derived from the AMF model are equivalent to those of the popular Rudin-Osher-Fatemi (ROF) model for image denoising. Solutions to the AMF model can thus be implemented by directly utilizing highly-efficient ROF solvers on log-likelihood ratio fields. We qualitatively assess the approach on synthetic data as well as on real natural and medical images. For a quantitative evaluation, we apply our approach to the icgbench dataset. △ Less

Submitted 4 October, 2016; v1 submitted 22 January, 2015; originally announced January 2015.

Multi-modal Image Registration for Correlative Microscopy

Authors: Tian Cao, Christopher Zach, Shannon Modla, Debbie Powell, Kirk Czymmek, Marc Niethammer

Abstract: Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies. Image registration for correlative microscopy is quite challenging because it is a multi-modal, multi-scale and multi-dimensional registration problem. In this report, I introduce two methods of image registration for correlative… ▽ More Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies. Image registration for correlative microscopy is quite challenging because it is a multi-modal, multi-scale and multi-dimensional registration problem. In this report, I introduce two methods of image registration for correlative microscopy. The first method is based on fiducials (beads). I generate landmarks from the fiducials and compute the similarity transformation matrix based on three pairs of nearest corresponding landmarks. A least-squares matching process is applied afterwards to further refine the registration. The second method is inspired by the image analogies approach. I introduce the sparse representation model into image analogies. I first train representative image patches (dictionaries) for pre-registered datasets from two different modalities, and then I use the sparse coding technique to transfer a given image to a predicted image from one modality to another based on the learned dictionaries. The final image registration is between the predicted image and the original image corresponding to the given image in the different modality. The method transforms a multi-modal registration problem to a mono-modal one. I test my approaches on Transmission Electron Microscopy (TEM) and confocal microscopy images. Experimental results of the methods are also shown in this report. △ Less

Submitted 13 January, 2015; v1 submitted 12 November, 2014; originally announced November 2014.

Comments: 24 pages