Showing 1–50 of 56 results for author: Schultz, T

NeuroSpex: Neuro-Guided Speaker Extraction with Cross-Modal Attention

Authors: Dashanka De Silva, Siqi Cai, Saurav Pahuja, Tanja Schultz, Haizhou Li

Abstract: In the study of auditory attention, it has been revealed that there exists a robust correlation between attended speech and elicited neural responses, measurable through electroencephalography (EEG). Therefore, it is possible to use the attention information available within EEG signals to guide the extraction of the target speaker in a cocktail party computationally. In this paper, we present a n… ▽ More In the study of auditory attention, it has been revealed that there exists a robust correlation between attended speech and elicited neural responses, measurable through electroencephalography (EEG). Therefore, it is possible to use the attention information available within EEG signals to guide the extraction of the target speaker in a cocktail party computationally. In this paper, we present a neuro-guided speaker extraction model, i.e. NeuroSpex, using the EEG response of the listener as the sole auxiliary reference cue to extract attended speech from monaural speech mixtures. We propose a novel EEG signal encoder that captures the attention information. Additionally, we propose a cross-attention (CA) mechanism to enhance the speech feature representations, generating a speaker extraction mask. Experimental results on a publicly available dataset demonstrate that our proposed model outperforms two baseline models across various evaluation metrics. △ Less

Submitted 4 September, 2024; originally announced September 2024.

On the Role of Visual Grounding in VQA

Authors: Daniel Reich, Tanja Schultz

Abstract: Visual Grounding (VG) in VQA refers to a model's proclivity to infer answers based on question-relevant image regions. Conceptually, VG identifies as an axiomatic requirement of the VQA task. In practice, however, DNN-based VQA models are notorious for bypassing VG by way of shortcut (SC) learning without suffering obvious performance losses in standard benchmarks. To uncover the impact of SC lear… ▽ More Visual Grounding (VG) in VQA refers to a model's proclivity to infer answers based on question-relevant image regions. Conceptually, VG identifies as an axiomatic requirement of the VQA task. In practice, however, DNN-based VQA models are notorious for bypassing VG by way of shortcut (SC) learning without suffering obvious performance losses in standard benchmarks. To uncover the impact of SC learning, Out-of-Distribution (OOD) tests have been proposed that expose a lack of VG with low accuracy. These tests have since been at the center of VG research and served as basis for various investigations into VG's impact on accuracy. However, the role of VG in VQA still remains not fully understood and has not yet been properly formalized. In this work, we seek to clarify VG's role in VQA by formalizing it on a conceptual level. We propose a novel theoretical framework called "Visually Grounded Reasoning" (VGR) that uses the concepts of VG and Reasoning to describe VQA inference in ideal OOD testing. By consolidating fundamental insights into VG's role in VQA, VGR helps to reveal rampant VG-related SC exploitation in OOD testing, which explains why the relationship between VG and OOD accuracy has been difficult to define. Finally, we propose an approach to create OOD tests that properly emphasize a requirement for VG, and show how to improve performance on them. △ Less

Submitted 26 June, 2024; originally announced June 2024.

Speech Emotion Recognition under Resource Constraints with Data Distillation

Authors: Yi Chang, Zhao Ren, Zhonghao Zhao, Thanh Tam Nguyen, Kun Qian, Tanja Schultz, Björn W. Schuller

Abstract: Speech emotion recognition (SER) plays a crucial role in human-computer interaction. The emergence of edge devices in the Internet of Things (IoT) presents challenges in constructing intricate deep learning models due to constraints in memory and computational resources. Moreover, emotional speech data often contains private information, raising concerns about privacy leakage during the deployment… ▽ More Speech emotion recognition (SER) plays a crucial role in human-computer interaction. The emergence of edge devices in the Internet of Things (IoT) presents challenges in constructing intricate deep learning models due to constraints in memory and computational resources. Moreover, emotional speech data often contains private information, raising concerns about privacy leakage during the deployment of SER models. To address these challenges, we propose a data distillation framework to facilitate efficient development of SER models in IoT applications using a synthesised, smaller, and distilled dataset. Our experiments demonstrate that the distilled dataset can be effectively utilised to train SER models with fixed initialisation, achieving performances comparable to those developed using the original full emotional speech dataset. △ Less

Submitted 21 June, 2024; originally announced June 2024.

Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversion

Authors: Zhao Ren, Kevin Scheck, Qinhan Hou, Stefano van Gogh, Michael Wand, Tanja Schultz

Abstract: Electromyography-to-Speech (ETS) conversion has demonstrated its potential for silent speech interfaces by generating audible speech from Electromyography (EMG) signals during silent articulations. ETS models usually consist of an EMG encoder which converts EMG signals to acoustic speech features, and a vocoder which then synthesises the speech signals. Due to an inadequate amount of available dat… ▽ More Electromyography-to-Speech (ETS) conversion has demonstrated its potential for silent speech interfaces by generating audible speech from Electromyography (EMG) signals during silent articulations. ETS models usually consist of an EMG encoder which converts EMG signals to acoustic speech features, and a vocoder which then synthesises the speech signals. Due to an inadequate amount of available data and noisy signals, the synthesised speech often exhibits a low level of naturalness. In this work, we propose Diff-ETS, an ETS model which uses a score-based diffusion probabilistic model to enhance the naturalness of synthesised speech. The diffusion model is applied to improve the quality of the acoustic features predicted by an EMG encoder. In our experiments, we evaluated fine-tuning the diffusion model on predictions of a pre-trained EMG encoder, and training both models in an end-to-end fashion. We compared Diff-ETS with a baseline ETS model without diffusion using objective metrics and a listening test. The results indicated the proposed Diff-ETS significantly improved speech naturalness over the baseline. △ Less

Submitted 11 May, 2024; originally announced May 2024.

Comments: Accepted by EMBC 2024

On Mirror Symmetry and Irrationality of Zeta Values

Authors: Andreas Malmendier, Michael T. Schultz

Abstract: A fundamental object of study in mirror symmetry of $n$-dimensional Fano varieties is the A-side connection on small quantum cohomology. When the Picard rank is 1, the Borel transform relates the quantum differential operator of the Fano to the Picard-Fuchs operator of the mirror to the associated pencil of anticanonical Calabi-Yau $(n-1)$-folds on the Fano variety. Expanding on related work by W.… ▽ More A fundamental object of study in mirror symmetry of $n$-dimensional Fano varieties is the A-side connection on small quantum cohomology. When the Picard rank is 1, the Borel transform relates the quantum differential operator of the Fano to the Picard-Fuchs operator of the mirror to the associated pencil of anticanonical Calabi-Yau $(n-1)$-folds on the Fano variety. Expanding on related work by W. Yang on the Beukers-Peters pencil of K3 surfaces associated with Apéry's proof for the irrationality of $ζ(3)$, for such operators we define holomorphic prepotentials, virtual Yukawa couplings, and virtual instanton numbers, analogous to the usual ingredients of Calabi-Yau mirror symmetry. We prove that when the underlying Calabi-Yau operator is modular, the virtual Yukawa coupling is a modular form of weight-$(n+1)$, with the holomorphic prepotential as an Eichler integral. We then analyze the quantum differential operators for modular pencils of K3 surfaces arising as Dolgachev-Nikulin-Pinkham mirrors for the anticanonical linear systems for the 17 deformation classes of Fano threefolds of Picard rank-1 classified by Iskovskikh from the perspective of Golyshev & Zagier's proof of the Gamma conjecture for such Fanos, the natural setting of Yang's work. Here, the virtual instanton numbers are proven to be periodic integers with period equal to the level of the modular subgroup. Finally, we conjecture that the geometric nature of these virtual instanton numbers can be understood in terms of relative genus zero Gromov-Witten invariants of the associated log Calabi-Yau pair from the Fano threefold and anticanonical K3. △ Less

Submitted 5 April, 2024; v1 submitted 12 March, 2024; originally announced March 2024.

Comments: 47 pages, conjecture sharpened, typos fixed, references added

MSC Class: 11J72; 14J27; 14J28; 14J33; 33C60

Correlated Rotational Alignment Spectroscopy: A New Tool for High-Resolution Spectroscopy and the Analysis of Heterogeneous Samples

Authors: Thomas Schultz

Abstract: Correlated rotational alignment spectroscopy correlates observables of ultrafast gas-phase spectroscopy with high-resolution, broad-band rotational Raman spectra. This article reviews the measurement principle of CRASY, existing implementations for mass-correlated measurements, and the potential for future developments. New spectroscopic capabilities are discussed in detail: Signals for individual… ▽ More Correlated rotational alignment spectroscopy correlates observables of ultrafast gas-phase spectroscopy with high-resolution, broad-band rotational Raman spectra. This article reviews the measurement principle of CRASY, existing implementations for mass-correlated measurements, and the potential for future developments. New spectroscopic capabilities are discussed in detail: Signals for individual sample components can be separated even in highly heterogeneous samples. Isotopologue rotational spectra can be observed at natural isotope abundance. Fragmentation channels are readily assigned in molecular and cluster mass spectra. And finally, rotational Raman spectra can be measured with sub-MHz resolution, an improvement of several orders-of-magnitude as compared to preceding experiments. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Comments: 33 pages, 33 figures

Is Open-Source There Yet? A Comparative Study on Commercial and Open-Source LLMs in Their Ability to Label Chest X-Ray Reports

Authors: Felix J. Dorfner, Liv Jürgensen, Leonhard Donle, Fares Al Mohamad, Tobias R. Bodenmann, Mason C. Cleveland, Felix Busch, Lisa C. Adams, James Sato, Thomas Schultz, Albert E. Kim, Jameson Merkow, Keno K. Bressem, Christopher P. Bridge

Abstract: Introduction: With the rapid advances in large language models (LLMs), there have been numerous new open source as well as commercial models. While recent publications have explored GPT-4 in its application to extracting information of interest from radiology reports, there has not been a real-world comparison of GPT-4 to different leading open-source models. Materials and Methods: Two different… ▽ More Introduction: With the rapid advances in large language models (LLMs), there have been numerous new open source as well as commercial models. While recent publications have explored GPT-4 in its application to extracting information of interest from radiology reports, there has not been a real-world comparison of GPT-4 to different leading open-source models. Materials and Methods: Two different and independent datasets were used. The first dataset consists of 540 chest x-ray reports that were created at the Massachusetts General Hospital between July 2019 and July 2021. The second dataset consists of 500 chest x-ray reports from the ImaGenome dataset. We then compared the commercial models GPT-3.5 Turbo and GPT-4 from OpenAI to the open-source models Mistral-7B, Mixtral-8x7B, Llama2-13B, Llama2-70B, QWEN1.5-72B and CheXbert and CheXpert-labeler in their ability to accurately label the presence of multiple findings in x-ray text reports using different prompting techniques. Results: On the ImaGenome dataset, the best performing open-source model was Llama2-70B with micro F1-scores of 0.972 and 0.970 for zero- and few-shot prompts, respectively. GPT-4 achieved micro F1-scores of 0.975 and 0.984, respectively. On the institutional dataset, the best performing open-source model was QWEN1.5-72B with micro F1-scores of 0.952 and 0.965 for zero- and few-shot prompting, respectively. GPT-4 achieved micro F1-scores of 0.975 and 0.973, respectively. Conclusion: In this paper, we show that while GPT-4 is superior to open-source models in zero-shot report labeling, the implementation of few-shot prompting can bring open-source models on par with GPT-4. This shows that open-source models could be a performant and privacy preserving alternative to GPT-4 for the task of radiology report classification. △ Less

Submitted 19 February, 2024; originally announced February 2024.

Correlating parent-fragment relationships in cluster photoionization

Authors: Jong Chan Lee, Begüm Rukiye Özer, In Heo, Thomas Schultz

Abstract: Fragment signals in ordinary mass spectra carry no label to identify their parent molecule. By correlating mass signals with rotational Raman spectra, we created a method to label each ion signal with the spectroscopic fingerprint of its neutral parent molecule. In data for a carbon disulfide molecular cluster beam, we assigned 28 distinct ionization and fragmentation channels based on their mass-… ▽ More Fragment signals in ordinary mass spectra carry no label to identify their parent molecule. By correlating mass signals with rotational Raman spectra, we created a method to label each ion signal with the spectroscopic fingerprint of its neutral parent molecule. In data for a carbon disulfide molecular cluster beam, we assigned 28 distinct ionization and fragmentation channels based on their mass-correlated rotational fingerprints. Unexpected observations included the formation of energetic S2 and SCCS cationic fragments from the CS2-dimer cluster and a significant CS3 signal, uncorrelated to the dimer. The large number of observed channels revealed a surprising complexity that could only be addressed with correlated spectroscopy and computer-aided correlation analysis. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Comments: 8 pages, 3 figures, 1 table

STAA-Net: A Sparse and Transferable Adversarial Attack for Speech Emotion Recognition

Authors: Yi Chang, Zhao Ren, Zixing Zhang, Xin Jing, Kun Qian, Xi Shao, Bin Hu, Tanja Schultz, Björn W. Schuller

Abstract: Speech contains rich information on the emotions of humans, and Speech Emotion Recognition (SER) has been an important topic in the area of human-computer interaction. The robustness of SER models is crucial, particularly in privacy-sensitive and reliability-demanding domains like private healthcare. Recently, the vulnerability of deep neural networks in the audio domain to adversarial attacks has… ▽ More Speech contains rich information on the emotions of humans, and Speech Emotion Recognition (SER) has been an important topic in the area of human-computer interaction. The robustness of SER models is crucial, particularly in privacy-sensitive and reliability-demanding domains like private healthcare. Recently, the vulnerability of deep neural networks in the audio domain to adversarial attacks has become a popular area of research. However, prior works on adversarial attacks in the audio domain primarily rely on iterative gradient-based techniques, which are time-consuming and prone to overfitting the specific threat model. Furthermore, the exploration of sparse perturbations, which have the potential for better stealthiness, remains limited in the audio domain. To address these challenges, we propose a generator-based attack method to generate sparse and transferable adversarial examples to deceive SER models in an end-to-end and efficient manner. We evaluate our method on two widely-used SER datasets, Database of Elicited Mood in Speech (DEMoS) and Interactive Emotional dyadic MOtion CAPture (IEMOCAP), and demonstrate its ability to generate successful sparse adversarial examples in an efficient manner. Moreover, our generated adversarial examples exhibit model-agnostic transferability, enabling effective adversarial attacks on advanced victim models. △ Less

Submitted 2 February, 2024; originally announced February 2024.

On holomorphic conformal structures associated with lattice polarized K3 surfaces

Authors: Andreas Malmendier, Michael T. Schultz

Abstract: We discuss the connection between Picard-Fuchs equations for certain families of lattice polarized K3 surfaces and the construction of integrable holomorphic conformal structures on their period domains. We then compute an explicit example of a locally conformally flat holomorphic metric associated with generic Jacobian Kummer surfaces, which allows for a novel description of the local variation o… ▽ More We discuss the connection between Picard-Fuchs equations for certain families of lattice polarized K3 surfaces and the construction of integrable holomorphic conformal structures on their period domains. We then compute an explicit example of a locally conformally flat holomorphic metric associated with generic Jacobian Kummer surfaces, which allows for a novel description of the local variation of complex structure. △ Less

Submitted 18 January, 2024; originally announced January 2024.

Comments: 15 pages

MSC Class: 14D07; 14J28; 53C18

Uncovering the Full Potential of Visual Grounding Methods in VQA

Authors: Daniel Reich, Tanja Schultz

Abstract: Visual Grounding (VG) methods in Visual Question Answering (VQA) attempt to improve VQA performance by strengthening a model's reliance on question-relevant visual information. The presence of such relevant information in the visual input is typically assumed in training and testing. This assumption, however, is inherently flawed when dealing with imperfect image representations common in large-sc… ▽ More Visual Grounding (VG) methods in Visual Question Answering (VQA) attempt to improve VQA performance by strengthening a model's reliance on question-relevant visual information. The presence of such relevant information in the visual input is typically assumed in training and testing. This assumption, however, is inherently flawed when dealing with imperfect image representations common in large-scale VQA, where the information carried by visual features frequently deviates from expected ground-truth contents. As a result, training and testing of VG-methods is performed with largely inaccurate data, which obstructs proper assessment of their potential benefits. In this study, we demonstrate that current evaluation schemes for VG-methods are problematic due to the flawed assumption of availability of relevant visual information. Our experiments show that these methods can be much more effective when evaluation conditions are corrected. Code is provided on GitHub. △ Less

Submitted 15 February, 2024; v1 submitted 15 January, 2024; originally announced January 2024.

Surface doping of rubrene single crystals by molecular electron donors and acceptors

Authors: Christos Gatsios, Andreas Opitz, Dominique Lungwitz, Ahmed E. Mansour, Thorsten Schultz, Dongguen Shin, Sebastian Hammer, Jens Pflaum, Yadong Zhang, Stephen Barlow, Seth R. Marder, Norbert Koch

Abstract: The surface molecular doping of organic semiconductors can play an important role in the development of organic electronic or optoelectronic devices. Single-crystal rubrene remains a leading molecular candidate for applications in electronics due to its high hole mobility. In parallel, intensive research into the fabrication of flexible organic electronics requires the careful design of functional… ▽ More The surface molecular doping of organic semiconductors can play an important role in the development of organic electronic or optoelectronic devices. Single-crystal rubrene remains a leading molecular candidate for applications in electronics due to its high hole mobility. In parallel, intensive research into the fabrication of flexible organic electronics requires the careful design of functional interfaces to enable optimal device characteristics. To this end, the present work seeks to understand the effect of surface molecular doping on the electronic band structure of rubrene single crystals. Our angle-resolved photoemission measurements reveal that the Fermi level moves in the band gap of rubrene depending on the direction of surface electron-transfer reactions with the molecular dopants, yet the valence band dispersion remains essentially unperturbed. This indicates that surface electron-transfer doping of a molecular single crystal can effectively modify the near-surface charge density, while retaining good charge-carrier mobility. △ Less

Submitted 11 January, 2024; originally announced January 2024.

Comments: 28 pages, 11 figures

Journal ref: Physical Chemistry Chemical Physics, 25, 2023, 29718-29726

Topological atom optics and beyond with knotted quantum wavefunctions

Authors: Maitreyi Jayaseelan, Joseph D. Murphree, Justin T. Schultz, Janne Ruostekoski, Nicholas P. Bigelow

Abstract: Atom optics demonstrates optical phenomena with coherent matter waves, providing a foundational connection between light and matter. Significant advances in optics have followed the realisation of structured light fields hosting complex singularities and topologically non-trivial characteristics. However, analogous studies are still in their infancy in the field of atom optics. Here, we investigat… ▽ More Atom optics demonstrates optical phenomena with coherent matter waves, providing a foundational connection between light and matter. Significant advances in optics have followed the realisation of structured light fields hosting complex singularities and topologically non-trivial characteristics. However, analogous studies are still in their infancy in the field of atom optics. Here, we investigate and experimentally create knotted quantum wavefunctions in spinor Bose--Einstein condensates which display non-trivial topologies. In our work we construct coordinated orbital and spin rotations of the atomic wavefunction, engineering a variety of discrete symmetries in the combined spin and orbital degrees of freedom. The structured wavefunctions that we create map to the surface of a torus to form torus knots, Möbius strips, and a twice-linked Solomon's knot. In this paper we demonstrate striking connections between the symmetries and underlying topologies of multicomponent atomic systems and of vector optical fields--a realization of topological atom-optics. △ Less

Submitted 15 December, 2023; originally announced December 2023.

Comments: 10 pages, 7 figures, 5 pages Supplementary information

Journal ref: Communications Physics 7, 7 (2024)

NeuroHeed: Neuro-Steered Speaker Extraction using EEG Signals

Authors: Zexu Pan, Marvin Borsdorf, Siqi Cai, Tanja Schultz, Haizhou Li

Abstract: Humans possess the remarkable ability to selectively attend to a single speaker amidst competing voices and background noise, known as selective auditory attention. Recent studies in auditory neuroscience indicate a strong correlation between the attended speech signal and the corresponding brain's elicited neuronal activities, which the latter can be measured using affordable and non-intrusive el… ▽ More Humans possess the remarkable ability to selectively attend to a single speaker amidst competing voices and background noise, known as selective auditory attention. Recent studies in auditory neuroscience indicate a strong correlation between the attended speech signal and the corresponding brain's elicited neuronal activities, which the latter can be measured using affordable and non-intrusive electroencephalography (EEG) devices. In this study, we present NeuroHeed, a speaker extraction model that leverages EEG signals to establish a neuronal attractor which is temporally associated with the speech stimulus, facilitating the extraction of the attended speech signal in a cocktail party scenario. We propose both an offline and an online NeuroHeed, with the latter designed for real-time inference. In the online NeuroHeed, we additionally propose an autoregressive speaker encoder, which accumulates past extracted speech signals for self-enrollment of the attended speaker information into an auditory attractor, that retains the attentional momentum over time. Online NeuroHeed extracts the current window of the speech signals with guidance from both attractors. Experimental results demonstrate that NeuroHeed effectively extracts brain-attended speech signals, achieving high signal quality, excellent perceptual quality, and intelligibility in a two-speaker scenario. △ Less

Submitted 26 July, 2023; originally announced July 2023.

Anisotropic Fanning Aware Low-Rank Tensor Approximation Based Tractography

Authors: Johannes Grün, Jonah Sieg, Thomas Schultz

Abstract: Low-rank higher-order tensor approximation has been used successfully to extract discrete directions for tractography from continuous fiber orientation density functions (fODFs). However, while it accounts for fiber crossings, it has so far ignored fanning, which has led to incomplete reconstructions. In this work, we integrate an anisotropic model of fanning based on the Bingham distribution into… ▽ More Low-rank higher-order tensor approximation has been used successfully to extract discrete directions for tractography from continuous fiber orientation density functions (fODFs). However, while it accounts for fiber crossings, it has so far ignored fanning, which has led to incomplete reconstructions. In this work, we integrate an anisotropic model of fanning based on the Bingham distribution into a recently proposed tractography method that performs low-rank approximation with an Unscented Kalman Filter. Our technical contributions include an initialization scheme for the new parameters, which is based on the Hessian of the low-rank approximation, pre-integration of the required convolution integrals to reduce the computational effort, and representation of the required 3D rotations with quaternions. Results on 12 subjects from the Human Connectome Project confirm that, in almost all considered tracts, our extended model significantly increases completeness of the reconstruction, while reducing excess, at acceptable additional computational cost. Its results are also more accurate than those from a simpler, isotropic fanning model that is based on Watson distributions. △ Less

Submitted 3 July, 2023; originally announced July 2023.

Measuring Faithful and Plausible Visual Grounding in VQA

Authors: Daniel Reich, Felix Putze, Tanja Schultz

Abstract: Metrics for Visual Grounding (VG) in Visual Question Answering (VQA) systems primarily aim to measure a system's reliance on relevant parts of the image when inferring an answer to the given question. Lack of VG has been a common problem among state-of-the-art VQA systems and can manifest in over-reliance on irrelevant image parts or a disregard for the visual modality entirely. Although inference… ▽ More Metrics for Visual Grounding (VG) in Visual Question Answering (VQA) systems primarily aim to measure a system's reliance on relevant parts of the image when inferring an answer to the given question. Lack of VG has been a common problem among state-of-the-art VQA systems and can manifest in over-reliance on irrelevant image parts or a disregard for the visual modality entirely. Although inference capabilities of VQA models are often illustrated by a few qualitative illustrations, most systems are not quantitatively assessed for their VG properties. We believe, an easily calculated criterion for meaningfully measuring a system's VG can help remedy this shortcoming, as well as add another valuable dimension to model evaluations and analysis. To this end, we propose a new VG metric that captures if a model a) identifies question-relevant objects in the scene, and b) actually relies on the information contained in the relevant objects when producing its answer, i.e., if its visual grounding is both "faithful" and "plausible". Our metric, called "Faithful and Plausible Visual Grounding" (FPVG), is straightforward to determine for most VQA model designs. We give a detailed description of FPVG and evaluate several reference systems spanning various VQA architectures. Code to support the metric calculations on the GQA data set is available on GitHub. △ Less

Submitted 14 October, 2023; v1 submitted 24 May, 2023; originally announced May 2023.

Journal ref: EMNLP 2023 Findings

Visually Grounded VQA by Lattice-based Retrieval

Authors: Daniel Reich, Felix Putze, Tanja Schultz

Abstract: Visual Grounding (VG) in Visual Question Answering (VQA) systems describes how well a system manages to tie a question and its answer to relevant image regions. Systems with strong VG are considered intuitively interpretable and suggest an improved scene understanding. While VQA accuracy performances have seen impressive gains over the past few years, explicit improvements to VG performance and ev… ▽ More Visual Grounding (VG) in Visual Question Answering (VQA) systems describes how well a system manages to tie a question and its answer to relevant image regions. Systems with strong VG are considered intuitively interpretable and suggest an improved scene understanding. While VQA accuracy performances have seen impressive gains over the past few years, explicit improvements to VG performance and evaluation thereof have often taken a back seat on the road to overall accuracy improvements. A cause of this originates in the predominant choice of learning paradigm for VQA systems, which consists of training a discriminative classifier over a predetermined set of answer options. In this work, we break with the dominant VQA modeling paradigm of classification and investigate VQA from the standpoint of an information retrieval task. As such, the developed system directly ties VG into its core search procedure. Our system operates over a weighted, directed, acyclic graph, a.k.a. "lattice", which is derived from the scene graph of a given image in conjunction with region-referring expressions extracted from the question. We give a detailed analysis of our approach and discuss its distinctive properties and limitations. Our approach achieves the strongest VG performance among examined systems and exhibits exceptional generalization capabilities in a number of scenarios. △ Less

Submitted 15 November, 2022; originally announced November 2022.

Molecular-Beam Spectroscopy with an Infinite Interferometer: Spectroscopic Resolution and Accuracy

Authors: Thomas Schultz, In Heo, Jong Chan Lee, Begüm Rukiye Özer

Abstract: An interferometer with effectively infinite maximum optical path difference removes the dominant resolution limitation for interferometric spectroscopy. We present mass-correlated rotational Raman spectra that represent the world's highest resolution scanned interferometric data and discuss the current and expected future limitations in achievable spectroscopic performance. An interferometer with effectively infinite maximum optical path difference removes the dominant resolution limitation for interferometric spectroscopy. We present mass-correlated rotational Raman spectra that represent the world's highest resolution scanned interferometric data and discuss the current and expected future limitations in achievable spectroscopic performance. △ Less

Submitted 22 September, 2022; originally announced September 2022.

Comments: 8 pages, 12 figures, 1 table, submitted to the Journal of the Korean Physical Society

Absolutely continuous and BV-curves in 1-Wasserstein spaces

Authors: Ehsan Abedi, Zhenhao Li, Timo Schultz

Abstract: We extend the result of Lisini (Calc Var Partial Differ Equ 28:85-120, 2007) on the superposition principle for absolutely continuous curves in $p$-Wasserstein spaces to the special case of $p=1$. In contrast to the case of $p>1$, it is not always possible to have lifts on absolutely continuous curves. Therefore, one needs to relax the notion of a lift by considering curves of bounded variation, o… ▽ More We extend the result of Lisini (Calc Var Partial Differ Equ 28:85-120, 2007) on the superposition principle for absolutely continuous curves in $p$-Wasserstein spaces to the special case of $p=1$. In contrast to the case of $p>1$, it is not always possible to have lifts on absolutely continuous curves. Therefore, one needs to relax the notion of a lift by considering curves of bounded variation, or shortly BV-curves, and replace the metric speed by the total variation measure. We prove that any BV-curve in a 1-Wasserstein space can be represented by a probability measure on the space of BV-curves which encodes the total variation measure of the Wasserstein curve. In particular, when the curve is absolutely continuous, the result gives a lift concentrated on BV-curves which also characterizes the metric speed. The main theorem is then applied for the characterization of geodesics and the study of the continuity equation in a discrete setting. △ Less

Submitted 16 December, 2023; v1 submitted 9 September, 2022; originally announced September 2022.

Comments: 37 pages, 3 figures

MSC Class: 49Q22; 49J27; 26A45

Journal ref: Calc. Var. Partial Differ. Equ. 63:16 (2024)

Combining Image Space and q-Space PDEs for Lossless Compression of Diffusion MR Images

Authors: Ikram Jumakulyyev, Thomas Schultz

Abstract: Diffusion MRI is a modern neuroimaging modality with a unique ability to acquire microstructural information by measuring water self-diffusion at the voxel level. However, it generates huge amounts of data, resulting from a large number of repeated 3D scans. Each volume samples a location in q-space, indicating the direction and strength of a diffusion sensitizing gradient during the measurement.… ▽ More Diffusion MRI is a modern neuroimaging modality with a unique ability to acquire microstructural information by measuring water self-diffusion at the voxel level. However, it generates huge amounts of data, resulting from a large number of repeated 3D scans. Each volume samples a location in q-space, indicating the direction and strength of a diffusion sensitizing gradient during the measurement. This captures detailed information about the self-diffusion, and the tissue microstructure that restricts it. Lossless compression with GZIP is widely used to reduce the memory requirements. We introduce a novel lossless codec for diffusion MRI data. It reduces file sizes by more than 30% compared to GZIP, and also beats lossless codecs from the JPEG family. Our codec builds on recent work on lossless PDE-based compression of 3D medical images, but additionally exploits smoothness in q-space. We demonstrate that, compared to using only image space PDEs, q-space PDEs further improve compression rates. Moreover, implementing them with Finite Element Methods and a custom acceleration significantly reduces computational expense. Finally, we show that our codec clearly benefits from integrating subject motion correction, and slightly from optimizing the order in which the 3D volumes are coded. △ Less

Submitted 5 April, 2023; v1 submitted 14 June, 2022; originally announced June 2022.

Comments: Accepted for publication at Journal of Mathematical Imaging and Vision

A Primer for Telemetry Interfacing in Accordance with NASA Standards Using Low Cost FPGAs

Authors: Jake A. McCoy, Ted B. Schultz, James H. Tutt, Thomas Rogers, Drew M. Miles, Randall L. McEntaffer

Abstract: Photon counting detector systems on sounding rocket payloads often require interfacing asynchronous outputs with a synchronously clocked telemetry (TM) stream. Though this can be handled with an on-board computer, there are several low cost alternatives including custom hardware, microcontrollers and field-programmable gate arrays (FPGAs). This paper outlines how a TM interface (TMIF) for detector… ▽ More Photon counting detector systems on sounding rocket payloads often require interfacing asynchronous outputs with a synchronously clocked telemetry (TM) stream. Though this can be handled with an on-board computer, there are several low cost alternatives including custom hardware, microcontrollers and field-programmable gate arrays (FPGAs). This paper outlines how a TM interface (TMIF) for detectors on a sounding rocket with asynchronous parallel digital output can be implemented using low cost FPGAs and minimal custom hardware. Low power consumption and high speed FPGAs are available as commercial off-the-shelf (COTS) products and can be used to develop the main component of the TMIF. Then, only a small amount of additional hardware is required for signal buffering and level translating. This paper also discusses how this system can be tested with a simulated TM chain in the small laboratory setting using FPGAs and COTS specialized data acquisition products. △ Less

Submitted 22 March, 2022; originally announced March 2022.

Comments: 16 pages, 11 pages (also published as a 2015 SPIE conference proceeding)

Journal ref: Journal of Astronomical Instrumentation | Vol. 05, No. 01, 1640002 (2016) | Special Issue - Solar and Astrophysical Sounding Rockets and Instrumentation; Guest Editors: Steven Christe and Ben Zeiger

On master test plans for the space of BV functions

Authors: Francesco Nobili, Enrico Pasqualetto, Timo Schultz

Abstract: We prove that on an arbitrary metric measure space a countable collection of test plans is sufficient to recover all $\rm BV$ functions and their total variation measures. In the setting of non-branching ${\sf CD}(K,N)$ spaces (with finite reference measure), we can additionally require these test plans to be concentrated on geodesics. We prove that on an arbitrary metric measure space a countable collection of test plans is sufficient to recover all $\rm BV$ functions and their total variation measures. In the setting of non-branching ${\sf CD}(K,N)$ spaces (with finite reference measure), we can additionally require these test plans to be concentrated on geodesics. △ Less

Submitted 10 September, 2021; originally announced September 2021.

Comments: 35 pages

MSC Class: 53C23; 26A45

On the mixed-twist construction and monodromy of associated Picard-Fuchs systems

Authors: Andreas Malmendier, Michael T. Schultz

Abstract: We use the mixed-twist construction of Doran and Malmendier to obtain a multi-parameter family of K3 surfaces of Picard rank $ρ\ge 16$. Upon identifying a particular Jacobian elliptic fibration on its general member, we determine the lattice polarization and the Picard-Fuchs system for the family. We construct a sequence of restrictions that lead to extensions of the polarization by two-elementary… ▽ More We use the mixed-twist construction of Doran and Malmendier to obtain a multi-parameter family of K3 surfaces of Picard rank $ρ\ge 16$. Upon identifying a particular Jacobian elliptic fibration on its general member, we determine the lattice polarization and the Picard-Fuchs system for the family. We construct a sequence of restrictions that lead to extensions of the polarization by two-elementary lattices. We show that the Picard-Fuchs operators for the restricted families coincide with known resonant hypergeometric systems. Second, for the one-parameter mirror families of deformed Fermat hypersurfaces we show that the mixed-twist construction produces a non-resonant GKZ system for which a basis of solutions in the form of absolutely convergent Mellin-Barnes integrals exists whose monodromy we compute explicitly. △ Less

Submitted 4 May, 2022; v1 submitted 15 August, 2021; originally announced August 2021.

Comments: 40 pages

MSC Class: 14J27; 14J28; 14D05; 33C60

Journal ref: Commun. Number Theory Phys. 16 (2022), no. 3, 459-513

Adventurer's Treasure Hunt: A Transparent System for Visually Grounded Compositional Visual Question Answering based on Scene Graphs

Authors: Daniel Reich, Felix Putze, Tanja Schultz

Abstract: With the expressed goal of improving system transparency and visual grounding in the reasoning process in VQA, we present a modular system for the task of compositional VQA based on scene graphs. Our system is called "Adventurer's Treasure Hunt" (or ATH), named after an analogy we draw between our model's search procedure for an answer and an adventurer's search for treasure. We developed ATH with… ▽ More With the expressed goal of improving system transparency and visual grounding in the reasoning process in VQA, we present a modular system for the task of compositional VQA based on scene graphs. Our system is called "Adventurer's Treasure Hunt" (or ATH), named after an analogy we draw between our model's search procedure for an answer and an adventurer's search for treasure. We developed ATH with three characteristic features in mind: 1. By design, ATH allows us to explicitly quantify the impact of each of the sub-components on overall VQA performance, as well as their performance on their individual sub-task. 2. By modeling the search task after a treasure hunt, ATH inherently produces an explicit, visually grounded inference path for the processed question. 3. ATH is the first GQA-trained VQA system that dynamically extracts answers by querying the visual knowledge base directly, instead of selecting one from a specially learned classifier's output distribution over a pre-fixed answer vocabulary. We report detailed results on all components and their contributions to overall VQA performance on the GQA dataset and show that ATH achieves the highest visual grounding score among all examined systems. △ Less

Submitted 28 June, 2021; originally announced June 2021.

Two-dimensional plasmonic polarons in n-doped monolayer MoS2

Authors: Fabio Caruso, Patrick Amsalem, Jie Ma, Areej Aljarb, Thorsten Schultz, Marios Zacharias, Vincent Tung, Norbert Koch, Claudia Draxl

Abstract: We report experimental and theoretical evidence of strong electron-plasmon interaction in n-doped single-layer MoS2. Angle-resolved photoemission spectroscopy (ARPES) measurements reveal the emergence of distinctive signatures of polaronic coupling in the electron spectral function. Calculations based on many-body perturbation theory illustrate that electronic coupling to two-dimensional (2D) carr… ▽ More We report experimental and theoretical evidence of strong electron-plasmon interaction in n-doped single-layer MoS2. Angle-resolved photoemission spectroscopy (ARPES) measurements reveal the emergence of distinctive signatures of polaronic coupling in the electron spectral function. Calculations based on many-body perturbation theory illustrate that electronic coupling to two-dimensional (2D) carrier plasmons provides an exhaustive explanation of the experimental spectral features and their energies. These results constitute compelling evidence of the formation of plasmon-induced polaronic quasiparticles, suggesting that highly-doped transition-metal dichalcogenides may provide a new platform to explore strong-coupling phenomena between electrons and plasmons in 2D. △ Less

Submitted 29 April, 2021; originally announced April 2021.

Journal ref: Phys. Rev. B 103, 205152 (2021)

Temperature-dependent electronic ground state charge transfer in van der Waals heterostructures

Authors: Soohyung Park, Haiyuan Wang, Thorsten Schultz, Dongguen Shin, Ruslan Ovsyannikov, Marios Zacharias, Dmitrii Maksimov, Matthias Meissner, Yuri Hasegawa, Takuma Yamaguchi, Satoshi Kera, Areej Aljarb, Mariam Hakami, Lain-Jong Li, Vincent Tung, Patrick Amsalem, Mariana Rossi, Norbert Koch

Abstract: Electronic charge rearrangement between components of a heterostructure is the fundamental principle to reach the electronic ground state. It is acknowledged that the density of states distribution of the components governs the amount of charge transfer, but a notable dependence on temperature has not yet been considered, particularly for weakly interacting systems. Here, we experimentally observe… ▽ More Electronic charge rearrangement between components of a heterostructure is the fundamental principle to reach the electronic ground state. It is acknowledged that the density of states distribution of the components governs the amount of charge transfer, but a notable dependence on temperature has not yet been considered, particularly for weakly interacting systems. Here, we experimentally observe that the amount of ground state charge transfer in a van der Waals heterostructure formed by monolayer MoS2 sandwiched between graphite and a molecular electron acceptor layer increases by a factor of three when going from 7 K to room temperature. State-of-the-art electronic structure calculations of the full heterostructure that account for nuclear thermal fluctuations reveal intra-component electron-phonon coupling and inter-component electronic coupling as the key factors determining the amount of charge transfer. This conclusion is rationalized by a model applicable to multi-component van der Waals heterostructures. △ Less

Submitted 14 March, 2021; originally announced March 2021.

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG

Authors: Siqi Cai, Pengcheng Sun, Tanja Schultz, Haizhou Li

Abstract: Detecting auditory attention based on brain signals enables many everyday applications, and serves as part of the solution to the cocktail party effect in speech processing. Several studies leverage the correlation between brain signals and auditory stimuli to detect the auditory attention of listeners. Recently, studies show that the alpha band (8-13 Hz) EEG signals enable the localization of aud… ▽ More Detecting auditory attention based on brain signals enables many everyday applications, and serves as part of the solution to the cocktail party effect in speech processing. Several studies leverage the correlation between brain signals and auditory stimuli to detect the auditory attention of listeners. Recently, studies show that the alpha band (8-13 Hz) EEG signals enable the localization of auditory stimuli. We believe that it is possible to detect auditory spatial attention without the need of auditory stimuli as references. In this work, we use alpha power signals for automatic auditory spatial attention detection. To the best of our knowledge, this is the first attempt to detect spatial attention based on alpha power neural signals. We propose a spectro-spatial feature extraction technique to detect the auditory spatial attention (left/right) based on the topographic specificity of alpha power. Experiments show that the proposed neural approach achieves 81.7% and 94.6% accuracy for 1-second and 10-second decision windows, respectively. Our comparative results show that this neural approach outperforms other competitive models by a large margin in all test cases. △ Less

Submitted 4 July, 2021; v1 submitted 5 March, 2021; originally announced March 2021.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Ultralimits of pointed metric measure spaces

Authors: Enrico Pasqualetto, Timo Schultz

Abstract: The aim of this paper is to study ultralimits of pointed metric measure spaces (possibly unbounded and having infinite mass). We prove that ultralimits exist under mild assumptions and are consistent with the pointed measured Gromov-Hausdorff convergence. We also introduce a weaker variant of pointed measured Gromov-Hausdorff convergence, for which we can prove a version of Gromov's compactness th… ▽ More The aim of this paper is to study ultralimits of pointed metric measure spaces (possibly unbounded and having infinite mass). We prove that ultralimits exist under mild assumptions and are consistent with the pointed measured Gromov-Hausdorff convergence. We also introduce a weaker variant of pointed measured Gromov-Hausdorff convergence, for which we can prove a version of Gromov's compactness theorem by using the ultralimit machinery. This compactness result shows that, a posteriori, our newly introduced notion of convergence is equivalent to the pointed measured Gromov one. Another byproduct of our ultralimit construction is the identification of direct and inverse limits in the category of pointed metric measure spaces. △ Less

Submitted 22 February, 2021; originally announced February 2021.

Comments: 65 pages

MSC Class: 53C23; 51F30; 54A20; 30L05

Linking Labs: Interconnecting Experimental Environments

Authors: Tanja Schultz, Felix Putze, Thorsten Fehr, Moritz Meier, Celeste Mason, Florian Ahrens, Manfred Herrmann

Abstract: We introduce the concept of LabLinking: a technology-based interconnection of experimental laboratories across institutions, disciplines, cultures, languages, and time zones - in other words experiments without borders. In particular, we introduce LabLinking levels (LLL), which define the degree of tightness of empirical interconnection between labs. We describe the technological infrastructure in… ▽ More We introduce the concept of LabLinking: a technology-based interconnection of experimental laboratories across institutions, disciplines, cultures, languages, and time zones - in other words experiments without borders. In particular, we introduce LabLinking levels (LLL), which define the degree of tightness of empirical interconnection between labs. We describe the technological infrastructure in terms of hard- and software required for the respective LLLs and present examples of linked laboratories along with insights about the challenges and benefits. In sum, we argue that linked labs provide a unique platform for a continuous exchange between scientists and experimenters, thereby enabling a time synchronous execution of experiments performed with and by decentralized user and researchers, improving outreach and ease of subject recruitment, allowing to establish new experimental designs and to incorporate a panoply of complementary biosensors, devices, hard- and software solutions. △ Less

Submitted 6 February, 2021; originally announced February 2021.

REX: X-ray experiment on the Water Recovery Rocket

Authors: Martin Urban, Ondrej Nentvich, Tomas Baca, Ivo Vertat, Veronika Marsikova, Daniela Doubravova, Vladimir Daniel, Adolf Inneman, Ladisla Pina, Randall L. McEntaffer, Ted B. Schultz, Drew M. Miles, James H. Tutt

Abstract: This paper presents Rocket Experiment (REX) that was part of a dual payload rocket campaign for NASA's sounding rocket Black Brant IX with water recovery technology. This mission was a suborbital sounding rocket flight that was launched and recovered on April 4, 2018 and targeted the Vela supernova remnant. The purpose of REX was to classify the Technology Readiness Level of onboard devices design… ▽ More This paper presents Rocket Experiment (REX) that was part of a dual payload rocket campaign for NASA's sounding rocket Black Brant IX with water recovery technology. This mission was a suborbital sounding rocket flight that was launched and recovered on April 4, 2018 and targeted the Vela supernova remnant. The purpose of REX was to classify the Technology Readiness Level of onboard devices designed for space applications. The devices were two wide-field X-ray telescopes consisting of a combination of Lobster-Eye (LE) optics with an uncooled Timepix detector (256 x 256 px @ 55 um), and additional sensors. The first telescope uses a two-dimensional combination of LE modules with a focal length of 1 m and a Field of View (FOV) of 1.0 x 1.2 deg and operates in the energy range of 3 - 60 keV. The second telescope was a one-dimensional LE with a focal length of 250 mm and a FOV of 2.7 x 8.0 deg for the energy range 3 - 40 keV. The X-ray telescopes were supplemented by a camera in the visible spectrum with 1,280 x 1,024 px resolution, which was used to obtain images of the observed sources and to verify the resulting pointing of the rocket carrier. Other devices also include infrared array sensors and inertial measurement units tested for future small satellite missions. The data handler and communication system were built using the Robot Operating System, and both the system and the electronics were deployed and operated in flight. The hardware was successfully recovered after the launch and the data were extracted. △ Less

Submitted 19 November, 2020; originally announced November 2020.

Comments: Submitted to Acta Astronautica

Federated Learning for Breast Density Classification: A Real-World Implementation

Authors: Holger R. Roth, Ken Chang, Praveer Singh, Nir Neumark, Wenqi Li, Vikash Gupta, Sharut Gupta, Liangqiong Qu, Alvin Ihsani, Bernardo C. Bizzo, Yuhong Wen, Varun Buch, Meesam Shah, Felipe Kitamura, Matheus Mendonça, Vitor Lavor, Ahmed Harouni, Colin Compas, Jesse Tetreault, Prerna Dogra, Yan Cheng, Selnur Erdal, Richard White, Behrooz Hashemian, Thomas Schultz , et al. (18 additional authors not shown)

Abstract: Building robust deep learning-based models requires large quantities of diverse training data. In this study, we investigate the use of federated learning (FL) to build medical imaging classification models in a real-world collaborative setting. Seven clinical institutions from across the world joined this FL effort to train a model for breast density classification based on Breast Imaging, Report… ▽ More Building robust deep learning-based models requires large quantities of diverse training data. In this study, we investigate the use of federated learning (FL) to build medical imaging classification models in a real-world collaborative setting. Seven clinical institutions from across the world joined this FL effort to train a model for breast density classification based on Breast Imaging, Reporting & Data System (BI-RADS). We show that despite substantial differences among the datasets from all sites (mammography system, class distribution, and data set size) and without centralizing data, we can successfully train AI models in federation. The results show that models trained using FL perform 6.3% on average better than their counterparts trained on an institute's local data alone. Furthermore, we show a 45.8% relative improvement in the models' generalizability when evaluated on the other participating sites' testing data. △ Less

Submitted 20 October, 2020; v1 submitted 3 September, 2020; originally announced September 2020.

Comments: Accepted at the 1st MICCAI Workshop on "Distributed And Collaborative Learning"; add citation to Fig. 1 & 2 and update Fig. 5; fix typo in affiliations

Journal ref: In: Albarqouni S. et al. (eds) Domain Adaptation and Representation Transfer, and Distributed and Collaborative Learning. DART 2020, DCL 2020. Lecture Notes in Computer Science, vol 12444. Springer, Cham

Fourth-Order Anisotropic Diffusion for Inpainting and Image Compression

Authors: Ikram Jumakulyyev, Thomas Schultz

Abstract: Edge-enhancing diffusion (EED) can reconstruct a close approximation of an original image from a small subset of its pixels. This makes it an attractive foundation for PDE based image compression. In this work, we generalize second-order EED to a fourth-order counterpart. It involves a fourth-order diffusion tensor that is constructed from the regularized image gradient in a similar way as in trad… ▽ More Edge-enhancing diffusion (EED) can reconstruct a close approximation of an original image from a small subset of its pixels. This makes it an attractive foundation for PDE based image compression. In this work, we generalize second-order EED to a fourth-order counterpart. It involves a fourth-order diffusion tensor that is constructed from the regularized image gradient in a similar way as in traditional second-order EED, permitting diffusion along edges, while applying a non-linear diffusivity function across them. We show that our fourth-order diffusion tensor formalism provides a unifying framework for all previous anisotropic fourth-order diffusion based methods, and that it provides additional flexibility. We achieve an efficient implementation using a fast semi-iterative scheme. Experimental results on natural and medical images suggest that our novel fourth-order method produces more accurate reconstructions compared to the existing second-order EED. △ Less

Submitted 18 June, 2020; originally announced June 2020.

Comments: Accepted for publication in Springer book "Anisotropy Across Fields and Scales"

ACM Class: I.4.2; I.4.4

On one-dimensionality of metric measure spaces

Authors: Timo Schultz

Abstract: In this paper, we prove that a metric measure space which has at least one open set isometric to an interval, and for which the (possibly non-unique) optimal transport map exists from any absolutely continuous measure to an arbitrary measure, is a one-dimensional manifold (possibly with boundary). As an immediate corollary we obtain that if a metric measure space is a very strict $CD(K,N)$ -space… ▽ More In this paper, we prove that a metric measure space which has at least one open set isometric to an interval, and for which the (possibly non-unique) optimal transport map exists from any absolutely continuous measure to an arbitrary measure, is a one-dimensional manifold (possibly with boundary). As an immediate corollary we obtain that if a metric measure space is a very strict $CD(K,N)$ -space or an essentially non-branching $MCP(K,N)$-space with some open set isometric to an interval, then it is a one-dimensional manifold. We also obtain the same conclusion for a metric measure space which has a point in which the Gromov-Hausdorff tangent is unique and isometric to the real line, and for which the optimal transport maps not only exist but are unique. Again, we obtain an analogous corollary in the setting of essentially non-branching $MCP(K,N)$-spaces. △ Less

Submitted 24 April, 2020; v1 submitted 3 December, 2019; originally announced December 2019.

Comments: 15 pages, 2 figures, to appear in Proceedings of the AMS

MSC Class: 53C23

Microstructure and Elastic Constants of Transition Metal Dichalcogenide Monolayers from Friction and Shear Force Microscopy

Authors: Xiaomin Xu, Thorsten Schultz, Ziyu Qin, Nikolai Severin, Benedikt Haas, Sumin Shen, Jan N. Kirchhof, Andreas Opitz, Christoph T. Koch, Kirill Bolotin, Jürgen P. Rabe, Goki Eda, Norbert Koch

Abstract: Optical and electrical properties of two-dimensional transition metal dichalcogenides (TMDCs) grown by chemical vapor deposition (CVD) are strongly determined by their microstructure. Consequently, the visualization of spatial structural variations is of paramount importance for future applications. Here we demonstrate how grain boundaries, crystal orientation, and strain fields can unambiguously… ▽ More Optical and electrical properties of two-dimensional transition metal dichalcogenides (TMDCs) grown by chemical vapor deposition (CVD) are strongly determined by their microstructure. Consequently, the visualization of spatial structural variations is of paramount importance for future applications. Here we demonstrate how grain boundaries, crystal orientation, and strain fields can unambiguously be identified with combined lateral force microscopy (LFM) and transverse shear microscopy (TSM) for CVD-grown tungsten disulfide (WS2) monolayers, on length scales that are relevant for optoelectronic applications. Further, angle-dependent TSM measurements enable us to acquire the fourth-order elastic constants of monolayer WS2 experimentally. Our results facilitate high-throughput and nondestructive microstructure visualization of monolayer TMDCs, insights into their elastic properties, thus providing an accessible tool to support the development of advanced optoelectronic devices based on such two-dimensional semiconductors. △ Less

Submitted 21 August, 2019; originally announced August 2019.

Journal ref: Advanced Materials 30 1803748 (2018)

From the signature theorem to anomaly cancellation

Authors: Andreas Malmendier, Michael T. Schultz

Abstract: We survey the Hirzebruch signature theorem as a special case of the Atiyah-Singer index theorem. The family version of the Atiyah-Singer index theorem in the form of the Riemann-Roch-Grothendieck-Quillen (RRGQ) formula is then applied to the complexified signature operators varying along the universal family of elliptic curves. The RRGQ formula allows us to determine a generalized cohomology class… ▽ More We survey the Hirzebruch signature theorem as a special case of the Atiyah-Singer index theorem. The family version of the Atiyah-Singer index theorem in the form of the Riemann-Roch-Grothendieck-Quillen (RRGQ) formula is then applied to the complexified signature operators varying along the universal family of elliptic curves. The RRGQ formula allows us to determine a generalized cohomology class on the base of the elliptic fibration that is known in physics as (a measure of) the local and global anomaly. Combining several anomalous operators allows us to cancel the local anomaly on a Jacobian elliptic surface, a construction that is based on the construction of the Poincaré line bundle over an elliptic surface. △ Less

Submitted 2 July, 2020; v1 submitted 16 July, 2019; originally announced July 2019.

Comments: 37 pages; minor typos corrected in version 2

MSC Class: 58J20; 14J27; 14J28; 81T50

Journal ref: Rocky Mountain J. Math. 50 (2020) 181-212

Equivalent definitions of very strict $CD(K,N)$ -spaces

Authors: Timo Schultz

Abstract: We show the equivalence of the definitions of very strict $CD(K,N)$ -condition defined, on one hand, using (only) the entropy functionals, and on the other, the full displacement convexity class $\mathcal{DC}_N$. In particular, we show that assuming the convexity inequalities for the critical exponent implies it for all the greater exponents. We also establish the existence of optimal transport ma… ▽ More We show the equivalence of the definitions of very strict $CD(K,N)$ -condition defined, on one hand, using (only) the entropy functionals, and on the other, the full displacement convexity class $\mathcal{DC}_N$. In particular, we show that assuming the convexity inequalities for the critical exponent implies it for all the greater exponents. We also establish the existence of optimal transport maps in very strict $CD(K,N)$ -spaces with finite $N$. △ Less

Submitted 18 June, 2019; originally announced June 2019.

Comments: 18 pages

MSC Class: 53C23

RefCurv: A Software for the Construction of Pediatric Reference Curves

Authors: Christian Winkler, Katharina Linden, Andreas Mayr, Thomas Schultz, Thomas Welchowski, Johannes Breuer, Ulrike Herberg

Abstract: In medicine, reference curves serve as an important tool for everyday clinical practice. Pediatricians assess the growth process of children with the help of percentile curves serving as norm references. The mathematical methods for the construction of these reference curves are sophisticated and often require technical knowledge beyond the scope of physicians. An easy-to-use software for life sci… ▽ More In medicine, reference curves serve as an important tool for everyday clinical practice. Pediatricians assess the growth process of children with the help of percentile curves serving as norm references. The mathematical methods for the construction of these reference curves are sophisticated and often require technical knowledge beyond the scope of physicians. An easy-to-use software for life scientists and physicians is missing. As a consequence, most medical publications do not document the construction properly. This project aims to develop a software that enables non-technical users to apply modern statistical methods to create and analyze reference curves. In this paper, we present RefCurv, a software that facilitates the construction of reference curves. The software comprises functionalities to select and visualize data. Users can fit models to the data and graphically present them as percentile curves. Furthermore, the software provides features to highlight possible outliers, perform model selection, and analyze the sensitivity. RefCurv is an open-source software with a graphical user interface (GUI) written in Python. It uses R and the gamlss add-on package (Rigby and Stasinopoulos (2005)) as the underlying statistical engine. In summary, RefCurv is the first software based on the gamlss package, which enables practitioners to construct and analyze reference curves in a user-friendly GUI. In broader terms, the software brings together the fields of statistical learning and medical application. Consequently, RefCurv can help to establish the construction of reference curves in other medical fields. △ Less

Submitted 28 January, 2019; originally announced January 2019.

Comments: You can find more information about the software (tutorials, link to the source code, etc.) on https://refcurv.com

Direct observation of state-filling at hybrid tin oxide/organic interfaces

Authors: Ulrich Hörmann, Stefan Zeiske, Soohyung Park, Thorsten Schultz, Sebastian Kickhöfel, Ullrich Scherf, Sylke Blumstengel, Norbert Koch, Dieter Neher

Abstract: Electroluminescence (EL) spectra from hybrid charge transfer excitons at metal oxide/organic type-II heterojunctions exhibit pronounced bias-induced spectral shifts. The reasons for this phenomenon have been discussed controversially and arguments for both electric field-induced effects as well as filling of trap states at the oxide surface have been put forward. Here, we combine the results from… ▽ More Electroluminescence (EL) spectra from hybrid charge transfer excitons at metal oxide/organic type-II heterojunctions exhibit pronounced bias-induced spectral shifts. The reasons for this phenomenon have been discussed controversially and arguments for both electric field-induced effects as well as filling of trap states at the oxide surface have been put forward. Here, we combine the results from EL and photovoltaic measurements to eliminate the disguising effects of the series resistance. For SnOx combined with the conjugated polymer MeLPPP, we find a one-to-one correspondence between the blueshift of the EL peak and the increase of the quasi-Fermi level splitting at the hybrid heterojunction, which we unambiguously assign to state filling. Our data is resembled best by a model considering the combination an exponential density of states with a doped semiconductor. △ Less

Submitted 20 November, 2018; v1 submitted 14 November, 2018; originally announced November 2018.

Modulation of the Work Function by the Atomic Structure of Strong Organic Electron Acceptors on H-Si(111)

Authors: Haiyuan Wang, Sergey V. Levchenko, Thorsten Schultz, Norbert Koch, Matthias Scheffler, Mariana Rossi

Abstract: Advances in hybrid organic/inorganic architectures for optoelectronics can be achieved by understanding how the atomic and electronic degrees of freedom cooperate or compete to yield the desired functional properties. Here we show how work-function changes are modulated by the structure of the organic components in model hybrid systems. We consider two cyano-quinodimethane derivatives (F4-TCNQ and… ▽ More Advances in hybrid organic/inorganic architectures for optoelectronics can be achieved by understanding how the atomic and electronic degrees of freedom cooperate or compete to yield the desired functional properties. Here we show how work-function changes are modulated by the structure of the organic components in model hybrid systems. We consider two cyano-quinodimethane derivatives (F4-TCNQ and F6-TCNNQ), which are strong electron-acceptor molecules, adsorbed on H-Si(111). From systematic structure searches employing range-separated hybrid HSE06 functional including many body van der Waals contributions, we predict that despite their similar composition, these molecules adsorb with significantly different densely-packed geometries in the first layer, due to strong intermolecular interaction. F6-TCNNQ shows a much stronger intralayer interaction (primarily due to van der Waals contributions) than F4-TCNQ in multilayered structures. The densely-packed geometries induce a large interface-charge rearrangement that result in a work-function increase of 1.11 and 1.76 eV for F4-TCNQ and F6-TCNNQ, respectively. Nuclear fluctuations at room temperature produce a wide distribution of work-function values, well modeled by a normal distribution with σ=0.17 eV. We corroborate our findings with experimental evidence of pronounced island formation for F6-TCNNQ on H-Si(111) and with the agreement of trends between predicted and measured work-function changes. △ Less

Submitted 16 January, 2019; v1 submitted 31 October, 2018; originally announced November 2018.

Influence of Vacuum modes on Photodetection

Authors: S. A. Wadood, J. T. Schultz, A. Nick Vamivakas, C. R. Stroud Jr

Abstract: Photodetection is a process in which an incident field induces a polarization current in the detector. The interaction of the field with this induced current excites an electron in the detector from a localized bound state to a state in which the electron freely propagates and can be classically amplified and detected. The induced current can interact not only with the applied field, but also with… ▽ More Photodetection is a process in which an incident field induces a polarization current in the detector. The interaction of the field with this induced current excites an electron in the detector from a localized bound state to a state in which the electron freely propagates and can be classically amplified and detected. The induced current can interact not only with the applied field, but also with all of the initially unpopulated vacuum modes. This interaction with the vacuum modes is assumed to be small and is neglected in conventional photodetection theory. We show that this interaction contributes to the quantum efficiency of the detector. We also show that in the Purcell enhancement regime, shot noise in the photocurrent depends on the bandwidth of the the vacuum modes interacting with the detector. Our theory allows design of sensitive detectors to probe the properties of the vacuum modes. △ Less

Submitted 11 June, 2018; v1 submitted 18 April, 2018; originally announced April 2018.

Optimal transport maps on Alexandrov spaces revisited

Authors: Tapio Rajala, Timo Schultz

Abstract: We give an alternative proof for the fact that in $n$-dimensional Alexandrov spaces with curvature bounded below there exists a unique optimal transport plan from any purely $(n-1)$-unrectifiable starting measure, and that this plan is induced by an optimal map. We give an alternative proof for the fact that in $n$-dimensional Alexandrov spaces with curvature bounded below there exists a unique optimal transport plan from any purely $(n-1)$-unrectifiable starting measure, and that this plan is induced by an optimal map. △ Less

Submitted 3 April, 2018; v1 submitted 27 March, 2018; originally announced March 2018.

Comments: 16 pages. Added a reference to an earlier proof of the result by Bertrand

MSC Class: Primary 53C23. Secondary 49K30

A density result for homogeneous Sobolev spaces on planar domains

Authors: Debanjan Nandi, Tapio Rajala, Timo Schultz

Abstract: We show that in a bounded simply connected planar domain $Ω$ the smooth Sobolev functions $W^{k,\infty}(Ω)\cap C^\infty(Ω)$ are dense in the homogeneous Sobolev spaces $L^{k,p}(Ω)$. We show that in a bounded simply connected planar domain $Ω$ the smooth Sobolev functions $W^{k,\infty}(Ω)\cap C^\infty(Ω)$ are dense in the homogeneous Sobolev spaces $L^{k,p}(Ω)$. △ Less

Submitted 9 January, 2018; originally announced January 2018.

Comments: 17 pages, 4 figures

MSC Class: 46E35

Existence of optimal transport maps in very strict $CD(K,\infty)$ -spaces

Authors: Timo Schultz

Abstract: We introduce a more restrictive version of the strict $CD(K,\infty)$ -condition, the so-called very strict $CD(K,\infty)$ -condition, and show the existence of optimal maps in very strict $CD(K,\infty)$ -spaces despite the possible lack of uniqueness of optimal plans. We introduce a more restrictive version of the strict $CD(K,\infty)$ -condition, the so-called very strict $CD(K,\infty)$ -condition, and show the existence of optimal maps in very strict $CD(K,\infty)$ -spaces despite the possible lack of uniqueness of optimal plans. △ Less

Submitted 11 December, 2017; originally announced December 2017.

Comments: 12 pages

MSC Class: 53C23

Visual Analytics of Group Differences in Tensor Fields: Application to Clinical DTI

Authors: Amin Abbasloo, Vitalis Wiens, Tobias Schmidt-Wilcke, Pia Sundgren, Reinhard Klein, Thomas Schultz

Abstract: We present a visual analytics system for exploring group differences in tensor fields with respect to all six degrees of freedom that are inherent in symmetric second-order tensors. Our framework closely integrates quantitative analysis, based on multivariate hypothesis testing and spatial cluster enhancement, with suitable visualization tools that facilitate interpretation of results, and forming… ▽ More We present a visual analytics system for exploring group differences in tensor fields with respect to all six degrees of freedom that are inherent in symmetric second-order tensors. Our framework closely integrates quantitative analysis, based on multivariate hypothesis testing and spatial cluster enhancement, with suitable visualization tools that facilitate interpretation of results, and forming of new hypotheses. Carefully chosen and linked spatial and abstract views show clusters of strong differences, and allow the analyst to relate them to the affected structures, to reveal the exact nature of the differences, and to investigate potential correlations. A mechanism for visually comparing the results of different tests or levels of smoothing is also provided. We carefully justify the need for such a visual analytics tool from a practical and theoretical point of view. In close collaboration with our clinical co-authors, we apply it to the results of a diffusion tensor imaging study of systemic lupus erythematosus, in which it revealed previously unknown group differences. △ Less

Submitted 22 November, 2017; originally announced November 2017.

Comments: Submitted to IEEE Transactions on Visualization and Computer Graphics

Classification on Large Networks: A Quantitative Bound via Motifs and Graphons

Authors: Andreas Haupt, Mohammad Khatami, Thomas Schultz, Ngoc Mai Tran

Abstract: When each data point is a large graph, graph statistics such as densities of certain subgraphs (motifs) can be used as feature vectors for machine learning. While intuitive, motif counts are expensive to compute and difficult to work with theoretically. Via graphon theory, we give an explicit quantitative bound for the ability of motif homomorphisms to distinguish large networks under both generat… ▽ More When each data point is a large graph, graph statistics such as densities of certain subgraphs (motifs) can be used as feature vectors for machine learning. While intuitive, motif counts are expensive to compute and difficult to work with theoretically. Via graphon theory, we give an explicit quantitative bound for the ability of motif homomorphisms to distinguish large networks under both generative and sampling noise. Furthermore, we give similar bounds for the graph spectrum and connect it to homomorphism densities of cycles. This results in an easily computable classifier on graph data with theoretical performance guarantee. Our method yields competitive results on classification tasks for the autoimmune disease Lupus Erythematosus. △ Less

Submitted 24 October, 2017; originally announced October 2017.

Comments: 17 pages, 2 figures, 1 table

MSC Class: 68T05; 05C80; 62G99

Syntactic and Semantic Features For Code-Switching Factored Language Models

Authors: Heike Adel, Ngoc Thang Vu, Katrin Kirchhoff, Dominic Telaar, Tanja Schultz

Abstract: This paper presents our latest investigations on different features for factored language models for Code-Switching speech and their effect on automatic speech recognition (ASR) performance. We focus on syntactic and semantic features which can be extracted from Code-Switching text data and integrate them into factored language models. Different possible factors, such as words, part-of-speech tags… ▽ More This paper presents our latest investigations on different features for factored language models for Code-Switching speech and their effect on automatic speech recognition (ASR) performance. We focus on syntactic and semantic features which can be extracted from Code-Switching text data and integrate them into factored language models. Different possible factors, such as words, part-of-speech tags, Brown word clusters, open class words and clusters of open class word embeddings are explored. The experimental results reveal that Brown word clusters, part-of-speech tags and open-class words are the most effective at reducing the perplexity of factored language models on the Mandarin-English Code-Switching corpus SEAME. In ASR experiments, the model containing Brown word clusters and part-of-speech tags and the model also including clusters of open class word embeddings yield the best mixed error rate results. In summary, the best language model can significantly reduce the perplexity on the SEAME evaluation set by up to 10.8% relative and the mixed error rate by up to 3.4% relative. △ Less

Submitted 4 October, 2017; originally announced October 2017.

Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing (Volume: 23, Issue: 3, March 2015)

Multi-Scale Anisotropic Fourth-Order Diffusion Improves Ridge and Valley Localization

Authors: Shekoufeh Gorgi Zadeh, Stephan Didas, Maximilian W. M. Wintergerst, Thomas Schultz

Abstract: Ridge and valley enhancing filters are widely used in applications such as vessel detection in medical image computing. When images are degraded by noise or include vessels at different scales, such filters are an essential step for meaningful and stable vessel localization. In this work, we propose a novel multi-scale anisotropic fourth-order diffusion equation that allows us to smooth along vess… ▽ More Ridge and valley enhancing filters are widely used in applications such as vessel detection in medical image computing. When images are degraded by noise or include vessels at different scales, such filters are an essential step for meaningful and stable vessel localization. In this work, we propose a novel multi-scale anisotropic fourth-order diffusion equation that allows us to smooth along vessels, while sharpening them in the orthogonal direction. The proposed filter uses a fourth order diffusion tensor whose eigentensors and eigenvalues are determined from the local Hessian matrix, at a scale that is automatically selected for each pixel. We discuss efficient implementation using a Fast Explicit Diffusion scheme and demonstrate results on synthetic images and vessels in fundus images. Compared to previous isotropic and anisotropic fourth-order filters, as well as established second-order vessel enhancing filters, our newly proposed one better restores the centerlines in all cases. △ Less

Submitted 18 April, 2017; v1 submitted 21 November, 2016; originally announced November 2016.

Comments: 12 pages, 8 figures, 1 table

Journal ref: Journal of Mathematical Imaging and Vision, 1-13, 2017

Raman fingerprints on the Bloch sphere of a spinor Bose-Einstein condensate

Authors: Justin T. Schultz, Azure Hansen, Joseph D. Murphree, Maitreyi Jayaseelan, Nicholas P. Bigelow

Abstract: We explore the geometric interpretation of a diabatic, two-photon Raman process as a rotation on the Bloch sphere for a pseudo-spin-1/2 system. The spin state of a spin-1/2 quantum system can be described by a point on the surface of the Bloch sphere, and its evolution during a Raman pulse is a trajectory on the sphere determined by properties of the optical beams: the pulse area, the relative int… ▽ More We explore the geometric interpretation of a diabatic, two-photon Raman process as a rotation on the Bloch sphere for a pseudo-spin-1/2 system. The spin state of a spin-1/2 quantum system can be described by a point on the surface of the Bloch sphere, and its evolution during a Raman pulse is a trajectory on the sphere determined by properties of the optical beams: the pulse area, the relative intensities and phases, and the relative frequencies. We experimentally demonstrate key features of this model with a $^{87}$Rb spinor Bose-Einstein condensate, which allows us to examine spatially dependent signatures of the Raman beams. The two-photon detuning allows us to precisely control the spin density and imprinted relative phase profiles, as we show with a coreless vortex. With this comprehensive understanding and intuitive geometric interpretation, we use the Raman process to create and tailor as well as study and characterize exotic topological spin textures in spinor BECs. △ Less

Submitted 18 January, 2016; v1 submitted 3 January, 2016; originally announced January 2016.

Comments: 13 pages, 13 figures, submitted to the Journal of Modern Optics "20 Years of Bose-Einstein condensates" Special Issue

Properties of optically selected BL Lac candidates from the SDSS

Authors: S. D. Kügler, K. Nilsson, J. Heidt, J. Esser, T. Schultz

Abstract: \textbf{Context.} Deep optical surveys open the avenue for find large numbers of BL Lac objects that are hard to identify because they lack the unique properties classifying them as such. While radio or X-ray surveys typically reveal dozens of sources, recent compilations based on optical criteria alone have increased the number of BL Lac candidates considerably. However, these compilations are su… ▽ More \textbf{Context.} Deep optical surveys open the avenue for find large numbers of BL Lac objects that are hard to identify because they lack the unique properties classifying them as such. While radio or X-ray surveys typically reveal dozens of sources, recent compilations based on optical criteria alone have increased the number of BL Lac candidates considerably. However, these compilations are subject to biases and may contain a substantial number of contaminating sources. \textbf{Aims.} In this paper we extend our analysis of 182 optically selected BL Lac object candidates from the SDSS with respect to an earlier study. The main goal is to determine the number of bona fide BL Lac objects in this sample. \textbf{Methods.} We examine their variability characteristics, determine their broad-band radio-UV SEDs, and search for the presence of a host galaxy. In addition we present new optical spectra for 27 targets with improved S/N with respect to the SDSS spectra. \textbf{Results.} At least 59% of our targets have shown variability between SDSS DR2 and our observations by more than 0.1-0.27 mag de- pending on the telescope used. A host galaxy was detected in 36% of our targets. The host galaxy type and luminosities are consistent with earlier studies of BL Lac host galaxies. Simple fits to broad-band SEDS for 104 targets of our sample derived synchrotron peak frequencies between $13.5 \leq \mathrm{log}_{10}(ν_{\mathrm{peak}}) \leq 16$ with a peak at $\mathrm{log}_{10} \sim 14.5$. Our new optical spectra do not reveal any new redshift for any of our objects. Thus the sample contains a large number of bona fide BL Lac objects and seems to contain a substantial fraction of intermediate-frequency peaked BL Lacs. △ Less

Submitted 29 September, 2014; originally announced September 2014.

Comments: Accepted for publication in A\&A

A Raman Waveplate for Spinor BECs

Authors: Justin T. Schultz, Azure Hansen, Nicholas P. Bigelow

Abstract: We demonstrate a waveplate for a pseudo-spin-1/2 Bose-Einstein condensate using a two-photon Raman interaction. The angle of the waveplate is set by the relative phase of the optical fields, and the retardance is controlled by the pulse area. The waveplate allows us to image maps of the Stokes parameters of a Bose-Einstein condensate and thereby measure its relative ground state phase. We demonstr… ▽ More We demonstrate a waveplate for a pseudo-spin-1/2 Bose-Einstein condensate using a two-photon Raman interaction. The angle of the waveplate is set by the relative phase of the optical fields, and the retardance is controlled by the pulse area. The waveplate allows us to image maps of the Stokes parameters of a Bose-Einstein condensate and thereby measure its relative ground state phase. We demonstrate the waveplate by measuring the Stokes parameters of a coreless vortex. △ Less

Submitted 17 June, 2014; originally announced June 2014.

Comments: 4 pages, 3 figures, to appear in Optics Letters

Journal ref: Optics Letters, Vol. 39, Issue 14, pp. 4271-4273 (2014)