Showing 1–50 of 138 results for author: Klein, L

Fine-tuning of Geospatial Foundation Models for Aboveground Biomass Estimation

Authors: Michal Muszynski, Levente Klein, Ademir Ferreira da Silva, Anjani Prasad Atluri, Carlos Gomes, Daniela Szwarcman, Gurkanwar Singh, Kewen Gu, Maciel Zortea, Naomi Simumba, Paolo Fraccaro, Shraddha Singh, Steve Meliksetian, Campbell Watson, Daiki Kimura, Harini Srinivasan

Abstract: Global vegetation structure mapping is critical for understanding the global carbon cycle and maximizing the efficacy of nature-based carbon sequestration initiatives. Moreover, vegetation structure mapping can help reduce the impacts of climate change by, for example, guiding actions to improve water security, increase biodiversity and reduce flood risk. Global satellite measurements provide an i… ▽ More Global vegetation structure mapping is critical for understanding the global carbon cycle and maximizing the efficacy of nature-based carbon sequestration initiatives. Moreover, vegetation structure mapping can help reduce the impacts of climate change by, for example, guiding actions to improve water security, increase biodiversity and reduce flood risk. Global satellite measurements provide an important set of observations for monitoring and managing deforestation and degradation of existing forests, natural forest regeneration, reforestation, biodiversity restoration, and the implementation of sustainable agricultural practices. In this paper, we explore the effectiveness of fine-tuning of a geospatial foundation model to estimate above-ground biomass (AGB) using space-borne data collected across different eco-regions in Brazil. The fine-tuned model architecture consisted of a Swin-B transformer as the encoder (i.e., backbone) and a single convolutional layer for the decoder head. All results were compared to a U-Net which was trained as the baseline model Experimental results of this sparse-label prediction task demonstrate that the fine-tuned geospatial foundation model with a frozen encoder has comparable performance to a U-Net trained from scratch. This is despite the fine-tuned model having 13 times less parameters requiring optimization, which saves both time and compute resources. Further, we explore the transfer-learning capabilities of the geospatial foundation models by fine-tuning on satellite imagery with sparse labels from different eco-regions in Brazil. △ Less

Submitted 28 June, 2024; originally announced June 2024.

Transferable Boltzmann Generators

Authors: Leon Klein, Frank Noé

Abstract: The generation of equilibrium samples of molecular systems has been a long-standing problem in statistical physics. Boltzmann Generators are a generative machine learning method that addresses this issue by learning a transformation via a normalizing flow from a simple prior distribution to the target Boltzmann distribution of interest. Recently, flow matching has been employed to train Boltzmann… ▽ More The generation of equilibrium samples of molecular systems has been a long-standing problem in statistical physics. Boltzmann Generators are a generative machine learning method that addresses this issue by learning a transformation via a normalizing flow from a simple prior distribution to the target Boltzmann distribution of interest. Recently, flow matching has been employed to train Boltzmann Generators for small molecular systems in Cartesian coordinates. We extend this work and propose a first framework for Boltzmann Generators that are transferable across chemical space, such that they predict zero-shot Boltzmann distributions for test molecules without being retrained for these systems. These transferable Boltzmann Generators allow approximate sampling from the target distribution of unseen systems, as well as efficient reweighting to the target Boltzmann distribution. The transferability of the proposed framework is evaluated on dipeptides, where we show that it generalizes efficiently to unseen systems. Furthermore, we demonstrate that our proposed architecture enhances the efficiency of Boltzmann Generators trained on single molecular systems. △ Less

Submitted 20 June, 2024; originally announced June 2024.

Seven white dwarfs with circumstellar gas discs II: Tracing the composition of exoplanetary building blocks

Authors: L. K. Rogers, A. Bonsor, S. Xu, A. M. Buchan, P. Dufour, B. L. Klein, S. Hodgkin, M. Kissler-Patig, C. Melis, C. Walton, A. Weinberger

Abstract: This second paper presents an in-depth analysis of the composition of the planetary material that has been accreted onto seven white dwarfs with circumstellar dust and gas emission discs with abundances reported in Paper I. The white dwarfs are accreting planetary bodies with a wide range of oxygen, carbon, and sulfur volatile contents, including one white dwarf that shows the most enhanced sulfur… ▽ More This second paper presents an in-depth analysis of the composition of the planetary material that has been accreted onto seven white dwarfs with circumstellar dust and gas emission discs with abundances reported in Paper I. The white dwarfs are accreting planetary bodies with a wide range of oxygen, carbon, and sulfur volatile contents, including one white dwarf that shows the most enhanced sulfur abundance seen to date. Three white dwarfs show tentative evidence (2-3$σ$) of accreting oxygen-rich material, potentially from water-rich bodies, whilst two others are accreting dry, rocky material. One white dwarf is accreting a mantle-rich fragment of a larger differentiated body, whilst two white dwarfs show an enhancement in their iron abundance and could be accreting core-rich fragments. Whilst most planetary material accreted by white dwarfs display chondritic or bulk Earth-like compositions, these observations demonstrate that core-mantle differentiation, disruptive collisions, and the accretion of core-mantle differentiated material are important. Less than one percent of polluted white dwarfs host both observable circumstellar gas and dust. It is unknown whether these systems are experiencing an early phase in the disruption and accretion of planetary bodies, or alternatively if they are accreting larger planetary bodies. From this work there is no substantial evidence for significant differences in the accreted refractory abundance ratios for those white dwarfs with or without circumstellar gas, but there is tentative evidence for those with circumstellar gas discs to be accreting more water rich material which may suggest that volatiles accrete earlier in a gas-rich phase. △ Less

Submitted 17 June, 2024; originally announced June 2024.

Comments: Accepted for publication in MNRAS

Existence of nonnegative energy-dissipating solutions to a class of stochastic thin-film equations under weak slippage: Part I -- positive solutions

Authors: Günther Grün, Lorenz Klein

Abstract: For mobility exponents $n \in (2,3)$, we prove existence of strictly positive solutions to stochastic thin-film equations with singular effective interface potential and Stratonovich-type lower-order terms. With the perspective of using these solutions in Part II to construct surface-tension-energy dissipating solutions to stochastic thin-film equations with compactly supported initial data, for w… ▽ More For mobility exponents $n \in (2,3)$, we prove existence of strictly positive solutions to stochastic thin-film equations with singular effective interface potential and Stratonovich-type lower-order terms. With the perspective of using these solutions in Part II to construct surface-tension-energy dissipating solutions to stochastic thin-film equations with compactly supported initial data, for which finite speed of propagation is shown in future work, we establish decay estimates on the sum of surface-tension energy and effective interface potential -- without relying on further functionals involving initial data. Besides an extension of earlier techniques used in the case $n=2$ and a refinement of oscillation estimates for discrete solutions, the main analytical novelty of this paper is a discretization method which shows nonnegativity for a finite-element counterpart of the integral $\int_{\mathcal O} (u^{n-2}u_{x})_x u_{xx} dx$ under periodic boundary conditions in the parameter regime $n \in (2,3)$. This nonnegativity property serves to control Itô-correction terms in the estimate for the decay of the surface-tension energy. This way, it is the key to obtain the desired decay estimates for the sum of surface-tension energy and effective interface potential which permit to establish the singular limit of vanishing effective interface potential in Part II. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Comments: 57 pages

MSC Class: 60H15; 76A20; 35G20; 35Q35; 35K65; 65M60; 35R37

Existence of nonnegative energy-dissipating solutions to a class of stochastic thin-film equations under weak slippage: Part II -- compactly supported initial data

Authors: Günther Grün, Lorenz Klein

Abstract: We prove existence of martingale solutions to a class of stochastic thin-film equations for mobility exponents $n \in (2,3)$ and compactly supported initial data. With the perspective to study free-boundary problems related to stochastic thin-film equations in future work, we start from the surface-tension driven stochastic thin-film equation with Stratonovich noise and exploit the regime of coeff… ▽ More We prove existence of martingale solutions to a class of stochastic thin-film equations for mobility exponents $n \in (2,3)$ and compactly supported initial data. With the perspective to study free-boundary problems related to stochastic thin-film equations in future work, we start from the surface-tension driven stochastic thin-film equation with Stratonovich noise and exploit the regime of coefficients in front of the Stratonovich correction term (which is of porous-media-type) for which energy dissipation can be established. By Bernis inequalities, third order spatial derivatives of appropriate powers of the solution are controlled. Analytically, we rely on approximation with $\mathbb{P}$-almost surely strictly positive solutions and compactness methods based on energy-entropy estimates as well as martingale identification techniques. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Comments: 38 pages

MSC Class: 60H15; 76A20; 35G20; 35Q35; 35K65; 35R35; 35R37

Enhancing predictive imaging biomarker discovery through treatment effect analysis

Authors: Shuhan Xiao, Lukas Klein, Jens Petersen, Philipp Vollmuth, Paul F. Jaeger, Klaus H. Maier-Hein

Abstract: Identifying predictive biomarkers, which forecast individual treatment effectiveness, is crucial for personalized medicine and informs decision-making across diverse disciplines. These biomarkers are extracted from pre-treatment data, often within randomized controlled trials, and have to be distinguished from prognostic biomarkers, which are independent of treatment assignment. Our study focuses… ▽ More Identifying predictive biomarkers, which forecast individual treatment effectiveness, is crucial for personalized medicine and informs decision-making across diverse disciplines. These biomarkers are extracted from pre-treatment data, often within randomized controlled trials, and have to be distinguished from prognostic biomarkers, which are independent of treatment assignment. Our study focuses on the discovery of predictive imaging biomarkers, aiming to leverage pre-treatment images to unveil new causal relationships. Previous approaches relied on labor-intensive handcrafted or manually derived features, which may introduce biases. In response, we present a new task of discovering predictive imaging biomarkers directly from the pre-treatment images to learn relevant image features. We propose an evaluation protocol for this task to assess a model's ability to identify predictive imaging biomarkers and differentiate them from prognostic ones. It employs statistical testing and a comprehensive analysis of image feature attribution. We explore the suitability of deep learning models originally designed for estimating the conditional average treatment effect (CATE) for this task, which previously have been primarily assessed for the precision of CATE estimation, overlooking the evaluation of imaging biomarker discovery. Our proof-of-concept analysis demonstrates promising results in discovering and validating predictive imaging biomarkers from synthetic outcomes and real-world image datasets. △ Less

Submitted 4 June, 2024; originally announced June 2024.

Comments: 19 pages, 12 figures

Fleet of Agents: Coordinated Problem Solving with Large Language Models using Genetic Particle Filtering

Authors: Akhil Arora, Lars Klein, Nearchos Potamitis, Roland Aydin, Caglar Gulcehre, Robert West

Abstract: Large language models (LLMs) have significantly evolved, moving from simple output generation to complex reasoning and from stand-alone usage to being embedded into broader frameworks. In this paper, we introduce \emph{Fleet of Agents (FoA)}, a novel framework utilizing LLMs as agents to navigate through dynamic tree searches, employing a genetic-type particle filtering approach. FoA spawns a mult… ▽ More Large language models (LLMs) have significantly evolved, moving from simple output generation to complex reasoning and from stand-alone usage to being embedded into broader frameworks. In this paper, we introduce \emph{Fleet of Agents (FoA)}, a novel framework utilizing LLMs as agents to navigate through dynamic tree searches, employing a genetic-type particle filtering approach. FoA spawns a multitude of agents, each exploring autonomously, followed by a selection phase where resampling based on a heuristic value function optimizes the balance between exploration and exploitation. This mechanism enables dynamic branching, adapting the exploration strategy based on discovered solutions. We experimentally validate FoA using two benchmark tasks, "Game of 24" and "Mini-Crosswords". FoA outperforms the previously proposed Tree-of-Thoughts method in terms of efficacy and efficiency: it significantly decreases computational costs (by calling the value function less frequently) while preserving comparable or even superior accuracy. △ Less

Submitted 7 May, 2024; originally announced May 2024.

Comments: 11 pages, 1 figure, 4 tables

The Power of Absence: Thinking with Archival Theory in Algorithmic Design

Authors: Jihan Sherman, Romi Morrison, Lauren Klein, Daniela K. Rosner

Abstract: This paper explores the value of archival theory as a means of grappling with bias in algorithmic design. Rather than seek to mitigate biases perpetuated by datasets and algorithmic systems, archival theory offers a reframing of bias itself. Drawing on a range of archival theory from the fields of history, literary and cultural studies, Black studies, and feminist STS, we propose absence-as power,… ▽ More This paper explores the value of archival theory as a means of grappling with bias in algorithmic design. Rather than seek to mitigate biases perpetuated by datasets and algorithmic systems, archival theory offers a reframing of bias itself. Drawing on a range of archival theory from the fields of history, literary and cultural studies, Black studies, and feminist STS, we propose absence-as power, presence, and productive-as a concept that might more securely anchor investigations into the causes of algorithmic bias, and that can prompt more capacious, creative, and joyful future work. This essay, in turn, can intervene into the technical as well as the social, historical, and political structures that serve as sources of bias. △ Less

Submitted 8 May, 2024; originally announced May 2024.

Comments: 16 pages, to be published in the 2024 ACM Conference on Designing Interactive Systems (DIS '24)

ACM Class: I.2.0; K.4.0

Data Feminism for AI

Authors: Lauren Klein, Catherine D'Ignazio

Abstract: This paper presents a set of intersectional feminist principles for conducting equitable, ethical, and sustainable AI research. In Data Feminism (2020), we offered seven principles for examining and challenging unequal power in data science. Here, we present a rationale for why feminism remains deeply relevant for AI research, rearticulate the original principles of data feminism with respect to A… ▽ More This paper presents a set of intersectional feminist principles for conducting equitable, ethical, and sustainable AI research. In Data Feminism (2020), we offered seven principles for examining and challenging unequal power in data science. Here, we present a rationale for why feminism remains deeply relevant for AI research, rearticulate the original principles of data feminism with respect to AI, and introduce two potential new principles related to environmental impact and consent. Together, these principles help to 1) account for the unequal, undemocratic, extractive, and exclusionary forces at work in AI research, development, and deployment; 2) identify and mitigate predictable harms in advance of unsafe, discriminatory, or otherwise oppressive systems being released into the world; and 3) inspire creative, joyful, and collective ways to work towards a more equitable, sustainable world in which all of us can thrive. △ Less

Submitted 2 May, 2024; originally announced May 2024.

Comments: 21 pages, to be published in the 2024 ACM Conference on Fairness, Accountability, and Transparency (FAccT '24)

ACM Class: I.2.0; K.4.0

Improving Patient Transport in Hospitals: A Literature Review of Operations Research Methods

Authors: Tom Lorenz Klein, Clemens Thielen

Abstract: Most activities in hospitals require the presence of the patient. Delays in patient transport can therefore cause disruptions and costly downtime in many different areas and departments, which makes patient transport planning a central operational problem in hospitals. This paper provides the first literature review of Operations Research approaches for improving non-emergency patient transport in… ▽ More Most activities in hospitals require the presence of the patient. Delays in patient transport can therefore cause disruptions and costly downtime in many different areas and departments, which makes patient transport planning a central operational problem in hospitals. This paper provides the first literature review of Operations Research approaches for improving non-emergency patient transport in hospitals. We structure the different patient transport problems considered in the literature according to several main characteristics and introduce a four-field notation for patient transport problems that allows for a concise representation of different problem variants. We then analyze the relevant literature with respect to different aspects related to the considered problem variant, the employed modeling and solution techniques, as well as the data used and the level of practical implementation achieved. Based on our literature analysis and semi-structured interviews with hospital practitioners, we provide a comparison of current hospital practice and the existing literature on patient transport, and we identify research gaps and formulate an agenda for relevant future research in this area. △ Less

Submitted 4 April, 2024; originally announced April 2024.

Modeling Circumstellar Gas Emission around a White Dwarf Using Cloudy

Authors: Siyi Xu, Sherry Yeh, Laura. K. Rogers, Amy Steele, Erik Dennihy, Alexandra E. Doyle, P. Dufour, Beth L. Klein, Christopher J. Manser, Carl Melis, Tinggui Wang, Alycia J. Weinberger

Abstract: The chemical composition of an extrasolar planet is fundamental to its formation, evolution and habitability. In this study, we explore a new way to measure the chemical composition of the building blocks of extrasolar planets, by measuring the gas composition of the disrupted planetesimals around white dwarf stars. As a first attempt, we used the photo-ionization code Cloudy to model the circumst… ▽ More The chemical composition of an extrasolar planet is fundamental to its formation, evolution and habitability. In this study, we explore a new way to measure the chemical composition of the building blocks of extrasolar planets, by measuring the gas composition of the disrupted planetesimals around white dwarf stars. As a first attempt, we used the photo-ionization code Cloudy to model the circumstellar gas emission around a white dwarf Gaia J0611$-$6931 under some simplified assumptions. We found most of the emission lines are saturated and the line ratios approaching the ratios of thermal emission; therefore only lower limits to the number density can be derived. Silicon is the best constrained element in the circumstellar gas and we derived a lower limit of 10$^{10.3}$ cm$^{-3}$. In addition, we placed a lower limit on the total amount of gas to be 1.8 $\times$ 10$^{19}$ g. Further study is needed to better constrain the parameters of the gas disk and connect it to other white dwarfs with circumstellar gas absorption. △ Less

Submitted 23 March, 2024; originally announced March 2024.

Comments: 14 pages, 10 figures, 4 table, accepted for publication in AJ

Emojinize: Enriching Any Text with Emoji Translations

Authors: Lars Henning Klein, Roland Aydin, Robert West

Abstract: Emoji have become ubiquitous in written communication, on the Web and beyond. They can emphasize or clarify emotions, add details to conversations, or simply serve decorative purposes. This casual use, however, barely scratches the surface of the expressive power of emoji. To further unleash this power, we present Emojinize, a method for translating arbitrary text phrases into sequences of one or… ▽ More Emoji have become ubiquitous in written communication, on the Web and beyond. They can emphasize or clarify emotions, add details to conversations, or simply serve decorative purposes. This casual use, however, barely scratches the surface of the expressive power of emoji. To further unleash this power, we present Emojinize, a method for translating arbitrary text phrases into sequences of one or more emoji without requiring human input. By leveraging the power of large language models, Emojinize can choose appropriate emoji by disambiguating based on context (eg, cricket-bat vs bat) and can express complex concepts compositionally by combining multiple emoji (eq, "Emojinize" is translated to input-latin-letters right-arrow grinning-face). In a cloze test--based user study, we show that Emojinize's emoji translations increase the human guessability of masked words by 55%, whereas human-picked emoji translations do so by only 29%. These results suggest that emoji provide a sufficiently rich vocabulary to accurately translate a wide variety of words. Moreover, annotating words and phrases with Emojinize's emoji translations opens the door to numerous downstream applications, including children learning how to read, adults learning foreign languages, and text understanding for people with learning disabilities. △ Less

Submitted 7 March, 2024; v1 submitted 6 March, 2024; originally announced March 2024.

Two-View Topogram-Based Anatomy-Guided CT Reconstruction for Prospective Risk Minimization

Authors: Chang Liu, Laura Klein, Yixing Huang, Edith Baader, Michael Lell, Marc Kachelrieß, Andreas Maier

Abstract: To facilitate a prospective estimation of CT effective dose and risk minimization process, a prospective spatial dose estimation and the known anatomical structures are expected. To this end, a CT reconstruction method is required to reconstruct CT volumes from as few projections as possible, i.e. by using the topograms, with anatomical structures as correct as possible. In this work, an optimized… ▽ More To facilitate a prospective estimation of CT effective dose and risk minimization process, a prospective spatial dose estimation and the known anatomical structures are expected. To this end, a CT reconstruction method is required to reconstruct CT volumes from as few projections as possible, i.e. by using the topograms, with anatomical structures as correct as possible. In this work, an optimized CT reconstruction model based on a generative adversarial network (GAN) is proposed. The GAN is trained to reconstruct 3D volumes from an anterior-posterior and a lateral CT projection. To enhance anatomical structures, a pre-trained organ segmentation network and the 3D perceptual loss are applied during the training phase, so that the model can then generate both organ-enhanced CT volume and the organ segmentation mask. The proposed method can reconstruct CT volumes with PSNR of 26.49, RMSE of 196.17, and SSIM of 0.64, compared to 26.21, 201.55 and 0.63 using the baseline method. In terms of the anatomical structure, the proposed method effectively enhances the organ shape and boundary and allows for a straight-forward identification of the relevant anatomical structures. We note that conventional reconstruction metrics fail to indicate the enhancement of anatomical structures. In addition to such metrics, the evaluation is expanded with assessing the organ segmentation performance. The average organ dice of the proposed method is 0.71 compared with 0.63 in baseline model, indicating the enhancement of anatomical structures. △ Less

Submitted 23 January, 2024; originally announced January 2024.

Optimal Sensor Allocation with Multiple Linear Dispersion Processes

Authors: Xinchao Liu, Dzung Phan, Youngdeok Hwang, Levente Klein, Xiao Liu, Kyongmin Yeo

Abstract: This paper considers the optimal sensor allocation for estimating the emission rates of multiple sources in a two-dimensional spatial domain. Locations of potential emission sources are known (e.g., factory stacks), and the number of sources is much greater than the number of sensors that can be deployed, giving rise to the optimal sensor allocation problem. In particular, we consider linear dispe… ▽ More This paper considers the optimal sensor allocation for estimating the emission rates of multiple sources in a two-dimensional spatial domain. Locations of potential emission sources are known (e.g., factory stacks), and the number of sources is much greater than the number of sensors that can be deployed, giving rise to the optimal sensor allocation problem. In particular, we consider linear dispersion forward models, and the optimal sensor allocation is formulated as a bilevel optimization problem. The outer problem determines the optimal sensor locations by minimizing the overall Mean Squared Error of the estimated emission rates over various wind conditions, while the inner problem solves an inverse problem that estimates the emission rates. Two algorithms, including the repeated Sample Average Approximation and the Stochastic Gradient Descent based bilevel approximation, are investigated in solving the sensor allocation problem. Convergence analysis is performed to obtain the performance guarantee, and numerical examples are presented to illustrate the proposed approach. △ Less

Submitted 18 January, 2024; originally announced January 2024.

AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters

Authors: Li Lucy, Suchin Gururangan, Luca Soldaini, Emma Strubell, David Bamman, Lauren F. Klein, Jesse Dodge

Abstract: Large language models' (LLMs) abilities are drawn from their pretraining data, and model development begins with data curation. However, decisions around what data is retained or removed during this initial stage are under-scrutinized. In our work, we ground web text, which is a popular pretraining data source, to its social and geographic contexts. We create a new dataset of 10.3 million self-des… ▽ More Large language models' (LLMs) abilities are drawn from their pretraining data, and model development begins with data curation. However, decisions around what data is retained or removed during this initial stage are under-scrutinized. In our work, we ground web text, which is a popular pretraining data source, to its social and geographic contexts. We create a new dataset of 10.3 million self-descriptions of website creators, and extract information about who they are and where they are from: their topical interests, social roles, and geographic affiliations. Then, we conduct the first study investigating how ten "quality" and English language identification (langID) filters affect webpages that vary along these social dimensions. Our experiments illuminate a range of implicit preferences in data curation: we show that some quality classifiers act like topical domain filters, and langID can overlook English content from some regions of the world. Overall, we hope that our work will encourage a new line of research on pretraining data curation practices and its social implications. △ Less

Submitted 20 June, 2024; v1 submitted 12 January, 2024; originally announced January 2024.

Comments: 28 pages, 13 figures. Association for Computational Linguistics (ACL) 2024

A 3D super-resolution of wind fields via physics-informed pixel-wise self-attention generative adversarial network

Authors: Takuya Kurihana, Kyongmin Yeo, Daniela Szwarcman, Bruce Elmegreen, Karthik Mukkavilli, Johannes Schmude, Levente Klein

Abstract: To mitigate global warming, greenhouse gas sources need to be resolved at a high spatial resolution and monitored in time to ensure the reduction and ultimately elimination of the pollution source. However, the complexity of computation in resolving high-resolution wind fields left the simulations impractical to test different time lengths and model configurations. This study presents a preliminar… ▽ More To mitigate global warming, greenhouse gas sources need to be resolved at a high spatial resolution and monitored in time to ensure the reduction and ultimately elimination of the pollution source. However, the complexity of computation in resolving high-resolution wind fields left the simulations impractical to test different time lengths and model configurations. This study presents a preliminary development of a physics-informed super-resolution (SR) generative adversarial network (GAN) that super-resolves the three-dimensional (3D) low-resolution wind fields by upscaling x9 times. We develop a pixel-wise self-attention (PWA) module that learns 3D weather dynamics via a self-attention computation followed by a 2D convolution. We also employ a loss term that regularizes the self-attention map during pretraining, capturing the vertical convection process from input wind data. The new PWA SR-GAN shows the high-fidelity super-resolved 3D wind data, learns a wind structure at the high-frequency domain, and reduces the computational cost of a high-resolution wind simulation by x89.7 times. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Comments: 7 pages, 4 figures, NeurIPS 2023 Workshop: Tackling Climate Change with Machine Learning

Riveter: Measuring Power and Social Dynamics Between Entities

Authors: Maria Antoniak, Anjalie Field, Jimin Mun, Melanie Walsh, Lauren F. Klein, Maarten Sap

Abstract: Riveter provides a complete easy-to-use pipeline for analyzing verb connotations associated with entities in text corpora. We prepopulate the package with connotation frames of sentiment, power, and agency, which have demonstrated usefulness for capturing social phenomena, such as gender bias, in a broad range of corpora. For decades, lexical frameworks have been foundational tools in computationa… ▽ More Riveter provides a complete easy-to-use pipeline for analyzing verb connotations associated with entities in text corpora. We prepopulate the package with connotation frames of sentiment, power, and agency, which have demonstrated usefulness for capturing social phenomena, such as gender bias, in a broad range of corpora. For decades, lexical frameworks have been foundational tools in computational social science, digital humanities, and natural language processing, facilitating multifaceted analysis of text corpora. But working with verb-centric lexica specifically requires natural language processing skills, reducing their accessibility to other researchers. By organizing the language processing pipeline, providing complete lexicon scores and visualizations for all entities in a corpus, and providing functionality for users to target specific research questions, Riveter greatly improves the accessibility of verb lexica and can facilitate a broad range of future research. △ Less

Submitted 15 December, 2023; originally announced December 2023.

Journal ref: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Volume 3: System Demonstrations, 2023, pages 377-388

The 40 pc sample of white dwarfs from Gaia

Authors: Mairi W. O'Brien, P. -E. Tremblay, B. L. Klein, D. Koester, C. Melis, A. Bédard, E. Cukanovaite, T. Cunningham, A. E. Doyle, B. T. Gänsicke, N. P. Gentile Fusillo, M. A. Hollands, J. McCleery, I. Pelisoli, S. Toonen, A. J. Weinberger, B. Zuckerman

Abstract: We present a comprehensive overview of a volume-complete sample of white dwarfs located within 40 pc of the Sun, a significant proportion of which were detected in Gaia Data Release 3 (DR3). Our DR3 sample contains 1076 spectroscopically confirmed white dwarfs, with just five candidates within the volume remaining unconfirmed (more than 99 per cent spectroscopic completeness). Additionally, 28 whi… ▽ More We present a comprehensive overview of a volume-complete sample of white dwarfs located within 40 pc of the Sun, a significant proportion of which were detected in Gaia Data Release 3 (DR3). Our DR3 sample contains 1076 spectroscopically confirmed white dwarfs, with just five candidates within the volume remaining unconfirmed (more than 99 per cent spectroscopic completeness). Additionally, 28 white dwarfs were not in our initial selection from Gaia DR3, most of which are in unresolved binaries. We use Gaia DR3 photometry and astrometry to determine a uniform set of white dwarf parameters, including mass, effective temperature, and cooling age. We assess the demographics of the 40 pc sample, specifically magnetic fields, binarity, space density and mass distributions. △ Less

Submitted 4 January, 2024; v1 submitted 5 December, 2023; originally announced December 2023.

Comments: Accepted for publication in MNRAS. 24 pages, 25 figures

Journal ref: MNRAS 527, 3 (2024) 8687-8705

Seven white dwarfs with circumstellar gas discs I: white dwarf parameters and accreted planetary abundances

Authors: L. K. Rogers, A. Bonsor, S. Xu, P. Dufour, B. L. Klein, A. Buchan, S. Hodgkin, F. Hardy, M. Kissler-Patig, C. Melis, A. J. Weinberger, B. Zuckerman

Abstract: Observations of planetary material polluting the atmospheres of white dwarfs are an important probe of the bulk composition of exoplanetary material. Medium- and high-resolution optical and ultraviolet spectroscopy of seven white dwarfs with known circumstellar dust and gas emission are presented. Detections or meaningful upper limits for photospheric absorption lines are measured for: C, O, Na, S… ▽ More Observations of planetary material polluting the atmospheres of white dwarfs are an important probe of the bulk composition of exoplanetary material. Medium- and high-resolution optical and ultraviolet spectroscopy of seven white dwarfs with known circumstellar dust and gas emission are presented. Detections or meaningful upper limits for photospheric absorption lines are measured for: C, O, Na, S, P, Mg, Al, Si, Ca, Ti, Cr, Fe, and Ni. For 16 white dwarfs with known observable gaseous emission discs (and measured photospheric abundances), there is no evidence that their accretion rates differ, on average, from those without detectable gaseous emission. This suggests that, typically, accretion is not enhanced by gas drag. At the effective temperature range of the white dwarfs in this sample (16,000-25,000K) the abundance ratios of elements are more consistent than absolute abundances when comparing abundances derived from spectroscopic white dwarf parameters versus photometric white dwarf parameters. Crucially, this highlights that the uncertainties on white dwarf parameters do not prevent white dwarfs from being utilised to study planetary composition. The abundances of oxygen and silicon for the three hydrogen-dominated white dwarfs in the sample with both optical and ultraviolet spectra differ by 0.62 dex depending on if they are derived from the optical or ultraviolet spectra. This optical/ultraviolet discrepancy may be related to differences in the atmospheric depth of line formation; further investigations into the white dwarf atmospheric modelling are needed to understand this discrepancy. △ Less

Submitted 23 November, 2023; originally announced November 2023.

Comments: Accepted for publication in MNRAS

Image-Based Soil Organic Carbon Remote Sensing from Satellite Images with Fourier Neural Operator and Structural Similarity

Authors: Ken C. L. Wong, Levente Klein, Ademir Ferreira da Silva, Hongzhi Wang, Jitendra Singh, Tanveer Syeda-Mahmood

Abstract: Soil organic carbon (SOC) sequestration is the transfer and storage of atmospheric carbon dioxide in soils, which plays an important role in climate change mitigation. SOC concentration can be improved by proper land use, thus it is beneficial if SOC can be estimated at a regional or global scale. As multispectral satellite data can provide SOC-related information such as vegetation and soil prope… ▽ More Soil organic carbon (SOC) sequestration is the transfer and storage of atmospheric carbon dioxide in soils, which plays an important role in climate change mitigation. SOC concentration can be improved by proper land use, thus it is beneficial if SOC can be estimated at a regional or global scale. As multispectral satellite data can provide SOC-related information such as vegetation and soil properties at a global scale, estimation of SOC through satellite data has been explored as an alternative to manual soil sampling. Although existing studies show promising results, they are mainly based on pixel-based approaches with traditional machine learning methods, and convolutional neural networks (CNNs) are uncommon. To study the use of CNNs on SOC remote sensing, here we propose the FNO-DenseNet based on the Fourier neural operator (FNO). By combining the advantages of the FNO and DenseNet, the FNO-DenseNet outperformed the FNO in our experiments with hundreds of times fewer parameters. The FNO-DenseNet also outperformed a pixel-based random forest by 18% in the mean absolute percentage error. △ Less

Submitted 21 November, 2023; originally announced November 2023.

Comments: This paper was accepted by the 2023 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2023)

A cool, magnetic white dwarf accreting planetary debris

Authors: Stephane Vennes, Adela Kawka, Beth L. Klein, B. Zuckerman, Alycia J. Weinberger, Carl Melis

Abstract: We present an analysis of spectroscopic data of the cool, highly magnetic and polluted white dwarf 2MASS J0916-4215. The atmosphere of the white dwarf is dominated by hydrogen, but numerous spectral lines of magnesium, calcium, titanium, chromium, iron, strontium, along with Li I, Na I, Al I, and K I lines, are found in the incomplete Paschen-Back regime, most visibly, in the case of Ca II lines.… ▽ More We present an analysis of spectroscopic data of the cool, highly magnetic and polluted white dwarf 2MASS J0916-4215. The atmosphere of the white dwarf is dominated by hydrogen, but numerous spectral lines of magnesium, calcium, titanium, chromium, iron, strontium, along with Li I, Na I, Al I, and K I lines, are found in the incomplete Paschen-Back regime, most visibly, in the case of Ca II lines. Extensive new calculations of the Paschen-Back effect in several spectral lines are presented and results of the calculations are tabulated for the Ca II H&K doublet. The abundance pattern shows a large lithium and strontium excess, which may be viewed as a signature of planetary debris akin to Earth's continental crust accreted onto the star, although the scarcity of silicon indicates possible dilution in bulk Earth material. Accurate abundance measurements proved sensitive to the value of the broadening parameter due to collisions with neutral hydrogen (Gamma_HI), particularly in saturated lines such as the resonance lines of Ca I and Ca II. We found that Gamma_HI if formulated with values from the literature could be overestimated by a factor of 10 in most resonance lines. △ Less

Submitted 14 November, 2023; originally announced November 2023.

Comments: Accepted for publication in MNRAS

Integrated patient-to-room and nurse-to-patient assignment in hospital wards

Authors: Tabea Brandt, Tom Lorenz Klein, Melanie Reuter-Oppermann, Fabian Schäfer, Clemens Thielen, Maartje van de Vrugt, Joe Viana

Abstract: Assigning patients to rooms and nurses to patients are critical tasks within hospitals that directly affect patient and staff satisfaction, quality of care, and hospital efficiency. Both patient-to-room assignments and nurse-to-patient assignments are typically agreed upon at the ward level, and they interact in several ways such as jointly determining the walking distances nurses must cover betwe… ▽ More Assigning patients to rooms and nurses to patients are critical tasks within hospitals that directly affect patient and staff satisfaction, quality of care, and hospital efficiency. Both patient-to-room assignments and nurse-to-patient assignments are typically agreed upon at the ward level, and they interact in several ways such as jointly determining the walking distances nurses must cover between different patient rooms. This motivates to consider both problems jointly in an integrated fashion. This paper presents the first optimization models and algorithms for the integrated patient-to-room and nurse-to-patient assignment problem. We provide a mixed integer programming formulation of the integrated problem that considers the typical objectives from the single problems as well as additional objectives that can only be properly evaluated when integrating both problems. Moreover, motivated by the inherent complexity that results from integrating these two NP-hard and already computationally challenging problems, we devise an efficient heuristic for the integrated patient-to-room and nurse-to-patient assignment problem. To evaluate the running time and quality of the solution obtained with the heuristic, we conduct extensive computational experiments on both artificial and real-world instances. The artificial instances are generated by a parameterized instance generator for the integrated problem that is made freely available. △ Less

Submitted 19 September, 2023; originally announced September 2023.

Flows: Building Blocks of Reasoning and Collaborating AI

Authors: Martin Josifoski, Lars Klein, Maxime Peyrard, Nicolas Baldwin, Yifei Li, Saibo Geng, Julian Paul Schnitzler, Yuxing Yao, Jiheng Wei, Debjit Paul, Robert West

Abstract: Recent advances in artificial intelligence (AI) have produced highly capable and controllable systems. This creates unprecedented opportunities for structured reasoning as well as collaboration among multiple AI systems and humans. To fully realize this potential, it is essential to develop a principled way of designing and studying such structured interactions. For this purpose, we introduce the… ▽ More Recent advances in artificial intelligence (AI) have produced highly capable and controllable systems. This creates unprecedented opportunities for structured reasoning as well as collaboration among multiple AI systems and humans. To fully realize this potential, it is essential to develop a principled way of designing and studying such structured interactions. For this purpose, we introduce the conceptual framework Flows. Flows are self-contained building blocks of computation, with an isolated state, communicating through a standardized message-based interface. This modular design simplifies the process of creating Flows by allowing them to be recursively composed into arbitrarily nested interactions and is inherently concurrency-friendly. Crucially, any interaction can be implemented using this framework, including prior work on AI-AI and human-AI interactions, prompt engineering schemes, and tool augmentation. We demonstrate the potential of Flows on competitive coding, a challenging task on which even GPT-4 struggles. Our results suggest that structured reasoning and collaboration substantially improve generalization, with AI-only Flows adding +21 and human-AI Flows adding +54 absolute points in terms of solve rate. To support rapid and rigorous research, we introduce the aiFlows library embodying Flows. The aiFlows library is available at https://github.com/epfl-dlab/aiflows. Data and Flows for reproducing our experiments are available at https://github.com/epfl-dlab/cc_flows. △ Less

Submitted 7 February, 2024; v1 submitted 2 August, 2023; originally announced August 2023.

Understanding the Anomalous Diffusion of Water in Aqueous Electrolytes Using Machine Learned Potentials

Authors: Nikhil V. S. Avula, Michael L. Klein, Sundaram Balasubramanian

Abstract: The diffusivity of water in aqueous cesium iodide solutions is larger than that in neat liquid water, and vice versa for sodium chloride solutions. Such peculiar ion-specific behavior, called anomalous diffusion, is not reproduced in typical force field-based molecular dynamics (MD) simulations due to inadequate treatment of ion-water interactions. Herein, this hurdle is tackled using machine lear… ▽ More The diffusivity of water in aqueous cesium iodide solutions is larger than that in neat liquid water, and vice versa for sodium chloride solutions. Such peculiar ion-specific behavior, called anomalous diffusion, is not reproduced in typical force field-based molecular dynamics (MD) simulations due to inadequate treatment of ion-water interactions. Herein, this hurdle is tackled using machine learned atomic potentials (MLPs) trained on data from density functional theory calculations. MLP-based atomistic MD simulations of aqueous salt solutions reproduce experimentally determined thermodynamic, structural, dynamical, and transport properties, including their varied trends of water diffusivities across salt concentration. This enables an examination of their intermolecular structure to unravel the microscopic underpinnings of the distinction in their transport. While both ions in CsI solutions contribute to faster diffusion of water molecules, the competition between the heavy retardation by Na-ions and slight acceleration by Cl-ions in NaCl solutions reduces their water diffusivity. △ Less

Submitted 28 July, 2023; originally announced July 2023.

Comments: 23 pages, 5 figures

Journal ref: J. Phys. Chem. Lett. 14 (2023) 9500-9507

Why does dissolving salt in water decrease its dielectric permittivity

Authors: Chunyi Zhang, Shuwen Yue, Athanassios Z. Panagiotopoulos, Michael L. Klein, Xifan Wu

Abstract: The dielectric permittivity of salt water decreases on dissolving more salt. For nearly a century, this phenomenon has been explained by invoking saturation in the dielectric response of the solvent water molecules. Herein, we employ an advanced deep neural network (DNN), built using data from density functional theory, to study the dielectric permittivity of sodium chloride solutions. Notably, th… ▽ More The dielectric permittivity of salt water decreases on dissolving more salt. For nearly a century, this phenomenon has been explained by invoking saturation in the dielectric response of the solvent water molecules. Herein, we employ an advanced deep neural network (DNN), built using data from density functional theory, to study the dielectric permittivity of sodium chloride solutions. Notably, the decrease in the dielectric permittivity as a function of concentration, computed using the DNN approach, agrees well with experiments. Detailed analysis of the computations reveals that the dominant effect, caused by the intrusion of ionic hydration shells into the solvent hydrogen-bond network, is the disruption of dipolar correlations among water molecules. Accordingly, the observed decrease in the dielectric permittivity is mostly due to increasing suppression of the collective response of solvent waters. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Comments: has accepted by Physical Review Letters

Equivariant flow matching

Authors: Leon Klein, Andreas Krämer, Frank Noé

Abstract: Normalizing flows are a class of deep generative models that are especially interesting for modeling probability distributions in physics, where the exact likelihood of flows allows reweighting to known target energy functions and computing unbiased observables. For instance, Boltzmann generators tackle the long-standing sampling problem in statistical physics by training flows to produce equilibr… ▽ More Normalizing flows are a class of deep generative models that are especially interesting for modeling probability distributions in physics, where the exact likelihood of flows allows reweighting to known target energy functions and computing unbiased observables. For instance, Boltzmann generators tackle the long-standing sampling problem in statistical physics by training flows to produce equilibrium samples of many-body systems such as small molecules and proteins. To build effective models for such systems, it is crucial to incorporate the symmetries of the target energy into the model, which can be achieved by equivariant continuous normalizing flows (CNFs). However, CNFs can be computationally expensive to train and generate samples from, which has hampered their scalability and practical application. In this paper, we introduce equivariant flow matching, a new training objective for equivariant CNFs that is based on the recently proposed optimal transport flow matching. Equivariant flow matching exploits the physical symmetries of the target energy for efficient, simulation-free training of equivariant CNFs. We demonstrate the effectiveness of flow matching on rotation and permutation invariant many-particle systems and a small molecule, alanine dipeptide, where for the first time we obtain a Boltzmann generator with significant sampling efficiency without relying on tailored internal coordinate featurization. Our results show that the equivariant flow matching objective yields flows with shorter integration paths, improved sampling efficiency, and higher scalability compared to existing methods. △ Less

Submitted 23 November, 2023; v1 submitted 26 June, 2023; originally announced June 2023.

Improving Explainability of Disentangled Representations using Multipath-Attribution Mappings

Authors: Lukas Klein, João B. S. Carvalho, Mennatallah El-Assady, Paolo Penna, Joachim M. Buhmann, Paul F. Jaeger

Abstract: Explainable AI aims to render model behavior understandable by humans, which can be seen as an intermediate step in extracting causal relations from correlative patterns. Due to the high risk of possible fatal decisions in image-based clinical diagnostics, it is necessary to integrate explainable AI into these safety-critical systems. Current explanatory methods typically assign attribution scores… ▽ More Explainable AI aims to render model behavior understandable by humans, which can be seen as an intermediate step in extracting causal relations from correlative patterns. Due to the high risk of possible fatal decisions in image-based clinical diagnostics, it is necessary to integrate explainable AI into these safety-critical systems. Current explanatory methods typically assign attribution scores to pixel regions in the input image, indicating their importance for a model's decision. However, they fall short when explaining why a visual feature is used. We propose a framework that utilizes interpretable disentangled representations for downstream-task prediction. Through visualizing the disentangled representations, we enable experts to investigate possible causation effects by leveraging their domain knowledge. Additionally, we deploy a multi-path attribution mapping for enriching and validating explanations. We demonstrate the effectiveness of our approach on a synthetic benchmark suite and two medical datasets. We show that the framework not only acts as a catalyst for causal relation extraction but also enhances model robustness by enabling shortcut detection without the need for testing under distribution shifts. △ Less

Submitted 15 June, 2023; originally announced June 2023.

Journal ref: Proceedings of The 5th International Conference on Medical Imaging with Deep Learning, PMLR 172:689-712, 2022

Fast Interactive Search with a Scale-Free Comparison Oracle

Authors: Daniyar Chumbalov, Lars Klein, Lucas Maystre, Matthias Grossglauser

Abstract: A comparison-based search algorithm lets a user find a target item $t$ in a database by answering queries of the form, ``Which of items $i$ and $j$ is closer to $t$?'' Instead of formulating an explicit query (such as one or several keywords), the user navigates towards the target via a sequence of such (typically noisy) queries. We propose a scale-free probabilistic oracle model called $γ$-CKL… ▽ More A comparison-based search algorithm lets a user find a target item $t$ in a database by answering queries of the form, ``Which of items $i$ and $j$ is closer to $t$?'' Instead of formulating an explicit query (such as one or several keywords), the user navigates towards the target via a sequence of such (typically noisy) queries. We propose a scale-free probabilistic oracle model called $γ$-CKL for such similarity triplets $(i,j;t)$, which generalizes the CKL triplet model proposed in the literature. The generalization affords independent control over the discriminating power of the oracle and the dimension of the feature space containing the items. We develop a search algorithm with provably exponential rate of convergence under the $γ$-CKL oracle, thanks to a backtracking strategy that deals with the unavoidable errors in updating the belief region around the target. We evaluate the performance of the algorithm both over the posited oracle and over several real-world triplet datasets. We also report on a comprehensive user study, where human subjects navigate a database of face portraits. △ Less

Submitted 2 June, 2023; originally announced June 2023.

Disk or Companion: Characterizing Excess Infrared Flux in Seven White Dwarf Systems with Near-Infrared Spectroscopy

Authors: Dylan Owens, Siyi Xu, Elena Manjavacas, S. K. Leggett, S. L. Casewell, Erik Dennihy, Patrick Dufour, Beth L. Klein, Sherry Yeh, B. Zuckerman

Abstract: Excess infrared flux from white dwarf stars is likely to arise from a dusty debris disk or a cool companion. In this work, we present near-infrared spectroscopic observations with Keck/MOSFIRE, Gemini/GNIRS, and Gemini/Flamingos-2 of seven white dwarfs with infrared excesses identified in previous studies. We confirmed the presence of dust disks around four white dwarfs (Gaia J0611-6931, Gaia J000… ▽ More Excess infrared flux from white dwarf stars is likely to arise from a dusty debris disk or a cool companion. In this work, we present near-infrared spectroscopic observations with Keck/MOSFIRE, Gemini/GNIRS, and Gemini/Flamingos-2 of seven white dwarfs with infrared excesses identified in previous studies. We confirmed the presence of dust disks around four white dwarfs (Gaia J0611-6931, Gaia J0006+2858, Gaia J2100+2122, and WD 0145+234) as well as two new white dwarf brown dwarf pairs (Gaia J0052+4505 and Gaia J0603+4518). In three of the dust disk systems, we detected for the first time near-infrared metal emissions (Mg I, Fe I, and Si I) from a gaseous component of the disk. We developed a new Markov Chain Monte Carlo framework to constrain the geometric properties of each dust disk. In three systems, the dust disk and the gas disk appear to coincide spatially. For the two brown dwarf white dwarf pairs, we identified broad molecular absorption features typically seen in L dwarfs. The origin of the infrared excess around Gaia J0723+6301 remains a mystery. Our study underlines how near-infrared spectroscopy can be used to determine sources of infrared excess around white dwarfs, which has now been detected in hundreds of systems photometrically. △ Less

Submitted 28 March, 2023; originally announced March 2023.

Comments: 23 pages, 10 figures, 5 tables, AJ, in press

New chondritic bodies identified in eight oxygen-bearing white dwarfs

Authors: Alexandra E. Doyle, Beth L. Klein, Patrick Dufour, Carl Melis, B. Zuckerman, Siyi Xu, Alycia J. Weinberger, Isabella L. Trierweiler, Nathaniel N. Monson, Michael A. Jura, Edward D. Young

Abstract: We present observations and analyses of eight white dwarf stars that have accreted rocky material from their surrounding planetary systems. The spectra of these helium-atmosphere white dwarfs contain detectable optical lines of all four major rock-forming elements (O, Mg, Si, Fe). This work increases the sample of oxygen-bearing white dwarfs with parent body composition analyses by roughly thirty-… ▽ More We present observations and analyses of eight white dwarf stars that have accreted rocky material from their surrounding planetary systems. The spectra of these helium-atmosphere white dwarfs contain detectable optical lines of all four major rock-forming elements (O, Mg, Si, Fe). This work increases the sample of oxygen-bearing white dwarfs with parent body composition analyses by roughly thirty-three percent. To first order, the parent bodies that have been accreted by the eight white dwarfs are similar to those of chondritic meteorites in relative elemental abundances and oxidation states. Seventy-five percent of the white dwarfs in this study have observed oxygen excesses implying volatiles in the parent bodies with abundances similar to those of chondritic meteorites. Three white dwarfs have oxidation states that imply more reduced material than found in CI chondrites, indicating the possible detection of Mercury-like parent bodies, but are less constrained. These results contribute to the recurring conclusion that extrasolar rocky bodies closely resemble those in our solar system, and do not, as a whole, yield unusual or unique compositions. △ Less

Submitted 28 February, 2023; originally announced March 2023.

Comments: Accepted for publication in ApJ. 7 Figures, 7 Tables

Timewarp: Transferable Acceleration of Molecular Dynamics by Learning Time-Coarsened Dynamics

Authors: Leon Klein, Andrew Y. K. Foong, Tor Erlend Fjelde, Bruno Mlodozeniec, Marc Brockschmidt, Sebastian Nowozin, Frank Noé, Ryota Tomioka

Abstract: Molecular dynamics (MD) simulation is a widely used technique to simulate molecular systems, most commonly at the all-atom resolution where equations of motion are integrated with timesteps on the order of femtoseconds ($1\textrm{fs}=10^{-15}\textrm{s}$). MD is often used to compute equilibrium properties, which requires sampling from an equilibrium distribution such as the Boltzmann distribution.… ▽ More Molecular dynamics (MD) simulation is a widely used technique to simulate molecular systems, most commonly at the all-atom resolution where equations of motion are integrated with timesteps on the order of femtoseconds ($1\textrm{fs}=10^{-15}\textrm{s}$). MD is often used to compute equilibrium properties, which requires sampling from an equilibrium distribution such as the Boltzmann distribution. However, many important processes, such as binding and folding, occur over timescales of milliseconds or beyond, and cannot be efficiently sampled with conventional MD. Furthermore, new MD simulations need to be performed for each molecular system studied. We present Timewarp, an enhanced sampling method which uses a normalising flow as a proposal distribution in a Markov chain Monte Carlo method targeting the Boltzmann distribution. The flow is trained offline on MD trajectories and learns to make large steps in time, simulating the molecular dynamics of $10^{5} - 10^{6}\:\textrm{fs}$. Crucially, Timewarp is transferable between molecular systems: once trained, we show that it generalises to unseen small peptides (2-4 amino acids) at all-atom resolution, exploring their metastable states and providing wall-clock acceleration of sampling compared to standard MD. Our method constitutes an important step towards general, transferable algorithms for accelerating MD. △ Less

Submitted 1 December, 2023; v1 submitted 2 February, 2023; originally announced February 2023.

Navigating the Pitfalls of Active Learning Evaluation: A Systematic Framework for Meaningful Performance Assessment

Authors: Carsten T. Lüth, Till J. Bungert, Lukas Klein, Paul F. Jaeger

Abstract: Active Learning (AL) aims to reduce the labeling burden by interactively selecting the most informative samples from a pool of unlabeled data. While there has been extensive research on improving AL query methods in recent years, some studies have questioned the effectiveness of AL compared to emerging paradigms such as semi-supervised (Semi-SL) and self-supervised learning (Self-SL), or a simple… ▽ More Active Learning (AL) aims to reduce the labeling burden by interactively selecting the most informative samples from a pool of unlabeled data. While there has been extensive research on improving AL query methods in recent years, some studies have questioned the effectiveness of AL compared to emerging paradigms such as semi-supervised (Semi-SL) and self-supervised learning (Self-SL), or a simple optimization of classifier configurations. Thus, today's AL literature presents an inconsistent and contradictory landscape, leaving practitioners uncertain about whether and how to use AL in their tasks. In this work, we make the case that this inconsistency arises from a lack of systematic and realistic evaluation of AL methods. Specifically, we identify five key pitfalls in the current literature that reflect the delicate considerations required for AL evaluation. Further, we present an evaluation framework that overcomes these pitfalls and thus enables meaningful statements about the performance of AL methods. To demonstrate the relevance of our protocol, we present a large-scale empirical study and benchmark for image classification spanning various data sets, query methods, AL settings, and training paradigms. Our findings clarify the inconsistent picture in the literature and enable us to give hands-on recommendations for practitioners. The benchmark is hosted at https://github.com/IML-DKFZ/realistic-al . △ Less

Submitted 3 November, 2023; v1 submitted 25 January, 2023; originally announced January 2023.

Comments: Accepted at NeurIPS 2023

A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification

Authors: Paul F. Jaeger, Carsten T. Lüth, Lukas Klein, Till J. Bungert

Abstract: Reliable application of machine learning-based decision systems in the wild is one of the major challenges currently investigated by the field. A large portion of established approaches aims to detect erroneous predictions by means of assigning confidence scores. This confidence may be obtained by either quantifying the model's predictive uncertainty, learning explicit scoring functions, or assess… ▽ More Reliable application of machine learning-based decision systems in the wild is one of the major challenges currently investigated by the field. A large portion of established approaches aims to detect erroneous predictions by means of assigning confidence scores. This confidence may be obtained by either quantifying the model's predictive uncertainty, learning explicit scoring functions, or assessing whether the input is in line with the training distribution. Curiously, while these approaches all state to address the same eventual goal of detecting failures of a classifier upon real-life application, they currently constitute largely separated research fields with individual evaluation protocols, which either exclude a substantial part of relevant methods or ignore large parts of relevant failure sources. In this work, we systematically reveal current pitfalls caused by these inconsistencies and derive requirements for a holistic and realistic evaluation of failure detection. To demonstrate the relevance of this unified perspective, we present a large-scale empirical study for the first time enabling benchmarking confidence scoring functions w.r.t all relevant methods and failure sources. The revelation of a simple softmax response baseline as the overall best performing method underlines the drastic shortcomings of current evaluation in the abundance of publicized research on confidence scoring. Code and trained models are at https://github.com/IML-DKFZ/fd-shifts. △ Less

Submitted 5 April, 2023; v1 submitted 28 November, 2022; originally announced November 2022.

Journal ref: ICLR 2023 (oral)

Unusual Abundances from Planetary System Material Polluting the White Dwarf G238-44

Authors: Ted M Johnson, Beth L. Klein, D. Koester, Carl Melis, B. Zuckerman, M. Jura

Abstract: Ultraviolet and optical spectra of the hydrogen-dominated atmosphere white dwarf star G238-44 obtained with FUSE, Keck/HIRES, HST/COS, and HST/STIS reveal ten elements heavier than helium: C, N, O, Mg, Al, Si, P, S, Ca, and Fe. G238-44 is only the third white dwarf with nitrogen detected in its atmosphere from polluting planetary system material. Keck/HIRES data taken on eleven nights over 24 year… ▽ More Ultraviolet and optical spectra of the hydrogen-dominated atmosphere white dwarf star G238-44 obtained with FUSE, Keck/HIRES, HST/COS, and HST/STIS reveal ten elements heavier than helium: C, N, O, Mg, Al, Si, P, S, Ca, and Fe. G238-44 is only the third white dwarf with nitrogen detected in its atmosphere from polluting planetary system material. Keck/HIRES data taken on eleven nights over 24 years show no evidence for variation in the equivalent width of measured absorption lines, suggesting stable and continuous accretion from a circumstellar reservoir. From measured abundances and limits on other elements we find an anomalous abundance pattern and evidence for the presence of metallic iron. If the pollution is from a single parent body, then it would have no known counterpart within the solar system. If we allow for two distinct parent bodies, then we can reproduce the observed abundances with a mix of iron-rich Mercury-like material and an analog of an icy Kuiper Belt object with a respective mass ratio of 1.7:1. Such compositionally disparate objects would provide chemical evidence for both rocky and icy bodies in an exoplanetary system and would be indicative of a planetary system so strongly perturbed that G238-44 is able to capture both asteroid- and Kuiper Belt-analog bodies near-simultaneously within its $<$100 Myr cooling age. △ Less

Submitted 4 November, 2022; originally announced November 2022.

Comments: Accepted to ApJ. 18 pages, 9 figures, 7 tables

Multi-task Learning for Source Attribution and Field Reconstruction for Methane Monitoring

Authors: Arka Daw, Kyongmin Yeo, Anuj Karpatne, Levente Klein

Abstract: Inferring the source information of greenhouse gases, such as methane, from spatially sparse sensor observations is an essential element in mitigating climate change. While it is well understood that the complex behavior of the atmospheric dispersion of such pollutants is governed by the Advection-Diffusion equation, it is difficult to directly apply the governing equations to identify the source… ▽ More Inferring the source information of greenhouse gases, such as methane, from spatially sparse sensor observations is an essential element in mitigating climate change. While it is well understood that the complex behavior of the atmospheric dispersion of such pollutants is governed by the Advection-Diffusion equation, it is difficult to directly apply the governing equations to identify the source location and magnitude (inverse problem) because of the spatially sparse and noisy observations, i.e., the pollution concentration is known only at the sensor locations and sensors sensitivity is limited. Here, we develop a multi-task learning framework that can provide high-fidelity reconstruction of the concentration field and identify emission characteristics of the pollution sources such as their location, emission strength, etc. from sparse sensor observations. We demonstrate that our proposed framework is able to achieve accurate reconstruction of the methane concentrations from sparse sensor measurements as well as precisely pin-point the location and emission strength of these pollution sources. △ Less

Submitted 2 November, 2022; originally announced November 2022.

Comments: 7 pages, 8 figures, 1 table

Aboveground carbon biomass estimate with Physics-informed deep network

Authors: Juan Nathaniel, Levente J. Klein, Campbell D. Watson, Gabrielle Nyirjesy, Conrad M. Albrecht

Abstract: The global carbon cycle is a key process to understand how our climate is changing. However, monitoring the dynamics is difficult because a high-resolution robust measurement of key state parameters including the aboveground carbon biomass (AGB) is required. Here, we use deep neural network to generate a wall-to-wall map of AGB within the Continental USA (CONUS) with 30-meter spatial resolution fo… ▽ More The global carbon cycle is a key process to understand how our climate is changing. However, monitoring the dynamics is difficult because a high-resolution robust measurement of key state parameters including the aboveground carbon biomass (AGB) is required. Here, we use deep neural network to generate a wall-to-wall map of AGB within the Continental USA (CONUS) with 30-meter spatial resolution for the year 2021. We combine radar and optical hyperspectral imagery, with a physical climate parameter of SIF-based GPP. Validation results show that a masked variation of UNet has the lowest validation RMSE of 37.93 $\pm$ 1.36 Mg C/ha, as compared to 52.30 $\pm$ 0.03 Mg C/ha for random forest algorithm. Furthermore, models that learn from SIF-based GPP in addition to radar and optical imagery reduce validation RMSE by almost 10% and the standard deviation by 40%. Finally, we apply our model to measure losses in AGB from the recent 2021 Caldor wildfire in California, and validate our analysis with Sentinel-based burn index. △ Less

Submitted 24 October, 2022; originally announced October 2022.

Comments: 6 pages, 5 figures

$\textit{Gaia}$ white dwarfs within 40 pc III: spectroscopic observations of new candidates in the southern hemisphere

Authors: Mairi W. O'Brien, P. -E. Tremblay, N. P. Gentile Fusillo, M. A. Hollands, B. T. Gaensicke, D. Koester, I. Pelisoli, E. Cukanovaite, T. Cunningham, A. E. Doyle, A. Elms, J. Farihi, J. J. Hermes, J. Holberg, S. Jordan, B. L. Klein, S. J. Kleinman, C. J. Manser, D. De Martino, T. R. Marsh, J. McCleery, C. Melis, A. Nitta, S. G. Parsons, R. Raddi , et al. (9 additional authors not shown)

Abstract: We present a spectroscopic survey of 248 white dwarf candidates within 40 pc of the Sun; of these 244 are in the southern hemisphere. Observations were performed mostly with the Very Large Telescope (X-Shooter) and Southern Astrophysical Research Telescope. Almost all candidates were selected from $\textit{Gaia}$ Data Release 3 (DR3). We find a total of 246 confirmed white dwarfs, 209 of which had… ▽ More We present a spectroscopic survey of 248 white dwarf candidates within 40 pc of the Sun; of these 244 are in the southern hemisphere. Observations were performed mostly with the Very Large Telescope (X-Shooter) and Southern Astrophysical Research Telescope. Almost all candidates were selected from $\textit{Gaia}$ Data Release 3 (DR3). We find a total of 246 confirmed white dwarfs, 209 of which had no previously published spectra, and two main-sequence star contaminants. Of these, 100 white dwarfs display hydrogen Balmer lines, 69 have featureless spectra, and two show only neutral helium lines. Additionally, 14 white dwarfs display traces of carbon, while 37 have traces of other elements that are heavier than helium. We observe 36 magnetic white dwarfs through the detection of Zeeman splitting of their hydrogen Balmer or metal spectral lines. High spectroscopic completeness (> 97 per cent) has now been reached, such that we have 1058 confirmed $\textit{Gaia}$ DR3 white dwarfs out of 1083 candidates within 40 pc of the Sun at all declinations. △ Less

Submitted 9 November, 2022; v1 submitted 4 October, 2022; originally announced October 2022.

Comments: 49 pages, 19 figures. Accepted by MNRAS on 8 November, 2022

Process Mining Meets Visual Analytics: The Case of Conformance Checking

Authors: Jana-Rebecca Rehse, Luise Pufahl, Michael Grohs, Lisa-Marie Klein

Abstract: Conformance checking is a major function of process mining, which allows organizations to identify and alleviate potential deviations from the intended process behavior. To fully leverage its benefits, it is important that conformance checking results are visualized in a way that is approachable and understandable for non-expert users. However, the visualization of conformance checking results has… ▽ More Conformance checking is a major function of process mining, which allows organizations to identify and alleviate potential deviations from the intended process behavior. To fully leverage its benefits, it is important that conformance checking results are visualized in a way that is approachable and understandable for non-expert users. However, the visualization of conformance checking results has so far not been widely considered in research. Therefore, the goal of this paper is to develop an understanding of how conformance checking results are visualized by process mining tools to provide a foundation for further research on this topic. We conduct a systematic study, where we analyze the visualization capabilities of nine academic and seven commercial tools by means of a visual analytics framework. In this study, we find that the ''Why?'' aspect of conformance checking visualization seems already be well-defined, but the ''What?'' and ''How?'' aspects require future research. △ Less

Submitted 20 September, 2022; originally announced September 2022.

Comments: Submitted to HICSS-56 (2023)

Evaluating Temporal Patterns in Applied Infant Affect Recognition

Authors: Allen Chang, Lauren Klein, Marcelo R. Rosales, Weiyang Deng, Beth A. Smith, Maja J. Matarić

Abstract: Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may occur during occlusions or transitions between affective states. This paper addresses temporal patterns in affect classification performance in the context of… ▽ More Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may occur during occlusions or transitions between affective states. This paper addresses temporal patterns in affect classification performance in the context of an infant-robot interaction, where infants' affective states contribute to their ability to participate in a therapeutic leg movement activity. To support robustness to facial occlusions in video recordings, we trained infant affect recognition classifiers using both facial and body features. Next, we conducted an in-depth analysis of our best-performing models to evaluate how performance changed over time as the models encountered missing data and changing infant affect. During time windows when features were extracted with high confidence, a unimodal model trained on facial features achieved the same optimal performance as multimodal models trained on both facial and body features. However, multimodal models outperformed unimodal models when evaluated on the entire dataset. Additionally, model performance was weakest when predicting an affective state transition and improved after multiple predictions of the same affective state. These findings emphasize the benefits of incorporating body features in continuous affect recognition for infants. Our work highlights the importance of evaluating variability in model performance both over time and in the presence of missing data when applying affect recognition to social interactions. △ Less

Submitted 7 September, 2022; originally announced September 2022.

Comments: 8 pages, 6 figures, 10th International Conference on Affective Computing and Intelligent Interaction (ACII 2022)

From Correlation to Causation: Formalizing Interpretable Machine Learning as a Statistical Process

Authors: Lukas Klein, Mennatallah El-Assady, Paul F. Jäger

Abstract: Explainable AI (XAI) is a necessity in safety-critical systems such as in clinical diagnostics due to a high risk for fatal decisions. Currently, however, XAI resembles a loose collection of methods rather than a well-defined process. In this work, we elaborate on conceptual similarities between the largest subgroup of XAI, interpretable machine learning (IML), and classical statistics. Based on t… ▽ More Explainable AI (XAI) is a necessity in safety-critical systems such as in clinical diagnostics due to a high risk for fatal decisions. Currently, however, XAI resembles a loose collection of methods rather than a well-defined process. In this work, we elaborate on conceptual similarities between the largest subgroup of XAI, interpretable machine learning (IML), and classical statistics. Based on these similarities, we present a formalization of IML along the lines of a statistical process. Adopting this statistical view allows us to interpret machine learning models and IML methods as sophisticated statistical tools. Based on this interpretation, we infer three key questions, which we identify as crucial for the success and adoption of IML in safety-critical settings. By formulating these questions, we further aim to spark a discussion about what distinguishes IML from classical statistics and what our perspective implies for the future of the field. △ Less

Submitted 11 July, 2022; originally announced July 2022.

Comments: Accepted at IJCAI 2022 Workshop on Explainable Artificial Intelligence (XAI)

Monitoring Urban Forests from Auto-Generated Segmentation Maps

Authors: Conrad M Albrecht, Chenying Liu, Yi Wang, Levente Klein, Xiao Xiang Zhu

Abstract: We present and evaluate a weakly-supervised methodology to quantify the spatio-temporal distribution of urban forests based on remotely sensed data with close-to-zero human interaction. Successfully training machine learning models for semantic segmentation typically depends on the availability of high-quality labels. We evaluate the benefit of high-resolution, three-dimensional point cloud data (… ▽ More We present and evaluate a weakly-supervised methodology to quantify the spatio-temporal distribution of urban forests based on remotely sensed data with close-to-zero human interaction. Successfully training machine learning models for semantic segmentation typically depends on the availability of high-quality labels. We evaluate the benefit of high-resolution, three-dimensional point cloud data (LiDAR) as source of noisy labels in order to train models for the localization of trees in orthophotos. As proof of concept we sense Hurricane Sandy's impact on urban forests in Coney Island, New York City (NYC) and reference it to less impacted urban space in Brooklyn, NYC. △ Less

Submitted 14 June, 2022; originally announced June 2022.

Comments: accepted for presentation and publication at IGARSS 2022

Dissolving salt is not equivalent to applying a pressure on water

Authors: Chunyi Zhang, Shuwen Yue, Athanassios Z. Panagiotopoulos, Michael L. Klein, Xifan Wu

Abstract: Salt water is ubiquitous, playing crucial roles in geological and physiological processes. Despite centuries of investigations, whether or not water's structure is drastically changed by dissolved ions is still debated. Based on density functional theory, we employ machine learning based molecular dynamics to model sodium chloride, potassium chloride, and sodium bromide solutions at different conc… ▽ More Salt water is ubiquitous, playing crucial roles in geological and physiological processes. Despite centuries of investigations, whether or not water's structure is drastically changed by dissolved ions is still debated. Based on density functional theory, we employ machine learning based molecular dynamics to model sodium chloride, potassium chloride, and sodium bromide solutions at different concentrations. The resulting reciprocal-space structure factors agree quantitatively with neutron diffraction data. Here we provide clear evidence that the ions in salt water do not distort the structure of water in the same way as neat water responds to elevated pressure. Rather, the computed structural changes are restricted to the ionic first solvation shells intruding into the hydrogen bond network, beyond which the oxygen radial-distribution function does not undergo major change relative to neat water. Our findings suggest that the widely cited pressure-like effect on the solvent in Hofmeister series ionic solutions should be carefully revisited. △ Less

Submitted 10 February, 2022; originally announced February 2022.

Comments: 22 pages, 4 figures

AutoGeoLabel: Automated Label Generation for Geospatial Machine Learning

Authors: Conrad M Albrecht, Fernando Marianno, Levente J Klein

Abstract: A key challenge of supervised learning is the availability of human-labeled data. We evaluate a big data processing pipeline to auto-generate labels for remote sensing data. It is based on rasterized statistical features extracted from surveys such as e.g. LiDAR measurements. Using simple combinations of the rasterized statistical layers, it is demonstrated that multiple classes can be generated a… ▽ More A key challenge of supervised learning is the availability of human-labeled data. We evaluate a big data processing pipeline to auto-generate labels for remote sensing data. It is based on rasterized statistical features extracted from surveys such as e.g. LiDAR measurements. Using simple combinations of the rasterized statistical layers, it is demonstrated that multiple classes can be generated at accuracies of ~0.9. As proof of concept, we utilize the big geo-data platform IBM PAIRS to dynamically generate such labels in dense urban areas with multiple land cover classes. The general method proposed here is platform independent, and it can be adapted to generate labels for other satellite modalities in order to enable machine learning on overhead imagery for land use classification and object detection. △ Less

Submitted 31 January, 2022; originally announced February 2022.

ACM Class: I.5.4; I.5.2; I.2.10

Journal ref: 2021 IEEE International Conference on Big Data (Big Data), pp. 1779-1786. IEEE, 2021

S3RP: Self-Supervised Super-Resolution and Prediction for Advection-Diffusion Process

Authors: Chulin Wang, Kyongmin Yeo, Xiao Jin, Andres Codas, Levente J. Klein, Bruce Elmegreen

Abstract: We present a super-resolution model for an advection-diffusion process with limited information. While most of the super-resolution models assume high-resolution (HR) ground-truth data in the training, in many cases such HR dataset is not readily accessible. Here, we show that a Recurrent Convolutional Network trained with physics-based regularizations is able to reconstruct the HR information wit… ▽ More We present a super-resolution model for an advection-diffusion process with limited information. While most of the super-resolution models assume high-resolution (HR) ground-truth data in the training, in many cases such HR dataset is not readily accessible. Here, we show that a Recurrent Convolutional Network trained with physics-based regularizations is able to reconstruct the HR information without having the HR ground-truth data. Moreover, considering the ill-posed nature of a super-resolution problem, we employ the Recurrent Wasserstein Autoencoder to model the uncertainty. △ Less

Submitted 8 November, 2021; originally announced November 2021.

Comments: 9 pages, 8 figures

Journal ref: Neural Information Processing Systems (NeurIPS 2021) Workshop

Zero-contact angle solutions to stochastic thin-film equations

Authors: Günther Grün, Lorenz Klein

Abstract: We establish existence of nonnegative martingale solutions to stochastic thin-film equations with compactly supported initial data under Stratonovich noise. Based on so called $α$-entropy estimates, we show that almost surely these solutions are classically differentiable in space almost everywhere in time and that their derivative attains the value zero at the boundary of the solution's support.… ▽ More We establish existence of nonnegative martingale solutions to stochastic thin-film equations with compactly supported initial data under Stratonovich noise. Based on so called $α$-entropy estimates, we show that almost surely these solutions are classically differentiable in space almost everywhere in time and that their derivative attains the value zero at the boundary of the solution's support. I.e., from a physics perspective, they exhibit a zero-contact angle at the three-phase contact line between liquid, solid, and ambient fluid. These $α$-entropy estimates are first derived for almost surely strictly positive solutions to a family of stochastic thin-film equations augmented by second-order linear diffusion terms. Using Itô's formula together with stopping time arguments, the Jakubowski/Skorokhod calculus, and martingale identification techniques, the passage to the limit of vanishing regularization terms gives the desired existence result. △ Less

Submitted 22 October, 2021; originally announced October 2021.

Comments: 35 pages

MSC Class: 60H15; 76A20; 76D08; 35K35; 35K65; 35Q35; 35R35; 35R37

Robust Polarization Gradient Cooling of Trapped Ions

Authors: Wenbing Li, Sebastian Wolf, Lukas Klein, Dmitry Budker, Christoph E. Düllmann, Ferdinand Schmidt-Kaler

Abstract: We implement three-dimensional polarization gradient cooling of trapped ions. Counter-propagating laser beams near $393\,$nm impinge in lin$\,\perp\,$lin configuration, at a frequency below the S$_{1/2}$ to P$_{3/2}$ resonance in $^{40}$Ca$^+$. We demonstrate mean phonon numbers of $5.4(4)$ at a trap frequency of $2π\times 285\,$kHz and $3.3(4)$ at $2π\times480\,$kHz, in the axial and radial direc… ▽ More We implement three-dimensional polarization gradient cooling of trapped ions. Counter-propagating laser beams near $393\,$nm impinge in lin$\,\perp\,$lin configuration, at a frequency below the S$_{1/2}$ to P$_{3/2}$ resonance in $^{40}$Ca$^+$. We demonstrate mean phonon numbers of $5.4(4)$ at a trap frequency of $2π\times 285\,$kHz and $3.3(4)$ at $2π\times480\,$kHz, in the axial and radial directions, respectively. Our measurements demonstrate that cooling with laser beams detuned to lower frequencies from the resonance is robust against an elevated phonon occupation number, and thus works well for an initial ion motion far out of the Lamb-Dicke regime, for up to four ions, and for a micromotion modulation index $β\leq 0.1$. Still, we find that the spectral impurity of the laser field influences both, cooling rates and cooling limits. Thus, a Fabry-Pérot cavity filter is employed for efficiently suppressing amplified spontaneous emission of the diode laser. △ Less

Submitted 29 March, 2022; v1 submitted 1 September, 2021; originally announced September 2021.

Comments: 11 pages and 9 figures

V488 Per revisited: no strong mid-infrared emission features and no evidence for stellar/sub-stellar companions

Authors: Swetha Sankar, Carl Melis, Beth L. Klein, B. J. Fulton, B. Zuckerman, Inseok Song, Andrew W. Howard

Abstract: We present characterization of the planetary system architecture for V488 Per, the dustiest main sequence star known with a fractional infrared luminosity of ~16%. Far-infrared imaging photometry confirms the existence of an outer planetary system dust population with blackbody-fit temperature of ~130 K. Mid-infrared spectroscopy probing the previously-identified ~800 K inner planetary system dust… ▽ More We present characterization of the planetary system architecture for V488 Per, the dustiest main sequence star known with a fractional infrared luminosity of ~16%. Far-infrared imaging photometry confirms the existence of an outer planetary system dust population with blackbody-fit temperature of ~130 K. Mid-infrared spectroscopy probing the previously-identified ~800 K inner planetary system dust population does not detect any obvious solid-state emission features, suggesting either large grain sizes that mute such emission and/or grain compositions dominated by species like amorphous carbon and metallic iron which do not produce such features. In the latter case, the presence of significant quantities of iron-rich material could be indicative of the active formation of a Mercury-like planet around V488 Per. In any event, the absence of solid-state emission features is very unusual among main sequence stars with copious amounts of warm orbiting dust particles; we know of no other such star whose mid-infrared spectrum lacks such features. Combined radial velocity monitoring and adaptive optics imaging find no evidence for stellar/sub-stellar companions within several hundred AU of V488 Per. △ Less

Submitted 8 August, 2021; originally announced August 2021.

Comments: Accepted to ApJ. 17 pages, 5 figures and 2 tables

Temperature Steerable Flows and Boltzmann Generators

Authors: Manuel Dibak, Leon Klein, Andreas Krämer, Frank Noé

Abstract: Boltzmann generators approach the sampling problem in many-body physics by combining a normalizing flow and a statistical reweighting method to generate samples in thermodynamic equilibrium. The equilibrium distribution is usually defined by an energy function and a thermodynamic state. Here we propose temperature-steerable flows (TSF) which are able to generate a family of probability densities p… ▽ More Boltzmann generators approach the sampling problem in many-body physics by combining a normalizing flow and a statistical reweighting method to generate samples in thermodynamic equilibrium. The equilibrium distribution is usually defined by an energy function and a thermodynamic state. Here we propose temperature-steerable flows (TSF) which are able to generate a family of probability densities parametrized by a choosable temperature parameter. TSFs can be embedded in generalized ensemble sampling frameworks to sample a physical system across multiple thermodynamic states. △ Less

Submitted 3 September, 2022; v1 submitted 3 August, 2021; originally announced August 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2012.00429

Recurring Planetary Debris Transits and Circumstellar Gas around White Dwarf ZTF J0328$-$1219

Authors: Zachary P. Vanderbosch, Saul Rappaport, Joseph A. Guidry, Bruce L. Gary, Simon Blouin, Thomas G. Kaye, Alycia J. Weinberger, Carl Melis, Beth L. Klein, B. Zuckerman, Andrew Vanderburg, J. J. Hermes, Ryan J. Hegedus, Matthew. R. Burleigh, Ramotholo Sefako, Hannah L. Worters, Tyler M. Heintz

Abstract: We present follow-up photometry and spectroscopy of ZTF J0328$-$1219 strengthening its status as a white dwarf exhibiting transiting planetary debris. Using TESS and Zwicky Transient Facility photometry, along with follow-up high speed photometry from various observatories, we find evidence for two significant periods of variability at 9.937 and 11.2 hr. We interpret these as most likely the orbit… ▽ More We present follow-up photometry and spectroscopy of ZTF J0328$-$1219 strengthening its status as a white dwarf exhibiting transiting planetary debris. Using TESS and Zwicky Transient Facility photometry, along with follow-up high speed photometry from various observatories, we find evidence for two significant periods of variability at 9.937 and 11.2 hr. We interpret these as most likely the orbital periods of different debris clumps. Changes in the detailed dip structures within the light curves are observed on nightly, weekly, and monthly timescales, reminiscent of the dynamic behavior observed in the first white dwarf discovered to harbor a disintegrating asteroid, WD 1145+017. We fit previously published spectroscopy along with broadband photometry to obtain new atmospheric parameters for the white dwarf, with $M_{\star} = 0.731 \pm 0.023\,M_{\odot}$, $T_{\mathrm{eff}} = 7630 \pm 140\,$K, and $\mathrm{[Ca/He]}=-9.55\pm0.12$. With new high-resolution spectroscopy, we detect prominent and narrow Na D absorption features likely of circumstellar origin, with velocities $21.4\pm1.0$ km s$^{-1}$ blue-shifted relative to atmospheric lines. We attribute the periodically modulated photometric signal to dusty effluents from small orbiting bodies such as asteroids or comets, but are unable to identify the most likely material that is being sublimated, or otherwise ejected, as the environmental temperatures range from roughly 400K to 600K. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Comments: 24 pages, 10 figures, 9 tables, accepted to ApJ

Quantification of Carbon Sequestration in Urban Forests

Authors: Levente J. Klein, Wang Zhou, Conrad M. Albrecht

Abstract: Vegetation, trees in particular, sequester carbon by absorbing carbon dioxide from the atmosphere. However, the lack of efficient quantification methods of carbon stored in trees renders it difficult to track the process. We present an approach to estimate the carbon storage in trees based on fusing multi-spectral aerial imagery and LiDAR data to identify tree coverage, geometric shape, and tree s… ▽ More Vegetation, trees in particular, sequester carbon by absorbing carbon dioxide from the atmosphere. However, the lack of efficient quantification methods of carbon stored in trees renders it difficult to track the process. We present an approach to estimate the carbon storage in trees based on fusing multi-spectral aerial imagery and LiDAR data to identify tree coverage, geometric shape, and tree species -- key attributes to carbon storage quantification. We demonstrate that tree species information and their three-dimensional geometric shapes can be estimated from aerial imagery in order to determine the tree's biomass. Specifically, we estimate a total of $52,000$ tons of carbon sequestered in trees for New York City's borough Manhattan. △ Less

Submitted 20 July, 2021; v1 submitted 31 May, 2021; originally announced June 2021.

Journal ref: International Conference on Machine Learning (ICML 2021) Workshop