Showing 1–50 of 126 results for author: Weber, L

Carlo.jl: A general framework for Monte Carlo simulations in Julia

Authors: Lukas Weber

Abstract: Carlo.jl is a Monte Carlo simulation framework written in Julia. It provides MPI-parallel scheduling, organized storage of input, checkpoint, and output files, as well as statistical postprocessing. With a minimalist design, it aims to aid the development of high-quality Monte Carlo codes, especially for demanding applications in condensed matter and statistical physics. This hands-on user guide s… ▽ More Carlo.jl is a Monte Carlo simulation framework written in Julia. It provides MPI-parallel scheduling, organized storage of input, checkpoint, and output files, as well as statistical postprocessing. With a minimalist design, it aims to aid the development of high-quality Monte Carlo codes, especially for demanding applications in condensed matter and statistical physics. This hands-on user guide shows how to implement a simple code with Carlo.jl and provides benchmarks to show its efficacy. △ Less

Submitted 6 August, 2024; originally announced August 2024.

Comments: 13 pages, 4 figures, code available at https://github.com/lukas-weber/Carlo.jl

Learning to Compile Programs to Neural Networks

Authors: Logan Weber, Jesse Michel, Alex Renda, Michael Carbin

Abstract: A $\textit{neural surrogate of a program}$ is a neural network that mimics the behavior of a program. Researchers have used these neural surrogates to automatically tune program inputs, adapt programs to new settings, and accelerate computations. Researchers traditionally develop neural surrogates by training on input-output examples from a single program. Alternatively, language models trained on… ▽ More A $\textit{neural surrogate of a program}$ is a neural network that mimics the behavior of a program. Researchers have used these neural surrogates to automatically tune program inputs, adapt programs to new settings, and accelerate computations. Researchers traditionally develop neural surrogates by training on input-output examples from a single program. Alternatively, language models trained on a large dataset including many programs can consume program text, to act as a neural surrogate. Using a language model to both generate a surrogate and act as a surrogate, however, leading to a trade-off between resource consumption and accuracy. We present $\textit{neural surrogate compilation}$, a technique for producing neural surrogates directly from program text without coupling neural surrogate generation and execution. We implement neural surrogate compilers using hypernetworks trained on a dataset of C programs and find that they produce neural surrogates that are $1.9$-$9.5\times$ as data-efficient, produce visual results that are $1.0$-$1.3\times$ more similar to ground truth, and train in $4.3$-$7.3\times$ fewer epochs than neural surrogates trained from scratch. △ Less

Submitted 21 July, 2024; originally announced July 2024.

How to Achieve High Spatial Resolution in Organic Optobioelectronic Devices?

Authors: Luca Fabbri, Ludovico Migliaccio, Aleksandra Širvinskytė, Giacomo Rizzi, Luca Bondi, Cristiano Tamarozzi, Stefan A. L. Weber, Beatrice Fraboni, Eric Daniel Glowacki, Tobias Cramer

Abstract: Light activated local stimulation and sensing of biological cells offers enormous potential for minimally invasive bioelectronic interfaces. Organic semiconductors are a promising material class to achieve this kind of transduction due to their optoelectronic properties and biocompatibility. Here we investigate which material properties are necessary to keep the optical excitation localized. This… ▽ More Light activated local stimulation and sensing of biological cells offers enormous potential for minimally invasive bioelectronic interfaces. Organic semiconductors are a promising material class to achieve this kind of transduction due to their optoelectronic properties and biocompatibility. Here we investigate which material properties are necessary to keep the optical excitation localized. This is critical to single cell transduction with high spatial resolution. As a model system we use organic photocapacitors for cell stimulation made of the small molecule semiconductors H2Pc and PTCDI. We investigate the spatial broadening of the localized optical excitation with photovoltage microscopy measurements. Our experimental data combined with modelling show that resolution losses due to the broadening of the excitation are directly related to the effective diffusion length of charge carriers generated at the heterojunction. With additional transient photovoltage measurements we find that the H2Pc/PTCDI heterojunction offers a small diffusion length of lambda = 1.5 +/- 0.1 um due to the small mobility of charge carriers along the heterojunction. Instead covering the heterojunction with a layer of PEDOT:PSS improves the photocapacitor performance but increases the carrier diffusion length to lambda = 7.0 +/- 0.3 um due to longer lifetime and higher carrier mobility. Furthermore, we introduce electrochemical photocurrent microscopy experiments to demonstrate micrometric resolution with the pn-junction under realistic aqueous operation conditions. This work offers valuable insights into the physical mechanisms governing the excitation and transduction profile and provide design principles for future organic semiconductor junctions, aiming to achieve high efficiency and high spatial resolution. △ Less

Submitted 26 June, 2024; originally announced June 2024.

Interpretability of Language Models via Task Spaces

Authors: Lucas Weber, Jaap Jumelet, Elia Bruni, Dieuwke Hupkes

Abstract: The usual way to interpret language models (LMs) is to test their performance on different benchmarks and subsequently infer their internal processes. In this paper, we present an alternative approach, concentrating on the quality of LM processing, with a focus on their language abilities. To this end, we construct 'linguistic task spaces' -- representations of an LM's language conceptualisation -… ▽ More The usual way to interpret language models (LMs) is to test their performance on different benchmarks and subsequently infer their internal processes. In this paper, we present an alternative approach, concentrating on the quality of LM processing, with a focus on their language abilities. To this end, we construct 'linguistic task spaces' -- representations of an LM's language conceptualisation -- that shed light on the connections LMs draw between language phenomena. Task spaces are based on the interactions of the learning signals from different linguistic phenomena, which we assess via a method we call 'similarity probing'. To disentangle the learning signals of linguistic phenomena, we further introduce a method called 'fine-tuning via gradient differentials' (FTGD). We apply our methods to language models of three different scales and find that larger models generalise better to overarching general concepts for linguistic tasks, making better use of their shared structure. Further, the distributedness of linguistic processing increases with pre-training through increased parameter sharing between related linguistic tasks. The overall generalisation patterns are mostly stable throughout training and not marked by incisive stages, potentially explaining the lack of successful curriculum strategies for LMs. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Comments: To be published at ACL 2024 (main)

Reinforcement Learning and Regret Bounds for Admission Control

Authors: Lucas Weber, Ana Bušić, Jiamin Zhu

Abstract: The expected regret of any reinforcement learning algorithm is lower bounded by $Ω\left(\sqrt{DXAT}\right)$ for undiscounted returns, where $D$ is the diameter of the Markov decision process, $X$ the size of the state space, $A$ the size of the action space and $T$ the number of time steps. However, this lower bound is general. A smaller regret can be obtained by taking into account some specific… ▽ More The expected regret of any reinforcement learning algorithm is lower bounded by $Ω\left(\sqrt{DXAT}\right)$ for undiscounted returns, where $D$ is the diameter of the Markov decision process, $X$ the size of the state space, $A$ the size of the action space and $T$ the number of time steps. However, this lower bound is general. A smaller regret can be obtained by taking into account some specific knowledge of the problem structure. In this article, we consider an admission control problem to an $M/M/c/S$ queue with $m$ job classes and class-dependent rewards and holding costs. Queuing systems often have a diameter that is exponential in the buffer size $S$, making the previous lower bound prohibitive for any practical use. We propose an algorithm inspired by UCRL2, and use the structure of the problem to upper bound the expected total regret by $O(S\log T + \sqrt{mT \log T})$ in the finite server case. In the infinite server case, we prove that the dependence of the regret on $S$ disappears. △ Less

Submitted 7 June, 2024; originally announced June 2024.

Efficient multi-prompt evaluation of LLMs

Authors: Felipe Maia Polo, Ronald Xu, Lucas Weber, Mírian Silva, Onkar Bhardwaj, Leshem Choshen, Allysson Flavio Melo de Oliveira, Yuekai Sun, Mikhail Yurochkin

Abstract: Most popular benchmarks for comparing LLMs rely on a limited set of prompt templates, which may not fully capture the LLMs' abilities and can affect the reproducibility of results on leaderboards. Many recent works empirically verify prompt sensitivity and advocate for changes in LLM evaluation. In this paper, we consider the problem of estimating the performance distribution across many prompt va… ▽ More Most popular benchmarks for comparing LLMs rely on a limited set of prompt templates, which may not fully capture the LLMs' abilities and can affect the reproducibility of results on leaderboards. Many recent works empirically verify prompt sensitivity and advocate for changes in LLM evaluation. In this paper, we consider the problem of estimating the performance distribution across many prompt variants instead of finding a single prompt to evaluate with. We introduce PromptEval, a method for estimating performance across a large set of prompts borrowing strength across prompts and examples to produce accurate estimates under practical evaluation budgets. The resulting distribution can be used to obtain performance quantiles to construct various robust performance metrics (e.g., top 95% quantile or median). We prove that PromptEval consistently estimates the performance distribution and demonstrate its efficacy empirically on three prominent LLM benchmarks: MMLU, BIG-bench Hard, and LMentry. For example, PromptEval can accurately estimate performance quantiles across 100 prompt templates on MMLU with a budget equivalent to two single-prompt evaluations. Our code and data can be found at https://github.com/felipemaiapolo/prompt-eval. △ Less

Submitted 7 June, 2024; v1 submitted 27 May, 2024; originally announced May 2024.

A Fresh Look at Sanity Checks for Saliency Maps

Authors: Anna Hedström, Leander Weber, Sebastian Lapuschkin, Marina Höhne

Abstract: The Model Parameter Randomisation Test (MPRT) is highly recognised in the eXplainable Artificial Intelligence (XAI) community due to its fundamental evaluative criterion: explanations should be sensitive to the parameters of the model they seek to explain. However, recent studies have raised several methodological concerns for the empirical interpretation of MPRT. In response, we propose two modif… ▽ More The Model Parameter Randomisation Test (MPRT) is highly recognised in the eXplainable Artificial Intelligence (XAI) community due to its fundamental evaluative criterion: explanations should be sensitive to the parameters of the model they seek to explain. However, recent studies have raised several methodological concerns for the empirical interpretation of MPRT. In response, we propose two modifications to the original test: Smooth MPRT and Efficient MPRT. The former reduces the impact of noise on evaluation outcomes via sampling, while the latter avoids the need for biased similarity measurements by re-interpreting the test through the increase in explanation complexity after full model randomisation. Our experiments show that these modifications enhance the metric reliability, facilitating a more trustworthy deployment of explanation methods. △ Less

Submitted 3 May, 2024; originally announced May 2024.

Comments: arXiv admin note: text overlap with arXiv:2401.06465

Scalable Ab Initio Electronic Structure Methods with Near Chemical Accuracy for Main Group Chemistry

Authors: Yujing Wei, Sibali Debnath, John L. Weber, Ankit Mahajan, David R. Reichman, Richard A. Friesner

Abstract: This study evaluates the precision of widely recognized quantum chemical methodologies, CCSD(T), DLPNO-CCSD(T) and localized ph-AFQMC, for determining the thermochemistry of main group elements. DLPNO-CCSD(T) and localized ph-AFQMC, which offer greater scalability compared to canonical CCSD(T), have emerged over the last decade as pivotal in producing precise benchmark chemical data. Our investiga… ▽ More This study evaluates the precision of widely recognized quantum chemical methodologies, CCSD(T), DLPNO-CCSD(T) and localized ph-AFQMC, for determining the thermochemistry of main group elements. DLPNO-CCSD(T) and localized ph-AFQMC, which offer greater scalability compared to canonical CCSD(T), have emerged over the last decade as pivotal in producing precise benchmark chemical data. Our investigation includes closed-shell, neutral molecules, focusing on their heat of formation and atomization energy sourced from four specific small molecule datasets. Firstly, we selected molecules from the G2 and G3 datasets, noted for their reliable experimental heat of formation data. Additionally, we incorporate molecules from the W4-11 and W4-17 sets, which provide high-level theoretical reference values for atomization energy at 0 K. Our findings reveal that both DLPNO-CCSD(T) and ph-AFQMC methods are capable of achieving a root-mean-square deviation (RMSD) of less than 1 kcal/mol across the combined dataset, aligning with the threshold for chemical accuracy. Moreover, we make efforts to confine the maximum deviations within 2 kcal/mol, a degree of precision that significantly broadens the applicability of these methods in fields such as biology and materials science. △ Less

Submitted 29 July, 2024; v1 submitted 2 May, 2024; originally announced May 2024.

Journal ref: J. Phys. Chem. A 2024, 128, 5796-5807

Exploring Cluster Analysis in Nelore Cattle Visual Score Attribution

Authors: Alexandre de Oliveira Bezerra, Rodrigo Goncalves Mateus, Vanessa Ap. de Moraes Weber, Fabricio de Lima Weber, Yasmin Alves de Arruda, Rodrigo da Costa Gomes, Gabriel Toshio Hirokawa Higa, Hemerson Pistori

Abstract: Assessing the biotype of cattle through human visual inspection is a very common and important practice in precision cattle breeding. This paper presents the results of a correlation analysis between scores produced by humans for Nelore cattle and a variety of measurements that can be derived from images or other instruments. It also presents a study using the k-means algorithm to generate new way… ▽ More Assessing the biotype of cattle through human visual inspection is a very common and important practice in precision cattle breeding. This paper presents the results of a correlation analysis between scores produced by humans for Nelore cattle and a variety of measurements that can be derived from images or other instruments. It also presents a study using the k-means algorithm to generate new ways of clustering a batch of cattle using the measurements that most correlate with the animal's body weight and visual scores. △ Less

Submitted 11 March, 2024; originally announced March 2024.

tinyBenchmarks: evaluating LLMs with fewer examples

Authors: Felipe Maia Polo, Lucas Weber, Leshem Choshen, Yuekai Sun, Gongjun Xu, Mikhail Yurochkin

Abstract: The versatility of large language models (LLMs) led to the creation of diverse benchmarks that thoroughly test a variety of language models' abilities. These benchmarks consist of tens of thousands of examples making evaluation of LLMs very expensive. In this paper, we investigate strategies to reduce the number of evaluations needed to assess the performance of an LLM on several key benchmarks. F… ▽ More The versatility of large language models (LLMs) led to the creation of diverse benchmarks that thoroughly test a variety of language models' abilities. These benchmarks consist of tens of thousands of examples making evaluation of LLMs very expensive. In this paper, we investigate strategies to reduce the number of evaluations needed to assess the performance of an LLM on several key benchmarks. For example, we show that to accurately estimate the performance of an LLM on MMLU, a popular multiple-choice QA benchmark consisting of 14K examples, it is sufficient to evaluate this LLM on 100 curated examples. We release evaluation tools and tiny versions of popular benchmarks: Open LLM Leaderboard, MMLU, HELM, and AlpacaEval 2.0. Our empirical analysis demonstrates that these tools and tiny benchmarks are sufficient to reliably and efficiently reproduce the original evaluation results. △ Less

Submitted 26 May, 2024; v1 submitted 22 February, 2024; originally announced February 2024.

Comments: Proceedings of the 41st International Conference on Machine Learning (ICML)

The interplay between forming planets and photoevaporating discs II: Wind-driven gas redistribution

Authors: Michael L. Weber, Giovanni Picogna, Barbara Ercolano

Abstract: Disc winds and planet-disc interactions are two crucial mechanisms that define the structure, evolution and dispersal of protoplanetary discs. While winds are capable of removing material from discs, eventually leading to their dispersal, massive planets can shape their disc by creating sub-structures such as gaps and spiral arms. We study the interplay between an X-ray photoevaporative disc wind… ▽ More Disc winds and planet-disc interactions are two crucial mechanisms that define the structure, evolution and dispersal of protoplanetary discs. While winds are capable of removing material from discs, eventually leading to their dispersal, massive planets can shape their disc by creating sub-structures such as gaps and spiral arms. We study the interplay between an X-ray photoevaporative disc wind and the substructures generated due to planet-disc interactions to determine how their mutual interactions affect the disc's and the planet's evolution. We perform three-dimensional hydrodynamic simulations of viscous ($α= 6.9\cdot10^{-4}$) discs that host a Jupiter-like planet and undergo X-ray photoevaporation. We trace the gas flows within the disc and wind and measure the accretion rate onto the planet, as well as the gravitational torque that is acting on it. Our results show that the planetary gap takes away the wind's pressure support, allowing wind material to fall back into the gap. This opens new pathways for material from the inner disc (and part of the outer disc) to be redistributed through the wind towards the gap. Consequently, the gap becomes shallower, and the flow of mass across the gap in both directions is significantly increased, as well as the planet's mass-accretion rate (by factors $\approx 5$ and $\approx 2$, respectively). Moreover, the wind-driven redistribution results in a denser inner disc and less dense outer disc, which, combined with the recycling of a significant portion of the inner wind, leads to longer lifetimes of the inner disc, contrary to the expectation in a planet-induced photoevaporation (PIPE) scenario that has been proposed in the past. △ Less

Submitted 19 February, 2024; originally announced February 2024.

Comments: Accepted for publication in A&A; 15+3 pages, 12+3 figures

Journal ref: A&A 686, A53 (2024)

Reinforcement learning based demand charge minimization using energy storage

Authors: Lucas Weber, Ana Bušić, Jiamin Zhu

Abstract: Utilities have introduced demand charges to encourage customers to reduce their demand peaks, since a high peak may cause very high costs for both the utility and the consumer. We herein study the bill minimization problem for customers equipped with an energy storage device and a self-owned renewable energy production. A model-free reinforcement learning algorithm is carefully designed to reduce… ▽ More Utilities have introduced demand charges to encourage customers to reduce their demand peaks, since a high peak may cause very high costs for both the utility and the consumer. We herein study the bill minimization problem for customers equipped with an energy storage device and a self-owned renewable energy production. A model-free reinforcement learning algorithm is carefully designed to reduce both the energy charge and the demand charge of the consumer. The proposed algorithm does not need forecasting models for the energy demand and the renewable energy production. The resulting controller can be used online, and progressively improved with newly gathered data. The algorithm is validated on real data from an office building of IFPEN Solaize site. Numerical results show that our algorithm can reduce electricity bills with both daily and monthly demand charges. △ Less

Submitted 12 February, 2024; originally announced February 2024.

Journal ref: 2023 IEEE 62nd Conference on Decision and Control (CDC), 2023

Sanity Checks Revisited: An Exploration to Repair the Model Parameter Randomisation Test

Authors: Anna Hedström, Leander Weber, Sebastian Lapuschkin, Marina MC Höhne

Abstract: The Model Parameter Randomisation Test (MPRT) is widely acknowledged in the eXplainable Artificial Intelligence (XAI) community for its well-motivated evaluative principle: that the explanation function should be sensitive to changes in the parameters of the model function. However, recent works have identified several methodological caveats for the empirical interpretation of MPRT. To address the… ▽ More The Model Parameter Randomisation Test (MPRT) is widely acknowledged in the eXplainable Artificial Intelligence (XAI) community for its well-motivated evaluative principle: that the explanation function should be sensitive to changes in the parameters of the model function. However, recent works have identified several methodological caveats for the empirical interpretation of MPRT. To address these caveats, we introduce two adaptations to the original MPRT -- Smooth MPRT and Efficient MPRT, where the former minimises the impact that noise has on the evaluation results through sampling and the latter circumvents the need for biased similarity measurements by re-interpreting the test through the explanation's rise in complexity, after full parameter randomisation. Our experimental results demonstrate that these proposed variants lead to improved metric reliability, thus enabling a more trustworthy application of XAI methods. △ Less

Submitted 12 January, 2024; originally announced January 2024.

Comments: 19 pages, 12 figures, NeurIPS XAIA 2023

GIARPS High-resolution Observations of T Tauri stars (GHOST) V. New insights into disk winds from 3 km/s resolution observations

Authors: Brunella Nisini, Manuele Gangi, Teresa Giannini, Simone Antoniucci, Katia Biazzo, Antonio Frasca, Juan M. Alcala', Carlo F. Manara, Michael L. Weber

Abstract: This paper aims at revisit the physical and dynamical properties of the warm atomic gas in the inner disk region of classical T Tauri stars (CTTs) and relate them to the properties of the outer dusty disk. We used the high resolution (R=115,000) spectra of 36 CTTs observed as part of the GHOsT project and analysed the profile and luminosity of the brightest optical forbidden lines, namely [OI]630… ▽ More This paper aims at revisit the physical and dynamical properties of the warm atomic gas in the inner disk region of classical T Tauri stars (CTTs) and relate them to the properties of the outer dusty disk. We used the high resolution (R=115,000) spectra of 36 CTTs observed as part of the GHOsT project and analysed the profile and luminosity of the brightest optical forbidden lines, namely [OI]630 and 557nm, [SII]406 and 673nm, and [NII]658nm. We find that in about 40% of sources the so-called narrow low-velocity component (NLVC) display a peak velocity compatible with the stellar velocity. In these sources, that typically show lower mass accretion rates and the absence of a jet, the [OI]630nm profiles are well fitted by a simple Keplerian disk model, indicating that the emission from the disk is dominant with respect to the wind contribution. For transitional disks (TD), no correlation is found between $R_{kep}$, derived from the line HWHM, and the size of the dust cavity. We also see an anti-correlation between the [OI] 557/630 nm ratio and $R_{kep}$, which suggests that the [OI] emitting region expands as the gas cools and becomes less dense. We confirmed previous findings on the density and temperature ranges implied by the line ratios, and additionally constrained the ionisation fraction in the NLVC to be < 0.1. We however discuss the limits of applying this diagnostic to winds that are not spatially resolved. For the outflow component, we estimated the mass-loss for both the disk winds and jets and compared the results with X-ray photoevaporative models. We conclude that without better knowledge of the wind geometry, and given the limitation of the diagnostics, the mass-loss in the wind traced by the LVC cannot be constrained better than a factor of 100, with a mass-loss/mass-accretion ratio spanning between ~ 0.01 and more than 1. △ Less

Submitted 17 December, 2023; originally announced December 2023.

Comments: Accepted for publication in Astronomy and Astrophysics

The ICL Consistency Test

Authors: Lucas Weber, Elia Bruni, Dieuwke Hupkes

Abstract: Just like the previous generation of task-tuned models, large language models (LLMs) that are adapted to tasks via prompt-based methods like in-context-learning (ICL) perform well in some setups but not in others. This lack of consistency in prompt-based learning hints at a lack of robust generalisation. We here introduce the ICL consistency test -- a contribution to the GenBench collaborative ben… ▽ More Just like the previous generation of task-tuned models, large language models (LLMs) that are adapted to tasks via prompt-based methods like in-context-learning (ICL) perform well in some setups but not in others. This lack of consistency in prompt-based learning hints at a lack of robust generalisation. We here introduce the ICL consistency test -- a contribution to the GenBench collaborative benchmark task (CBT) -- which evaluates how consistent a model makes predictions across many different setups while using the same data. The test is based on different established natural language inference tasks. We provide preprocessed data constituting 96 different 'setups' and a metric that estimates model consistency across these setups. The metric is provided on a fine-grained level to understand what properties of a setup render predictions unstable and on an aggregated level to compare overall model consistency. We conduct an empirical analysis of eight state-of-the-art models, and our consistency metric reveals how all tested LLMs lack robust generalisation. △ Less

Submitted 8 December, 2023; originally announced December 2023.

Comments: Accepted as non-archival submission to the GenBench Workshop 2023. arXiv admin note: substantial text overlap with arXiv:2310.13486

A note on multicolour Erdős-Hajnal conjecture

Authors: Maria Axenovich, Lea Weber

Abstract: Informally, the Erdős-Hajnal conjecture (shortly EH-conjecture) asserts that if a sufficiently large host clique on $n$ vertices is edge-coloured avoiding a copy of some fixed edge-coloured clique, then there is a large homogeneous set of size $n^β$ for some positive $β$, where a set of vertices is homogeneous if it does not induce all the colours. This conjecture, if true, claims that imposing lo… ▽ More Informally, the Erdős-Hajnal conjecture (shortly EH-conjecture) asserts that if a sufficiently large host clique on $n$ vertices is edge-coloured avoiding a copy of some fixed edge-coloured clique, then there is a large homogeneous set of size $n^β$ for some positive $β$, where a set of vertices is homogeneous if it does not induce all the colours. This conjecture, if true, claims that imposing local conditions on edge-partitions of cliques results in a global structural consequence such as a large homogeneous set, a set avoiding all edges of some part. While this conjecture attracted a lot of attention, it is still open even for two colours. In this note, we reduce the multicolour EH-conjecture to the case when the number of colours used in a host clique is either the same as in the forbidden pattern or one more. We exhibit a non-monotonicity behaviour of homogeneous sets in coloured cliques with forbidden patterns by showing that allowing an extra colour in the host graph could actually decrease the size of a largest homogeneous set. △ Less

Submitted 12 December, 2023; v1 submitted 6 November, 2023; originally announced November 2023.

Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning

Authors: Lucas Weber, Elia Bruni, Dieuwke Hupkes

Abstract: Finding the best way of adapting pre-trained language models to a task is a big challenge in current NLP. Just like the previous generation of task-tuned models (TT), models that are adapted to tasks via in-context-learning (ICL) are robust in some setups but not in others. Here, we present a detailed analysis of which design choices cause instabilities and inconsistencies in LLM predictions. Firs… ▽ More Finding the best way of adapting pre-trained language models to a task is a big challenge in current NLP. Just like the previous generation of task-tuned models (TT), models that are adapted to tasks via in-context-learning (ICL) are robust in some setups but not in others. Here, we present a detailed analysis of which design choices cause instabilities and inconsistencies in LLM predictions. First, we show how spurious correlations between input distributions and labels -- a known issue in TT models -- form only a minor problem for prompted models. Then, we engage in a systematic, holistic evaluation of different factors that have been found to influence predictions in a prompting setup. We test all possible combinations of a range of factors on both vanilla and instruction-tuned (IT) LLMs of different scale and statistically analyse the results to show which factors are the most influential, interactive or stable. Our results show which factors can be used without precautions and which should be avoided or handled with care in most settings. △ Less

Submitted 20 October, 2023; originally announced October 2023.

Establishing Trustworthiness: Rethinking Tasks and Model Evaluation

Authors: Robert Litschko, Max Müller-Eberstein, Rob van der Goot, Leon Weber, Barbara Plank

Abstract: Language understanding is a multi-faceted cognitive capability, which the Natural Language Processing (NLP) community has striven to model computationally for decades. Traditionally, facets of linguistic intelligence have been compartmentalized into tasks with specialized model architectures and corresponding evaluation protocols. With the advent of large language models (LLMs) the community has w… ▽ More Language understanding is a multi-faceted cognitive capability, which the Natural Language Processing (NLP) community has striven to model computationally for decades. Traditionally, facets of linguistic intelligence have been compartmentalized into tasks with specialized model architectures and corresponding evaluation protocols. With the advent of large language models (LLMs) the community has witnessed a dramatic shift towards general purpose, task-agnostic approaches powered by generative models. As a consequence, the traditional compartmentalized notion of language tasks is breaking down, followed by an increasing challenge for evaluation and analysis. At the same time, LLMs are being deployed in more real-world scenarios, including previously unforeseen zero-shot setups, increasing the need for trustworthy and reliable systems. Therefore, we argue that it is time to rethink what constitutes tasks and model evaluation in NLP, and pursue a more holistic view on language, placing trustworthiness at the center. Towards this goal, we review existing compartmentalized approaches for understanding the origins of a model's functional capacity, and provide recommendations for more multi-faceted evaluation protocols. △ Less

Submitted 23 October, 2023; v1 submitted 9 October, 2023; originally announced October 2023.

Comments: Accepted at EMNLP 2023 (Main Conference), camera-ready

Curriculum Learning with Adam: The Devil Is in the Wrong Details

Authors: Lucas Weber, Jaap Jumelet, Paul Michel, Elia Bruni, Dieuwke Hupkes

Abstract: Curriculum learning (CL) posits that machine learning models -- similar to humans -- may learn more efficiently from data that match their current learning progress. However, CL methods are still poorly understood and, in particular for natural language processing (NLP), have achieved only limited success. In this paper, we explore why. Starting from an attempt to replicate and extend a number of… ▽ More Curriculum learning (CL) posits that machine learning models -- similar to humans -- may learn more efficiently from data that match their current learning progress. However, CL methods are still poorly understood and, in particular for natural language processing (NLP), have achieved only limited success. In this paper, we explore why. Starting from an attempt to replicate and extend a number of recent curriculum methods, we find that their results are surprisingly brittle when applied to NLP. A deep dive into the (in)effectiveness of the curricula in some scenarios shows us why: when curricula are employed in combination with the popular Adam optimisation algorithm, they oftentimes learn to adapt to suboptimally chosen optimisation parameters for this algorithm. We present a number of different case studies with different common hand-crafted and automated CL approaches to illustrate this phenomenon, and we find that none of them outperforms optimisation with only Adam with well-chosen hyperparameters. As such, our results contribute to understanding why CL methods work, but at the same time urge caution when claiming positive results. △ Less

Submitted 23 August, 2023; originally announced August 2023.

Layer-wise Feedback Propagation

Authors: Leander Weber, Jim Berend, Alexander Binder, Thomas Wiegand, Wojciech Samek, Sebastian Lapuschkin

Abstract: In this paper, we present Layer-wise Feedback Propagation (LFP), a novel training approach for neural-network-like predictors that utilizes explainability, specifically Layer-wise Relevance Propagation(LRP), to assign rewards to individual connections based on their respective contributions to solving a given task. This differs from traditional gradient descent, which updates parameters towards an… ▽ More In this paper, we present Layer-wise Feedback Propagation (LFP), a novel training approach for neural-network-like predictors that utilizes explainability, specifically Layer-wise Relevance Propagation(LRP), to assign rewards to individual connections based on their respective contributions to solving a given task. This differs from traditional gradient descent, which updates parameters towards anestimated loss minimum. LFP distributes a reward signal throughout the model without the need for gradient computations. It then strengthens structures that receive positive feedback while reducingthe influence of structures that receive negative feedback. We establish the convergence of LFP theoretically and empirically, and demonstrate its effectiveness in achieving comparable performance to gradient descent on various models and datasets. Notably, LFP overcomes certain limitations associated with gradient-based methods, such as reliance on meaningful derivatives. We further investigate how the different LRP-rules can be extended to LFP, what their effects are on training, as well as potential applications, such as training models with no meaningful derivatives, e.g., step-function activated Spiking Neural Networks (SNNs), or for transfer learning, to efficiently utilize existing knowledge. △ Less

Submitted 23 August, 2023; originally announced August 2023.

MSC Class: 68T05

Optical Second Harmonic Generation in Anisotropic Multilayers with Complete Multireflection of Linear and Nonlinear Waves using #SHAARP.ml Package

Authors: Rui Zu, Bo Wang, Jingyang He, Lincoln Weber, Akash Saha, Long-Qing Chen, Venkatraman Gopalan

Abstract: Optical second harmonic generation (SHG) is a nonlinear optical effect widely used for nonlinear optical microscopy and laser frequency conversion. Closed-form analytical solution of the nonlinear optical responses is essential for evaluating the optical responses of new materials whose optical properties are unknown a priori. A recent open-source code, SHAARP(si), can provide such closed form sol… ▽ More Optical second harmonic generation (SHG) is a nonlinear optical effect widely used for nonlinear optical microscopy and laser frequency conversion. Closed-form analytical solution of the nonlinear optical responses is essential for evaluating the optical responses of new materials whose optical properties are unknown a priori. A recent open-source code, SHAARP(si), can provide such closed form solutions for crystals with arbitrary symmetries, orientations, and anisotropic properties at a single interface. However, optical components are often in the form of slabs, thin films on substrates, and multilayer heterostructures with multiple reflections of both the fundamental and up to ten different SHG waves at each interface, adding significant complexity. Many approximations have therefore been employed in the existing analytical approaches, such as slowly varying approximation, weak reflection of the nonlinear polarization, transparent medium, high crystallographic symmetry, Kleinman symmetry, easy crystal orientation along a high-symmetry direction, phase matching conditions and negligible interference among nonlinear waves, which may lead to large errors in the reported material properties. To avoid these approximations, we have developed an open-source package named Second Harmonic Analysis of Anisotropic Rotational Polarimetry in Multilayers (SHAARP(ml)). The reliability and accuracy are established by experimentally benchmarking with both the SHG polarimetry and Maker fringes predicted from the package using standard materials. △ Less

Submitted 20 December, 2023; v1 submitted 3 July, 2023; originally announced July 2023.

The Design of New Practical Constraints in Auxiliary-Field Quantum Monte Carlo

Authors: John L. Weber, Hung Vuong, Richard A. Friesner, David R. Reichman

Abstract: We formulate and characterize a new constraint for Auxiliary Field Quantum Monte Carlo (AFQMC) applicable for general fermionic systems, which allows for the accumulation of phase in the random walk but disallows walkers with a magnitude of phase greater than $π$ with respect to the trial wave function. For short imaginary times, before walkers accumulate sizable phase values, this approach is equ… ▽ More We formulate and characterize a new constraint for Auxiliary Field Quantum Monte Carlo (AFQMC) applicable for general fermionic systems, which allows for the accumulation of phase in the random walk but disallows walkers with a magnitude of phase greater than $π$ with respect to the trial wave function. For short imaginary times, before walkers accumulate sizable phase values, this approach is equivalent to exact free projection, allowing one to observe the accumulation of bias associated with the constraint and thus estimate its magnitude \textit{a priori}. We demonstrate the stability of this constraint over arbitrary imaginary times and system sizes, highlighting the removal of noise due to the fermionic sign problem. Benchmark total energies for a variety of weakly and strongly correlated molecular systems reveal a distinct bias with respect to standard phaseless AFQMC, with a comparative increase in accuracy given a sufficient quality of trial wave function for the set of studied cases. We then take this constraint, referred to as linecut (lc-) AFQMC, and systematically release it (lcR-AFQMC), providing a route to obtain a smooth bridge between constrained AFQMC and the exact free projection results. △ Less

Submitted 15 June, 2023; originally announced June 2023.

Comments: 26 pages, 11 figures, 3 tables

ActiveAED: A Human in the Loop Improves Annotation Error Detection

Authors: Leon Weber, Barbara Plank

Abstract: Manually annotated datasets are crucial for training and evaluating Natural Language Processing models. However, recent work has discovered that even widely-used benchmark datasets contain a substantial number of erroneous annotations. This problem has been addressed with Annotation Error Detection (AED) models, which can flag such errors for human re-annotation. However, even though many of these… ▽ More Manually annotated datasets are crucial for training and evaluating Natural Language Processing models. However, recent work has discovered that even widely-used benchmark datasets contain a substantial number of erroneous annotations. This problem has been addressed with Annotation Error Detection (AED) models, which can flag such errors for human re-annotation. However, even though many of these AED methods assume a final curation step in which a human annotator decides whether the annotation is erroneous, they have been developed as static models without any human-in-the-loop component. In this work, we propose ActiveAED, an AED method that can detect errors more accurately by repeatedly querying a human for error corrections in its prediction loop. We evaluate ActiveAED on eight datasets spanning five different tasks and find that it leads to improvements over the state of the art on seven of them, with gains of up to six percentage points in average precision. △ Less

Submitted 31 May, 2023; originally announced May 2023.

Comments: Findings of ACL 2023

The generalized Hierarchical Gaussian Filter

Authors: Lilian Aline Weber, Peter Thestrup Waade, Nicolas Legrand, Anna Hedvig Møller, Klaas Enno Stephan, Christoph Mathys

Abstract: Hierarchical Bayesian models of perception and learning feature prominently in contemporary cognitive neuroscience where, for example, they inform computational concepts of mental disorders. This includes predictive coding and hierarchical Gaussian filtering (HGF), which differ in the nature of hierarchical representations. Predictive coding assumes that higher levels in a given hierarchy influenc… ▽ More Hierarchical Bayesian models of perception and learning feature prominently in contemporary cognitive neuroscience where, for example, they inform computational concepts of mental disorders. This includes predictive coding and hierarchical Gaussian filtering (HGF), which differ in the nature of hierarchical representations. Predictive coding assumes that higher levels in a given hierarchy influence the state (value) of lower levels. In HGF, however, higher levels determine the rate of change at lower levels. Here, we extend the space of generative models underlying HGF to include a form of nonlinear hierarchical coupling between state values akin to predictive coding and artificial neural networks in general. We derive the update equations corresponding to this generalization of HGF and conceptualize them as connecting a network of (belief) nodes where parent nodes either predict the state of child nodes or their rate of change. This enables us to (1) create modular architectures with generic computational steps in each node of the network, and (2) disclose the hierarchical message passing implied by generalized HGF models and to compare this to comparable schemes under predictive coding. We find that the algorithmic architecture instantiated by the generalized HGF is largely compatible with that of predictive coding but extends it with some unique predictions which arise from precision and volatility related computations. Our developments enable highly flexible implementations of hierarchical Bayesian models for empirical data analysis and are available as open source software. △ Less

Submitted 4 September, 2024; v1 submitted 18 May, 2023; originally announced May 2023.

How charges separate when surfaces are dewetted

Authors: Aaron D. Ratschow, Lisa S. Bauer, Pravash Bista, Stefan A. L. Weber, Hans-Jürgen Butt, Steffen Hardt

Abstract: Charge separation at moving three-phase contact lines is observed in nature as well as technological processes. Despite the growing number of experimental investigations in recent years, the physical mechanism behind the charging remains obscure. Here we identify the origin of charge separation as the dewetting of the bound surface charge within the electric double layer by the receding contact li… ▽ More Charge separation at moving three-phase contact lines is observed in nature as well as technological processes. Despite the growing number of experimental investigations in recent years, the physical mechanism behind the charging remains obscure. Here we identify the origin of charge separation as the dewetting of the bound surface charge within the electric double layer by the receding contact line. This charge depends strongly on the local electric double layer structure close to the contact line, which is affected by the gas-liquid interface and the internal flow of the liquid. We summarize the charge separation mechanism in an analytical model that captures parametric dependencies in agreement with our experiments and numerical simulations. Charge separation increases with increasing contact angle and decreases with increasing dewetting velocity. Our findings reveal the universal mechanism of charge separation at receding contact lines, relevant to many dynamic wetting scenarios, and provide a theoretical foundation for both fundamental questions, like contact angle hysteresis, and practical applications. △ Less

Submitted 3 May, 2023; originally announced May 2023.

Large cliques or co-cliques in hypergraphs with forbidden order-size pairs

Authors: Maria Axenovich, Domagoj Bradač, Lior Gishboliner, Dhruv Mubayi, Lea Weber

Abstract: The well-known Erdős-Hajnal conjecture states that for any graph $F$, there exists $ε>0$ such that every $n$-vertex graph $G$ that contains no induced copy of $F$ has a homogeneous set of size at least $n^ε$. We consider a variant of the Erdős-Hajnal problem for hypergraphs where we forbid a family of hypergraphs described by their orders and sizes. For graphs, we observe that if we forbid induced… ▽ More The well-known Erdős-Hajnal conjecture states that for any graph $F$, there exists $ε>0$ such that every $n$-vertex graph $G$ that contains no induced copy of $F$ has a homogeneous set of size at least $n^ε$. We consider a variant of the Erdős-Hajnal problem for hypergraphs where we forbid a family of hypergraphs described by their orders and sizes. For graphs, we observe that if we forbid induced subgraphs on $m$ vertices and $f$ edges for any positive $m$ and $0\leq f \leq \binom{m}{2}$, then we obtain large homogeneous sets. For triple systems, in the first nontrivial case $m=4$, for every $S \subseteq \{0,1,2,3,4\}$, we give bounds on the minimum size of a homogeneous set in a triple system where the number of edges spanned by every four vertices is not in $S$. In most cases the bounds are essentially tight. We also determine, for all $S$, whether the growth rate is polynomial or polylogarithmic. Some open problems remain. △ Less

Submitted 2 May, 2023; originally announced May 2023.

Comments: A preliminary version of this manuscript appeared as arXiv:2303.09578

Homogeneous sets in hypergraphs with forbidden order-size pairs

Authors: Maria Axenovich, Dhruv Mubayi, Lea Weber

Abstract: The well-known Erdős-Hajnal conjecture states that for any graph $F$, there exists $ε>0$ such that every $n$-vertex graph $G$ that contains no induced copy of $F$ has a homogeneous set of size at least $n^ε$. We consider a variant of the Erdős-Hajnal problem for hypergraphs where we forbid a family of hypergraphs described by their orders and sizes. For graphs, we observe that if we forbid induced… ▽ More The well-known Erdős-Hajnal conjecture states that for any graph $F$, there exists $ε>0$ such that every $n$-vertex graph $G$ that contains no induced copy of $F$ has a homogeneous set of size at least $n^ε$. We consider a variant of the Erdős-Hajnal problem for hypergraphs where we forbid a family of hypergraphs described by their orders and sizes. For graphs, we observe that if we forbid induced subgraphs on $m$ vertices and $f$ edges for any positive $m$ and $0\leq f \leq \binom{m}{2}$, then we obtain large homogeneous sets. For triple systems, in the first nontrivial case $m=4$, for every $S \subseteq \{0,1,2,3,4\}$, we give bounds on the minimum size of a homogeneous set in a triple system where the number of edges spanned by every four vertices is not in $S$. For all $S$ we determine if the growth rate is polylogarithmic. Several open problems remain. △ Less

Submitted 16 March, 2023; originally announced March 2023.

MSC Class: 05

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset

Authors: Hugo Laurençon, Lucile Saulnier, Thomas Wang, Christopher Akiki, Albert Villanova del Moral, Teven Le Scao, Leandro Von Werra, Chenghao Mou, Eduardo González Ponferrada, Huu Nguyen, Jörg Frohberg, Mario Šaško, Quentin Lhoest, Angelina McMillan-Major, Gerard Dupont, Stella Biderman, Anna Rogers, Loubna Ben allal, Francesco De Toni, Giada Pistilli, Olivier Nguyen, Somaieh Nikpoor, Maraim Masoud, Pierre Colombo, Javier de la Rosa , et al. (29 additional authors not shown)

Abstract: As language models grow ever larger, the need for large-scale high-quality text datasets has never been more pressing, especially in multilingual settings. The BigScience workshop, a 1-year international and multidisciplinary initiative, was formed with the goal of researching and training large language models as a values-driven undertaking, putting issues of ethics, harm, and governance in the f… ▽ More As language models grow ever larger, the need for large-scale high-quality text datasets has never been more pressing, especially in multilingual settings. The BigScience workshop, a 1-year international and multidisciplinary initiative, was formed with the goal of researching and training large language models as a values-driven undertaking, putting issues of ethics, harm, and governance in the foreground. This paper documents the data creation and curation efforts undertaken by BigScience to assemble the Responsible Open-science Open-collaboration Text Sources (ROOTS) corpus, a 1.6TB dataset spanning 59 languages that was used to train the 176-billion-parameter BigScience Large Open-science Open-access Multilingual (BLOOM) language model. We further release a large initial subset of the corpus and analyses thereof, and hope to empower large-scale monolingual and multilingual modeling projects with both the data and the processing tools, as well as stimulate research around this large multilingual corpus. △ Less

Submitted 7 March, 2023; originally announced March 2023.

Comments: NeurIPS 2022, Datasets and Benchmarks Track

ACM Class: I.2.7

Cavity-renormalized quantum criticality in a honeycomb bilayer antiferromagnet

Authors: Lukas Weber, Emil Viñas Boström, Martin Claassen, Angel Rubio, Dante M. Kennes

Abstract: Strong light-matter interactions as realized in an optical cavity provide a tantalizing opportunity to control the properties of condensed matter systems. Inspired by experimental advances in cavity quantum electrodynamics and the fabrication and control of two-dimensional magnets, we investigate the fate of a quantum critical antiferromagnet coupled to an optical cavity field. Using unbiased quan… ▽ More Strong light-matter interactions as realized in an optical cavity provide a tantalizing opportunity to control the properties of condensed matter systems. Inspired by experimental advances in cavity quantum electrodynamics and the fabrication and control of two-dimensional magnets, we investigate the fate of a quantum critical antiferromagnet coupled to an optical cavity field. Using unbiased quantum Monte Carlo simulations, we compute the scaling behavior of the magnetic structure factor and other observables. While the position and universality class are not changed by a single cavity mode, the critical fluctuations themselves obtain a sizable enhancement, scaling with a fractional exponent that defies expectations based on simple perturbation theory. The scaling exponent can be understood using a generic scaling argument, based on which we predict that the effect may be even stronger in other universality classes. Our microscopic model is based on realistic parameters for two-dimensional magnetic quantum materials and the effect may be within the range of experimental detection. △ Less

Submitted 16 February, 2023; originally announced February 2023.

Comments: 16 pages, 10 figures

Journal ref: Communications Physics 6, 247 (2023)

Revisiting the atmosphere of the exoplanet 51 Eridani b with VLT/SPHERE

Authors: S. B. Brown-Sevilla, A. -L. Maire, P. Mollière, M. Samland, M. Feldt, W. Brandner, Th. Henning, R. Gratton, M. Janson, T. Stolker, J. Hagelberg, A. Zurlo, F. Cantalloube, A. Boccaletti, M. Bonnefoy, G. Chauvin, S. Desidera, V. D'Orazi, A. -M. Lagrange, M. Langlois, F. Menard, D. Mesa, M. Meyer, A. Pavlov, C. Petit , et al. (5 additional authors not shown)

Abstract: [Full abstract in the paper] We aim to better constrain the atmospheric properties of the directly imaged exoplanet 51~Eri~b by using a retrieval approach on higher signal-to-noise data than previously reported. In this context, we also compare the results of using the atmospheric retrieval code \texttt{petitRADTRANS} vs a self-consistent model to fit atmospheric parameters. We present a higher si… ▽ More [Full abstract in the paper] We aim to better constrain the atmospheric properties of the directly imaged exoplanet 51~Eri~b by using a retrieval approach on higher signal-to-noise data than previously reported. In this context, we also compare the results of using the atmospheric retrieval code \texttt{petitRADTRANS} vs a self-consistent model to fit atmospheric parameters. We present a higher signal-to-noise $YH$ spectrum of the planet and revised $K1K2$ photometry (M$_{K1} = 15.11 \pm 0.04$ mag, M$_{K2} = 17.11 \pm 0.38$ mag). The best-fit parameters obtained using an atmospheric retrieval differ from previous results using self-consistent models. In general, we find that our solutions tend towards cloud-free atmospheres (e.g. log $τ_{\rm clouds} = -5.20 \pm 1.44$). For our ``nominal'' model with new data, we find a lower metallicity ([Fe/H] $= 0.26\pm$0.30 dex) and C/O ratio ($0.38\pm0.09$), and a slightly higher effective temperature (T$_{\rm{eff}} = 807\pm$45 K) than previous studies. The surface gravity (log $g = 4.05\pm0.37$) is in agreement with the reported values in the literature within uncertainties. We estimate the mass of the planet to be between 2 and 4 M$_{\rm{Jup}}$. When comparing with self-consistent models, we encounter a known correlation between the presence of clouds and the shape of the $P-T$ profiles. Our findings support the idea that results from atmospheric retrievals should not be discussed in isolation, but rather along with self-consistent temperature structures obtained using the retrieval's best-fit parameters. △ Less

Submitted 25 November, 2022; originally announced November 2022.

Comments: Accepted for publication in A&A. 21 pages, 7 figures in the main text and 9 figures in the Appendix

Journal ref: A&A 673, A98 (2023)

Shortcomings of Top-Down Randomization-Based Sanity Checks for Evaluations of Deep Neural Network Explanations

Authors: Alexander Binder, Leander Weber, Sebastian Lapuschkin, Grégoire Montavon, Klaus-Robert Müller, Wojciech Samek

Abstract: While the evaluation of explanations is an important step towards trustworthy models, it needs to be done carefully, and the employed metrics need to be well-understood. Specifically model randomization testing is often overestimated and regarded as a sole criterion for selecting or discarding certain explanation methods. To address shortcomings of this test, we start by observing an experimental… ▽ More While the evaluation of explanations is an important step towards trustworthy models, it needs to be done carefully, and the employed metrics need to be well-understood. Specifically model randomization testing is often overestimated and regarded as a sole criterion for selecting or discarding certain explanation methods. To address shortcomings of this test, we start by observing an experimental gap in the ranking of explanation methods between randomization-based sanity checks [1] and model output faithfulness measures (e.g. [25]). We identify limitations of model-randomization-based sanity checks for the purpose of evaluating explanations. Firstly, we show that uninformative attribution maps created with zero pixel-wise covariance easily achieve high scores in this type of checks. Secondly, we show that top-down model randomization preserves scales of forward pass activations with high probability. That is, channels with large activations have a high probility to contribute strongly to the output, even after randomization of the network on top of them. Hence, explanations after randomization can only be expected to differ to a certain extent. This explains the observed experimental gap. In summary, these results demonstrate the inadequacy of model-randomization-based sanity checks as a criterion to rank attribution methods. △ Less

Submitted 22 November, 2022; originally announced November 2022.

Comments: 23 pages

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Authors: BigScience Workshop, :, Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilić, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, Jonathan Tow, Alexander M. Rush, Stella Biderman, Albert Webson, Pawan Sasanka Ammanamanchi, Thomas Wang, Benoît Sagot, Niklas Muennighoff, Albert Villanova del Moral, Olatunji Ruwase, Rachel Bawden, Stas Bekman, Angelina McMillan-Major , et al. (369 additional authors not shown)

Abstract: Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access… ▽ More Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License. △ Less

Submitted 27 June, 2023; v1 submitted 9 November, 2022; originally announced November 2022.

Thermal critical points from competing singlet formations in fully frustrated bilayer antiferromagnets

Authors: Lukas Weber, Antoine Yves Dimitri Fache, Frédéric Mila, Stefan Wessel

Abstract: We examine the ground-state phase diagram and thermal phase transitions in a plaquettized fully frustrated bilayer spin-1/2 Heisenberg model. Based on a combined analysis from sign-problem free quantum Monte Carlo simulations, perturbation theory and free-energy arguments, we identify a first-order quantum phase transition line that separates two competing quantum-disordered ground states with dom… ▽ More We examine the ground-state phase diagram and thermal phase transitions in a plaquettized fully frustrated bilayer spin-1/2 Heisenberg model. Based on a combined analysis from sign-problem free quantum Monte Carlo simulations, perturbation theory and free-energy arguments, we identify a first-order quantum phase transition line that separates two competing quantum-disordered ground states with dominant singlet formations on inter-layer dimers and plaquettes, respectively. At finite temperatures, this line extends to form a wall of first-order thermal transitions, which terminates in a line of thermal critical points. From a perturbative approach in terms of an effective Ising model description, we identify a quadratic suppression of the critical temperature scale in the strongly plaquettized region. Based on free-energy arguments we furthermore obtain the full phase boundary of the low-temperature dimer-singlet regime, which agrees well with the quantum Monte Carlo data. △ Less

Submitted 17 October, 2022; originally announced October 2022.

Comments: 7 pages, 6 figures

The interplay between forming planets and photo-evaporating discs I: Forbidden line diagnostics

Authors: Michael L. Weber, Barbara Ercolano, Giovanni Picogna, Christian Rab

Abstract: Disc winds and planet formation are considered to be two of the most important mechanisms that drive the evolution and dispersal of protoplanetary discs and in turn define the environment in which planets form and evolve. While both have been studied extensively in the past, we combine them into one model by performing three-dimensional radiation-hydrodynamic simulations of giant planet hosting di… ▽ More Disc winds and planet formation are considered to be two of the most important mechanisms that drive the evolution and dispersal of protoplanetary discs and in turn define the environment in which planets form and evolve. While both have been studied extensively in the past, we combine them into one model by performing three-dimensional radiation-hydrodynamic simulations of giant planet hosting discs that are undergoing X-ray photo-evaporation, with the goal to analyse the interactions between both mechanisms. In order to study the effect on observational diagnostics, we produce synthetic observations of commonly used wind-tracing forbidden emission lines with detailed radiative transfer and photo-ionisation calculations. We find that a sufficiently massive giant planet carves a gap in the gas disc that is deep enough to affect the structure and kinematics of the pressure-driven photo-evaporative wind significantly. This effect can be strong enough to be visible in the synthetic high-resolution observations of some of our wind diagnostic lines, such as the [OI] 6300 Å or [SII] 6730 Å lines. When the disc is observed at inclinations around 40° and higher, the spectral line profiles may exhibit a peak in the redshifted part of the spectrum, which cannot easily be explained by simple wind models alone. Moreover, massive planets can induce asymmetric substructures within the disc and the photo-evaporative wind, giving rise to temporal variations of the line profiles that can be strong enough to be observable on timescales of less than a quarter of the planet's orbital period. △ Less

Submitted 12 October, 2022; originally announced October 2022.

Comments: Accepted for publication in MNRAS. 13+3 pages, 8+1 figures

Unavoidable order-size pairs in hypergraphs -- positive forcing density

Authors: Maria Axenovich, József Balogh, Felix Christian Clemen, Lea Weber

Abstract: Erdős, Füredi, Rothschild and Sós initiated a study of classes of graphs that forbid every induced subgraph on a given number $m$ of vertices and number $f$ of edges. Extending their notation to $r$-graphs, we write $(n,e) \to_r (m,f)$ if every $r$-graph $G$ on $n$ vertices with $e$ edges has an induced subgraph on $m$ vertices and $f$ edges. The \emph{forcing density} of a pair $(m,f)$ is… ▽ More Erdős, Füredi, Rothschild and Sós initiated a study of classes of graphs that forbid every induced subgraph on a given number $m$ of vertices and number $f$ of edges. Extending their notation to $r$-graphs, we write $(n,e) \to_r (m,f)$ if every $r$-graph $G$ on $n$ vertices with $e$ edges has an induced subgraph on $m$ vertices and $f$ edges. The \emph{forcing density} of a pair $(m,f)$ is $$ σ_r(m,f) =\left. \limsup\limits_{n \to \infty} \frac{|\{e : (n,e) \to_r (m,f)\}|}{\binom{n}{r}} \right. .$$ In the graph setting it is known that there are infinitely many pairs $(m, f)$ with positive forcing density. Weber asked if there is a pair of positive forcing density for $r\geq 3$ apart from the trivial ones $(m, 0)$ and $(m, \binom{m}{r})$. Answering her question, we show that $(6,10)$ is such a pair for $r=3$ and conjecture that it is the unique such pair. Further, we find necessary conditions for a pair to have positive forcing density, supporting this conjecture. △ Less

Submitted 13 August, 2022; originally announced August 2022.

SHAARP: An Open-Source Package for Analytical and Numerical Modeling of Optical Second Harmonic Generation in Anisotropic Crystals

Authors: Rui Zu, Bo Wang, Jingyang He, Jian-Jun Wang, Lincoln Weber, Long-Qing Chen, Venkatraman Gopalan

Abstract: Optical second harmonic generation is a second-order nonlinear process that combines two photons of a given frequency into a third photon at twice the frequency. Due to the symmetry constraints, it is widely used as a sensitive probe to detect broken inversion symmetry and local polar order. Analytical modeling of the electric-dipole SHG response is essential to extract fundamental properties of m… ▽ More Optical second harmonic generation is a second-order nonlinear process that combines two photons of a given frequency into a third photon at twice the frequency. Due to the symmetry constraints, it is widely used as a sensitive probe to detect broken inversion symmetry and local polar order. Analytical modeling of the electric-dipole SHG response is essential to extract fundamental properties of materials from experiments. However, complexity builds up dramatically in the analytical model when the probed crystal is of a low bulk crystal symmetry, with a low-symmetry surface orientation, exhibits absorption and dispersion, and consists of multiple interfaces. As a result, there is a largely uneven landscape in the literature on the SHG modeling of new materials, involving numerous approximations and a wide range of (in)accuracies, leading to a rather scattered dataset of reported SHG nonlinear susceptibility. Towards streamlining the reliability and accuracy of this process, we have developed an open-source package called the Second Harmonic Analysis of Anisotropic Rotational Polarimetry (SHAARP) which derives analytical solutions and performs numerical simulations of reflection SHG from a single interface for homogeneous crystals. Five key generalizations in SHG modeling are implemented, including all crystal symmetries down to triclinic, any crystal orientation, complex dielectric tensor (refractive indices) with frequency dispersion, and general polarization states of the light. SHAARP enables accurate anisotropic modeling of SHG response for a broad range of materials systems. The method is extendible to multiple interfaces. The code is free to download from https://github.com/Rui-Zu/SHAARP △ Less

Submitted 1 September, 2022; v1 submitted 7 August, 2022; originally announced August 2022.

BigBIO: A Framework for Data-Centric Biomedical Natural Language Processing

Authors: Jason Alan Fries, Leon Weber, Natasha Seelam, Gabriel Altay, Debajyoti Datta, Samuele Garda, Myungsun Kang, Ruisi Su, Wojciech Kusa, Samuel Cahyawijaya, Fabio Barth, Simon Ott, Matthias Samwald, Stephen Bach, Stella Biderman, Mario Sänger, Bo Wang, Alison Callahan, Daniel León Periñán, Théo Gigant, Patrick Haller, Jenny Chim, Jose David Posada, John Michael Giorgi, Karthik Rangasai Sivaraman , et al. (18 additional authors not shown)

Abstract: Training and evaluating language models increasingly requires the construction of meta-datasets --diverse collections of curated data with clear provenance. Natural language prompting has recently lead to improved zero-shot generalization by transforming existing, supervised datasets into a diversity of novel pretraining tasks, highlighting the benefits of meta-dataset curation. While successful i… ▽ More Training and evaluating language models increasingly requires the construction of meta-datasets --diverse collections of curated data with clear provenance. Natural language prompting has recently lead to improved zero-shot generalization by transforming existing, supervised datasets into a diversity of novel pretraining tasks, highlighting the benefits of meta-dataset curation. While successful in general-domain text, translating these data-centric approaches to biomedical language modeling remains challenging, as labeled biomedical datasets are significantly underrepresented in popular data hubs. To address this challenge, we introduce BigBIO a community library of 126+ biomedical NLP datasets, currently covering 12 task categories and 10+ languages. BigBIO facilitates reproducible meta-dataset curation via programmatic access to datasets and their metadata, and is compatible with current platforms for prompt engineering and end-to-end few/zero shot language model evaluation. We discuss our process for task schema harmonization, data auditing, contribution guidelines, and outline two illustrative use cases: zero-shot evaluation of biomedical prompts and large-scale, multi-task learning. BigBIO is an ongoing community effort and is available at https://github.com/bigscience-workshop/biomedical △ Less

Submitted 30 June, 2022; originally announced June 2022.

Comments: Submitted to NeurIPS 2022 Datasets and Benchmarks Track

Absolutely avoidable order-size pairs in hypergraphs

Authors: Lea Weber

Abstract: For fixed integer $r\ge 2$, we call a pair $(m,f)$ of integers, $m\geq 1$, $0\leq f \leq \binom{m}{r}$, $absolutely$ $avoidable$ if there is $n_0$, such that for any pair of integers $(n,e)$ with $n>n_0$ and $0\leq e\leq \binom{n}{r}$ there is an $r$-uniform hypergraph on $n$ vertices and $e$ edges that contains no induced sub-hypergraph on $m$ vertices and $f$ edges. Some pairs are clearly not ab… ▽ More For fixed integer $r\ge 2$, we call a pair $(m,f)$ of integers, $m\geq 1$, $0\leq f \leq \binom{m}{r}$, $absolutely$ $avoidable$ if there is $n_0$, such that for any pair of integers $(n,e)$ with $n>n_0$ and $0\leq e\leq \binom{n}{r}$ there is an $r$-uniform hypergraph on $n$ vertices and $e$ edges that contains no induced sub-hypergraph on $m$ vertices and $f$ edges. Some pairs are clearly not absolutely avoidable, for example $(m,0)$ is not absolutely avoidable since any sufficiently sparse hypergraph on at least $m$ vertices contains independent sets on $m$ vertices. Here we show that for any $r\ge 3$ and $m \ge m_0$, either the pair $(m, \lfloor\binom mr/2\rfloor)$ or the pair $(m, \lfloor\binom{m}{r}/2\rfloor-m-1)$ is absolutely avoidable. Next, following the definition of Erdős, Füredi, Rothschild and Sós, we define the $density$ of a pair $(m,f)$ as $σ_r(m,f) = \limsup_{n \to \infty} \frac{|\{e : (n,e) \to (m,f)\}|}{\binom mr}$. We show that for $ r\ge 3$ most pairs $(m,f)$ satisfy $σ_r(m,f)=0$, and that for $m > r$, there exists no pair $(m,f)$ of density 1. △ Less

Submitted 1 August, 2022; v1 submitted 30 May, 2022; originally announced May 2022.

Explain to Not Forget: Defending Against Catastrophic Forgetting with XAI

Authors: Sami Ede, Serop Baghdadlian, Leander Weber, An Nguyen, Dario Zanca, Wojciech Samek, Sebastian Lapuschkin

Abstract: The ability to continuously process and retain new information like we do naturally as humans is a feat that is highly sought after when training neural networks. Unfortunately, the traditional optimization algorithms often require large amounts of data available during training time and updates wrt. new data are difficult after the training process has been completed. In fact, when new data or ta… ▽ More The ability to continuously process and retain new information like we do naturally as humans is a feat that is highly sought after when training neural networks. Unfortunately, the traditional optimization algorithms often require large amounts of data available during training time and updates wrt. new data are difficult after the training process has been completed. In fact, when new data or tasks arise, previous progress may be lost as neural networks are prone to catastrophic forgetting. Catastrophic forgetting describes the phenomenon when a neural network completely forgets previous knowledge when given new information. We propose a novel training algorithm called training by explaining in which we leverage Layer-wise Relevance Propagation in order to retain the information a neural network has already learned in previous tasks when training on new data. The method is evaluated on a range of benchmark datasets as well as more complex data. Our method not only successfully retains the knowledge of old tasks within the neural networks but does so more resource-efficiently than other state-of-the-art solutions. △ Less

Submitted 22 June, 2022; v1 submitted 4 May, 2022; originally announced May 2022.

Comments: 14 pages including appendix, 5 figures, 2 tables, 1 algorithm listing. v2 update increases figure readability, updates Fig 5 caption, adds our collaborators Dario and An as co-authors v3 brings the preprint in line with the final version accepted for peer-reviewed publication at CD-MAKE 2022. v4 metadata update

Chemical Strain Engineering of MAPbI3 Perovskite Films

Authors: Yenal Yalcinkaya, Ilka M. Hermes, Tobias Seewald, Katrin Amann-Winkel, Lothar Veith, Lukas Schmidt-Mende, Stefan A. L. Weber

Abstract: This study introduces a new chemical method for controlling the strain in methylammonium lead iodide (MAPbI3) perovskite crystals by varying the ratio of Pb(Ac)2 and PbCl2 in the precursor solution. To observe the effect on crystal strain, a combination of piezoresponse force microscopy (PFM) and X-ray diffraction (XRD) is used. The PFM images show an increase in the average size of ferroelastic t… ▽ More This study introduces a new chemical method for controlling the strain in methylammonium lead iodide (MAPbI3) perovskite crystals by varying the ratio of Pb(Ac)2 and PbCl2 in the precursor solution. To observe the effect on crystal strain, a combination of piezoresponse force microscopy (PFM) and X-ray diffraction (XRD) is used. The PFM images show an increase in the average size of ferroelastic twin domains upon increasing the PbCl2 content, indicating an increase in crystal strain. The XRD spectra support this observation with strong crystal twinning features that appear in the spectra. This behaviour is caused by a strain gradient during the crystallization due to different evaporation rates of methylammonium acetate and methylammonium chloride as revealed by time-of-flight secondary ion mass spectroscopy (ToF-SIMS) and grazing incidince x-ray diffraction (GIXRD) measurements. Additional time-resolved photoluminescence (TRPL) show an increased carrier lifetime in the MAPbI3 films prepared with higher PbCl2 content, suggesting a decreased trap density in films with larger twin domain structures. The results demonstrate the potential of chemical strain engineering as an easy method for controlling strain-related effects in lead halide perovskites. △ Less

Submitted 30 April, 2022; originally announced May 2022.

Cluster quantum Monte Carlo study of two-dimensional weakly-coupled frustrated trimer antiferromagnets

Authors: Lukas Weber, Nils Caci, Stefan Wessel

Abstract: We report results from spin trimer-based cluster quantum Monte Carlo simulations for the thermodynamic properties of two-dimensional frustrated quantum antiferromagnets that are composed of weakly-coupled three-spin (trimer) clusters. In particular, we consider the spin-1/2 kagome lattice with a strong breathing distortion, and the triangle-square lattice model proposed previously for the cuprate… ▽ More We report results from spin trimer-based cluster quantum Monte Carlo simulations for the thermodynamic properties of two-dimensional frustrated quantum antiferromagnets that are composed of weakly-coupled three-spin (trimer) clusters. In particular, we consider the spin-1/2 kagome lattice with a strong breathing distortion, and the triangle-square lattice model proposed previously for the cuprate La${}_4$Cu${}_3$MoO${}_{12}$. For both cases, we demonstrate that an appropriately chosen trimer-based computational basis allows us to significantly reduce the quantum Monte Carlo sign problem down to the low-temperature regime. Besides exploring the thermodynamic behavior for the triangle-square lattice model we also assess a mean field theory-based prediction for the onset of chiral order. For the breathing distorted kagome lattice model, we observe a robust two-peak structure in the specific heat, both in the quantum spin liquid and the lattice-nematic regimes. △ Less

Submitted 30 March, 2022; v1 submitted 29 March, 2022; originally announced March 2022.

Comments: 10 pages, 12 figures

Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvement

Authors: Leander Weber, Sebastian Lapuschkin, Alexander Binder, Wojciech Samek

Abstract: Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. Despite the development of a multitude of methods to explain the decisions of black-box classifiers in recent years, these tools are seldomly used beyond visualization purposes. Only recently, researchers have started to employ explanations in pra… ▽ More Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. Despite the development of a multitude of methods to explain the decisions of black-box classifiers in recent years, these tools are seldomly used beyond visualization purposes. Only recently, researchers have started to employ explanations in practice to actually improve models. This paper offers a comprehensive overview over techniques that apply XAI practically for improving various properties of ML models, and systematically categorizes these approaches, comparing their respective strengths and weaknesses. We provide a theoretical perspective on these methods, and show empirically through experiments on toy and realistic settings how explanations can help improve properties such as model generalization ability or reasoning, among others. We further discuss potential caveats and drawbacks of these methods. We conclude that while model improvement based on XAI can have significant beneficial effects even on complex and not easily quantifyable model properties, these methods need to be applied carefully, since their success can vary depending on a multitude of factors, such as the model and dataset used, or the employed explanation method. △ Less

Submitted 15 March, 2022; originally announced March 2022.

Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyond

Authors: Anna Hedström, Leander Weber, Dilyara Bareeva, Daniel Krakowczyk, Franz Motzkus, Wojciech Samek, Sebastian Lapuschkin, Marina M. -C. Höhne

Abstract: The evaluation of explanation methods is a research topic that has not yet been explored deeply, however, since explainability is supposed to strengthen trust in artificial intelligence, it is necessary to systematically review and compare explanation methods in order to confirm their correctness. Until now, no tool with focus on XAI evaluation exists that exhaustively and speedily allows research… ▽ More The evaluation of explanation methods is a research topic that has not yet been explored deeply, however, since explainability is supposed to strengthen trust in artificial intelligence, it is necessary to systematically review and compare explanation methods in order to confirm their correctness. Until now, no tool with focus on XAI evaluation exists that exhaustively and speedily allows researchers to evaluate the performance of explanations of neural network predictions. To increase transparency and reproducibility in the field, we therefore built Quantus -- a comprehensive, evaluation toolkit in Python that includes a growing, well-organised collection of evaluation metrics and tutorials for evaluating explainable methods. The toolkit has been thoroughly tested and is available under an open-source license on PyPi (or on https://github.com/understandable-machine-intelligence-lab/Quantus/). △ Less

Submitted 27 April, 2023; v1 submitted 14 February, 2022; originally announced February 2022.

Comments: 4 pages, 1 figure, 1 table

Journal ref: Journal of Machine Learning Research, Vol. 24 (2023) 1-11

Measurably Stronger Explanation Reliability via Model Canonization

Authors: Franz Motzkus, Leander Weber, Sebastian Lapuschkin

Abstract: While rule-based attribution methods have proven useful for providing local explanations for Deep Neural Networks, explaining modern and more varied network architectures yields new challenges in generating trustworthy explanations, since the established rule sets might not be sufficient or applicable to novel network structures. As an elegant solution to the above issue, network canonization has… ▽ More While rule-based attribution methods have proven useful for providing local explanations for Deep Neural Networks, explaining modern and more varied network architectures yields new challenges in generating trustworthy explanations, since the established rule sets might not be sufficient or applicable to novel network structures. As an elegant solution to the above issue, network canonization has recently been introduced. This procedure leverages the implementation-dependency of rule-based attributions and restructures a model into a functionally identical equivalent of alternative design to which established attribution rules can be applied. However, the idea of canonization and its usefulness have so far only been explored qualitatively. In this work, we quantitatively verify the beneficial effects of network canonization to rule-based attributions on VGG-16 and ResNet18 models with BatchNorm layers and thus extend the current best practices for obtaining reliable neural network explanations. △ Less

Submitted 14 February, 2022; originally announced February 2022.

Comments: 5 pages, 4 figures

Adaptive two capacitor model to describe slide electrification in moving water drops

Authors: Pravash Bista, Amy Z. Stetten, William S. Y Wong, Hans-Jürgen Butt, Stefan A. L. Weber

Abstract: Slide electrification is a spontaneous charge separation between a surface and a sliding drop. Here, we describe this effect in terms of a voltage generated at the three-phase contact line. This voltage moves charges between capacitors, one formed by the drop and one on the surface. By introducing an adaptation of the voltage upon water contact, we can model drop charge experiments on many surface… ▽ More Slide electrification is a spontaneous charge separation between a surface and a sliding drop. Here, we describe this effect in terms of a voltage generated at the three-phase contact line. This voltage moves charges between capacitors, one formed by the drop and one on the surface. By introducing an adaptation of the voltage upon water contact, we can model drop charge experiments on many surfaces, including more exotic ones with drop-rate dependent charge polarity. Thus, the adaptive two capacitor model enables new insights into the molecular details of the charge separation mechanism. △ Less

Submitted 26 February, 2024; v1 submitted 8 February, 2022; originally announced February 2022.

Comments: The experimental results are accurate, but the physical model proposed in the paper does not fully capture the underlying physics behind the data. We are actively working to develop an improved model that better describes the experimental observations

Navigating Neural Space: Revisiting Concept Activation Vectors to Overcome Directional Divergence

Authors: Frederik Pahde, Maximilian Dreyer, Leander Weber, Moritz Weckbecker, Christopher J. Anders, Thomas Wiegand, Wojciech Samek, Sebastian Lapuschkin

Abstract: With a growing interest in understanding neural network prediction strategies, Concept Activation Vectors (CAVs) have emerged as a popular tool for modeling human-understandable concepts in the latent space. Commonly, CAVs are computed by leveraging linear classifiers optimizing the separability of latent representations of samples with and without a given concept. However, in this paper we show t… ▽ More With a growing interest in understanding neural network prediction strategies, Concept Activation Vectors (CAVs) have emerged as a popular tool for modeling human-understandable concepts in the latent space. Commonly, CAVs are computed by leveraging linear classifiers optimizing the separability of latent representations of samples with and without a given concept. However, in this paper we show that such a separability-oriented computation leads to solutions, which may diverge from the actual goal of precisely modeling the concept direction. This discrepancy can be attributed to the significant influence of distractor directions, i.e., signals unrelated to the concept, which are picked up by filters (i.e., weights) of linear models to optimize class-separability. To address this, we introduce pattern-based CAVs, solely focussing on concept signals, thereby providing more accurate concept directions. We evaluate various CAV methods in terms of their alignment with the true concept direction and their impact on CAV applications, including concept sensitivity testing and model correction for shortcut behavior caused by data artifacts. We demonstrate the benefits of pattern-based CAVs using the Pediatric Bone Age, ISIC2019, and FunnyBirds datasets with VGG, ResNet, and EfficientNet model architectures. △ Less

Submitted 5 February, 2024; v1 submitted 7 February, 2022; originally announced February 2022.

A Localized-Orbital Energy Evaluation for Auxiliary-Field Quantum Monte Carlo

Authors: John L. Weber, Hung Vuong, Pierre A. Devlaminck, James Shee, Joonho Lee, David R. Reichman, Richard A. Friesner

Abstract: Phaseless Auxiliary-Field Quantum Monte Carlo (ph-AFQMC) has recently emerged as a promising method for the production of benchmark-level simulations of medium to large-sized molecules, due to its accuracy and favorable polynomial scaling with system size. Unfortunately the memory footprint of standard energy evaluation algorithms are non-trivial, which can significantly impact timings on graphica… ▽ More Phaseless Auxiliary-Field Quantum Monte Carlo (ph-AFQMC) has recently emerged as a promising method for the production of benchmark-level simulations of medium to large-sized molecules, due to its accuracy and favorable polynomial scaling with system size. Unfortunately the memory footprint of standard energy evaluation algorithms are non-trivial, which can significantly impact timings on graphical processing units (GPUs) where memory is limited. Previous attempts to reduce scaling by taking advantage of the low rank structure of the Coulombic integrals have been successful, but are significantly limited by high prefactors, rendering the utility limited to very large systems. Here, we present a complementary, cubic scaling route to reduce memory and computational scaling based on the low rank of the Coulombic interactions between localized orbitals, focusing on the application to phaseless AFQMC. We show that the error due to this approximation, which we term Localized Orbital AFQMC (LO-AFQMC), is systematic and controllable via a single variable, and is computationally favorable even for small systems. We present results demonstrating a robust retention of accuracy versus both experiment and full ph-AFQMC for a variety of test cases chosen for their potential difficulty for localized orbital based methods, including the singlet-triplet gaps of polyacenes benzene through pentacene, the heats of formation for a set of platonic hydrocarbon cages, and the total energy of ferrocene (Fe(Cp)$_2$). Finally, we reproduce our previous result of the gas phase ionization energy of Ni(Cp)$_2$, agreeing with full ph-AFQMC to within statistical error while using less than a fifteenth of the computer time. △ Less

Submitted 4 April, 2022; v1 submitted 1 February, 2022; originally announced February 2022.

Comments: 36 pages, 8 figures; Supplemental Info, 11 pages, 1 figure

PLANETAMOS, A Physics Show Musical (Phyusical)

Authors: Lara Becker, Erik Busley, Jakob Dietl, Herbi K. Dreiner, Till Fohrmann, Kathrin Grunthal, Jana Heysel, Finn Jaekel, Kristoffer Kerkhof, Michael Kortmann, Barbara Leibrock, Viola Middelhauve, Steffi Moll, David Ohse, Johann Ostmeyer, Laura Rodríguez Gómez, Christoph Schürmann, Anne Stockhausen, Joshua Streichhahn, Carsten Urbach, Heinrich von Campe, Alexandra Wald, Laura Weber, Inga Woeste

Abstract: We present a physics show musical with live physics experiments and live performed songs with live orchestral accompaniment. The musical was first put on stage in German at the Physikalische Institut, University of Bonn, on the 24th of March, 2019. Here we present the original German script as well as an English translation, including a translation of the songs. We also give brief descriptions of… ▽ More We present a physics show musical with live physics experiments and live performed songs with live orchestral accompaniment. The musical was first put on stage in German at the Physikalische Institut, University of Bonn, on the 24th of March, 2019. Here we present the original German script as well as an English translation, including a translation of the songs. We also give brief descriptions of all the experiments employed, with photos as well as how we present the experiments. The musical tells the story of a couple, Life and Death, nicknamed Vita and Mortis, who want to buy a planet where they can settle down and raise a family. They arrive at the store Planetamos, run by the manager Luna Callisto and the scientist Jupi Mercury. The latter two present to Vita and Mortis what is required for life on a planet, as well as all of the extra features for sale, to make it that very special place for their family. Through Vita and Mortis the audience learns about the physical requirements for life on a planet orbiting a star. The show involves 14 live physics experiments. The four actors sing 7 songs, which are to well-known tunes with new lyrics, in German. During the show the singers are accompanied by a small live orchestra, consisting of a flute, an oboe, a piano, a violin, a cello, a harp and percussion. The show was developed by the University of Bonn physics students, who have all been very active in the University of Bonn Physics Show (Physikshow der Universitaet Bonn) the past few years. To the best of our knowledge this is the first physics show musical with live experiments and live song and orchestra. △ Less

Submitted 26 January, 2022; originally announced January 2022.

Comments: 86 pages, 18 figures

Quantum Monte Carlo simulations of highly frustrated magnets in a cluster basis: The two-dimensional Shastry-Sutherland model

Authors: Andreas Honecker, Lukas Weber, Philippe Corboz, Frédéric Mila, Stefan Wessel

Abstract: Quantum Monte Carlo (QMC) simulations constitute nowadays one of the most powerful methods to study strongly correlated quantum systems, provided that no "sign problem" arises. However, many systems of interest, including highly frustrated magnets, suffer from an average sign that is close to zero in standard QMC simulations. Nevertheless, a possible sign problem depends on the simulation basis, a… ▽ More Quantum Monte Carlo (QMC) simulations constitute nowadays one of the most powerful methods to study strongly correlated quantum systems, provided that no "sign problem" arises. However, many systems of interest, including highly frustrated magnets, suffer from an average sign that is close to zero in standard QMC simulations. Nevertheless, a possible sign problem depends on the simulation basis, and here we demonstrate how a suitable choice of cluster basis can be used to eliminate or at least reduce the sign problem in highly frustrated magnets that were so far inaccessible to efficient QMC simulations. We focus in particular on the application of a two-spin (dimer)-based QMC method to the thermodynamics of the spin-1/2 Shastry-Sutherland model for SrCu$_2$(BO$_3$)$_2$. △ Less

Submitted 29 December, 2021; v1 submitted 6 December, 2021; originally announced December 2021.

Comments: 6 pages including 4 figures; to appear in the proceedings of the XXXII IUPAP Conference on Computational Physics (CCP2021); v2: list of authors changed

Journal ref: J. Phys.: Conf. Ser. 2207 (2022) 012032

An extended scattered light disk around AT Pyx -- Possible planet formation in a cometary globule

Authors: C. Ginski, R. Gratton, A. Bohn, C. Dominik, S. Jorquera, G. Chauvin, J. Milli, M. Rodriguez, M. Benisty, R. Launhardt, A. Mueller, G. Cugno, R. G. van Holstein, A. Boccaletti, G. A. Muro-Arena, S. Desidera, M. Keppler, A. Zurlo, E. Sissa, T. Henning, M. Janson, M. Langlois, M. Bonnefoy, F. Cantalloube, V. D'Orazi , et al. (13 additional authors not shown)

Abstract: To understand how the multitude of planetary systems that have been discovered come to be, we need to study systems at different evolutionary stages, with different central stars but also in different environments. The most challenging environment for planet formation may be the harsh UV radiation field of nearby massive stars which quickly erodes disks by external photo-evaporation. We have obser… ▽ More To understand how the multitude of planetary systems that have been discovered come to be, we need to study systems at different evolutionary stages, with different central stars but also in different environments. The most challenging environment for planet formation may be the harsh UV radiation field of nearby massive stars which quickly erodes disks by external photo-evaporation. We have observed the AT Pyx system, located in the head of a cometary globule in the Gum Nebula, to search for signs of ongoing planet formation. We used the extreme adaptive optics imager VLT/SPHERE to observe AT Pyx in polarized light as well as total intensity in the J, H and K-band. Additionally we employed VLT/NACO to observe the system in the L-band. We resolve the disk around AT Pyx in scattered light across multiple wavelengths. We find an extended (>126 au) disk, with an intermediate inclination between 35 deg and 42 deg. The disk shows complex sub-structure and we identify 2 and possibly 3 spiral-like features. Depending on the precise geometry of the disk (which we can not unambiguously infer from our data) the disk may be eccentric with an eccentricity of ~0.16 or partially self-shadowed. The spiral features and possible eccentricity are both consistent with signatures of an embedded gas giant planet equal in mass to Jupiter. Our own observations can rule out brown dwarf companions embedded in the resolved disk, but are not sensitive enough to detect gas giants. AT Pyx is the first disk in a cometray globule in the Gum Nebula which is spatially resolved. By comparison with disks in the Orion Nebula Cluster we note that the extension of the disk may be exceptional for this environment if the external UV radiation field is comparable to other cometary globules in the region. The signposts of ongoing planet formation are intriguing and need to be followed up with higher sensitivity. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: 11 pages, 9 figures, accepted for publication in A&A

Journal ref: A&A 662, A74 (2022)