Showing 1–50 of 104 results for author: Brandt, J

TurboEdit: Instant text-based image editing

Authors: Zongze Wu, Nicholas Kolkin, Jonathan Brandt, Richard Zhang, Eli Shechtman

Abstract: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disent… ▽ More We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: Accepted to European Conference on Computer Vision (ECCV), 2024. Project page: https://betterze.github.io/TurboEdit/

The DAMIC-M Low Background Chamber

Authors: I. Arnquist, N. Avalos, P. Bailly, D. Baxter, X. Bertou, M. Bogdan, C. Bourgeois, J. Brandt, A. Cadiou, N. Castello-Mor, A. E. Chavarria, M. Conde, J. Cuevas-Zepeda, A. Dastgheibi-Fard, C. De Dominicis, O. Deligny, R. Desani, M. Dhellot, J. Duarte-Campderros, E. Estrada, D. Florin, N. Gadola, R. Gaior, E. -L. Gkougkousis, J. Gonzalez Sanchez , et al. (45 additional authors not shown)

Abstract: The DArk Matter In CCDs at Modane (DAMIC-M) experiment is designed to search for light dark matter (m$_χ$<10\,GeV/c$^2$) at the Laboratoire Souterrain de Modane (LSM) in France. DAMIC-M will use skipper charge-coupled devices (CCDs) as a kg-scale active detector target. Its single-electron resolution will enable eV-scale energy thresholds and thus world-leading sensitivity to a range of hidden sec… ▽ More The DArk Matter In CCDs at Modane (DAMIC-M) experiment is designed to search for light dark matter (m$_χ$<10\,GeV/c$^2$) at the Laboratoire Souterrain de Modane (LSM) in France. DAMIC-M will use skipper charge-coupled devices (CCDs) as a kg-scale active detector target. Its single-electron resolution will enable eV-scale energy thresholds and thus world-leading sensitivity to a range of hidden sector dark matter candidates. A DAMIC-M prototype, the Low Background Chamber (LBC), has been taking data at LSM since 2022. The LBC provides a low-background environment, which has been used to characterize skipper CCDs, study dark current, and measure radiopurity of materials planned for DAMIC-M. It also allows testing of various subsystems like readout electronics, data acquisition software, and slow control. This paper describes the technical design and performance of the LBC. △ Less

Submitted 25 July, 2024; originally announced July 2024.

Observation of Gravitational Waves from the Coalescence of a $2.5\text{-}4.5~M_\odot$ Compact Object and a Neutron Star

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, A. G. Abac, R. Abbott, I. Abouelfettouh, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, D. Agarwal, M. Agathos, M. Aghaei Abchouyeh, O. D. Aguiar, I. Aguilar, L. Aiello, A. Ain, P. Ajith, S. Akçay, T. Akutsu, S. Albanesi, R. A. Alfaidi, A. Al-Jodah , et al. (1771 additional authors not shown)

Abstract: We report the observation of a coalescing compact binary with component masses $2.5\text{-}4.5~M_\odot$ and $1.2\text{-}2.0~M_\odot$ (all measurements quoted at the 90% credible level). The gravitational-wave signal GW230529_181500 was observed during the fourth observing run of the LIGO-Virgo-KAGRA detector network on 2023 May 29 by the LIGO Livingston Observatory. The primary component of the so… ▽ More We report the observation of a coalescing compact binary with component masses $2.5\text{-}4.5~M_\odot$ and $1.2\text{-}2.0~M_\odot$ (all measurements quoted at the 90% credible level). The gravitational-wave signal GW230529_181500 was observed during the fourth observing run of the LIGO-Virgo-KAGRA detector network on 2023 May 29 by the LIGO Livingston Observatory. The primary component of the source has a mass less than $5~M_\odot$ at 99% credibility. We cannot definitively determine from gravitational-wave data alone whether either component of the source is a neutron star or a black hole. However, given existing estimates of the maximum neutron star mass, we find the most probable interpretation of the source to be the coalescence of a neutron star with a black hole that has a mass between the most massive neutron stars and the least massive black holes observed in the Galaxy. We provisionally estimate a merger rate density of $55^{+127}_{-47}~\text{Gpc}^{-3}\,\text{yr}^{-1}$ for compact binary coalescences with properties similar to the source of GW230529_181500; assuming that the source is a neutron star-black hole merger, GW230529_181500-like sources constitute about 60% of the total merger rate inferred for neutron star-black hole coalescences. The discovery of this system implies an increase in the expected rate of neutron star-black hole mergers with electromagnetic counterparts and provides further evidence for compact objects existing within the purported lower mass gap. △ Less

Submitted 26 July, 2024; v1 submitted 5 April, 2024; originally announced April 2024.

Comments: 45 pages (10 pages author list, 13 pages main text, 1 page acknowledgements, 13 pages appendices, 8 pages bibliography), 17 figures, 16 tables. Update to match version published in The Astrophysical Journal Letters. Data products available from https://zenodo.org/records/10845779

Report number: LIGO-P2300352

Journal ref: ApJL 970, L34 (2024)

Autonomy Loops for Monitoring, Operational Data Analytics, Feedback, and Response in HPC Operations

Authors: Francieli Boito, Jim Brandt, Valeria Cardellini, Philip Carns, Florina M. Ciorba, Hilary Egan, Ahmed Eleliemy, Ann Gentile, Thomas Gruber, Jeff Hanson, Utz-Uwe Haus, Kevin Huck, Thomas Ilsche, Thomas Jakobsche, Terry Jones, Sven Karlsson, Abdullah Mueen, Michael Ott, Tapasya Patki, Ivy Peng, Krishnan Raghavan, Stephen Simms, Kathleen Shoga, Michael Showerman, Devesh Tiwari , et al. (2 additional authors not shown)

Abstract: Many High Performance Computing (HPC) facilities have developed and deployed frameworks in support of continuous monitoring and operational data analytics (MODA) to help improve efficiency and throughput. Because of the complexity and scale of systems and workflows and the need for low-latency response to address dynamic circumstances, automated feedback and response have the potential to be more… ▽ More Many High Performance Computing (HPC) facilities have developed and deployed frameworks in support of continuous monitoring and operational data analytics (MODA) to help improve efficiency and throughput. Because of the complexity and scale of systems and workflows and the need for low-latency response to address dynamic circumstances, automated feedback and response have the potential to be more effective than current human-in-the-loop approaches which are laborious and error prone. Progress has been limited, however, by factors such as the lack of infrastructure and feedback hooks, and successful deployment is often site- and case-specific. In this position paper we report on the outcomes and plans from a recent Dagstuhl Seminar, seeking to carve a path for community progress in the development of autonomous feedback loops for MODA, based on the established formalism of similar (MAPE-K) loops in autonomous computing and self-adaptive systems. By defining and developing such loops for significant cases experienced across HPC sites, we seek to extract commonalities and develop conventions that will facilitate interoperability and interchangeability with system hardware, software, and applications across different sites, and will motivate vendors and others to provide telemetry interfaces and feedback hooks to enable community development and pervasive deployment of MODA autonomy loops. △ Less

Submitted 30 January, 2024; originally announced January 2024.

Reconciling AI Performance and Data Reconstruction Resilience for Medical Imaging

Authors: Alexander Ziller, Tamara T. Mueller, Simon Stieger, Leonhard Feiner, Johannes Brandt, Rickmer Braren, Daniel Rueckert, Georgios Kaissis

Abstract: Artificial Intelligence (AI) models are vulnerable to information leakage of their training data, which can be highly sensitive, for example in medical imaging. Privacy Enhancing Technologies (PETs), such as Differential Privacy (DP), aim to circumvent these susceptibilities. DP is the strongest possible protection for training models while bounding the risks of inferring the inclusion of training… ▽ More Artificial Intelligence (AI) models are vulnerable to information leakage of their training data, which can be highly sensitive, for example in medical imaging. Privacy Enhancing Technologies (PETs), such as Differential Privacy (DP), aim to circumvent these susceptibilities. DP is the strongest possible protection for training models while bounding the risks of inferring the inclusion of training samples or reconstructing the original data. DP achieves this by setting a quantifiable privacy budget. Although a lower budget decreases the risk of information leakage, it typically also reduces the performance of such models. This imposes a trade-off between robust performance and stringent privacy. Additionally, the interpretation of a privacy budget remains abstract and challenging to contextualize. In this study, we contrast the performance of AI models at various privacy budgets against both, theoretical risk bounds and empirical success of reconstruction attacks. We show that using very large privacy budgets can render reconstruction attacks impossible, while drops in performance are negligible. We thus conclude that not using DP -- at all -- is negligent when applying AI models to sensitive data. We deem those results to lie a foundation for further debates on striking a balance between privacy risks and model performance. △ Less

Submitted 5 December, 2023; originally announced December 2023.

Characterizing the efficacy of methods to subtract terrestrial transient noise near gravitational wave events and the effects on parameter estimation

Authors: Sudarshan Ghonge, Joshua Brandt, J. M. Sullivan, Margaret Millhouse, Katerina Chatziioannou, James A. Clark, Tyson Littenberg, Neil Cornish, Sophie Hourihane, Laura Cadonati

Abstract: We investigate the impact of transient noise artifacts, or {\it glitches}, on gravitational wave inference, and the efficacy of data cleaning procedures in recovering unbiased source properties. Due to their time-frequency morphology, broadband glitches demonstrate moderate to significant biasing of posterior distributions away from true values. In contrast, narrowband glitches have negligible bia… ▽ More We investigate the impact of transient noise artifacts, or {\it glitches}, on gravitational wave inference, and the efficacy of data cleaning procedures in recovering unbiased source properties. Due to their time-frequency morphology, broadband glitches demonstrate moderate to significant biasing of posterior distributions away from true values. In contrast, narrowband glitches have negligible biasing effects owing to distinct signal and glitch morphologies. We inject simulated binary black hole signals into data containing three common glitch types from past LIGO-Virgo observing runs, and reconstruct both signal and glitch waveforms using {\tt BayesWave}, a wavelet-based Bayesian analysis. We apply the standard LIGO-Virgo-KAGRA deglitching procedure to the detector data - we subtract the glitch waveform estimated by the joint {\tt BayesWave} inference before performing parameter estimation with detailed compact binary waveform models. We find that this deglitching effectively mitigates bias from broadband glitches, with posterior peaks aligning with true values post deglitching. This provides a baseline validation of existing techniques, while demonstrating waveform reconstruction improvements to the Bayesian algorithm for robust astrophysical characterization in glitch-prone detector data. △ Less

Submitted 15 November, 2023; originally announced November 2023.

Comments: 22 pages, 17 figures

Report number: LIGO Document P2300385-v2

Experiments On Electron Cooling and Intense Space-charge at IOTA

Authors: N. Banerjee, G. Stancari, M. K. Bossard, J. Brandt, Y-K. Kim, S. Nagaitsev

Abstract: The Integrable Optics Test Accelerator at Fermilab will explore beam dynamics in a ring with intense space-charge using 2.5 MeV proton beams with an incoherent tune shift approaching -0.5. We will use this machine to explore the interplay between electron cooling, intense space-charge, and coherent instabilities. In this contribution, we describe the machine setup including the design of the elect… ▽ More The Integrable Optics Test Accelerator at Fermilab will explore beam dynamics in a ring with intense space-charge using 2.5 MeV proton beams with an incoherent tune shift approaching -0.5. We will use this machine to explore the interplay between electron cooling, intense space-charge, and coherent instabilities. In this contribution, we describe the machine setup including the design of the electron cooler and the lattice, list specific experiments and discuss the results of numerical simulations which include the effects of electron cooling and transverse space-charge forces. △ Less

Submitted 23 October, 2023; originally announced October 2023.

Comments: 14th International Workshop on Beam Cooling and Related Topics (COOL'23)

Report number: FERMILAB-CONF-23-582-AD

Anatomy-Driven Pathology Detection on Chest X-rays

Authors: Philip Müller, Felix Meissen, Johannes Brandt, Georgios Kaissis, Daniel Rueckert

Abstract: Pathology detection and delineation enables the automatic interpretation of medical scans such as chest X-rays while providing a high level of explainability to support radiologists in making informed decisions. However, annotating pathology bounding boxes is a time-consuming task such that large public datasets for this purpose are scarce. Current approaches thus use weakly supervised object dete… ▽ More Pathology detection and delineation enables the automatic interpretation of medical scans such as chest X-rays while providing a high level of explainability to support radiologists in making informed decisions. However, annotating pathology bounding boxes is a time-consuming task such that large public datasets for this purpose are scarce. Current approaches thus use weakly supervised object detection to learn the (rough) localization of pathologies from image-level annotations, which is however limited in performance due to the lack of bounding box supervision. We therefore propose anatomy-driven pathology detection (ADPD), which uses easy-to-annotate bounding boxes of anatomical regions as proxies for pathologies. We study two training approaches: supervised training using anatomy-level pathology labels and multiple instance learning (MIL) with image-level pathology labels. Our results show that our anatomy-level training approach outperforms weakly supervised methods and fully supervised detection with limited training samples, and our MIL approach is competitive with both baseline approaches, therefore demonstrating the potential of our approach. △ Less

Submitted 5 September, 2023; originally announced September 2023.

Comments: Accepted at MICCAI 2023

Interpretable 2D Vision Models for 3D Medical Images

Authors: Alexander Ziller, Ayhan Can Erdur, Marwa Trigui, Alp Güvenir, Tamara T. Mueller, Philip Müller, Friederike Jungmann, Johannes Brandt, Jan Peeken, Rickmer Braren, Daniel Rueckert, Georgios Kaissis

Abstract: Training Artificial Intelligence (AI) models on 3D images presents unique challenges compared to the 2D case: Firstly, the demand for computational resources is significantly higher, and secondly, the availability of large datasets for pre-training is often limited, impeding training success. This study proposes a simple approach of adapting 2D networks with an intermediate feature representation… ▽ More Training Artificial Intelligence (AI) models on 3D images presents unique challenges compared to the 2D case: Firstly, the demand for computational resources is significantly higher, and secondly, the availability of large datasets for pre-training is often limited, impeding training success. This study proposes a simple approach of adapting 2D networks with an intermediate feature representation for processing 3D images. Our method employs attention pooling to learn to assign each slice an importance weight and, by that, obtain a weighted average of all 2D slices. These weights directly quantify the contribution of each slice to the contribution and thus make the model prediction inspectable. We show on all 3D MedMNIST datasets as benchmark and two real-world datasets consisting of several hundred high-resolution CT or MRI scans that our approach performs on par with existing methods. Furthermore, we compare the in-built interpretability of our approach to HiResCam, a state-of-the-art retrospective interpretability approach. △ Less

Submitted 5 December, 2023; v1 submitted 13 July, 2023; originally announced July 2023.

Thermionic Sources for Electron Cooling at IOTA

Authors: M. K. Bossard, J. Brandt, Y. -K. Kim, S. Kladov, N. Banerjee, B. Cathey, G. Stancari, S. Nagaitsev

Abstract: We are designing and fabricating two new thermionic sources of magnetized electrons for use in the electron lens project in the Integrable Optics Test Accelerator (IOTA) at Fermilab. These electron sources will be used for cooling 2.5 MeV protons. One source will be used to compensate for emittance growth due to Intra Beam Scattering in experiments with weak space-charge, while the other source wi… ▽ More We are designing and fabricating two new thermionic sources of magnetized electrons for use in the electron lens project in the Integrable Optics Test Accelerator (IOTA) at Fermilab. These electron sources will be used for cooling 2.5 MeV protons. One source will be used to compensate for emittance growth due to Intra Beam Scattering in experiments with weak space-charge, while the other source will be used to research the interplay between electron cooling and intense space charge. In this paper we present the progress made so far and the upcoming steps for the thermionic electron sources. △ Less

Submitted 12 July, 2023; originally announced July 2023.

Comments: 14th International Particle Accelerator Conference (IPAC'23). arXiv admin note: text overlap with arXiv:2209.02480

Report number: FERMILAB-CONF-23-187-AD

Commissioning of the Low Energy Electron Gun Test Stand at the University of Chicago

Authors: S. Kladov, M. Bossard, J. Brandt, Y-K. Kim, N. Banerjee, G. Stancari, B. Cathey, S. Nagaitsev

Abstract: We built a test stand for evaluating the performance of the thermionic electron sources for the electron lens project at the Integrable Optics Test Accelerator (IOTA) in Fermilab. The lens will be used to study nonlinear dynamics and electron cooling of 2.5 MeV protons with strong space charge. The test stand will validate the characteristics of the thermionic sources and the main parameters of th… ▽ More We built a test stand for evaluating the performance of the thermionic electron sources for the electron lens project at the Integrable Optics Test Accelerator (IOTA) in Fermilab. The lens will be used to study nonlinear dynamics and electron cooling of 2.5 MeV protons with strong space charge. The test stand will validate the characteristics of the thermionic sources and the main parameters of the generated beams. In this paper we present the results of the commissioning of the UChicago test stand and validation of the hollow beam source. △ Less

Submitted 5 July, 2023; originally announced July 2023.

Comments: 14th International Particle Accelerator Conference (IPAC'23)

Report number: FERMILAB-CONF-23-225-AD

Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidar

Authors: Jamie Tolan, Hung-I Yang, Ben Nosarzewski, Guillaume Couairon, Huy Vo, John Brandt, Justine Spore, Sayantan Majumdar, Daniel Haziza, Janaki Vamaraju, Theo Moutakanni, Piotr Bojanowski, Tracy Johns, Brian White, Tobias Tiecke, Camille Couprie

Abstract: Vegetation structure mapping is critical for understanding the global carbon cycle and monitoring nature-based approaches to climate adaptation and mitigation. Repeated measurements of these data allow for the observation of deforestation or degradation of existing forests, natural forest regeneration, and the implementation of sustainable agricultural practices like agroforestry. Assessments of t… ▽ More Vegetation structure mapping is critical for understanding the global carbon cycle and monitoring nature-based approaches to climate adaptation and mitigation. Repeated measurements of these data allow for the observation of deforestation or degradation of existing forests, natural forest regeneration, and the implementation of sustainable agricultural practices like agroforestry. Assessments of tree canopy height and crown projected area at a high spatial resolution are also important for monitoring carbon fluxes and assessing tree-based land uses, since forest structures can be highly spatially heterogeneous, especially in agroforestry systems. Very high resolution satellite imagery (less than one meter (1m) Ground Sample Distance) makes it possible to extract information at the tree level while allowing monitoring at a very large scale. This paper presents the first high-resolution canopy height map concurrently produced for multiple sub-national jurisdictions. Specifically, we produce very high resolution canopy height maps for the states of California and Sao Paulo, a significant improvement in resolution over the ten meter (10m) resolution of previous Sentinel / GEDI based worldwide maps of canopy height. The maps are generated by the extraction of features from a self-supervised model trained on Maxar imagery from 2017 to 2020, and the training of a dense prediction decoder against aerial lidar maps. We also introduce a post-processing step using a convolutional network trained on GEDI observations. We evaluate the proposed maps with set-aside validation lidar data as well as by comparing with other remotely sensed maps and field-collected data, and find our model produces an average Mean Absolute Error (MAE) of 2.8 meters and Mean Error (ME) of 0.6 meters. △ Less

Submitted 15 December, 2023; v1 submitted 14 April, 2023; originally announced April 2023.

Journal ref: Remote Sensing of Environment 300, 113888, 2024

Iterative Deepening Hyperband

Authors: Jasmin Brandt, Marcel Wever, Dimitrios Iliadis, Viktor Bengs, Eyke Hüllermeier

Abstract: Hyperparameter optimization (HPO) is concerned with the automated search for the most appropriate hyperparameter configuration (HPC) of a parameterized machine learning algorithm. A state-of-the-art HPO method is Hyperband, which, however, has its own parameters that influence its performance. One of these parameters, the maximal budget, is especially problematic: If chosen too small, the budget n… ▽ More Hyperparameter optimization (HPO) is concerned with the automated search for the most appropriate hyperparameter configuration (HPC) of a parameterized machine learning algorithm. A state-of-the-art HPO method is Hyperband, which, however, has its own parameters that influence its performance. One of these parameters, the maximal budget, is especially problematic: If chosen too small, the budget needs to be increased in hindsight and, as Hyperband is not incremental by design, the entire algorithm must be re-run. This is not only costly but also comes with a loss of valuable knowledge already accumulated. In this paper, we propose incremental variants of Hyperband that eliminate these drawbacks, and show that these variants satisfy theoretical guarantees qualitatively similar to those for the original Hyperband with the "right" budget. Moreover, we demonstrate their practical utility in experiments with benchmark data sets. △ Less

Submitted 6 February, 2023; v1 submitted 1 February, 2023; originally announced February 2023.

AC-Band: A Combinatorial Bandit-Based Approach to Algorithm Configuration

Authors: Jasmin Brandt, Elias Schede, Viktor Bengs, Björn Haddenhorst, Eyke Hüllermeier, Kevin Tierney

Abstract: We study the algorithm configuration (AC) problem, in which one seeks to find an optimal parameter configuration of a given target algorithm in an automated way. Recently, there has been significant progress in designing AC approaches that satisfy strong theoretical guarantees. However, a significant gap still remains between the practical performance of these approaches and state-of-the-art heuri… ▽ More We study the algorithm configuration (AC) problem, in which one seeks to find an optimal parameter configuration of a given target algorithm in an automated way. Recently, there has been significant progress in designing AC approaches that satisfy strong theoretical guarantees. However, a significant gap still remains between the practical performance of these approaches and state-of-the-art heuristic methods. To this end, we introduce AC-Band, a general approach for the AC problem based on multi-armed bandits that provides theoretical guarantees while exhibiting strong practical performance. We show that AC-Band requires significantly less computation time than other AC approaches providing theoretical guarantees while still yielding high-quality configurations. △ Less

Submitted 1 December, 2022; originally announced December 2022.

The DAMIC-M Experiment: Status and First Results

Authors: I. Arnquist, N. Avalos, P. Bailly, D. Baxter, X. Bertou, M. Bogdan, C. Bourgeois, J. Brandt, A. Cadiou, N. Castelló-Mor, A. E. Chavarria, M. Conde, N. J. Corso, J. Cortabitarte Gutiérrez, J. Cuevas-Zepeda, A. Dastgheibi-Fard, C. De Dominicis, O. Deligny, R. Desani, M. Dhellot, J-J. Dormard, J. Duarte-Campderros, E. Estrada, D. Florin, N. Gadola , et al. (47 additional authors not shown)

Abstract: The DAMIC-M (DArk Matter In CCDs at Modane) experiment employs thick, fully depleted silicon charged-coupled devices (CCDs) to search for dark matter particles with a target exposure of 1 kg-year. A novel skipper readout implemented in the CCDs provides single electron resolution through multiple non-destructive measurements of the individual pixel charge, pushing the detection threshold to the eV… ▽ More The DAMIC-M (DArk Matter In CCDs at Modane) experiment employs thick, fully depleted silicon charged-coupled devices (CCDs) to search for dark matter particles with a target exposure of 1 kg-year. A novel skipper readout implemented in the CCDs provides single electron resolution through multiple non-destructive measurements of the individual pixel charge, pushing the detection threshold to the eV-scale. DAMIC-M will advance by several orders of magnitude the exploration of the dark matter particle hypothesis, in particular of candidates pertaining to the so-called "hidden sector." A prototype, the Low Background Chamber (LBC), with 20g of low background Skipper CCDs, has been recently installed at Laboratoire Souterrain de Modane and is currently taking data. We will report the status of the DAMIC-M experiment and first results obtained with LBC commissioning data. △ Less

Submitted 25 November, 2022; v1 submitted 11 October, 2022; originally announced October 2022.

Comments: 10 pages, 6 figures, Submission to SciPost Physics Proceedings: 14th International Conference on Identification of Dark Matter (IDM) 2022

Electron Cooling Experiment for Proton Beams with Intense Space-charge in IOTA

Authors: N. Banerjee, M. K. Bossard, J. Brandt, Y-K. Kim, B. Cathey, S. Nagaitsev, G. Stancari

Abstract: Electron cooling as a method of creating intense ion beams has a practical upper limit when it comes to the peak phase space density of ion beams which can be achieved in practice. We describe a new experiment to study electron cooling of 2.5 MeV protons at the intensity limit using the Integrable Optics Test Accelerator (IOTA), which is a storage ring dedicated to beam physics research at Fermila… ▽ More Electron cooling as a method of creating intense ion beams has a practical upper limit when it comes to the peak phase space density of ion beams which can be achieved in practice. We describe a new experiment to study electron cooling of 2.5 MeV protons at the intensity limit using the Integrable Optics Test Accelerator (IOTA), which is a storage ring dedicated to beam physics research at Fermilab. This system will enable the study of magnetized electron cooling of a proton beam with transverse incoherent tune shifts approaching -0.5 due to the presence of intense space-charge forces. We present an overview of the hardware design, simulations and specific experiments planned for this project. △ Less

Submitted 8 September, 2022; originally announced September 2022.

Comments: arXiv admin note: text overlap with arXiv:2201.10363

Report number: FERMILAB-CONF-22-472-AD

Thermionic Sources For Electron Cooling At IOTA

Authors: M. K. Bossard, N. Banerjee, J. Brandt, Y. -K. Kim, M. Krieg, B. Cathey, S. Nagaitsev, G. Stancari

Abstract: We are designing and fabricating two new thermionic sources of magnetized electrons for use in the electron lens project at the Integrable Optics Test Accelerator (IOTA) at Fermilab. These electron sources will be used for cooling of 2.5 MeV protons in the presence of intense space-charge. Furthermore, we are constructing an electron source test stand at the University of Chicago which will valida… ▽ More We are designing and fabricating two new thermionic sources of magnetized electrons for use in the electron lens project at the Integrable Optics Test Accelerator (IOTA) at Fermilab. These electron sources will be used for cooling of 2.5 MeV protons in the presence of intense space-charge. Furthermore, we are constructing an electron source test stand at the University of Chicago which will validate the electrical, thermal, and vacuum characteristics of thermionic sources. In this paper we present the progress made so far and the upcoming steps for the thermionic electron sources for electron cooling and the test stand. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Report number: FERMILAB-CONF-22-621-AD

Detecting Unknown DGAs without Context Information

Authors: Arthur Drichel, Justus von Brandt, Ulrike Meyer

Abstract: New malware emerges at a rapid pace and often incorporates Domain Generation Algorithms (DGAs) to avoid blocking the malware's connection to the command and control (C2) server. Current state-of-the-art classifiers are able to separate benign from malicious domains (binary classification) and attribute them with high probability to the DGAs that generated them (multiclass classification). While bi… ▽ More New malware emerges at a rapid pace and often incorporates Domain Generation Algorithms (DGAs) to avoid blocking the malware's connection to the command and control (C2) server. Current state-of-the-art classifiers are able to separate benign from malicious domains (binary classification) and attribute them with high probability to the DGAs that generated them (multiclass classification). While binary classifiers can label domains of yet unknown DGAs as malicious, multiclass classifiers can only assign domains to DGAs that are known at the time of training, limiting the ability to uncover new malware families. In this work, we perform a comprehensive study on the detection of new DGAs, which includes an evaluation of 59,690 classifiers. We examine four different approaches in 15 different configurations and propose a simple yet effective approach based on the combination of a softmax classifier and regular expressions (regexes) to detect multiple unknown DGAs with high probability. At the same time, our approach retains state-of-the-art classification performance for known DGAs. Our evaluation is based on a leave-one-group-out cross-validation with a total of 94 DGA families. By using the maximum number of known DGAs, our evaluation scenario is particularly difficult and close to the real world. All of the approaches examined are privacy-preserving, since they operate without context and exclusively on a single domain to be classified. We round up our study with a thorough discussion of class-incremental learning strategies that can adapt an existing classifier to newly discovered classes. △ Less

Submitted 30 May, 2022; originally announced May 2022.

Comments: Accepted at The 17th International Conference on Availability, Reliability and Security (ARES 2022)

Evaluating a strategy for measuring deformations of the primary reflector of the Green Bank telescope using a terrestrial laser scanner

Authors: Pedro Salas, Paul Marganian, Joe Brandt, Andrew Seymour, John Shelton, Nathan Sharp, Laura Jensen, Marty Bloss, Carla Beaudet, Dennis Egan, Nathaniel Sizemore, David T. Frayer, Frederic R. Schwab, Felix J. Lockman

Abstract: Astronomical observations in the molecule rich 3 mm window using large reflector antennas provide a unique view of the Universe. To efficiently carry out these observations gravitational and thermal deformations have to be corrected. Terrestrial laser scanners have been used to measure the deformations in large reflector antennas due to gravity, but have not yet been used for measuring thermal def… ▽ More Astronomical observations in the molecule rich 3 mm window using large reflector antennas provide a unique view of the Universe. To efficiently carry out these observations gravitational and thermal deformations have to be corrected. Terrestrial laser scanners have been used to measure the deformations in large reflector antennas due to gravity, but have not yet been used for measuring thermal deformations. In this work we investigate the use of a terrestrial laser scanner to measure thermal deformations on the primary reflector of the Green Bank Telescope (GBT). Our method involves the use of differential measurements to reduce the systematic effects of the terrestrial laser scanner. We use the active surface of the primary reflector of the GBT to validate our method and explore its limitations. We find that when using differential measurements it is possible to accurately measure deformations corresponding to different Zernike polynomials down to an amplitude of 60 $μ$m. The difference between the amplitudes of known deformations and those measured are $<140~μ$m when the wind speed is $\lesssim2$ m s$^{-1}$. From these differences we estimate that it should be possible to bring the surface error of the GBT down to $240\pm6~μ$m. This suggests that using a commercial off-the-shelf terrestrial laser scanner it is possible to measure deformations induced by thermal gradients on a large parabolic reflector. △ Less

Submitted 8 March, 2022; originally announced March 2022.

Comments: 16 pages, 8 figures, accepted for publication in Advanced Control for Applications

Calibrations of the Compton Spectrometer and Imager

Authors: Jacqueline Beechert, Hadar Lazar, Steven E. Boggs, Terri J. Brandt, Yi-Chi Chang, Che-Yen Chu, Hannah Gulick, Carolyn Kierans, Alexander Lowell, Nicholas Pellegrini, Jarred M. Roberts, Thomas Siegert, Clio Sleator, John A. Tomsick, Andreas Zoglauer

Abstract: The Compton Spectrometer and Imager (COSI) is a balloon-borne soft $γ$-ray telescope (0.2-5 MeV) designed to study astrophysical sources. COSI employs a compact Compton telescope design and is comprised of twelve high-purity germanium semiconductor detectors. Tracking the locations and energies of $γ$-ray scatters within the detectors permits high-resolution spectroscopy, direct imaging over a wid… ▽ More The Compton Spectrometer and Imager (COSI) is a balloon-borne soft $γ$-ray telescope (0.2-5 MeV) designed to study astrophysical sources. COSI employs a compact Compton telescope design and is comprised of twelve high-purity germanium semiconductor detectors. Tracking the locations and energies of $γ$-ray scatters within the detectors permits high-resolution spectroscopy, direct imaging over a wide field-of-view, polarization studies, and effective suppression of background events. Critical to the precise determination of each interaction's energy, position, and the subsequent event reconstruction are several calibrations conducted in the field before launch. Additionally, benchmarking the instrument's higher-level performance through studies of its angular resolution, effective area, and polarization sensitivity quantifies COSI's scientific capabilities. In May 2016, COSI became the first science payload to be launched on NASA's superpressure balloon and was slated for launch again in April 2020. Though the 2020 launch was canceled due to the COVID-19 pandemic, the COSI team took calibration measurements prior to cancellation. In this paper we provide a detailed overview of COSI instrumentation, describe the calibration methods, and compare the calibration and benchmarking results of the 2016 and 2020 balloon campaigns. These procedures will be integral to the calibration and benchmarking of the NASA Small Explorer satellite version of COSI scheduled to launch in 2025. △ Less

Submitted 1 March, 2022; originally announced March 2022.

Comments: 29 pages, 22 figures, accepted by Nuclear Instruments and Methods in Physics Research Section A

Measurement of Galactic $^{26}$Al with the Compton Spectrometer and Imager

Authors: Jacqueline Beechert, Thomas Siegert, John A. Tomsick, Andreas Zoglauer, Steven E. Boggs, Terri J. Brandt, Hannah Gulick, Pierre Jean, Carolyn Kierans, Hadar Lazar, Alexander Lowell, Jarred M. Roberts, Clio Sleator, Peter von Ballmoos

Abstract: The Compton Spectrometer and Imager (COSI) is a balloon-borne compact Compton telescope designed to survey the 0.2-5 MeV sky. COSI's energy resolution of $\sim$0.2% at 1.8 MeV, single-photon reconstruction, and wide field of view make it capable of studying astrophysical nuclear lines, particularly the 1809 keV $γ$-ray line from decaying Galactic $^{26}$Al. Most $^{26}$Al originates in massive sta… ▽ More The Compton Spectrometer and Imager (COSI) is a balloon-borne compact Compton telescope designed to survey the 0.2-5 MeV sky. COSI's energy resolution of $\sim$0.2% at 1.8 MeV, single-photon reconstruction, and wide field of view make it capable of studying astrophysical nuclear lines, particularly the 1809 keV $γ$-ray line from decaying Galactic $^{26}$Al. Most $^{26}$Al originates in massive stars and core-collapse supernova nucleosynthesis, but the path from stellar evolution models to Galaxy-wide emission remains unconstrained. In 2016, COSI had a successful 46-day flight on a NASA superpressure balloon. Here, we detail the first search for the 1809 keV $^{26}$Al line in the COSI 2016 balloon flight using a maximum likelihood analysis. We find a Galactic $^{26}$Al flux of $(8.6 \pm 2.5) \times 10^{-4}$ ph cm$^{-2}$ s$^{-1}$ within the Inner Galaxy ($|\ell| \leq 30^{\circ}$, $|b| \leq 10^{\circ}$) with 3.7$σ$ significance above background. Within uncertainties, this flux is consistent with expectations from previous measurements by SPI and COMPTEL. This analysis demonstrates COSI's powerful capabilities for studies of $γ$-ray lines and underscores the scientific potential of future compact Compton telescopes. In particular, the next iteration of COSI as a NASA Small Explorer satellite has recently been approved for launch in 2025. △ Less

Submitted 23 February, 2022; originally announced February 2022.

Comments: 23 pages, 22 figures, accepted by The Astrophysical Journal (ApJ)

Finding Optimal Arms in Non-stochastic Combinatorial Bandits with Semi-bandit Feedback and Finite Budget

Authors: Jasmin Brandt, Viktor Bengs, Björn Haddenhorst, Eyke Hüllermeier

Abstract: We consider the combinatorial bandits problem with semi-bandit feedback under finite sampling budget constraints, in which the learner can carry out its action only for a limited number of times specified by an overall budget. The action is to choose a set of arms, whereupon feedback for each arm in the chosen set is received. Unlike existing works, we study this problem in a non-stochastic settin… ▽ More We consider the combinatorial bandits problem with semi-bandit feedback under finite sampling budget constraints, in which the learner can carry out its action only for a limited number of times specified by an overall budget. The action is to choose a set of arms, whereupon feedback for each arm in the chosen set is received. Unlike existing works, we study this problem in a non-stochastic setting with subset-dependent feedback, i.e., the semi-bandit feedback received could be generated by an oblivious adversary and also might depend on the chosen set of arms. In addition, we consider a general feedback scenario covering both the numerical-based as well as preference-based case and introduce a sound theoretical framework for this setting guaranteeing sensible notions of optimal arms, which a learner seeks to find. We suggest a generic algorithm suitable to cover the full spectrum of conceivable arm elimination strategies from aggressive to conservative. Theoretical questions about the sufficient and necessary budget of the algorithm to find the best arm are answered and complemented by deriving lower bounds for any learning algorithm for this problem scenario. △ Less

Submitted 14 October, 2022; v1 submitted 9 February, 2022; originally announced February 2022.

MSC Class: 68Q32 (Primary) 68T05; 68W27 (Secondary)

A Survey of Methods for Automated Algorithm Configuration

Authors: Elias Schede, Jasmin Brandt, Alexander Tornede, Marcel Wever, Viktor Bengs, Eyke Hüllermeier, Kevin Tierney

Abstract: Algorithm configuration (AC) is concerned with the automated search of the most suitable parameter configuration of a parametrized algorithm. There is currently a wide variety of AC problem variants and methods proposed in the literature. Existing reviews do not take into account all derivatives of the AC problem, nor do they offer a complete classification scheme. To this end, we introduce taxono… ▽ More Algorithm configuration (AC) is concerned with the automated search of the most suitable parameter configuration of a parametrized algorithm. There is currently a wide variety of AC problem variants and methods proposed in the literature. Existing reviews do not take into account all derivatives of the AC problem, nor do they offer a complete classification scheme. To this end, we introduce taxonomies to describe the AC problem and features of configuration methods, respectively. We review existing AC literature within the lens of our taxonomies, outline relevant design choices of configuration approaches, contrast methods and problem variants against each other, and describe the state of AC in industry. Finally, our review provides researchers and practitioners with a look at future research directions in the field of AC. △ Less

Submitted 13 October, 2022; v1 submitted 3 February, 2022; originally announced February 2022.

ACM Class: I.2.6

Journal ref: Journal of Artificial Intelligence Research (JAIR) 75 (2022) 425-487

Fabrication and installation of the Mu2e cryogenic distribution system

Authors: M. White, M. Lamm, A. Hocker, D. Arnold, G. Tatkowski, J. Kilmer, V. Poloubotko, T. Tope, Y. Huang, L. Elementi, K. Badgley, E. Voirin, I. Young, J. Brandt, S. Feher, C. Hess, D. Markley

Abstract: The muon-to-electron conversion (Mu2e) experiment at Fermilab will be used to search for the charged lepton flavor-violating conversion of muons to electrons in the field of an atomic nucleus. The Mu2e experiment is currently in the construction stage. The scope of this paper is the cryogenic distribution system and superconducting power leads for four superconducting solenoid magnets: Production… ▽ More The muon-to-electron conversion (Mu2e) experiment at Fermilab will be used to search for the charged lepton flavor-violating conversion of muons to electrons in the field of an atomic nucleus. The Mu2e experiment is currently in the construction stage. The scope of this paper is the cryogenic distribution system and superconducting power leads for four superconducting solenoid magnets: Production Solenoid (PS), an Upstream and Downstream Transport Solenoids (TSu and TSd) and Detector Solenoid (DS). The design of the cryogenic distribution system and the fabrication of several sub-systems was reported previously. This paper reports on additional fabrication and installation progress that has been performed over the past two years. Lessons learned during fabrication and testing of the cryogenic distribution system components are described. In particular, the challenges and solutions implemented for aluminum welding are reported. A description of the process used to qualify the welding procedure and welders for welding the aluminium stabilized NbTi superconducting power leads is provided. Additionally, the progress made with regards to installing the power leads into the cryogenic Feedboxes is covered. △ Less

Submitted 25 January, 2022; originally announced January 2022.

Report number: FERMILAB-CONF-21-733-TD

Electron Cooling with Space-Charge Dominated Proton Beams at Iota

Authors: N. Banerjee, M. K. Bossard, J. Brandt, Y-K. Kim, B. Cathey, S. Nagaitsev, G. Stancari

Abstract: We describe a new electron cooler being developed for 2.5 MeV protons at the Integrable Optics Test Accelerator (IOTA), which is a highly re-configurable storage ring at Fermilab. This system would enable the study of magnetized electron cooling in the presence of intense space-charge with transverse tune shifts approaching -0.5 as well as highly nonlinear focusing optics in the IOTA ring. We pres… ▽ More We describe a new electron cooler being developed for 2.5 MeV protons at the Integrable Optics Test Accelerator (IOTA), which is a highly re-configurable storage ring at Fermilab. This system would enable the study of magnetized electron cooling in the presence of intense space-charge with transverse tune shifts approaching -0.5 as well as highly nonlinear focusing optics in the IOTA ring. We present an overview of the design, simulations and hardware to be used for this project. △ Less

Submitted 25 January, 2022; originally announced January 2022.

Comments: 13th Workshop on Beam Cooling and Related Topics

Report number: FERMILAB-CONF-21-684-AD

Low dosage 3D volume fluorescence microscopy imaging using compressive sensing

Authors: Varun Mannam, Jacob Brandt, Cody J. Smith, Scott Howard

Abstract: Fluorescence microscopy has been a significant tool to observe long-term imaging of embryos (in vivo) growth over time. However, cumulative exposure is phototoxic to such sensitive live samples. While techniques like light-sheet fluorescence microscopy (LSFM) allow for reduced exposure, it is not well suited for deep imaging models. Other computational techniques are computationally expensive and… ▽ More Fluorescence microscopy has been a significant tool to observe long-term imaging of embryos (in vivo) growth over time. However, cumulative exposure is phototoxic to such sensitive live samples. While techniques like light-sheet fluorescence microscopy (LSFM) allow for reduced exposure, it is not well suited for deep imaging models. Other computational techniques are computationally expensive and often lack restoration quality. To address this challenge, one can use various low-dosage imaging techniques that are developed to achieve the 3D volume reconstruction using a few slices in the axial direction (z-axis); however, they often lack restoration quality. Also, acquiring dense images (with small steps) in the axial direction is computationally expensive. To address this challenge, we present a compressive sensing (CS) based approach to fully reconstruct 3D volumes with the same signal-to-noise ratio (SNR) with less than half of the excitation dosage. We present the theory and experimentally validate the approach. To demonstrate our technique, we capture a 3D volume of the RFP labeled neurons in the zebrafish embryo spinal cord (30um thickness) with the axial sampling of 0.1um using a confocal microscope. From the results, we observe the CS-based approach achieves accurate 3D volume reconstruction from less than 20% of the entire stack optical sections. The developed CS-based methodology in this work can be easily applied to other deep imaging modalities such as two-photon and light-sheet microscopy, where reducing sample photo-toxicity is a critical challenge. △ Less

Submitted 3 January, 2022; originally announced January 2022.

Green Bank Telescope: Overview and analysis of metrology systems and pointing performance

Authors: E. White, F. D. Ghigo, R. M. Prestage, D. T. Frayer, R. J. Maddalena, P. T. Wallace, J. J. Brandt, D. Egan, J. D. Nelson, J. Ray

Abstract: With a 100mx110m off-axis paraboloid dish, the Green Bank Telescope (GBT) is the largest fully steerable radio telescope on Earth. A major challenge facing large ground-based radio telescopes is achieving sufficient pointing accuracy for observing at high frequencies, up to 116 GHz in the case of the GBT. Accurate pointing requires the ability to blindly acquire source locations and perform ad hoc… ▽ More With a 100mx110m off-axis paraboloid dish, the Green Bank Telescope (GBT) is the largest fully steerable radio telescope on Earth. A major challenge facing large ground-based radio telescopes is achieving sufficient pointing accuracy for observing at high frequencies, up to 116 GHz in the case of the GBT. Accurate pointing requires the ability to blindly acquire source locations and perform ad hoc corrections determined by observing nearby calibrator sources in order to obtain a starting position accurate to within a small margin of error of the target's location. The required pointing accuracy is dependent upon the half-power beamwidth, and for the higher-frequency end of GBT observing, this means that pointing must be accurate to within a few arcseconds RMS. The GBT's off-axis design is advantageous in that it eliminates blockage of the dish and reduces sidelobe interference, and there is no evidence that the resulting asymmetric structure adversely affects pointing accuracy. However, factors such as gravitational flexure, thermal deformation, azimuth track tilt and irregularity, and small misalignments and offset errors within the telescope's structure cause pointing inaccuracies. A pointing model was developed for the GBT to correct for these effects. The model utilizes standard geometrical corrections along with metrology data from the GBT's structural temperature sensors and data from measurements of the track levels. In this paper we provide a summary of the GBT's pointing model and associated corrections, as well as a discussion of relevant metrology systems and an analysis of its current nighttime pointing accuracy. △ Less

Submitted 24 November, 2021; originally announced November 2021.

Comments: 13 pages, 9 figures. Accepted for publication in Astronomy & Astrophysics

Journal ref: A&A 659, A113 (2022)

GWTC-3: Compact Binary Coalescences Observed by LIGO and Virgo During the Second Part of the Third Observing Run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, S. Akcay, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin , et al. (1637 additional authors not shown)

Abstract: The third Gravitational-Wave Transient Catalog (GWTC-3) describes signals detected with Advanced LIGO and Advanced Virgo up to the end of their third observing run. Updating the previous GWTC-2.1, we present candidate gravitational waves from compact binary coalescences during the second half of the third observing run (O3b) between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. There ar… ▽ More The third Gravitational-Wave Transient Catalog (GWTC-3) describes signals detected with Advanced LIGO and Advanced Virgo up to the end of their third observing run. Updating the previous GWTC-2.1, we present candidate gravitational waves from compact binary coalescences during the second half of the third observing run (O3b) between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. There are 35 compact binary coalescence candidates identified by at least one of our search algorithms with a probability of astrophysical origin $p_\mathrm{astro} > 0.5$. Of these, 18 were previously reported as low-latency public alerts, and 17 are reported here for the first time. Based upon estimates for the component masses, our O3b candidates with $p_\mathrm{astro} > 0.5$ are consistent with gravitational-wave signals from binary black holes or neutron star-black hole binaries, and we identify none from binary neutron stars. However, from the gravitational-wave data alone, we are not able to measure matter effects that distinguish whether the binary components are neutron stars or black holes. The range of inferred component masses is similar to that found with previous catalogs, but the O3b candidates include the first confident observations of neutron star-black hole binaries. Including the 35 candidates from O3b in addition to those from GWTC-2.1, GWTC-3 contains 90 candidates found by our analysis with $p_\mathrm{astro} > 0.5$ across the first three observing runs. These observations of compact binary coalescences present an unprecedented view of the properties of black holes and neutron stars. △ Less

Submitted 23 October, 2023; v1 submitted 5 November, 2021; originally announced November 2021.

Comments: 88 pages (10 pages author list, 31 pages main text, 1 page acknowledgements, 24 pages appendices, 22 pages bibliography), 17 figures, 16 tables. Update to match version to be published in Physical Review X. Data products available from https://gwosc.org/GWTC-3/

Report number: LIGO-P2000318

Journal ref: Phys. Rev. X; 13(4):041039; 2023

RUNMON-RIFT: Adaptive Configuration and Healing for Large-Scale Parameter Inference

Authors: Richard Udall, Joshua Brandt, Grihith Manchanda, Adhav Arulanandan, James Clark, Jacob Lange, Richard O'Shaughnessy, Laura Cadonati

Abstract: Gravitational wave parameter inference pipelines operate on data containing unknown sources on distributed hardware with unreliable performance. For one specific analysis pipeline (RIFT), we have developed a flexible tool (RUNMON-RIFT) to mitigate the most common challenges introduced by these two uncertainties. On the one hand, RUNMON provides several mechanisms to identify and redress unreliable… ▽ More Gravitational wave parameter inference pipelines operate on data containing unknown sources on distributed hardware with unreliable performance. For one specific analysis pipeline (RIFT), we have developed a flexible tool (RUNMON-RIFT) to mitigate the most common challenges introduced by these two uncertainties. On the one hand, RUNMON provides several mechanisms to identify and redress unreliable computing environments. On the other hand, RUNMON provides mechanisms to adjust pipeline-specific run settings, including prior ranges, to ensure the analysis completes and encompasses the physical source parameters. We demonstrate both general features with two controlled examples. △ Less

Submitted 19 October, 2021; originally announced October 2021.

Comments: 9 pages, 2 figures

The More, the Better? A Study on Collaborative Machine Learning for DGA Detection

Authors: Arthur Drichel, Benedikt Holmes, Justus von Brandt, Ulrike Meyer

Abstract: Domain generation algorithms (DGAs) prevent the connection between a botnet and its master from being blocked by generating a large number of domain names. Promising single-data-source approaches have been proposed for separating benign from DGA-generated domains. Collaborative machine learning (ML) can be used in order to enhance a classifier's detection rate, reduce its false positive rate (FPR)… ▽ More Domain generation algorithms (DGAs) prevent the connection between a botnet and its master from being blocked by generating a large number of domain names. Promising single-data-source approaches have been proposed for separating benign from DGA-generated domains. Collaborative machine learning (ML) can be used in order to enhance a classifier's detection rate, reduce its false positive rate (FPR), and to improve the classifier's generalization capability to different networks. In this paper, we complement the research area of DGA detection by conducting a comprehensive collaborative learning study, including a total of 13,440 evaluation runs. In two real-world scenarios we evaluate a total of eleven different variations of collaborative learning using three different state-of-the-art classifiers. We show that collaborative ML can lead to a reduction in FPR by up to 51.7%. However, while collaborative ML is beneficial for DGA detection, not all approaches and classifier types profit equally. We round up our comprehensive study with a thorough discussion of the privacy threats implicated by the different collaborative ML approaches. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Comments: Accepted at The 3rd Workshop on Cyber-Security Arms Race (CYSARM '21)

StreamHover: Livestream Transcript Summarization and Annotation

Authors: Sangwoo Cho, Franck Dernoncourt, Tim Ganter, Trung Bui, Nedim Lipka, Walter Chang, Hailin Jin, Jonathan Brandt, Hassan Foroosh, Fei Liu

Abstract: With the explosive growth of livestream broadcasting, there is an urgent need for new summarization technology that enables us to create a preview of streamed content and tap into this wealth of knowledge. However, the problem is nontrivial due to the informal nature of spoken language. Further, there has been a shortage of annotated datasets that are necessary for transcript summarization. In thi… ▽ More With the explosive growth of livestream broadcasting, there is an urgent need for new summarization technology that enables us to create a preview of streamed content and tap into this wealth of knowledge. However, the problem is nontrivial due to the informal nature of spoken language. Further, there has been a shortage of annotated datasets that are necessary for transcript summarization. In this paper, we present StreamHover, a framework for annotating and summarizing livestream transcripts. With a total of over 500 hours of videos annotated with both extractive and abstractive summaries, our benchmark dataset is significantly larger than currently existing annotated corpora. We explore a neural extractive summarization model that leverages vector-quantized variational autoencoder to learn latent vector representations of spoken utterances and identify salient utterances from the transcripts to form summaries. We show that our model generalizes better and improves performance over strong baselines. The results of this study provide an avenue for future research to improve summarization solutions for efficient browsing of livestreams. △ Less

Submitted 10 September, 2021; originally announced September 2021.

Comments: EMNLP 2021 (Long Paper)

Finding Phish in a Haystack: A Pipeline for Phishing Classification on Certificate Transparency Logs

Authors: Arthur Drichel, Vincent Drury, Justus von Brandt, Ulrike Meyer

Abstract: Current popular phishing prevention techniques mainly utilize reactive blocklists, which leave a ``window of opportunity'' for attackers during which victims are unprotected. One possible approach to shorten this window aims to detect phishing attacks earlier, during website preparation, by monitoring Certificate Transparency (CT) logs. Previous attempts to work with CT log data for phishing class… ▽ More Current popular phishing prevention techniques mainly utilize reactive blocklists, which leave a ``window of opportunity'' for attackers during which victims are unprotected. One possible approach to shorten this window aims to detect phishing attacks earlier, during website preparation, by monitoring Certificate Transparency (CT) logs. Previous attempts to work with CT log data for phishing classification exist, however they lack evaluations on actual CT log data. In this paper, we present a pipeline that facilitates such evaluations by addressing a number of problems when working with CT log data. The pipeline includes dataset creation, training, and past or live classification of CT logs. Its modular structure makes it possible to easily exchange classifiers or verification sources to support ground truth labeling efforts and classifier comparisons. We test the pipeline on a number of new and existing classifiers, and find a general potential to improve classifiers for this scenario in the future. We publish the source code of the pipeline and the used datasets along with this paper (https://gitlab.com/rwth-itsec/ctl-pipeline), thus making future research in this direction more accessible. △ Less

Submitted 23 June, 2021; originally announced June 2021.

Comments: Accepted at The 16th International Conference on Availability, Reliability and Security (ARES 2021)

COSI: From Calibrations and Observations to All-sky Images

Authors: Andreas Zoglauer, Thomas Siegert, Alexander Lowell, Brent Mochizuki, Carolyn Kierans, Clio Sleator, Dieter H. Hartmann, Hadar Lazar, Hannah Gulick, Jacqueline Beechert, Jarred M. Roberts, John A. Tomsick, Mark D. Leising, Nicholas Pellegrini, Steven E. Boggs, Terri J. Brandt

Abstract: The soft MeV gamma-ray sky, from a few hundred keV up to several MeV, is one of the least explored regions of the electromagnetic spectrum. The most promising technology to access this energy range is a telescope that uses Compton scattering to detect the gamma rays. Going from the measured data to all-sky images ready for scientific interpretation, however, requires a well-understood detector set… ▽ More The soft MeV gamma-ray sky, from a few hundred keV up to several MeV, is one of the least explored regions of the electromagnetic spectrum. The most promising technology to access this energy range is a telescope that uses Compton scattering to detect the gamma rays. Going from the measured data to all-sky images ready for scientific interpretation, however, requires a well-understood detector setup and a multi-step data-analysis pipeline. We have developed these capabilities for the Compton Spectrometer and Imager (COSI). Starting with a deep understanding of the many intricacies of the Compton measurement process and the Compton data space, we developed the tools to perform simulations that match well with instrument calibrations and to reconstruct the gamma-ray path in the detector. Together with our work to create an adequate model of the measured background while in flight, we are able to perform spectral and polarization analysis, and create images of the gamma-ray sky. This will enable future telescopes to achieve a deeper understanding of the astrophysical processes that shape the gamma-ray sky from the sites of star formation (26-Al map), to the history of core-collapse supernovae (e.g. 60-Fe map) and the distributions of positron annihilation (511-keV map) in our Galaxy. △ Less

Submitted 25 February, 2021; originally announced February 2021.

Comments: 21 pages, 10 figures, submitted to ApJ

Application-aware Congestion Mitigation for High-Performance Computing Systems

Authors: Archit Patke, Saurabh Jha, Haoran Qiu, Jim Brandt, Ann Gentile, Joe Greenseid, Zbigniew Kalbarczyk, Ravishankar Iyer

Abstract: High-performance computing (HPC) systems frequently experience congestion leading to significant application performance variation. However, the impact of congestion on application runtime differs from application to application depending on their network characteristics (such as bandwidth and latency requirements). We leverage this insight to develop Netscope, an automated ML-driven framework tha… ▽ More High-performance computing (HPC) systems frequently experience congestion leading to significant application performance variation. However, the impact of congestion on application runtime differs from application to application depending on their network characteristics (such as bandwidth and latency requirements). We leverage this insight to develop Netscope, an automated ML-driven framework that considers those network characteristics to dynamically mitigate congestion. We evaluate Netscope on four Cray Aries systems, including a production supercomputer on real scientific applications. Netscope has a lower training cost and accurately estimates the impact of congestion on application runtime with a correlation between 0.7and 0.9 for common scientific applications. Moreover, we find that Netscope reduces tail runtime variability by up to 14.9 times while improving median system utility by 12%. △ Less

Submitted 3 February, 2021; v1 submitted 14 December, 2020; originally announced December 2020.

Strong constraints on the $b \to sγ$ photon polarisation from $B^0 \to K^{*0} e^+ e^-$ decays

Authors: LHCb collaboration, R. Aaij, C. Abellán Beteta, T. Ackernley, B. Adeva, M. Adinolfi, H. Afsharnia, C. A. Aidala, S. Aiola, Z. Ajaltouni, S. Akar, J. Albrecht, F. Alessio, M. Alexander, A. Alfonso Albero, Z. Aliouche, G. Alkhazov, P. Alvarez Cartelle, S. Amato, Y. Amhis, L. An, L. Anderlini, A. Andreianov, M. Andreotti, F. Archilli , et al. (962 additional authors not shown)

Abstract: An angular analysis of the $B^0 \to K^{*0} e^+ e^-$ decay is performed using a data sample corresponding to an integrated luminosity of $9~{\rm fb}^{-1}$ of $pp$ collisions collected with the LHCb experiment. The analysis is conducted in the very low dielectron mass squared ($q^2$) interval between $0.0008$ and $0.257~{\rm GeV}^2$, where the rate is dominated by the $B^0\to K^{\ast 0}γ$ transition… ▽ More An angular analysis of the $B^0 \to K^{*0} e^+ e^-$ decay is performed using a data sample corresponding to an integrated luminosity of $9~{\rm fb}^{-1}$ of $pp$ collisions collected with the LHCb experiment. The analysis is conducted in the very low dielectron mass squared ($q^2$) interval between $0.0008$ and $0.257~{\rm GeV}^2$, where the rate is dominated by the $B^0\to K^{\ast 0}γ$ transition with a virtual photon. The fraction of longitudinal polarisation of the $K^{\ast 0}$ meson, $F_{\rm L}$, is measured to be $F_{\rm L} = (4.4 \pm 2.6 \pm 1.4)\%$, where the first uncertainty is statistical and the second systematic. The $A_{\rm T}^{\rm Re}$ observable, which is related to the lepton forward-backward asymmetry, is measured to be $A_{\rm T}^{\rm Re}=-0.06 \pm 0.08 \pm 0.02$. The $A_{\rm T}^{(2)}$ and $A_{\rm T}^{\rm Im}$ transverse asymmetries, which are sensitive to the virtual photon polarisation, are found to be $A_{\rm T}^{(2)} = 0.11 \pm 0.10 \ \pm 0.02$ and $A_{\rm T}^{\rm Im} = 0.02 \pm 0.10 \pm 0.01$. The results are consistent with Standard Model predictions and provide the world's best constraint on the $b\to sγ$ photon polarisation. △ Less

Submitted 16 December, 2020; v1 submitted 12 October, 2020; originally announced October 2020.

Comments: All figures and tables, along with machine-readable versions and any supplementary material and additional information, are available at https://cern.ch/lhcbproject/Publications/p/LHCb-PAPER-2020-020.html (LHCb public pages)

Report number: LHCb-PAPER-2020-020, CERN-EP-2020-176

Journal ref: JHEP 12 (2020) 081

Portability of Scientific Workflows in NGS Data Analysis: A Case Study

Authors: Christopher Schiefer, Marc Bux, Joergen Brandt, Clemens Messerschmidt, Knut Reinert, Dieter Beule, Ulf Leser

Abstract: The analysis of next-generation sequencing (NGS) data requires complex computational workflows consisting of dozens of autonomously developed yet interdependent processing steps. Whenever large amounts of data need to be processed, these workflows must be executed on a parallel and/or distributed systems to ensure reasonable runtime. Porting a workflow developed for a particular system on a partic… ▽ More The analysis of next-generation sequencing (NGS) data requires complex computational workflows consisting of dozens of autonomously developed yet interdependent processing steps. Whenever large amounts of data need to be processed, these workflows must be executed on a parallel and/or distributed systems to ensure reasonable runtime. Porting a workflow developed for a particular system on a particular hardware infrastructure to another system or to another infrastructure is non-trivial, which poses a major impediment to the scientific necessities of workflow reproducibility and workflow reusability. In this work, we describe our efforts to port a state-of-the-art workflow for the detection of specific variants in whole-exome sequencing of mice. The workflow originally was developed in the scientific workflow system snakemake for execution on a high-performance cluster controlled by Sun Grid Engine. In the project, we ported it to the scientific workflow system SaasFee that can execute workflows on (multi-core) stand-alone servers or on clusters of arbitrary sizes using the Hadoop. The purpose of this port was that also owners of low-cost hardware infrastructures, for which Hadoop was made for, become able to use the workflow. Although both the source and the target system are called scientific workflow systems, they differ in numerous aspects, ranging from the workflow languages to the scheduling mechanisms and the file access interfaces. These differences resulted in various problems, some expected and more unexpected, that had to be resolved before the workflow could be run with equal semantics. As a side-effect, we also report cost/runtime ratios for a state-of-the-art NGS workflow on very different hardware platforms: A comparably cheap stand-alone server (80 threads), a mid-cost, mid-sized cluster (552 threads), and a high-end HPC system (3784 threads). △ Less

Submitted 4 June, 2020; originally announced June 2020.

A global method to identify trees outside of closed-canopy forests with medium-resolution satellite imagery

Authors: John Brandt, Fred Stolle

Abstract: Scattered trees outside of dense, closed-canopy forests are very important for carbon sequestration, supporting livelihoods, maintaining ecosystem integrity, and climate change adaptation and mitigation. In contrast to trees inside of closed-canopy forests, not much is known about the spatial extent and distribution of scattered trees at a global scale. Due to the cost of high-resolution satellite… ▽ More Scattered trees outside of dense, closed-canopy forests are very important for carbon sequestration, supporting livelihoods, maintaining ecosystem integrity, and climate change adaptation and mitigation. In contrast to trees inside of closed-canopy forests, not much is known about the spatial extent and distribution of scattered trees at a global scale. Due to the cost of high-resolution satellite imagery, global monitoring systems rely on medium-resolution satellites to monitor land use. Here we present a globally consistent method to identify trees with canopy diameters greater than three meters with medium-resolution optical and radar imagery. Biweekly cloud-free, pan-sharpened 10 meter Sentinel-2 optical imagery and Sentinel-1 radar imagery are used to train a fully convolutional network, consisting of a convolutional gated recurrent unit layer and a feature pyramid attention layer. Tested across more than 215,000 Sentinel-1 and Sentinel-2 pixels distributed from -60 to +60 latitude, the proposed model exceeds 75% user's and producer's accuracy identifying trees in hectares with a low to medium density (less than 40%) of tree cover, and 95% user's and producer's accuracy in hectares with dense (greater than 40%) tree cover. The proposed method increases the accuracy of monitoring tree presence in areas with sparse and scattered tree cover (less than 40%) by as much as 20%, and reduces commission and omission error in mountainous and very cloudy regions by nearly half. When applied across large, heterogeneous landscapes, the results demonstrate potential to map trees in high detail and accuracy over diverse landscapes across the globe. This information is important for understanding current land cover and can be used to detect changes in land cover such as agroforestry, buffer zones around biological hotspots, and expansion or encroachment of forests. △ Less

Submitted 24 July, 2020; v1 submitted 13 May, 2020; originally announced May 2020.

Label-Free Chemical Nano-Imaging of Intracellular Drug Binding Sites

Authors: William S. Hart, Hemmel Amrania, Alice Beckley, Jochen R. Brandt, Sandeep Sundriyal, Ainoa Rueda-Zubiaurre, Alexandra E. Porter, Eric O. Aboagye, Matthew J. Fuchter, Chris C. Phillips

Abstract: Optical microscopy has a diffraction limited resolution of about 250 nm. Fluorescence methods (e.g. PALM, STORM, STED) beat this, but they are still limited to 10 s of nm, and the images are an indirect pointillist representation of only part of the original object. Here we describe a way of combining a sample preparation technique taken from histopathology, with a probe-based nano-imaging techniq… ▽ More Optical microscopy has a diffraction limited resolution of about 250 nm. Fluorescence methods (e.g. PALM, STORM, STED) beat this, but they are still limited to 10 s of nm, and the images are an indirect pointillist representation of only part of the original object. Here we describe a way of combining a sample preparation technique taken from histopathology, with a probe-based nano-imaging technique, (s SNOM) from the world of Solid State Physics. This allows us to image subcellular structures optically, and at a nanoscale resolution that is about 100 x better than normal microscopes. By adding a tuneable laser source, we also demonstrate mid-infrared chemical nano-imaging (MICHNI) in human myeloma cells and we use it to map the binding sites of the anti cancer drug bortezomib to less than 10 zL sized intracellular components. MICHNI is label free and can be used with any biological material and drugs with specific functional chemistry. We believe that its combination of speed, cheapness, simplicity, safety and chemical contrast promises a transformative impact across the life sciences. △ Less

Submitted 11 May, 2020; originally announced May 2020.

Comments: 13 pages including supplementary information section. arXiv admin note: substantial text overlap with arXiv:1805.11466

Few-monolayer yttria-doped zirconia films: Segregation and phase stabilization

Authors: Peter Lackner, Amy J. Brandt, Ulrike Diebold, Michael Schmid

Abstract: For most applications, zirconia (ZrO2) is doped with yttria. Doping leads to the stabilization of the tetragonal or cubic phase, and increased oxygen ion conductivity. Most previous surface studies of yttria-doped zirconia were plagued by impurities, however. We have studied doping of pure, 5-monolayer ZrO2 films on Rh(111) by x-ray photoelectron spectroscopy (XPS), scanning tunneling microscopy (… ▽ More For most applications, zirconia (ZrO2) is doped with yttria. Doping leads to the stabilization of the tetragonal or cubic phase, and increased oxygen ion conductivity. Most previous surface studies of yttria-doped zirconia were plagued by impurities, however. We have studied doping of pure, 5-monolayer ZrO2 films on Rh(111) by x-ray photoelectron spectroscopy (XPS), scanning tunneling microscopy (STM), and low-energy electron diffraction (LEED). STM and LEED show that the tetragonal phase is stabilized by unexpectedly low dopant concentrations, 0.5 mol% Y2O3, even when the films are essentially fully oxidized (as evidenced by XPS core level shifts). XPS also shows Y segregation to the surface with an estimated segregation enthalpy of $-23 \pm 4$\,kJ/mol. △ Less

Submitted 21 January, 2020; originally announced January 2020.

Comments: Accepted for Journal of Chemical Physics

Building A Field: The Future of Astronomy with Gravitational Waves, A State of The Profession Consideration for Astro2020

Authors: Kelly Holley-Bockelmann, Joey Shapiro Key, Brittany Kamai, Robert Caldwell, Warren Brown, Bill Gabella, Karan Jani, Quentin Baghi, John Baker, Jillian Bellovary, Pete Bender, Emanuele Berti, T. J. Brandt, Curt Cutler, John W. Conklin, Michael Eracleous, Elizabeth C. Ferrara, Bernard J. Kelly, Shane L. Larson, Jeff Livas, Maura McLaughlin, Sean T. McWilliams, Guido Mueller, Priyamvada Natarajan, Norman Rioux , et al. (6 additional authors not shown)

Abstract: Harnessing the sheer discovery potential of gravitational wave astronomy will require bold, deliberate, and sustained efforts to train and develop the requisite workforce. The next decade requires a strategic plan to build -- from the ground up -- a robust, open, and well-connected gravitational wave astronomy community with deep participation from traditional astronomers, physicists, data scienti… ▽ More Harnessing the sheer discovery potential of gravitational wave astronomy will require bold, deliberate, and sustained efforts to train and develop the requisite workforce. The next decade requires a strategic plan to build -- from the ground up -- a robust, open, and well-connected gravitational wave astronomy community with deep participation from traditional astronomers, physicists, data scientists, and instrumentalists. This basic infrastructure is sorely needed as an enabling foundation for research. We outline a set of recommendations for funding agencies, universities, and professional societies to help build a thriving, diverse, and inclusive new field. △ Less

Submitted 16 December, 2019; originally announced December 2019.

Detection of the 511 keV Galactic positron annihilation line with COSI

Authors: Carolyn A. Kierans, Steven E. Boggs, Andreas Zoglauer, Alex W. Lowell, Clio C. Sleator, Jacqueline Beechert, Terri J. Brandt, Pierre Jean, Hadar Lazar, Jarred M. Roberts, Thomas Siegert, John A. Tomsick, Peter von Ballmoos

Abstract: The signature of positron annihilation, namely the 511 keV $γ$-ray line, was first detected coming from the direction of the Galactic center in the 1970's, but the source of Galactic positrons still remains a puzzle. The measured flux of the annihilation corresponds to an intense steady source of positron production, with an annihilation rate on the order of $\sim10^{43}$~e$^{+}$/s. The 511 keV em… ▽ More The signature of positron annihilation, namely the 511 keV $γ$-ray line, was first detected coming from the direction of the Galactic center in the 1970's, but the source of Galactic positrons still remains a puzzle. The measured flux of the annihilation corresponds to an intense steady source of positron production, with an annihilation rate on the order of $\sim10^{43}$~e$^{+}$/s. The 511 keV emission is the strongest persistent Galactic $γ$-ray line signal and it shows a concentration towards the Galactic center region. An additional low-surface brightness component is aligned with the Galactic disk; however, the morphology of the latter is not well constrained. The Compton Spectrometer and Imager (COSI) is a balloon-borne soft $γ$-ray (0.2--5 MeV) telescope designed to perform wide-field imaging and high-resolution spectroscopy. One of its major goals is to further our understanding of Galactic positrons. COSI had a 46-day balloon flight in May--July 2016 from Wanaka, New Zealand, and here we report on the detection and spectral and spatial analyses of the 511 keV emission from those observations. To isolate the Galactic positron annihilation emission from instrumental background, we have developed a technique to separate celestial signals utilizing the COMPTEL Data Space. With this method, we find a 7.2$σ$ detection of the 511 keV line. We find that the spatial distribution is not consistent with a single point source, and it appears to be broader than what has been previously reported. △ Less

Submitted 17 April, 2020; v1 submitted 29 November, 2019; originally announced December 2019.

Comments: 14 pages, 12 figures. Submitted to ApJ

Benchmarking simulations of the Compton Spectrometer and Imager with calibrations

Authors: Clio C. Sleator, Andreas Zoglauer, Alexander W. Lowell, Carolyn A. Kierans, Nicholas Pellegrini, Jacqueline Beechert, Steven E. Boggs, Terri J. Brandt, Hadar Lazar, Jarred M. Robert, Thomas Siegert, John A. Tomsick

Abstract: The Compton Spectrometer and Imager (COSI) is a balloon-borne gamma-ray (0.2-5 MeV) telescope designed to study astrophysical sources. COSI employs a compact Compton telescope design utilizing 12 high-purity germanium double-sided strip detectors and is inherently sensitive to polarization. In 2016, COSI was launched from Wanaka, New Zealand and completed a successful 46-day flight on NASA's new S… ▽ More The Compton Spectrometer and Imager (COSI) is a balloon-borne gamma-ray (0.2-5 MeV) telescope designed to study astrophysical sources. COSI employs a compact Compton telescope design utilizing 12 high-purity germanium double-sided strip detectors and is inherently sensitive to polarization. In 2016, COSI was launched from Wanaka, New Zealand and completed a successful 46-day flight on NASA's new Super Pressure Balloon. In order to perform imaging, spectral, and polarization analysis of the sources observed during the 2016 flight, we compute the detector response from well-benchmarked simulations. As required for accurate simulations of the instrument, we have built a comprehensive mass model of the instrument and developed a detailed detector effects engine which applies the intrinsic detector performance to Monte Carlo simulations. The simulated detector effects include energy, position, and timing resolution, thresholds, dead strips, charge sharing, charge loss, crosstalk, dead time, and detector trigger conditions. After including these effects, the simulations closely resemble the measurements, the standard analysis pipeline used for measurements can also be applied to the simulations, and the responses computed from the simulations are accurate. We have computed the systematic error that we must apply to measured fluxes at certain energies, which is 6.3% on average. Here we describe the detector effects engine and the benchmarking tests performed with calibrations. △ Less

Submitted 7 November, 2019; originally announced November 2019.

Comments: 16 pages, 21 figures

Journal ref: Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Volume 946, 2019, 162643, ISSN 0168-9002, https://doi.org/10.1016/j.nima.2019.162643

Text mining policy: Classifying forest and landscape restoration policy agenda with neural information retrieval

Authors: John Brandt

Abstract: Dozens of countries have committed to restoring the ecological functionality of 350 million hectares of land by 2030. In order to achieve such wide-scale implementation of restoration, the values and priorities of multi-sectoral stakeholders must be aligned and integrated with national level commitments and other development agenda. Although misalignment across scales of policy and between stakeho… ▽ More Dozens of countries have committed to restoring the ecological functionality of 350 million hectares of land by 2030. In order to achieve such wide-scale implementation of restoration, the values and priorities of multi-sectoral stakeholders must be aligned and integrated with national level commitments and other development agenda. Although misalignment across scales of policy and between stakeholders are well known barriers to implementing restoration, fast-paced policy making in multi-stakeholder environments complicates the monitoring and analysis of governance and policy. In this work, we assess the potential of machine learning to identify restoration policy agenda across diverse policy documents. An unsupervised neural information retrieval architecture is introduced that leverages transfer learning and word embeddings to create high-dimensional representations of paragraphs. Policy agenda labels are recast as information retrieval queries in order to classify policies with a cosine similarity threshold between paragraphs and query embeddings. This approach achieves a 0.83 F1-score measured across 14 policy agenda in 31 policy documents in Malawi, Kenya, and Rwanda, indicating that automated text mining can provide reliable, generalizable, and efficient analyses of restoration policy. △ Less

Submitted 6 August, 2019; originally announced August 2019.

Comments: In FEED 19 Workshop at KDD 2019. Anchorage, AK, USA, 5 pages

Astro2020 APC White Paper: Providing a Timely Review of Input Demographics to Advisory Committees

Authors: Dara Norman, Terri J. Brandt, Nancy D. Morrison, Sarah Tuttle, Julie Rathbun, Zach Berta-Thompson, Edmund Bertschinger, Nancy Chanover, Karen Knierman, Aparna Venkatesan, Kim Coble, Jonathan Fraine, Adam Burgasser, Ivelina Momcheva, Marie Lemoine-Busserolle

Abstract: Organizations that support science (astronomy) such as federal agencies, research centers, observatories, academic institutions, societies, etc. employ advisory committees and boards as a mechanism for reviewing their activities and giving advice on practices, policies and future directions. As with any scientific endeavor, there is concern over complementing these committees with enough members w… ▽ More Organizations that support science (astronomy) such as federal agencies, research centers, observatories, academic institutions, societies, etc. employ advisory committees and boards as a mechanism for reviewing their activities and giving advice on practices, policies and future directions. As with any scientific endeavor, there is concern over complementing these committees with enough members who have as broad a range of expertise and understanding as possible, so that bias is mitigated. However, for a number of reasons (logistical, practical, financial, etc.), committees can also not be infinitely large and thus trade-offs must be made. It is often recognized that conflicts of interest must be acknowledged within these committees, but what is not often recognized it the potential for unmitigated biases and "group think" that can be introduced as part of these committees. In this white paper, we recommend that advisory committees that collect community input, (e.g., the Decadal Survey review committee), also collect, compile and review input demographic data before finalizing reports, (e.g., the final 2020 Decadal Survey Report). A summary of these data should be released alongside the final survey report. This information would enable the committee to understand potential "blind spots" and biases of the data collection phase and inform future data collections of any barriers that affect the omission of perspectives from various demographics. △ Less

Submitted 30 July, 2019; originally announced July 2019.

Comments: 8 pages; APC (State of the Profession) White Paper submitted to the Astro2020 Decadal Survey

A Study of Network Congestion in Two Supercomputing High-Speed Interconnects

Authors: Saurabh Jha, Archit Patke, Jim Brandt, Ann Gentile, Mike Showerman, Eric Roman, Zbigniew T. Kalbarczyk, William T. Kramer, Ravishankar K. Iyer

Abstract: Network congestion in high-speed interconnects is a major source of application run time performance variation. Recent years have witnessed a surge of interest from both academia and industry in the development of novel approaches for congestion control at the network level and in application placement, mapping, and scheduling at the system-level. However, these studies are based on proxy applicat… ▽ More Network congestion in high-speed interconnects is a major source of application run time performance variation. Recent years have witnessed a surge of interest from both academia and industry in the development of novel approaches for congestion control at the network level and in application placement, mapping, and scheduling at the system-level. However, these studies are based on proxy applications and benchmarks that are not representative of field-congestion characteristics of high-speed interconnects. To address this gap, we present (a) an end-to-end framework for monitoring and analysis to support long-term field-congestion characterization studies, and (b) an empirical study of network congestion in petascale systems across two different interconnect technologies: (i) Cray Gemini, which uses a 3-D torus topology, and (ii) Cray Aries, which uses the DragonFly topology. △ Less

Submitted 11 July, 2019; originally announced July 2019.

Comments: Accepted for HOTI2019

Understanding Fault Scenarios and Impacts through Fault Injection Experiments in Cielo

Authors: Valerio Formicola, Saurabh Jha, Daniel Chen, Fei Deng, Amanda Bonnie, Mike Mason, Jim Brandt, Ann Gentile, Larry Kaplan, Jason Repik, Jeremy Enos, Mike Showerman, Annette Greiner, Zbigniew Kalbarczyk, Ravishankar K. Iyer, Bill Krammer

Abstract: We present a set of fault injection experiments performed on the ACES (LANL/SNL) Cray XE supercomputer Cielo. We use this experimental campaign to improve the understanding of failure causes and propagation that we observed in the field failure data analysis of NCSA's Blue Waters. We use the data collected from the logs and from network performance counter data 1) to characterize the fault-error-f… ▽ More We present a set of fault injection experiments performed on the ACES (LANL/SNL) Cray XE supercomputer Cielo. We use this experimental campaign to improve the understanding of failure causes and propagation that we observed in the field failure data analysis of NCSA's Blue Waters. We use the data collected from the logs and from network performance counter data 1) to characterize the fault-error-failure sequence and recovery mechanisms in the Gemini network and in the Cray compute nodes, 2) to understand the impact of failures on the system and the user applications at different scale, and 3) to identify and recreate fault scenarios that induce unrecoverable failures, in order to create new tests for system and application design. The faults were injected through special input commands to bring down network links, directional connections, nodes, and blades. We present extensions that will be needed to apply our methodologies of injection and analysis to the Cray XC (Aries) systems. △ Less

Submitted 1 July, 2019; originally announced July 2019.

Comments: Presented at Cray User Group 2017

LPaintB: Learning to Paint from Self-Supervision

Authors: Biao Jia, Jonathan Brandt, Radomir Mech, Byungmoon Kim, Dinesh Manocha

Abstract: We present a novel reinforcement learning-based natural media painting algorithm. Our goal is to reproduce a reference image using brush strokes and we encode the objective through observations. Our formulation takes into account that the distribution of the reward in the action space is sparse and training a reinforcement learning algorithm from scratch can be difficult. We present an approach th… ▽ More We present a novel reinforcement learning-based natural media painting algorithm. Our goal is to reproduce a reference image using brush strokes and we encode the objective through observations. Our formulation takes into account that the distribution of the reward in the action space is sparse and training a reinforcement learning algorithm from scratch can be difficult. We present an approach that combines self-supervised learning and reinforcement learning to effectively transfer negative samples into positive ones and change the reward distribution. We demonstrate the benefits of our painting agent to reproduce reference images with brush strokes. The training phase takes about one hour and the runtime algorithm takes about 30 seconds on a GTX1080 GPU reproducing a 1000x800 image with 20,000 strokes. △ Less

Submitted 21 September, 2019; v1 submitted 17 June, 2019; originally announced June 2019.

Spatio-temporal crop classification of low-resolution satellite imagery with capsule layers and distributed attention

Authors: John Brandt

Abstract: Land use classification of low resolution spatial imagery is one of the most extensively researched fields in remote sensing. Despite significant advancements in satellite technology, high resolution imagery lacks global coverage and can be prohibitively expensive to procure for extended time periods. Accurately classifying land use change without high resolution imagery offers the potential to mo… ▽ More Land use classification of low resolution spatial imagery is one of the most extensively researched fields in remote sensing. Despite significant advancements in satellite technology, high resolution imagery lacks global coverage and can be prohibitively expensive to procure for extended time periods. Accurately classifying land use change without high resolution imagery offers the potential to monitor vital aspects of global development agenda including climate smart agriculture, drought resistant crops, and sustainable land management. Utilizing a combination of capsule layers and long-short term memory layers with distributed attention, the present paper achieves state-of-the-art accuracy on temporal crop type classification at a 30x30m resolution with Sentinel 2 imagery. △ Less

Submitted 22 April, 2019; originally announced April 2019.

PaintBot: A Reinforcement Learning Approach for Natural Media Painting

Authors: Biao Jia, Chen Fang, Jonathan Brandt, Byungmoon Kim, Dinesh Manocha

Abstract: We propose a new automated digital painting framework, based on a painting agent trained through reinforcement learning. To synthesize an image, the agent selects a sequence of continuous-valued actions representing primitive painting strokes, which are accumulated on a digital canvas. Action selection is guided by a given reference image, which the agent attempts to replicate subject to the limit… ▽ More We propose a new automated digital painting framework, based on a painting agent trained through reinforcement learning. To synthesize an image, the agent selects a sequence of continuous-valued actions representing primitive painting strokes, which are accumulated on a digital canvas. Action selection is guided by a given reference image, which the agent attempts to replicate subject to the limitations of the action space and the agent's learned policy. The painting agent policy is determined using a variant of proximal policy optimization reinforcement learning. During training, our agent is presented with patches sampled from an ensemble of reference images. To accelerate training convergence, we adopt a curriculum learning strategy, whereby reference patches are sampled according to how challenging they are using the current policy. We experiment with differing loss functions, including pixel-wise and perceptual loss, which have consequent differing effects on the learned policy. We demonstrate that our painting agent can learn an effective policy with a high dimensional continuous action space comprising pen pressure, width, tilt, and color, for a variety of painting styles. Through a coarse-to-fine refinement process our agent can paint arbitrarily complex images in the desired style. △ Less

Submitted 3 April, 2019; originally announced April 2019.

Ultra-heavy cosmic-ray science--Are r-process nuclei in the cosmic rays produced in supernovae or binary neutron star mergers?

Authors: W. R. Binns, M. H. Israel, B. F. Rauch, A. C. Cummings, A. J. Davis, A. W. Labrador, R. A. Leske, R. A Mewaldt, E. C. Stone, M. E. Wiedenbeck, T. J. Brandt, E. R. Christian, J. T. Link, J. W. Mitchell, G. A. de Nolfo, T. T. von Rosenvinge, K. Sakai, M. Sasaki, C. J. Waddington, H. T. Janka, A. L. Melott, G. M. Mason, E-S. Seo, J. H. Adams, F-K. Thielemann , et al. (3 additional authors not shown)

Abstract: The recent detection of 60Fe in the cosmic rays provides conclusive evidence that there is a recently synthesized component (few MY) in the GCRs (Binns et al. 2016). In addition, these nuclei must have been synthesized and accelerated in supernovae near the solar system, probably in the Sco-Cen OB association subgroups, which are about 100 pc distant from the Sun. Recent theoretical work on the pr… ▽ More The recent detection of 60Fe in the cosmic rays provides conclusive evidence that there is a recently synthesized component (few MY) in the GCRs (Binns et al. 2016). In addition, these nuclei must have been synthesized and accelerated in supernovae near the solar system, probably in the Sco-Cen OB association subgroups, which are about 100 pc distant from the Sun. Recent theoretical work on the production of r-process nuclei appears to indicate that it is difficult for SNe to produce the solar system abundances relative to iron of r-process elements with high atomic number (Z), including the actinides (Th, U, Np, Pu, and Cm). Instead, it is believed by many that the heaviest r-process nuclei, or perhaps even all r-process nuclei, are produced in binary neutron star mergers. Since we now know that there is at least a component of the GCRs that has been recently synthesized and accelerated, models of r-process production by SNe and BNSM can be tested by measuring the relative abundances of these ultra-heavy r-process nuclei, and especially the actinides, since they are radioactive and provide clocks that give the time interval from nucleosynthesis to detection at Earth. Since BNSM are believed to be much less frequent in our galaxy than SNe (roughly 1000 times less frequent, the ratios of the actinides, each with their own half-life, will enable a clear determination of whether the heaviest r-process nuclei are synthesized in SNe or in BNSM. In addition, the r-process nuclei for the charge range from 34 to 82 can be used to constrain models of r-process production in BNSM and SNe. Thus, GCRs become a multi-messenger component in the study of BNSM and SNe. △ Less

Submitted 28 March, 2019; originally announced March 2019.

Comments: Astro2020 Science White Paper