Showing 1–50 of 108 results for author: Corso, A

Cosmic ray susceptibility of the Terahertz Intensity Mapper detector arrays

Authors: Lun-Jun Liu, Reinier M. J. Janssen, Bruce Bumble, Elijah Kane, Logan M. Foote, Charles M. Bradford, Steven Hailey-Dunsheath, Shubh Agrawal, James E. Aguirre, Hrushi Athreya, Justin S. Bracks, Brockton S. Brendal, Anthony J. Corso, Jeffrey P. Filippini, Jianyang Fu, Christopher E. Groppi, Dylan Joralmon, Ryan P. Keenan, Mikolaj Kowalik, Ian N. Lowe, Alex Manduca, Daniel P. Marrone, Philip D. Mauskopf, Evan C. Mayer, Rong Nie , et al. (4 additional authors not shown)

Abstract: We report on the effects of cosmic ray interactions with the Kinetic Inductance Detector (KID) based focal plane array for the Terahertz Intensity Mapper (TIM). TIM is a NASA-funded balloon-borne experiment designed to probe the peak of the star formation in the Universe. It employs two spectroscopic bands, each equipped with a focal plane of four $\sim\,$900-pixel, KID-based array chips. Measurem… ▽ More We report on the effects of cosmic ray interactions with the Kinetic Inductance Detector (KID) based focal plane array for the Terahertz Intensity Mapper (TIM). TIM is a NASA-funded balloon-borne experiment designed to probe the peak of the star formation in the Universe. It employs two spectroscopic bands, each equipped with a focal plane of four $\sim\,$900-pixel, KID-based array chips. Measurements of an 864-pixel TIM array shows 791 resonators in a 0.5$\,$GHz bandwidth. We discuss challenges with resonator calibration caused by this high multiplexing density. We robustly identify the physical positions of 788 (99.6$\,$%) detectors using a custom LED-based identification scheme. Using this information we show that cosmic ray events occur at a rate of 2.1$\,\mathrm{events/min/cm^2}$ in our array. 66$\,$% of the events affect a single pixel, and another 33$\,$% affect $<\,$5 KIDs per event spread over a 0.66$\,\mathrm{cm^2}$ region (2 pixel pitches in radius). We observe a total cosmic ray dead fraction of 0.0011$\,$%, and predict that the maximum possible in-flight dead fraction is $\sim\,$0.165$\,$%, which demonstrates our design will be robust against these high-energy events. △ Less

Submitted 24 July, 2024; originally announced July 2024.

Comments: 14 pages, 5 figures. Accepted for the publication in Journal of Low Temperature Physics (2024)

Ab initio quasi-harmonic thermoelasticity of molybdenum at high temperature and pressure

Authors: Xuejun Gong, Andrea Dal Corso

Abstract: We present the ab-initio thermoelastic properties of body-centered cubic molybdenum under extreme conditions obtained within the quasi-harmonic approximation including both the vibrational and the electronic thermal excitations contributions to the free energy. The quasi-harmonic temperature dependent elastic constants are calculated and compared with existing experiments and with the quasi-static… ▽ More We present the ab-initio thermoelastic properties of body-centered cubic molybdenum under extreme conditions obtained within the quasi-harmonic approximation including both the vibrational and the electronic thermal excitations contributions to the free energy. The quasi-harmonic temperature dependent elastic constants are calculated and compared with existing experiments and with the quasi-static approximation. We find that the quasi-harmonic approximation allows a much better interpretation of the experimental data confirming the trend found previously in other metals. Using the Voigt-Reuss-Hill average we predict the compressional and shear sound velocities of polycrystalline molybdenum as a function of pressure for several temperatures which might be accessible in experiments. △ Less

Submitted 24 June, 2024; originally announced June 2024.

Diffusion-Based Failure Sampling for Cyber-Physical Systems

Authors: Harrison Delecki, Marc R. Schlichting, Mansur Arief, Anthony Corso, Marcell Vazquez-Chanlatte, Mykel J. Kochenderfer

Abstract: Validating safety-critical autonomous systems in high-dimensional domains such as robotics presents a significant challenge. Existing black-box approaches based on Markov chain Monte Carlo may require an enormous number of samples, while methods based on importance sampling often rely on simple parametric families that may struggle to represent the distribution over failures. We propose to sample… ▽ More Validating safety-critical autonomous systems in high-dimensional domains such as robotics presents a significant challenge. Existing black-box approaches based on Markov chain Monte Carlo may require an enormous number of samples, while methods based on importance sampling often rely on simple parametric families that may struggle to represent the distribution over failures. We propose to sample the distribution over failures using a conditional denoising diffusion model, which has shown success in complex high-dimensional problems such as robotic task planning. We iteratively train a diffusion model to produce state trajectories closer to failure. We demonstrate the effectiveness of our approach on high-dimensional robotic validation tasks, improving sample efficiency and mode coverage compared to existing black-box techniques. △ Less

Submitted 20 June, 2024; originally announced June 2024.

Comments: Under review at RA-L

ConstrainedZero: Chance-Constrained POMDP Planning using Learned Probabilistic Failure Surrogates and Adaptive Safety Constraints

Authors: Robert J. Moss, Arec Jamgochian, Johannes Fischer, Anthony Corso, Mykel J. Kochenderfer

Abstract: To plan safely in uncertain environments, agents must balance utility with safety constraints. Safe planning problems can be modeled as a chance-constrained partially observable Markov decision process (CC-POMDP) and solutions often use expensive rollouts or heuristics to estimate the optimal value and action-selection policy. This work introduces the ConstrainedZero policy iteration algorithm tha… ▽ More To plan safely in uncertain environments, agents must balance utility with safety constraints. Safe planning problems can be modeled as a chance-constrained partially observable Markov decision process (CC-POMDP) and solutions often use expensive rollouts or heuristics to estimate the optimal value and action-selection policy. This work introduces the ConstrainedZero policy iteration algorithm that solves CC-POMDPs in belief space by learning neural network approximations of the optimal value and policy with an additional network head that estimates the failure probability given a belief. This failure probability guides safe action selection during online Monte Carlo tree search (MCTS). To avoid overemphasizing search based on the failure estimates, we introduce $Δ$-MCTS, which uses adaptive conformal inference to update the failure threshold during planning. The approach is tested on a safety-critical POMDP benchmark, an aircraft collision avoidance system, and the sustainability problem of safe CO$_2$ storage. Results show that by separating safety constraints from the objective we can achieve a target level of safety without optimizing the balance between rewards and costs. △ Less

Submitted 1 May, 2024; originally announced May 2024.

Comments: In Proceedings of the 2024 International Joint Conference on Artificial Intelligence (IJCAI)

Human vs. Machine: Behavioral Differences Between Expert Humans and Language Models in Wargame Simulations

Authors: Max Lamparth, Anthony Corso, Jacob Ganz, Oriana Skylar Mastro, Jacquelyn Schneider, Harold Trinkunas

Abstract: To some, the advent of AI promises better decision-making and increased military effectiveness while reducing the influence of human error and emotions. However, there is still debate about how AI systems, especially large language models (LLMs) that can be applied to many tasks, behave compared to humans in high-stakes military decision-making scenarios with the potential for increased risks towa… ▽ More To some, the advent of AI promises better decision-making and increased military effectiveness while reducing the influence of human error and emotions. However, there is still debate about how AI systems, especially large language models (LLMs) that can be applied to many tasks, behave compared to humans in high-stakes military decision-making scenarios with the potential for increased risks towards escalation and unnecessary conflicts. To test this potential and scrutinize the use of LLMs for such purposes, we use a new wargame experiment with 107 national security experts designed to examine crisis escalation in a fictional US-China scenario and compare the behavior of human player teams to LLM-simulated team responses in separate simulations. Here, we find that the LLM-simulated responses can be more aggressive and significantly affected by changes in the scenario. We show a considerable high-level agreement in the LLM and human responses and significant quantitative and qualitative differences in individual actions and strategic tendencies. These differences depend on intrinsic biases in LLMs regarding the appropriate level of violence following strategic instructions, the choice of LLM, and whether the LLMs are tasked to decide for a team of players directly or first to simulate dialog between a team of players. When simulating the dialog, the discussions lack quality and maintain a farcical harmony. The LLM simulations cannot account for human player characteristics, showing no significant difference even for extreme traits, such as "pacifist" or "aggressive sociopath." When probing behavioral consistency across individual moves of the simulation, the tested LLMs deviated from each other but generally showed somewhat consistent behavior. Our results motivate policymakers to be cautious before granting autonomy or following AI-based strategy recommendations. △ Less

Submitted 30 July, 2024; v1 submitted 5 March, 2024; originally announced March 2024.

Comments: Updated based on reviewer feedback to match AIES accepted camera-ready version

Ab initio thermodynamic properties of Iridium: A high-pressure and high-temperature study

Authors: Balaram Thakur, Xuejun Gong, Andrea Dal Corso

Abstract: The high-pressure and high-temperature thermodynamic properties of iridium are studied using density functional theory in combination with the quasi-harmonic approximation, where both the contributions to the free energy of phonons and of electronic excitations are considered. The reliability of different exchange and correlational functionals [Perdew-Burke-Ernzerhof generalized gradient approxima… ▽ More The high-pressure and high-temperature thermodynamic properties of iridium are studied using density functional theory in combination with the quasi-harmonic approximation, where both the contributions to the free energy of phonons and of electronic excitations are considered. The reliability of different exchange and correlational functionals [Perdew-Burke-Ernzerhof generalized gradient approximation (PBE) (Perdew et al. Phys. Rev. Lett. 77, 3865 (1996)), PBE modified for dense solids (PBEsol) (Perdew et al. Phys. Rev. B 100, 136406 (2008)) and local density approximation (LDA) (Perdew et al. Phys. Rev. B 23, 5048 (1981))], for studying the equation of state (EOS), the phonon dispersions, the mode-Grüneisen parameter, and different thermodynamic properties like thermal pressure, volume thermal expansivity, isobaric heat capacity, bulk modulus, and the average Grüneisen parameter are tested. Elastic constants are studied at T=0 K as a function of pressure. The predicted results are compared with the available experiments and previous theoretical data. We find generally a good agreement with experiments with at least one functional, but none of the three outperforms the others in all the investigated thermodynamic properties. The electronic excitations contribution is minimal in bulk modulus, but it is significant for other thermodynamic properties. △ Less

Submitted 23 January, 2024; originally announced January 2024.

Comments: 18 Pages, 10 Figures and 2 Tables

Journal ref: Computational Materials Science (Volume 234, February 2024, 112797)

Constrained Hierarchical Monte Carlo Belief-State Planning

Authors: Arec Jamgochian, Hugo Buurmeijer, Kyle H. Wray, Anthony Corso, Mykel J. Kochenderfer

Abstract: Optimal plans in Constrained Partially Observable Markov Decision Processes (CPOMDPs) maximize reward objectives while satisfying hard cost constraints, generalizing safe planning under state and transition uncertainty. Unfortunately, online CPOMDP planning is extremely difficult in large or continuous problem domains. In many large robotic domains, hierarchical decomposition can simplify planning… ▽ More Optimal plans in Constrained Partially Observable Markov Decision Processes (CPOMDPs) maximize reward objectives while satisfying hard cost constraints, generalizing safe planning under state and transition uncertainty. Unfortunately, online CPOMDP planning is extremely difficult in large or continuous problem domains. In many large robotic domains, hierarchical decomposition can simplify planning by using tools for low-level control given high-level action primitives (options). We introduce Constrained Options Belief Tree Search (COBeTS) to leverage this hierarchy and scale online search-based CPOMDP planning to large robotic problems. We show that if primitive option controllers are defined to satisfy assigned constraint budgets, then COBeTS will satisfy constraints anytime. Otherwise, COBeTS will guide the search towards a safe sequence of option primitives, and hierarchical monitoring can be used to achieve runtime safety. We demonstrate COBeTS in several safety-critical, constrained partially observable robotic domains, showing that it can plan successfully in continuous CPOMDPs while non-hierarchical baselines cannot. △ Less

Submitted 26 February, 2024; v1 submitted 30 October, 2023; originally announced October 2023.

Comments: Accepted to the 2024 IEEE International Conference on Robotics and Automation (ICRA)

Transcending the Attention Paradigm: Representation Learning from Geospatial Social Media Data

Authors: Nick DiSanto, Anthony Corso, Benjamin Sanders, Gavin Harding

Abstract: While transformers have pioneered attention-driven architectures as a cornerstone of language modeling, their dependence on explicitly contextual information underscores limitations in their abilities to tacitly learn overarching textual themes. This study challenges the heuristic paradigm of performance benchmarking by investigating social media data as a source of distributed patterns. In stark… ▽ More While transformers have pioneered attention-driven architectures as a cornerstone of language modeling, their dependence on explicitly contextual information underscores limitations in their abilities to tacitly learn overarching textual themes. This study challenges the heuristic paradigm of performance benchmarking by investigating social media data as a source of distributed patterns. In stark contrast to networks that rely on capturing complex long-term dependencies, models of online data inherently lack structure and are forced to detect latent structures in the aggregate. To properly represent these abstract relationships, this research dissects empirical social media corpora into their elemental components, analyzing over two billion tweets across population-dense locations. We create Bag-of-Word embedding specific to each city and compare their respective representations. This finds that even amidst noisy data, geographic location has a considerable influence on online communication, and that hidden insights can be uncovered without the crutch of advanced algorithms. This evidence presents valuable geospatial implications in social science and challenges the notion that intricate models are prerequisites for pattern recognition in natural language. This aligns with the evolving landscape that questions the embrace of absolute interpretability over abstract understanding and bridges the divide between sophisticated frameworks and intangible relationships. △ Less

Submitted 14 January, 2024; v1 submitted 8 October, 2023; originally announced October 2023.

SAVME: Efficient Safety Validation for Autonomous Systems Using Meta-Learning

Authors: Marc R. Schlichting, Nina V. Boord, Anthony L. Corso, Mykel J. Kochenderfer

Abstract: Discovering potential failures of an autonomous system is important prior to deployment. Falsification-based methods are often used to assess the safety of such systems, but the cost of running many accurate simulation can be high. The validation can be accelerated by identifying critical failure scenarios for the system under test and by reducing the simulation runtime. We propose a Bayesian appr… ▽ More Discovering potential failures of an autonomous system is important prior to deployment. Falsification-based methods are often used to assess the safety of such systems, but the cost of running many accurate simulation can be high. The validation can be accelerated by identifying critical failure scenarios for the system under test and by reducing the simulation runtime. We propose a Bayesian approach that integrates meta-learning strategies with a multi-armed bandit framework. Our method involves learning distributions over scenario parameters that are prone to triggering failures in the system under test, as well as a distribution over fidelity settings that enable fast and accurate simulations. In the spirit of meta-learning, we also assess whether the learned fidelity settings distribution facilitates faster learning of the scenario parameter distributions for new scenarios. We showcase our methodology using a cutting-edge 3D driving simulator, incorporating 16 fidelity settings for an autonomous vehicle stack that includes camera and lidar sensors. We evaluate various scenarios based on an autonomous vehicle pre-crash typology. As a result, our approach achieves a significant speedup, up to 18 times faster compared to traditional methods that solely rely on a high-fidelity simulator. △ Less

Submitted 30 September, 2023; v1 submitted 21 September, 2023; originally announced September 2023.

Comments: Accepted for ITSC 2023

Spin-Flop Ordering from Frustrated Ferro- and Antiferromagnetic Interactions: A Combined Theoretical and Experimental Study of a $\mathrm{Mn}/\mathrm{Fe}(100)$ Monolayer

Authors: C. Grazioli, Dario Alfè, S. R. Krishnakumar, Subhra Sen Gupta, M. Veronese, S. Turchini, Nicola Bonini, Andrea Dal Corso, D. D. Sarma, Stefano Baroni, C. Carbone

Abstract: The occurrence of a noncollinear magnetic structure at a Mn monolayer grown epitaxially on Fe(100) is predicted theoretically, using spinor density-functional theory, and observed experimentally, using x-ray magnetic circular dichroism (XMCD) and linear dichroism (XMLD) spectroscopies. The combined use of XMCD and XMLD at the Mn-absorption edge allows us to assess the existence of ferromagnetic an… ▽ More The occurrence of a noncollinear magnetic structure at a Mn monolayer grown epitaxially on Fe(100) is predicted theoretically, using spinor density-functional theory, and observed experimentally, using x-ray magnetic circular dichroism (XMCD) and linear dichroism (XMLD) spectroscopies. The combined use of XMCD and XMLD at the Mn-absorption edge allows us to assess the existence of ferromagnetic and antiferromagnetic order at the interface, and also to determine the moment orientations with element specificity. The experimental results thus obtained are in excellent agreement with the magnetic structure determined theoretically. △ Less

Submitted 21 July, 2023; originally announced July 2023.

A Holistic Assessment of the Reliability of Machine Learning Systems

Authors: Anthony Corso, David Karamadian, Romeo Valentin, Mary Cooper, Mykel J. Kochenderfer

Abstract: As machine learning (ML) systems increasingly permeate high-stakes settings such as healthcare, transportation, military, and national security, concerns regarding their reliability have emerged. Despite notable progress, the performance of these systems can significantly diminish due to adversarial attacks or environmental changes, leading to overconfident predictions, failures to detect input fa… ▽ More As machine learning (ML) systems increasingly permeate high-stakes settings such as healthcare, transportation, military, and national security, concerns regarding their reliability have emerged. Despite notable progress, the performance of these systems can significantly diminish due to adversarial attacks or environmental changes, leading to overconfident predictions, failures to detect input faults, and an inability to generalize in unexpected scenarios. This paper proposes a holistic assessment methodology for the reliability of ML systems. Our framework evaluates five key properties: in-distribution accuracy, distribution-shift robustness, adversarial robustness, calibration, and out-of-distribution detection. A reliability score is also introduced and used to assess the overall system reliability. To provide insights into the performance of different algorithmic approaches, we identify and categorize state-of-the-art techniques, then evaluate a selection on real-world tasks using our proposed reliability metrics and reliability score. Our analysis of over 500 models reveals that designing for one metric does not necessarily constrain others but certain algorithmic techniques can improve reliability across multiple metrics simultaneously. This study contributes to a more comprehensive understanding of ML reliability and provides a roadmap for future research and development. △ Less

Submitted 29 July, 2023; v1 submitted 20 July, 2023; originally announced July 2023.

Reflections from the Workshop on AI-Assisted Decision Making for Conservation

Authors: Lily Xu, Esther Rolf, Sara Beery, Joseph R. Bennett, Tanya Berger-Wolf, Tanya Birch, Elizabeth Bondi-Kelly, Justin Brashares, Melissa Chapman, Anthony Corso, Andrew Davies, Nikhil Garg, Angela Gaylard, Robert Heilmayr, Hannah Kerner, Konstantin Klemmer, Vipin Kumar, Lester Mackey, Claire Monteleoni, Paul Moorcroft, Jonathan Palmer, Andrew Perrault, David Thau, Milind Tambe

Abstract: In this white paper, we synthesize key points made during presentations and discussions from the AI-Assisted Decision Making for Conservation workshop, hosted by the Center for Research on Computation and Society at Harvard University on October 20-21, 2022. We identify key open research questions in resource allocation, planning, and interventions for biodiversity conservation, highlighting conse… ▽ More In this white paper, we synthesize key points made during presentations and discussions from the AI-Assisted Decision Making for Conservation workshop, hosted by the Center for Research on Computation and Society at Harvard University on October 20-21, 2022. We identify key open research questions in resource allocation, planning, and interventions for biodiversity conservation, highlighting conservation challenges that not only require AI solutions, but also require novel methodological advances. In addition to providing a summary of the workshop talks and discussions, we hope this document serves as a call-to-action to orient the expansion of algorithmic decision-making approaches to prioritize real-world conservation challenges, through collaborative efforts of ecologists, conservation decision-makers, and AI researchers. △ Less

Submitted 17 July, 2023; originally announced July 2023.

Comments: Co-authored by participants from the October 2022 workshop: https://crcs.seas.harvard.edu/conservation-workshop

Efficient Determination of Safety Requirements for Perception Systems

Authors: Sydney M. Katz, Anthony L. Corso, Esen Yel, Mykel J. Kochenderfer

Abstract: Perception systems operate as a subcomponent of the general autonomy stack, and perception system designers often need to optimize performance characteristics while maintaining safety with respect to the overall closed-loop system. For this reason, it is useful to distill high-level safety requirements into component-level requirements on the perception system. In this work, we focus on efficientl… ▽ More Perception systems operate as a subcomponent of the general autonomy stack, and perception system designers often need to optimize performance characteristics while maintaining safety with respect to the overall closed-loop system. For this reason, it is useful to distill high-level safety requirements into component-level requirements on the perception system. In this work, we focus on efficiently determining sets of safe perception system performance characteristics given a black-box simulator of the fully-integrated, closed-loop system. We combine the advantages of common black-box estimation techniques such as Gaussian processes and threshold bandits to develop a new estimation method, which we call smoothing bandits. We demonstrate our method on a vision-based aircraft collision avoidance problem and show improvements in terms of both accuracy and efficiency over the Gaussian process and threshold bandit baselines. △ Less

Submitted 3 July, 2023; originally announced July 2023.

Comments: 10 pages, 14 figures, submitted to the 2023 Digital Avionics Systems Conference

AVOIDDS: Aircraft Vision-based Intruder Detection Dataset and Simulator

Authors: Elysia Q. Smyers, Sydney M. Katz, Anthony L. Corso, Mykel J. Kochenderfer

Abstract: Designing robust machine learning systems remains an open problem, and there is a need for benchmark problems that cover both environmental changes and evaluation on a downstream task. In this work, we introduce AVOIDDS, a realistic object detection benchmark for the vision-based aircraft detect-and-avoid problem. We provide a labeled dataset consisting of 72,000 photorealistic images of intruder… ▽ More Designing robust machine learning systems remains an open problem, and there is a need for benchmark problems that cover both environmental changes and evaluation on a downstream task. In this work, we introduce AVOIDDS, a realistic object detection benchmark for the vision-based aircraft detect-and-avoid problem. We provide a labeled dataset consisting of 72,000 photorealistic images of intruder aircraft with various lighting conditions, weather conditions, relative geometries, and geographic locations. We also provide an interface that evaluates trained models on slices of this dataset to identify changes in performance with respect to changing environmental conditions. Finally, we implement a fully-integrated, closed-loop simulator of the vision-based detect-and-avoid problem to evaluate trained models with respect to the downstream collision avoidance task. This benchmark will enable further research in the design of robust machine learning systems for use in safety-critical applications. The AVOIDDS dataset and code are publicly available at https://purl.stanford.edu/hj293cv5980 and https://github.com/sisl/VisionBasedAircraftDAA respectively. △ Less

Submitted 26 December, 2023; v1 submitted 19 June, 2023; originally announced June 2023.

Comments: Accepted to and presented at NeurIPS 2023, Datasets and Benchmarks Track; fixed link formatting in the abstract

Coronal Heating Rate in the Slow Solar Wind

Authors: Daniele Telloni, Marco Romoli, Marco Velli, Gary P. Zank, Laxman Adhikari, Cooper Downs, Aleksandr Burtovoi, Roberto Susino, Daniele Spadaro, Lingling Zhao, Alessandro Liberatore, Chen Shi, Yara De Leo, Lucia Abbo, Federica Frassati, Giovanna Jerse, Federico Landini, Gianalfredo Nicolini, Maurizio Pancrazzi, Giuliana Russano, Clementina Sasso, Vincenzo Andretta, Vania Da Deppo, Silvano Fineschi, Catia Grimani , et al. (37 additional authors not shown)

Abstract: This Letter reports the first observational estimate of the heating rate in the slowly expanding solar corona. The analysis exploits the simultaneous remote and local observations of the same coronal plasma volume with the Solar Orbiter/Metis and the Parker Solar Probe instruments, respectively, and relies on the basic solar wind magnetohydrodynamic equations. As expected, energy losses are a mino… ▽ More This Letter reports the first observational estimate of the heating rate in the slowly expanding solar corona. The analysis exploits the simultaneous remote and local observations of the same coronal plasma volume with the Solar Orbiter/Metis and the Parker Solar Probe instruments, respectively, and relies on the basic solar wind magnetohydrodynamic equations. As expected, energy losses are a minor fraction of the solar wind energy flux, since most of the energy dissipation that feeds the heating and acceleration of the coronal flow occurs much closer to the Sun than the heights probed in the present study, which range from 6.3 to 13.3 solar radii. The energy deposited to the supersonic wind is then used to explain the observed slight residual wind acceleration and to maintain the plasma in a non-adiabatic state. As derived in the Wentzel-Kramers-Brillouin limit, the present energy transfer rate estimates provide a lower limit, which can be very useful in refining the turbulence-based modeling of coronal heating and subsequent solar wind acceleration. △ Less

Submitted 19 June, 2023; originally announced June 2023.

BetaZero: Belief-State Planning for Long-Horizon POMDPs using Learned Approximations

Authors: Robert J. Moss, Anthony Corso, Jef Caers, Mykel J. Kochenderfer

Abstract: Real-world planning problems, including autonomous driving and sustainable energy applications like carbon storage and resource exploration, have recently been modeled as partially observable Markov decision processes (POMDPs) and solved using approximate methods. To solve high-dimensional POMDPs in practice, state-of-the-art methods use online planning with problem-specific heuristics to reduce p… ▽ More Real-world planning problems, including autonomous driving and sustainable energy applications like carbon storage and resource exploration, have recently been modeled as partially observable Markov decision processes (POMDPs) and solved using approximate methods. To solve high-dimensional POMDPs in practice, state-of-the-art methods use online planning with problem-specific heuristics to reduce planning horizons and make the problems tractable. Algorithms that learn approximations to replace heuristics have recently found success in large-scale fully observable domains. The key insight is the combination of online Monte Carlo tree search with offline neural network approximations of the optimal policy and value function. In this work, we bring this insight to partially observable domains and propose BetaZero, a belief-state planning algorithm for high-dimensional POMDPs. BetaZero learns offline approximations that replace heuristics to enable online decision making in long-horizon problems. We address several challenges inherent in large-scale partially observable domains; namely challenges of transitioning in stochastic environments, prioritizing action branching with a limited search budget, and representing beliefs as input to the network. To formalize the use of all limited search information, we train against a novel $Q$-weighted visit counts policy. We test BetaZero on various well-established POMDP benchmarks found in the literature and a real-world problem of critical mineral exploration. Experiments show that BetaZero outperforms state-of-the-art POMDP solvers on a variety of tasks. △ Less

Submitted 31 July, 2024; v1 submitted 31 May, 2023; originally announced June 2023.

Comments: Presented at the Reinforcement Learning Conference (RLC) 2024

Journal ref: RLJ, Volume 1, Issue (Number) 1, 2024

Experience Filter: Using Past Experiences on Unseen Tasks or Environments

Authors: Anil Yildiz, Esen Yel, Anthony L. Corso, Kyle H. Wray, Stefan J. Witwicki, Mykel J. Kochenderfer

Abstract: One of the bottlenecks of training autonomous vehicle (AV) agents is the variability of training environments. Since learning optimal policies for unseen environments is often very costly and requires substantial data collection, it becomes computationally intractable to train the agent on every possible environment or task the AV may encounter. This paper introduces a zero-shot filtering approach… ▽ More One of the bottlenecks of training autonomous vehicle (AV) agents is the variability of training environments. Since learning optimal policies for unseen environments is often very costly and requires substantial data collection, it becomes computationally intractable to train the agent on every possible environment or task the AV may encounter. This paper introduces a zero-shot filtering approach to interpolate learned policies of past experiences to generalize to unseen ones. We use an experience kernel to correlate environments. These correlations are then exploited to produce policies for new tasks or environments from learned policies. We demonstrate our methods on an autonomous vehicle driving through T-intersections with different characteristics, where its behavior is modeled as a partially observable Markov decision process (POMDP). We first construct compact representations of learned policies for POMDPs with unknown transition functions given a dataset of sequential actions and observations. Then, we filter parameterized policies of previously visited environments to generate policies to new, unseen environments. We demonstrate our approaches on both an actual AV and a high-fidelity simulator. Results indicate that our experience filter offers a fast, low-effort, and near-optimal solution to create policies for tasks or environments never seen before. Furthermore, the generated new policies outperform the policy learned using the entire data collected from past environments, suggesting that the correlation among different environments can be exploited and irrelevant ones can be filtered out. △ Less

Submitted 29 May, 2023; originally announced May 2023.

Comments: Accepted at IEEE Intelligent Vehicles Symposium (IV) 2023

Model-based Validation as Probabilistic Inference

Authors: Harrison Delecki, Anthony Corso, Mykel J. Kochenderfer

Abstract: Estimating the distribution over failures is a key step in validating autonomous systems. Existing approaches focus on finding failures for a small range of initial conditions or make restrictive assumptions about the properties of the system under test. We frame estimating the distribution over failure trajectories for sequential systems as Bayesian inference. Our model-based approach represents… ▽ More Estimating the distribution over failures is a key step in validating autonomous systems. Existing approaches focus on finding failures for a small range of initial conditions or make restrictive assumptions about the properties of the system under test. We frame estimating the distribution over failure trajectories for sequential systems as Bayesian inference. Our model-based approach represents the distribution over failure trajectories using rollouts of system dynamics and computes trajectory gradients using automatic differentiation. Our approach is demonstrated in an inverted pendulum control system, an autonomous vehicle driving scenario, and a partially observable lunar lander. Sampling is performed using an off-the-shelf implementation of Hamiltonian Monte Carlo with multiple chains to capture multimodality and gradient smoothing for safe trajectories. In all experiments, we observed improvements in sample efficiency and parameter space coverage compared to black-box baseline approaches. This work is open sourced. △ Less

Submitted 16 May, 2023; originally announced May 2023.

Comments: Accepted to 5th Annual Learning for Dynamics & Control Conference (L4DC) 2023

Reconstructing higher-order interactions in coupled dynamical systems

Authors: Federico Malizia, Alessandra Corso, Lucia Valentina Gambuzza, Giovanni Russo, Vito Latora, Mattia Frasca

Abstract: Higher-order interactions play a key role for the stability and function of a complex system. However, how to identify them is still an open problem. Here, we propose a method to fully reconstruct the structural connectivity of a system of coupled dynamical units, identifying both pairwise and higher-order interactions from the system time evolution. Our method works for any dynamics, and allows t… ▽ More Higher-order interactions play a key role for the stability and function of a complex system. However, how to identify them is still an open problem. Here, we propose a method to fully reconstruct the structural connectivity of a system of coupled dynamical units, identifying both pairwise and higher-order interactions from the system time evolution. Our method works for any dynamics, and allows the reconstruction of both hypergraphs and simplicial complexes, either undirected or directed, unweighted or weighted. With two concrete applications, we show how the method can help understanding the ecosystemic complexity of bacterial systems, or the microscopic mechanisms of interaction underlying coupled chaotic oscillators. △ Less

Submitted 11 May, 2023; originally announced May 2023.

Comments: 6 pages, 2 figures

Leveraging Compositional Methods for Modeling and Verification of an Autonomous Taxi System

Authors: Alessandro Pinto, Anthony Corso, Edward Schmerling

Abstract: We apply a compositional formal modeling and verification method to an autonomous aircraft taxi system. We provide insights into the modeling approach and we identify several research areas where further development is needed. Specifically, we identify the following needs: (1) semantics of composition of viewpoints expressed in different specification languages, and tools to reason about heterogen… ▽ More We apply a compositional formal modeling and verification method to an autonomous aircraft taxi system. We provide insights into the modeling approach and we identify several research areas where further development is needed. Specifically, we identify the following needs: (1) semantics of composition of viewpoints expressed in different specification languages, and tools to reason about heterogeneous declarative models; (2) libraries of formal models for autonomous systems to speed up modeling and enable efficient reasoning; (3) methods to lift verification results generated by automated reasoning tools to the specification level; (4) probabilistic contract frameworks to reason about imperfect implementations; (5) standard high-level functional architectures for autonomous systems; and (6) a theory of higher-order contracts. We believe that addressing these research needs, among others, could improve the adoption of formal methods in the design of autonomous systems including learning-enabled systems, and increase confidence in their safe operations. △ Less

Submitted 26 April, 2023; originally announced April 2023.

Comments: 2023 International Conference on Assured Autonomy (ICAA)

Optimizing Carbon Storage Operations for Long-Term Safety

Authors: Yizheng Wang, Markus Zechner, Gege Wen, Anthony Louis Corso, John Michael Mern, Mykel J. Kochenderfer, Jef Karel Caers

Abstract: To combat global warming and mitigate the risks associated with climate change, carbon capture and storage (CCS) has emerged as a crucial technology. However, safely sequestering CO2 in geological formations for long-term storage presents several challenges. In this study, we address these issues by modeling the decision-making process for carbon storage operations as a partially observable Markov… ▽ More To combat global warming and mitigate the risks associated with climate change, carbon capture and storage (CCS) has emerged as a crucial technology. However, safely sequestering CO2 in geological formations for long-term storage presents several challenges. In this study, we address these issues by modeling the decision-making process for carbon storage operations as a partially observable Markov decision process (POMDP). We solve the POMDP using belief state planning to optimize injector and monitoring well locations, with the goal of maximizing stored CO2 while maintaining safety. Empirical results in simulation demonstrate that our approach is effective in ensuring safe long-term carbon storage operations. We showcase the flexibility of our approach by introducing three different monitoring strategies and examining their impact on decision quality. Additionally, we introduce a neural network surrogate model for the POMDP decision-making process to handle the complex dynamics of the multi-phase flow. We also investigate the effects of different fidelity levels of the surrogate model on decision qualities. △ Less

Submitted 18 April, 2023; originally announced April 2023.

FLYEYE family tree, from smart fast cameras to MezzoCielo

Authors: Roberto Ragazzoni, Silvio Di Rosa, Carmelo Arcidiacono, Marco Dima, Demetrio Magrin, Alain J. Corso, Jacopo Farinato, Maria Pelizzo, Giovanni L. Santi, Matteo Simioni, Simone Zaggia

Abstract: We developed game-changing concepts for meter(s) class very-wide-field telescopes, spanning three orders of magnitude of the covered field of view. Multiple cameras and monocentric systems: from the Smart Fast Cameras (with a quasi-monocentric aperture), through the FlyEye, toward a MezzoCielo concept (both with a truly monocentric aperture). MezzoCielo (or "half of the sky") is the last developed… ▽ More We developed game-changing concepts for meter(s) class very-wide-field telescopes, spanning three orders of magnitude of the covered field of view. Multiple cameras and monocentric systems: from the Smart Fast Cameras (with a quasi-monocentric aperture), through the FlyEye, toward a MezzoCielo concept (both with a truly monocentric aperture). MezzoCielo (or "half of the sky") is the last developed concept for a new class of telescopes. Such a concept is based on a fully spherical optical surface filled with a low refractive index, and high transparency liquid surrounded by multiple identical cameras. MezzoCielo is capable to reach field of views in the range of ten to twenty thousand square degrees. △ Less

Submitted 1 February, 2023; originally announced February 2023.

Comments: 6 pages, 5 figures, to be published in the proceedings of the 2nd ESA NEO and DEBRIS DETECTION CONFERENCE ESA/ESOC, Darmstadt, Germany, 24 - 26 January 2023

Online Planning for Constrained POMDPs with Continuous Spaces through Dual Ascent

Authors: Arec Jamgochian, Anthony Corso, Mykel J. Kochenderfer

Abstract: Rather than augmenting rewards with penalties for undesired behavior, Constrained Partially Observable Markov Decision Processes (CPOMDPs) plan safely by imposing inviolable hard constraint value budgets. Previous work performing online planning for CPOMDPs has only been applied to discrete action and observation spaces. In this work, we propose algorithms for online CPOMDP planning for continuous… ▽ More Rather than augmenting rewards with penalties for undesired behavior, Constrained Partially Observable Markov Decision Processes (CPOMDPs) plan safely by imposing inviolable hard constraint value budgets. Previous work performing online planning for CPOMDPs has only been applied to discrete action and observation spaces. In this work, we propose algorithms for online CPOMDP planning for continuous state, action, and observation spaces by combining dual ascent with progressive widening. We empirically compare the effectiveness of our proposed algorithms on continuous CPOMDPs that model both toy and real-world safety-critical problems. Additionally, we compare against the use of online solvers for continuous unconstrained POMDPs that scalarize cost constraints into rewards, and investigate the effect of optimistic cost propagation. △ Less

Submitted 23 December, 2022; originally announced December 2022.

Comments: Submitted to ICAPS-23

A POMDP Model for Safe Geological Carbon Sequestration

Authors: Anthony Corso, Yizheng Wang, Markus Zechner, Jef Caers, Mykel J. Kochenderfer

Abstract: Geological carbon capture and sequestration (CCS), where CO$_2$ is stored in subsurface formations, is a promising and scalable approach for reducing global emissions. However, if done incorrectly, it may lead to earthquakes and leakage of CO$_2$ back to the surface, harming both humans and the environment. These risks are exacerbated by the large amount of uncertainty in the structure of the stor… ▽ More Geological carbon capture and sequestration (CCS), where CO$_2$ is stored in subsurface formations, is a promising and scalable approach for reducing global emissions. However, if done incorrectly, it may lead to earthquakes and leakage of CO$_2$ back to the surface, harming both humans and the environment. These risks are exacerbated by the large amount of uncertainty in the structure of the storage formation. For these reasons, we propose that CCS operations be modeled as a partially observable Markov decision process (POMDP) and decisions be informed using automated planning algorithms. To this end, we develop a simplified model of CCS operations based on a 2D spillpoint analysis that retains many of the challenges and safety considerations of the real-world problem. We show how off-the-shelf POMDP solvers outperform expert baselines for safe CCS planning. This POMDP model can be used as a test bed to drive the development of novel decision-making algorithms for CCS operations. △ Less

Submitted 24 October, 2022; originally announced December 2022.

Comments: Accepted at NeurIPS 2022 Workshop on Tackling Climate Change with Machine Learning

A Deep Reinforcement Learning Approach to Rare Event Estimation

Authors: Anthony Corso, Kyu-Young Kim, Shubh Gupta, Grace Gao, Mykel J. Kochenderfer

Abstract: An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo sampling is inefficient. Adaptive importance sampling approaches have been developed for rare event estimation but do not scale well to sequential systems with lo… ▽ More An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo sampling is inefficient. Adaptive importance sampling approaches have been developed for rare event estimation but do not scale well to sequential systems with long horizons. In this work, we develop two adaptive importance sampling algorithms that can efficiently estimate the probability of rare events for sequential decision making systems. The basis for these algorithms is the minimization of the Kullback-Leibler divergence between a state-dependent proposal distribution and a target distribution over trajectories, but the resulting algorithms resemble policy gradient and value-based reinforcement learning. We apply multiple importance sampling to reduce the variance of our estimate and to address the issue of multi-modality in the optimal proposal distribution. We demonstrate our approach on a control task with both continuous and discrete actions spaces and show accuracy improvements over several baselines. △ Less

Submitted 22 November, 2022; originally announced November 2022.

Design of The Kinetic Inductance Detector Based Focal Plane Assembly for The Terahertz Intensity Mapper

Authors: L. -J. Liu, R. M. J. Janssen, C. M. Bradford, S. Hailey-Dunsheath, J. Fu, J. P. Filippini, J. E. Aguirre, J. S. Bracks, A. J. Corso, C. Groppi, J. Hoh, R. P. Keenan, I. N. Lowe, D. P. Marrone, P. Mauskopf, R. Nie, J. Redford, I. Trumper, J. D. Vieira

Abstract: We report on the kinetic inductance detector (KID) array focal plane assembly design for the Terahertz Intensity Mapper (TIM). Each of the 2 arrays consists of 4 wafer-sized dies (quadrants), and the overall assembly must satisfy thermal and mechanical requirements, while maintaining high optical efficiency and a suitable electromagnetic environment for the KIDs. In particular, our design manages… ▽ More We report on the kinetic inductance detector (KID) array focal plane assembly design for the Terahertz Intensity Mapper (TIM). Each of the 2 arrays consists of 4 wafer-sized dies (quadrants), and the overall assembly must satisfy thermal and mechanical requirements, while maintaining high optical efficiency and a suitable electromagnetic environment for the KIDs. In particular, our design manages to strictly maintain a 50 $\mathrm{μm}$ air gap between the array and the horn block. We have prototyped and are now testing a sub-scale assembly which houses a single quadrant for characterization before integration into the full array. The initial test result shows a $>$95% yield, indicating a good performance of our TIM detector packaging design. △ Less

Submitted 24 July, 2024; v1 submitted 17 November, 2022; originally announced November 2022.

Comments: 8 pages, 6 figures, accepted for publication in Journal of Low Temperature Physics (2022)

Design and testing of Kinetic Inductance Detector package for the Terahertz Intensity Mapper

Authors: L. -J. Liu, R. M. J Janssen, C. M. Bradford, S. Hailey-Dunsheath, J. P. Filippini, J. E. Aguirre, J. S. Bracks, A. J. Corso, J. Fu, C. Groppi, J. Hoh, R. P. Keenan, I. N. Lowe, D. P. Marrone, P. Mauskopf, R. Nie, J. Redford, I. Trumper, J. D. Vieira

Abstract: The Terahertz Intensity Mapper (TIM) is designed to probe the star formation history in dust-obscured star-forming galaxies around the peak of cosmic star formation. This will be done via measurements of the redshifted 157.7 um line of singly ionized carbon ([CII]). TIM employs two R $\sim 250$ long-slit grating spectrometers covering 240-420 um. Each is equipped with a focal plane unit containing… ▽ More The Terahertz Intensity Mapper (TIM) is designed to probe the star formation history in dust-obscured star-forming galaxies around the peak of cosmic star formation. This will be done via measurements of the redshifted 157.7 um line of singly ionized carbon ([CII]). TIM employs two R $\sim 250$ long-slit grating spectrometers covering 240-420 um. Each is equipped with a focal plane unit containing 4 wafer-sized subarrays of horn-coupled aluminum kinetic inductance detectors (KIDs). We present the design and performance of a prototype focal plane assembly for one of TIM's KID-based subarrays. Our design strictly maintain high optical efficiency and a suitable electromagnetic environment for the KIDs. The prototype detector housing in combination with the first flight-like quadrant are tested at 250 mK. Initial frequency scan shows that many resonances are affected by collisions and/or very shallow transmission dips as a result of a degraded internal quality factor (Q factor). This is attributed to the presence of an external magnetic field during cooldown. We report on a study of magnetic field dependence of the Q factor of our quadrant array. We implement a Helmholtz coil to vary the magnetic field at the detectors by (partially) nulling earth's. Our investigation shows that the earth magnetic field can significantly affect our KIDs' performance by degrading the Q factor by a factor of 2-5, well below those expected from the operational temperature or optical loading. We find that we can sufficiently recover our detectors' quality factor by tuning the current in the coils to generate a field that matches earth's magnetic field in magnitude to within a few uT. Therefore, it is necessary to employ a properly designed magnetic shield enclosing the TIM focal plane unit. Based on the results presented in this paper, we set a shielding requirement of |B| < 3 uT. △ Less

Submitted 24 July, 2024; v1 submitted 16 November, 2022; originally announced November 2022.

Comments: This conference proceeding reports on a study of magnetic field dependence of the quality factor of Terahertz Intensity Mapper's 864-pixel Kinetic Inductance Detector array and an effort on carrying out the magnetic shielding requirement for TIM's balloon flight and science operation. 8 pages, 5 figures, accepted for publication in conference proceedings of SPIE

Journal ref: Proceedings of the SPIE, Volume 12190 (2022)

Swarm of lightsail nanosatellites for Solar System exploration

Authors: Giovanni Santi, Alain J. Corso, Denis Garoli, Giuseppe Emanuele Lio, Marco Manente, Giulio Favaro, Marco Bazzan, Giampaolo Piotto, Nicola Andriolli, Lucanos Strambini, Daniele Pavarin, Leonardo Badia, Remo Proietti Zaccaria, Philip Lubin, Roberto Ragazzoni, Maria G. Pelizzo

Abstract: This paper presents a study for the realization of a space mission which employs nanosatellites driven by an external laser source impinging on an optimized lightsail, as a valuable technology to launch swarms of spacecrafts into the Solar System. Nanosatellites propelled by laser can be useful for the heliosphere exploration and for planetary observation, if suitably equipped with sensors, or be… ▽ More This paper presents a study for the realization of a space mission which employs nanosatellites driven by an external laser source impinging on an optimized lightsail, as a valuable technology to launch swarms of spacecrafts into the Solar System. Nanosatellites propelled by laser can be useful for the heliosphere exploration and for planetary observation, if suitably equipped with sensors, or be adopted for the establishment of network systems when placed into specific orbits. By varying the area-to-mass ratio (i.e., the ratio between the sail area and the payload weight) and the laser power, it is ossible to insert nanosatellites into different hyperbolic orbits with respect to Earth, thus reaching the target by means of controlled trajectories in a relatively short amount of time. A mission involving nanosatellites of the order of 1 kg of mass is envisioned, by describing all the on-board subsystems and satisfying all the requirements in term of power and mass budget. Particular attention is paid to the telecommunication subsystem, which must offer all the necessary functionalities. To fabricate the lightsail, the thin films technology has been considered, by verifying the sail thermal stability during the thrust phase. Moreover, the problem of mechanical stability of the lightsail has been tackled, showing that the distance between the ligthsail structure and the payload plays a pivotal role. Some potential applications of the proposed technology are discussed, such as the mapping of the heliospheric environment. △ Less

Submitted 15 September, 2022; v1 submitted 23 August, 2022; originally announced August 2022.

Risk-Driven Design of Perception Systems

Authors: Anthony L. Corso, Sydney M. Katz, Craig Innes, Xin Du, Subramanian Ramamoorthy, Mykel J. Kochenderfer

Abstract: Modern autonomous systems rely on perception modules to process complex sensor measurements into state estimates. These estimates are then passed to a controller, which uses them to make safety-critical decisions. It is therefore important that we design perception systems to minimize errors that reduce the overall safety of the system. We develop a risk-driven approach to designing perception sys… ▽ More Modern autonomous systems rely on perception modules to process complex sensor measurements into state estimates. These estimates are then passed to a controller, which uses them to make safety-critical decisions. It is therefore important that we design perception systems to minimize errors that reduce the overall safety of the system. We develop a risk-driven approach to designing perception systems that accounts for the effect of perceptual errors on the performance of the fully-integrated, closed-loop system. We formulate a risk function to quantify the effect of a given perceptual error on overall safety, and show how we can use it to design safer perception systems by including a risk-dependent term in the loss function and generating training data in risk-sensitive regions. We evaluate our techniques on a realistic vision-based aircraft detect and avoid application and show that risk-driven design reduces collision risk by 37% over a baseline system. △ Less

Submitted 11 October, 2022; v1 submitted 21 May, 2022; originally announced May 2022.

Comments: 17 pages, 10 figures

Verifying Inverse Model Neural Networks

Authors: Chelsea Sidrane, Sydney Katz, Anthony Corso, Mykel J. Kochenderfer

Abstract: Inverse problems exist in a wide variety of physical domains from aerospace engineering to medical imaging. The goal is to infer the underlying state from a set of observations. When the forward model that produced the observations is nonlinear and stochastic, solving the inverse problem is very challenging. Neural networks are an appealing solution for solving inverse problems as they can be trai… ▽ More Inverse problems exist in a wide variety of physical domains from aerospace engineering to medical imaging. The goal is to infer the underlying state from a set of observations. When the forward model that produced the observations is nonlinear and stochastic, solving the inverse problem is very challenging. Neural networks are an appealing solution for solving inverse problems as they can be trained from noisy data and once trained are computationally efficient to run. However, inverse model neural networks do not have guarantees of correctness built-in, which makes them unreliable for use in safety and accuracy-critical contexts. In this work we introduce a method for verifying the correctness of inverse model neural networks. Our approach is to overapproximate a nonlinear, stochastic forward model with piecewise linear constraints and encode both the overapproximate forward model and the neural network inverse model as a mixed-integer program. We demonstrate this verification procedure on a real-world airplane fuel gauge case study. The ability to verify and consequently trust inverse model neural networks allows their use in a wide variety of contexts, from aerospace to medicine. △ Less

Submitted 4 January, 2023; v1 submitted 4 February, 2022; originally announced February 2022.

Comments: Reformatted and fixed typos

MSC Class: 68T07; 68Q60 ACM Class: I.2.6; D.2.4

Electron energy loss spectroscopy of bulk gold with ultrasoft pseudopotentials and the Liouville-Lanczos method

Authors: Oleksandr Motornyi, Nathalie Vast, Iurii Timrov, Oscar Baseggio, Stefano Baroni, Andrea Dal Corso

Abstract: The implementation of ultrasoft pseudopotentials into time-dependent density-functional perturbation theory is detailed for both the Sternheimer approach and the Liouville-Lanczos (LL) method, and equations are presented in the scalar relativistic approximation for periodic solids with finite momentum transfer q. The LL method is applied to calculations of the electron energy loss (EEL) spectrum o… ▽ More The implementation of ultrasoft pseudopotentials into time-dependent density-functional perturbation theory is detailed for both the Sternheimer approach and the Liouville-Lanczos (LL) method, and equations are presented in the scalar relativistic approximation for periodic solids with finite momentum transfer q. The LL method is applied to calculations of the electron energy loss (EEL) spectrum of face-centered cubic bulk Au both at vanishing and finite q. Our study reveals the richness of the physics underlying the various contributions to the density fluctuation in gold. In particular, our calculations suggest the existence in gold of two quasi-separate 5d and 6s electron gasses, each one oscillating with its own frequency at resp. 5.1 eV and 10.2 eV. We find that the contribution near 2.2 eV comes from 5d to 6s interband transitions modified by the intraband contribution to the real part of the dielectric function, which we call a mixed excitation. △ Less

Submitted 18 November, 2021; originally announced November 2021.

Journal ref: Phys. Rev. B 102, 035156 (2020)

Exploring the Solar Wind from its Source on the Corona into the Inner Heliosphere during the First Solar Orbiter - Parker Solar Probe Quadrature

Authors: Daniele Telloni, Vincenzo Andretta, Ester Antonucci, Alessandro Bemporad, Giuseppe E. Capuano, Silvano Fineschi, Silvio Giordano, Shadia Habbal, Denise Perrone, Rui F. Pinto, Luca Sorriso-Valvo, Daniele Spadaro, Roberto Susino, Lloyd D. Woodham, Gary P. Zank, Marco Romoli, Stuart D. Bale, Justin C. Kasper, Frédéric Auchère, Roberto Bruno, Gerardo Capobianco, Anthony W. Case, Chiara Casini, Marta Casti, Paolo Chioetto , et al. (46 additional authors not shown)

Abstract: This Letter addresses the first Solar Orbiter (SO) -- Parker Solar Probe (PSP) quadrature, occurring on January 18, 2021, to investigate the evolution of solar wind from the extended corona to the inner heliosphere. Assuming ballistic propagation, the same plasma volume observed remotely in corona at altitudes between 3.5 and 6.3 solar radii above the solar limb with the Metis coronagraph on SO ca… ▽ More This Letter addresses the first Solar Orbiter (SO) -- Parker Solar Probe (PSP) quadrature, occurring on January 18, 2021, to investigate the evolution of solar wind from the extended corona to the inner heliosphere. Assuming ballistic propagation, the same plasma volume observed remotely in corona at altitudes between 3.5 and 6.3 solar radii above the solar limb with the Metis coronagraph on SO can be tracked to PSP, orbiting at 0.1 au, thus allowing the local properties of the solar wind to be linked to the coronal source region from where it originated. Thanks to the close approach of PSP to the Sun and the simultaneous Metis observation of the solar corona, the flow-aligned magnetic field and the bulk kinetic energy flux density can be empirically inferred along the coronal current sheet with an unprecedented accuracy, allowing in particular estimation of the Alfvén radius at 8.7 solar radii during the time of this event. This is thus the very first study of the same solar wind plasma as it expands from the sub-Alfvénic solar corona to just above the Alfvén surface. △ Less

Submitted 21 October, 2021; originally announced October 2021.

Comments: 10 pages, 4 figures

Journal ref: Telloni, D., Andretta, V., Antonucci, E., et al. 2021, ApJL, 920, L14

Quasi-harmonic temperature dependent elastic constants: applications to silicon, aluminum, and silver

Authors: Cristiano Malica, Andrea Dal Corso

Abstract: We present ab-initio calculations of the quasi-harmonic temperature dependent elastic constants. The isothermal elastic constants are calculated at each temperature as second derivatives of the Helmholtz free energy with respect to strain and corrected for finite pressure effects. This calculation is repeated for a grid of geometries and the results interpolated at the minimum of the Helmholtz fre… ▽ More We present ab-initio calculations of the quasi-harmonic temperature dependent elastic constants. The isothermal elastic constants are calculated at each temperature as second derivatives of the Helmholtz free energy with respect to strain and corrected for finite pressure effects. This calculation is repeated for a grid of geometries and the results interpolated at the minimum of the Helmholtz free energy. The results are compared with the quasi-static elastic constants. Thermodynamic relationships are used to derive the adiabatic elastic constants that are compared with the experimental measurements. These approaches are implemented for cubic solids in the $\texttt{thermo_pw}$ code and are validated by applications to silicon, aluminum, and silver. △ Less

Submitted 28 September, 2021; originally announced September 2021.

Journal ref: 2020 J. Phys.: Condens. Matter 32 315902

Quasi-harmonic thermoelasticity of palladium, platinum, copper, and gold from first principles

Authors: Cristiano Malica, Andrea Dal Corso

Abstract: We calculate the temperature-dependent elastic constants of palladium, platinum, copper and gold within the quasi-harmonic approximation using a first-principles approach and evaluating numerically the second derivatives of the Helmholtz free-energy with respect to strain at the minimum of the free-energy itself. We find an overall good agreement with the experimental data although the anomalies o… ▽ More We calculate the temperature-dependent elastic constants of palladium, platinum, copper and gold within the quasi-harmonic approximation using a first-principles approach and evaluating numerically the second derivatives of the Helmholtz free-energy with respect to strain at the minimum of the free-energy itself. We find an overall good agreement with the experimental data although the anomalies of palladium and platinum reported at room temperature are not reproduced. The contribution of electronic excitations is also investigated: we find that it is non-negligible for the $C_{44}$ elastic constants of palladium and platinum while it is irrelevant in the other cases. Its effect is not sufficient to explain the details of the anomalies found by experiments, not even when, in the case of platinum, we take into account the electron-phonon interaction. Lastly, the effect of the exchange and correlation functional is addressed and it is found that it is important at T=0 K, while all functionals give similar temperature dependencies. △ Less

Submitted 1 September, 2021; originally announced September 2021.

ZoPE: A Fast Optimizer for ReLU Networks with Low-Dimensional Inputs

Authors: Christopher A. Strong, Sydney M. Katz, Anthony L. Corso, Mykel J. Kochenderfer

Abstract: Deep neural networks often lack the safety and robustness guarantees needed to be deployed in safety critical systems. Formal verification techniques can be used to prove input-output safety properties of networks, but when properties are difficult to specify, we rely on the solution to various optimization problems. In this work, we present an algorithm called ZoPE that solves optimization proble… ▽ More Deep neural networks often lack the safety and robustness guarantees needed to be deployed in safety critical systems. Formal verification techniques can be used to prove input-output safety properties of networks, but when properties are difficult to specify, we rely on the solution to various optimization problems. In this work, we present an algorithm called ZoPE that solves optimization problems over the output of feedforward ReLU networks with low-dimensional inputs. The algorithm eagerly splits the input space, bounding the objective using zonotope propagation at each step, and improves computational efficiency compared to existing mixed-integer programming approaches. We demonstrate how to formulate and solve three types of optimization problems: (i) minimization of any convex function over the output space, (ii) minimization of a convex function over the output of two networks in series with an adversarial perturbation in the layer between them, and (iii) maximization of the difference in output between two networks. Using ZoPE, we observe a $25\times$ speedup on property $1$ of the ACAS Xu neural network verification benchmark compared to several state-of-the-art verifiers, and an $85\times$ speedup on a set of linear optimization problems compared to a mixed-integer programming baseline. We demonstrate the versatility of the optimizer in analyzing networks by projecting onto the range of a generative adversarial network and visualizing the differences between a compressed and uncompressed network. △ Less

Submitted 16 May, 2022; v1 submitted 9 June, 2021; originally announced June 2021.

Comments: 14 pages, 3 figures

Verification of Image-based Neural Network Controllers Using Generative Models

Authors: Sydney M. Katz, Anthony L. Corso, Christopher A. Strong, Mykel J. Kochenderfer

Abstract: Neural networks are often used to process information from image-based sensors to produce control actions. While they are effective for this task, the complex nature of neural networks makes their output difficult to verify and predict, limiting their use in safety-critical systems. For this reason, recent work has focused on combining techniques in formal methods and reachability analysis to obta… ▽ More Neural networks are often used to process information from image-based sensors to produce control actions. While they are effective for this task, the complex nature of neural networks makes their output difficult to verify and predict, limiting their use in safety-critical systems. For this reason, recent work has focused on combining techniques in formal methods and reachability analysis to obtain guarantees on the closed-loop performance of neural network controllers. However, these techniques do not scale to the high-dimensional and complicated input space of image-based neural network controllers. In this work, we propose a method to address these challenges by training a generative adversarial network (GAN) to map states to plausible input images. By concatenating the generator network with the control network, we obtain a network with a low-dimensional input space. This insight allows us to use existing closed-loop verification tools to obtain formal guarantees on the performance of image-based controllers. We apply our approach to provide safety guarantees for an image-based neural network controller for an autonomous aircraft taxi problem. We guarantee that the controller will keep the aircraft on the runway and guide the aircraft towards the center of the runway. The guarantees we provide are with respect to the set of input images modeled by our generator network, so we provide a recall metric to evaluate how well the generator captures the space of plausible images. △ Less

Submitted 14 May, 2021; originally announced May 2021.

Comments: 10 pages, 12 figures, presented at the 2021 AIAA Digital Avionics Systems Conference (DASC)

Future perspectives in solar hot plasma observations in the soft X-rays

Authors: Alain Jody Corso, Giulio Del Zanna, Vanessa Polito

Abstract: The soft X-rays (SXRs: 90--150 $Å$) are among the most interesting spectral ranges to be investigated in the next generation of solar missions due to their unique capability of diagnosing phenomena involving hot plasma with temperatures up to 15~MK. Multilayer (ML) coatings are crucial for developing SXR instrumentation, as so far they represent the only viable option for the development of high-e… ▽ More The soft X-rays (SXRs: 90--150 $Å$) are among the most interesting spectral ranges to be investigated in the next generation of solar missions due to their unique capability of diagnosing phenomena involving hot plasma with temperatures up to 15~MK. Multilayer (ML) coatings are crucial for developing SXR instrumentation, as so far they represent the only viable option for the development of high-efficiency mirrors in this spectral range. However, the current standard MLs are characterized by a very narrow spectral band which is incompatible with the science requirements expected for a SXR spectrometer. Nevertheless, recent advancement in the ML technology has made the development of non-periodic stacks repeatable and reliable, enabling the manufacturing of SXR mirrors with a valuable efficiency over a large range of wavelengths. In this work, after reviewing the state-of-the-art ML coatings for the SXR range, we investigate the possibility of using M-fold and aperiodic stacks for the development of multiband SXR spectrometers. After selecting a possible choice of key spectral lines, some trade-off studies for an eight-bands spectrometer are also presented and discussed, giving an evaluation of their feasibility and potential performance. △ Less

Submitted 12 May, 2021; originally announced May 2021.

Comments: Accepted for publication in Experimental Astronomy

Journal ref: Experimental Astronomy (2021)

High resolution soft X-ray spectroscopy and the quest for the hot (5-10 MK) plasma in solar active regions

Authors: G. Del Zanna, V. Andretta, P. J. Cargill, A. J. Corso, A. N. Daw, L. Golub, J. A. Klimchuk, H. E. Mason

Abstract: We discuss the diagnostics available to study the 5-10 MK plasma in the solar corona, which is key to understanding the heating in the cores of solar active regions. We present several simulated spectra, and show that excellent diagnostics are available in the soft X-rays, around 100 Angstroms, as six ionisation stages of Fe can simultaneously be observed, and electron densities derived, within a… ▽ More We discuss the diagnostics available to study the 5-10 MK plasma in the solar corona, which is key to understanding the heating in the cores of solar active regions. We present several simulated spectra, and show that excellent diagnostics are available in the soft X-rays, around 100 Angstroms, as six ionisation stages of Fe can simultaneously be observed, and electron densities derived, within a narrow spectral region. As this spectral range is almost unexplored, we present an analysis of available and simulated spectra, to compare the hot emission with the cooler component. We adopt recently designed multilayers to present estimates of count rates in the hot lines, with a baseline spectrometer design. Excellent count rates are found, opening up the exciting opportunity to obtain high-resolution spectroscopy of hot plasma. △ Less

Submitted 10 March, 2021; originally announced March 2021.

Comments: Accepted for publication in Frontiers in Astronomy and Space Sciences, section Stellar and Solar Physics

Transfer Learning for Efficient Iterative Safety Validation

Authors: Anthony Corso, Mykel J. Kochenderfer

Abstract: Safety validation is important during the development of safety-critical autonomous systems but can require significant computational effort. Existing algorithms often start from scratch each time the system under test changes. We apply transfer learning to improve the efficiency of reinforcement learning based safety validation algorithms when applied to related systems. Knowledge from previous s… ▽ More Safety validation is important during the development of safety-critical autonomous systems but can require significant computational effort. Existing algorithms often start from scratch each time the system under test changes. We apply transfer learning to improve the efficiency of reinforcement learning based safety validation algorithms when applied to related systems. Knowledge from previous safety validation tasks is encoded through the action value function and transferred to future tasks with a learned set of attention weights. Including a learned state and action value transformation for each source task can improve performance even when systems have substantially different failure modes. We conduct experiments on safety validation tasks in gridworld and autonomous driving scenarios. We show that transfer learning can improve the initial and final performance of validation algorithms and reduce the number of training steps. △ Less

Submitted 9 December, 2020; originally announced December 2020.

Comments: Accepted to AAAI 2021

Mirrors for space telescopes: degradation issues

Authors: D. Garoli, L. V. Rodriguez De Marcos, J. I. Larruquert, A. J. Corso, R. Proietti Zaccaria, M. G. Pelizzo

Abstract: Mirrors are a subset of optical components essential for the success of current and future space missions. Most of the telescopes for space programs ranging from Earth Observation to Astrophysics and covering all the electromagnetic spectrum from X-rays to Far-Infrared are based on reflective optics. Mirrors operate in diverse and harsh environments that range from Low-Earth Orbit, to interplaneta… ▽ More Mirrors are a subset of optical components essential for the success of current and future space missions. Most of the telescopes for space programs ranging from Earth Observation to Astrophysics and covering all the electromagnetic spectrum from X-rays to Far-Infrared are based on reflective optics. Mirrors operate in diverse and harsh environments that range from Low-Earth Orbit, to interplanetary orbits and the deep space. The operational life of space observatories spans from minutes (sounding rockets) to decades (large observatories), and the performance of the mirrors within the optical system is susceptible to degrade, which results in a transient optical efficiency of the instrument. The degradation that occurs in space environments depends on the operational life on the orbital properties of the space mission, and it reduces the total system throughput and hence compromises the science return. Therefore, the knowledge of potential degradation physical mechanisms, how they affect mirror performance, and how to prevent it, is of paramount importance to ensure the long-term success of space telescopes. In this review we report an overview on current mirror technology for space missions with a particular focus on the importance of degradation and radiation resistance of the coating materials. Particular detail will be given to degradation effects on mirrors for the far and extreme UV as in these ranges the degradation is enhanced by the strong absorption of most contaminants. △ Less

Submitted 30 September, 2020; originally announced October 2020.

Lattice dynamics effects on the magnetocrystalline anisotropy energy: application to MnBi

Authors: Andrea Urru, Andrea Dal Corso

Abstract: Using a first-principles fully relativistic scheme based on ultrasoft pseudopotentials and density functional perturbation theory, we study the magnetocrystalline anisotropy free energy of the ferromagnetic binary compound MnBi. We find that differences in the phonon dispersions due to the different orientations of the magnetization (in-plane and perpendicular to the plane) give a difference betwe… ▽ More Using a first-principles fully relativistic scheme based on ultrasoft pseudopotentials and density functional perturbation theory, we study the magnetocrystalline anisotropy free energy of the ferromagnetic binary compound MnBi. We find that differences in the phonon dispersions due to the different orientations of the magnetization (in-plane and perpendicular to the plane) give a difference between the vibrational free energies of the high-temperature and low-temperature phases. This vibrational contribution to the magnetocrystalline anisotropy energy (MAE) constant, $K_u$, is non-negligible. When the energy contribution to the MAE is calculated by the PBEsol exchange and correlation functional, the addition of the phonon contribution allows to get a $T = 0$ K $K_u$ and a spin-reorientation transition temperature in reasonable agreement with experiments. △ Less

Submitted 1 September, 2020; originally announced September 2020.

Comments: 6 pages, 4 figures, 2 tables

Journal ref: Phys. Rev. B 102, 115126 (2020)

Temperature dependent elastic constants and thermodynamic properties of BAs: an ab-initio investigation

Authors: Cristiano Malica, Andrea Dal Corso

Abstract: We present an ab-initio study of the temperature dependent elastic constants of BAs, a semiconductor that exhibits ultra-high thermal conductivity and is under investigation for thermal management in electronics. We test the consistency of our predictions by computing the temperature dependent sound velocity of the longitudinal acoustic mode along the $[111]$ direction and comparing with experimen… ▽ More We present an ab-initio study of the temperature dependent elastic constants of BAs, a semiconductor that exhibits ultra-high thermal conductivity and is under investigation for thermal management in electronics. We test the consistency of our predictions by computing the temperature dependent sound velocity of the longitudinal acoustic mode along the $[111]$ direction and comparing with experiment. Furthermore, as a byproduct, we present the room temperature phonon dispersions, and the temperature dependent thermal expansion, isobaric heat capacity, and average Grüneisen parameter comparing with the most updated experiments and previous calculations when available. Finally, we present the theoretical estimate of the temperature dependent mean square atomic displacements. △ Less

Submitted 19 June, 2020; originally announced June 2020.

A Survey of Algorithms for Black-Box Safety Validation of Cyber-Physical Systems

Authors: Anthony Corso, Robert J. Moss, Mark Koren, Ritchie Lee, Mykel J. Kochenderfer

Abstract: Autonomous cyber-physical systems (CPS) can improve safety and efficiency for safety-critical applications, but require rigorous testing before deployment. The complexity of these systems often precludes the use of formal verification and real-world testing can be too dangerous during development. Therefore, simulation-based techniques have been developed that treat the system under test as a blac… ▽ More Autonomous cyber-physical systems (CPS) can improve safety and efficiency for safety-critical applications, but require rigorous testing before deployment. The complexity of these systems often precludes the use of formal verification and real-world testing can be too dangerous during development. Therefore, simulation-based techniques have been developed that treat the system under test as a black box operating in a simulated environment. Safety validation tasks include finding disturbances in the environment that cause the system to fail (falsification), finding the most-likely failure, and estimating the probability that the system fails. Motivated by the prevalence of safety-critical artificial intelligence, this work provides a survey of state-of-the-art safety validation techniques for CPS with a focus on applied algorithms and their modifications for the safety validation problem. We present and discuss algorithms in the domains of optimization, path planning, reinforcement learning, and importance sampling. Problem decomposition techniques are presented to help scale algorithms to large state spaces, which are common for CPS. A brief overview of safety-critical applications is given, including autonomous vehicles and aircraft collision avoidance systems. Finally, we present a survey of existing academic and commercially available safety validation tools. △ Less

Submitted 14 October, 2021; v1 submitted 6 May, 2020; originally announced May 2020.

Journal ref: Journal of Artificial Intelligence Research, vol. 72, p. 377-428, 2021

Interpretable Safety Validation for Autonomous Vehicles

Authors: Anthony Corso, Mykel J. Kochenderfer

Abstract: An open problem for autonomous driving is how to validate the safety of an autonomous vehicle in simulation. Automated testing procedures can find failures of an autonomous system but these failures may be difficult to interpret due to their high dimensionality and may be so unlikely as to not be important. This work describes an approach for finding interpretable failures of an autonomous system.… ▽ More An open problem for autonomous driving is how to validate the safety of an autonomous vehicle in simulation. Automated testing procedures can find failures of an autonomous system but these failures may be difficult to interpret due to their high dimensionality and may be so unlikely as to not be important. This work describes an approach for finding interpretable failures of an autonomous system. The failures are described by signal temporal logic expressions that can be understood by a human, and are optimized to produce failures that have high likelihood. Our methodology is demonstrated for the safety validation of an autonomous vehicle in the context of an unprotected left turn and a crosswalk with a pedestrian. Compared to a baseline importance sampling approach, our methodology finds more failures with higher likelihood while retaining interpretability. △ Less

Submitted 26 June, 2020; v1 submitted 14 April, 2020; originally announced April 2020.

Scalable Autonomous Vehicle Safety Validation through Dynamic Programming and Scene Decomposition

Authors: Anthony Corso, Ritchie Lee, Mykel J. Kochenderfer

Abstract: An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other techniques are designed to only discover a single failure. In this work, we present a new safety validation approach that attempts to estimate the distribution over f… ▽ More An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other techniques are designed to only discover a single failure. In this work, we present a new safety validation approach that attempts to estimate the distribution over failures of an autonomous policy using approximate dynamic programming. Knowledge of this distribution allows for the efficient discovery of many failure examples. To address the problem of scalability, we decompose complex driving scenarios into subproblems consisting of only the ego vehicle and one other vehicle. These subproblems can be solved with approximate dynamic programming and their solutions are recombined to approximate the solution to the full scenario. We apply our approach to a simple two-vehicle scenario to demonstrate the technique as well as a more complex five-vehicle scenario to demonstrate scalability. In both experiments, we observed an increase in the number of failures discovered compared to baseline approaches. △ Less

Submitted 26 June, 2020; v1 submitted 14 April, 2020; originally announced April 2020.

The Adaptive Stress Testing Formulation

Authors: Mark Koren, Anthony Corso, Mykel J. Kochenderfer

Abstract: Validation is a key challenge in the search for safe autonomy. Simulations are often either too simple to provide robust validation, or too complex to tractably compute. Therefore, approximate validation methods are needed to tractably find failures without unsafe simplifications. This paper presents the theory behind one such black-box approach: adaptive stress testing (AST). We also provide thre… ▽ More Validation is a key challenge in the search for safe autonomy. Simulations are often either too simple to provide robust validation, or too complex to tractably compute. Therefore, approximate validation methods are needed to tractably find failures without unsafe simplifications. This paper presents the theory behind one such black-box approach: adaptive stress testing (AST). We also provide three examples of validation problems formulated to work with AST. △ Less

Submitted 8 April, 2020; originally announced April 2020.

Comments: Presented at the Workshop on Robust Autonomy at RSS 2019

Metis: the Solar Orbiter visible light and ultraviolet coronal imager

Authors: Ester Antonucci, Marco Romoli, Vincenzo Andretta, Silvano Fineschi, Petr Heinzel, J. Daniel Moses, Giampiero Naletto, Gianalfredo Nicolini, Daniele Spadaro, Luca Teriaca, Arkadiusz Berlicki, Gerardo Capobianco, Giuseppe Crescenzio, Vania Da Deppo, Mauro Focardi, Fabio Frassetto, Klaus Heerlein, Federico Landini, Enrico Magli, Andrea Marco Malvezzi, Giuseppe Massone, Radek Melich, Piergiorgio Nicolosi, Giancarlo Noci, Maurizio Pancrazzi , et al. (78 additional authors not shown)

Abstract: Metis is the first solar coronagraph designed for a space mission capable of performing simultaneous imaging of the off-limb solar corona in both visible and UV light. The observations obtained with Metis aboard the Solar Orbiter ESA-NASA observatory will enable us to diagnose, with unprecedented temporal coverage and spatial resolution, the structures and dynamics of the full corona from 1.7… ▽ More Metis is the first solar coronagraph designed for a space mission capable of performing simultaneous imaging of the off-limb solar corona in both visible and UV light. The observations obtained with Metis aboard the Solar Orbiter ESA-NASA observatory will enable us to diagnose, with unprecedented temporal coverage and spatial resolution, the structures and dynamics of the full corona from 1.7 $R_\odot$ to about 9 $R_\odot$. Due to the uniqueness of the Solar Orbiter mission profile, Metis will be able to observe the solar corona from a close vantage point (down to 0.28 AU), achieving out-of-ecliptic views with the increase of the orbit inclination over time. Moreover, observations near perihelion, during the phase of lower rotational velocity of the solar surface relative to the spacecraft, will allow longer-term studies of the coronal features. Thanks to a novel occultation design and a combination of a UV interference coating of the mirrors and a spectral bandpass filter, Metis images the solar corona simultaneously in the visible light band, between 580 and 640 nm, and in the UV H I Lyman-α line at 121.6 nm. The coronal images in both the UV Lyman-α and polarised visible light are obtained at high spatial resolution with a spatial scale down to about 2000 km and 15000 km at perihelion, in the cases of the visible and UV light, respectively. A temporal resolution down to 1 second can be achieved when observing coronal fluctuations in visible light. The Metis measurements will allow for complete characterisation of the main physical parameters and dynamics of the electron and neutral hydrogen/proton plasma components of the corona in the region where the solar wind undergoes acceleration and where the onset and initial propagation of coronal mass ejections take place, thus significantly improving our understanding of the region connecting the Sun to the heliosphere. △ Less

Submitted 14 November, 2019; originally announced November 2019.

Adaptive Stress Testing with Reward Augmentation for Autonomous Vehicle Validation

Authors: Anthony Corso, Peter Du, Katherine Driggs-Campbell, Mykel J. Kochenderfer

Abstract: Determining possible failure scenarios is a critical step in the evaluation of autonomous vehicle systems. Real-world vehicle testing is commonly employed for autonomous vehicle validation, but the costs and time requirements are high. Consequently, simulation-driven methods such as Adaptive Stress Testing (AST) have been proposed to aid in validation. AST formulates the problem of finding the mos… ▽ More Determining possible failure scenarios is a critical step in the evaluation of autonomous vehicle systems. Real-world vehicle testing is commonly employed for autonomous vehicle validation, but the costs and time requirements are high. Consequently, simulation-driven methods such as Adaptive Stress Testing (AST) have been proposed to aid in validation. AST formulates the problem of finding the most likely failure scenarios as a Markov decision process, which can be solved using reinforcement learning. In practice, AST tends to find scenarios where failure is unavoidable and tends to repeatedly discover the same types of failures of a system. This work addresses these issues by encoding domain relevant information into the search procedure. With this modification, the AST method discovers a larger and more expressive subset of the failure space when compared to the original AST formulation. We show that our approach is able to identify useful failure scenarios of an autonomous vehicle policy. △ Less

Submitted 6 August, 2019; v1 submitted 2 August, 2019; originally announced August 2019.

Comments: Appears in IEEE ITSC 2019

Spin-polarized electronic surface states of Re(0001): an ab-initio investigation

Authors: Andrea Urru, Andrea Dal Corso

Abstract: We study the electronic structure of the Re(0001) surface by means of ab-initio techniques based on the Fully Relativistic (FR) Density Functional Theory (DFT) and the Projector Augmented-Wave (PAW) method. We identify the main surface states and resonances and study in detail their energy dispersion along the main symmetry lines of the SBZ. Moreover, we discuss the effect of spin-orbit coupling o… ▽ More We study the electronic structure of the Re(0001) surface by means of ab-initio techniques based on the Fully Relativistic (FR) Density Functional Theory (DFT) and the Projector Augmented-Wave (PAW) method. We identify the main surface states and resonances and study in detail their energy dispersion along the main symmetry lines of the SBZ. Moreover, we discuss the effect of spin-orbit coupling on the energy splittings and the spin-polarization of the main surface states and resonances. Whenever possible, we compare the results with previously studied heavy metals surfaces. We find empty resonances, located below a gap similar to the L-gap of the (111) fcc surfaces, that have a downward dispersion and cross the Fermi level, similarly to the recently studied Os(0001) surface. Their spin polarization at the Fermi level is similar to that predicted by the Rashba model, but the usual level crossing at $\barΓ$ is not found with our slab thickness. Moreover, for selected states, we follow the spin polarization along the high symmetry lines, discussing its behavior with respect to ${\bf k}_{\parallel}$, the wave-vector parallel to the surface. △ Less

Submitted 27 June, 2019; originally announced June 2019.

Comments: 11 pages, 8 figures, 1 table. arXiv admin note: text overlap with arXiv:1801.09267

Journal ref: Surface Science 686 (2019) 22-29

Density functional perturbation theory for lattice dynamics with fully relativistic ultrasoft pseudopotentials: the magnetic case

Authors: Andrea Urru, Andrea Dal Corso

Abstract: We extend density functional perturbation theory for lattice dynamics with fully relativistic ultrasoft pseudopotentials to magnetic materials. Our approach is based on the application of the time-reversal operator to the Sternheimer linear system and to its self-consistent solutions. Moreover, we discuss how to include in the formalism the symmetry operations of the magnetic point group which req… ▽ More We extend density functional perturbation theory for lattice dynamics with fully relativistic ultrasoft pseudopotentials to magnetic materials. Our approach is based on the application of the time-reversal operator to the Sternheimer linear system and to its self-consistent solutions. Moreover, we discuss how to include in the formalism the symmetry operations of the magnetic point group which require the time-reversal operator. We validate our implementation by comparison with the frozen phonon method in fcc Ni and in a monatomic ferromagnetic Pt wire. △ Less

Submitted 27 June, 2019; originally announced June 2019.

Comments: 7 pages, 2 figures, 2 tables