-
Evaluation of automated driving system safety metrics with logged vehicle trajectory data
Authors:
Xintao Yan,
Shuo Feng,
David J. LeBlanc,
Carol Flannagan,
Henry X. Liu
Abstract:
Real-time safety metrics are important for the automated driving system (ADS) to assess the risk of driving situations and to assist the decision-making. Although a number of real-time safety metrics have been proposed in the literature, systematic performance evaluation of these safety metrics has been lacking. As different behavioral assumptions are adopted in different safety metrics, it is dif…
▽ More
Real-time safety metrics are important for the automated driving system (ADS) to assess the risk of driving situations and to assist the decision-making. Although a number of real-time safety metrics have been proposed in the literature, systematic performance evaluation of these safety metrics has been lacking. As different behavioral assumptions are adopted in different safety metrics, it is difficult to compare the safety metrics and evaluate their performance. To overcome this challenge, in this study, we propose an evaluation framework utilizing logged vehicle trajectory data, in that vehicle trajectories for both subject vehicle (SV) and background vehicles (BVs) are obtained and the prediction errors caused by behavioral assumptions can be eliminated. Specifically, we examine whether the SV is in a collision unavoidable situation at each moment, given all near-future trajectories of BVs. In this way, we level the ground for a fair comparison of different safety metrics, as a good safety metric should always alarm in advance to the collision unavoidable moment. When trajectory data from a large number of trips are available, we can systematically evaluate and compare different metrics' statistical performance. In the case study, three representative real-time safety metrics, including the time-to-collision (TTC), the PEGASUS Criticality Metric (PCM), and the Model Predictive Instantaneous Safety Metric (MPrISM), are evaluated using a large-scale simulated trajectory dataset. The proposed evaluation framework is important for researchers, practitioners, and regulators to characterize different metrics, and to select appropriate metrics for different applications. Moreover, by conducting failure analysis on moments when a safety metric failed, we can identify its potential weaknesses which are valuable for its potential refinements and improvements.
△ Less
Submitted 2 January, 2024;
originally announced January 2024.
-
Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models
Authors:
Manish Bhatt,
Sahana Chennabasappa,
Cyrus Nikolaidis,
Shengye Wan,
Ivan Evtimov,
Dominik Gabi,
Daniel Song,
Faizan Ahmad,
Cornelius Aschermann,
Lorenzo Fontana,
Sasha Frolov,
Ravi Prakash Giri,
Dhaval Kapil,
Yiannis Kozyrakis,
David LeBlanc,
James Milazzo,
Aleksandar Straumann,
Gabriel Synnaeve,
Varun Vontimitta,
Spencer Whitman,
Joshua Saxe
Abstract:
This paper presents CyberSecEval, a comprehensive benchmark developed to help bolster the cybersecurity of Large Language Models (LLMs) employed as coding assistants. As what we believe to be the most extensive unified cybersecurity safety benchmark to date, CyberSecEval provides a thorough evaluation of LLMs in two crucial security domains: their propensity to generate insecure code and their lev…
▽ More
This paper presents CyberSecEval, a comprehensive benchmark developed to help bolster the cybersecurity of Large Language Models (LLMs) employed as coding assistants. As what we believe to be the most extensive unified cybersecurity safety benchmark to date, CyberSecEval provides a thorough evaluation of LLMs in two crucial security domains: their propensity to generate insecure code and their level of compliance when asked to assist in cyberattacks. Through a case study involving seven models from the Llama 2, Code Llama, and OpenAI GPT large language model families, CyberSecEval effectively pinpointed key cybersecurity risks. More importantly, it offered practical insights for refining these models. A significant observation from the study was the tendency of more advanced models to suggest insecure code, highlighting the critical need for integrating security considerations in the development of sophisticated LLMs. CyberSecEval, with its automated test case generation and evaluation pipeline covers a broad scope and equips LLM designers and researchers with a tool to broadly measure and enhance the cybersecurity safety properties of LLMs, contributing to the development of more secure AI systems.
△ Less
Submitted 7 December, 2023;
originally announced December 2023.
-
Object level footprint uncertainty quantification in infrastructure based sensing
Authors:
Arpan Kusari,
Asma Almutairi,
Mark E. Gilbert,
David J. LeBlanc
Abstract:
We examine the problem of estimating footprint uncertainty of objects imaged using the infrastructure based camera sensing. A closed form relationship is established between the ground coordinates and the sources of the camera errors. Using the error propagation equation, the covariance of a given ground coordinate can be measured as a function of the camera errors. The uncertainty of the footprin…
▽ More
We examine the problem of estimating footprint uncertainty of objects imaged using the infrastructure based camera sensing. A closed form relationship is established between the ground coordinates and the sources of the camera errors. Using the error propagation equation, the covariance of a given ground coordinate can be measured as a function of the camera errors. The uncertainty of the footprint of the bounding box can then be given as the function of all the extreme points of the object footprint. In order to calculate the uncertainty of a ground point, the typical error sizes of the error sources are required. We present a method of estimating the typical error sizes from an experiment using a static, high-precision LiDAR as the ground truth. Finally, we present a simulated case study of uncertainty quantification from infrastructure based camera in CARLA to provide a sense of how the uncertainty changes across a left turn maneuver.
△ Less
Submitted 24 August, 2023;
originally announced August 2023.
-
Improved Moore-Penrose continuation algorithm for the computation of problems with critical points
Authors:
S. Léger,
P. Larocque,
D. LeBlanc
Abstract:
Using typical solution strategies to compute the solution curve of challenging problems often leads to the break down of the algorithm. To improve the solution process, numerical continuation methods have proved to be a very efficient tool. However, these methods can still lead to undesired results. In particular, near severe limit points and cusps, the solution process frequently encounters one o…
▽ More
Using typical solution strategies to compute the solution curve of challenging problems often leads to the break down of the algorithm. To improve the solution process, numerical continuation methods have proved to be a very efficient tool. However, these methods can still lead to undesired results. In particular, near severe limit points and cusps, the solution process frequently encounters one of the following situations : divergence of the algorithm, a change in direction which makes the algorithm backtrack on a part of the solution curve that has already been obtained and omitting important regions of the solution curve by converging to a point that is much farther than the one anticipated. Detecting these situations is not an easy task when solving practical problems since the shape of the solution curve is not known in advance. This paper will therefore present a modified Moore-Penrose continuation method that will include two key aspects to solve challenging problems : detection of problematic regions during the solution process and additional steps to deal with them. The proposed approach can either be used as a basic continuation method or simply activated when difficulties occur. Numerical examples will be presented to show the efficiency of the new approach.
△ Less
Submitted 16 March, 2023;
originally announced March 2023.
-
A Novel Traffic Simulation Framework for Testing Autonomous Vehicles Using SUMO and CARLA
Authors:
Pei Li,
Arpan Kusari,
David J. LeBlanc
Abstract:
Traffic simulation is an efficient and cost-effective way to test Autonomous Vehicles (AVs) in a complex and dynamic environment. Numerous studies have been conducted for AV evaluation using traffic simulation over the past decades. However, the current simulation environments fall behind on two fronts -- the background vehicles (BVs) fail to simulate naturalistic driving behavior and the existing…
▽ More
Traffic simulation is an efficient and cost-effective way to test Autonomous Vehicles (AVs) in a complex and dynamic environment. Numerous studies have been conducted for AV evaluation using traffic simulation over the past decades. However, the current simulation environments fall behind on two fronts -- the background vehicles (BVs) fail to simulate naturalistic driving behavior and the existing environments do not test the entire pipeline in a modular fashion. This study aims to propose a simulation framework that creates a complex and naturalistic traffic environment. Specifically, we combine a modified version of the Simulation of Urban MObility (SUMO) simulator with the Cars Learning to Act (CARLA) simulator to generate a simulation environment that could emulate the complexities of the external environment while providing realistic sensor outputs to the AV pipeline. In a past research work, we created an open-source Python package called SUMO-Gym which generates a realistic road network and naturalistic traffic through SUMO and combines that with OpenAI Gym to provide ease of use for the end user. We propose to extend our developed software by adding CARLA, which in turn will enrich the perception of the ego vehicle by providing realistic sensors outputs of the AVs surrounding environment. Using the proposed framework, AVs perception, planning, and control could be tested in a complex and realistic driving environment. The performance of the proposed framework in constructing output generation and AV evaluations are demonstrated using several case studies.
△ Less
Submitted 13 October, 2021;
originally announced October 2021.
-
Enhancing SUMO simulator for simulation based testing and validation of autonomous vehicles
Authors:
Arpan Kusari,
Pei Li,
Hanzhi Yang,
Nikhil Punshi,
Mich Rasulis,
Scott Bogard,
David J. LeBlanc
Abstract:
Current autonomous vehicle (AV) simulators are built to provide large-scale testing required to prove capabilities under varied conditions in controlled, repeatable fashion. However, they have certain failings including the need for user expertise and complex inconvenient tutorials for customized scenario creation. Simulation of Urban Mobility (SUMO) simulator, which has been presented as an open-…
▽ More
Current autonomous vehicle (AV) simulators are built to provide large-scale testing required to prove capabilities under varied conditions in controlled, repeatable fashion. However, they have certain failings including the need for user expertise and complex inconvenient tutorials for customized scenario creation. Simulation of Urban Mobility (SUMO) simulator, which has been presented as an open-source AV simulator, is used extensively but suffer from similar issues which make it difficult for entry-level practitioners to utilize the simulator without significant time investment. In that regard, we provide two enhancements to SUMO simulator geared towards massively improving user experience and providing real-life like variability for surrounding traffic. Firstly, we calibrate a car-following model, Intelligent Driver Model (IDM), for highway and urban naturalistic driving data and sample automatically from the parameter distributions to create the background vehicles. Secondly, we combine SUMO with OpenAI gym, creating a Python package which can run simulations based on real world highway and urban layouts with generic output observations and input actions that can be processed via any AV pipeline. Our aim through these enhancements is to provide an easy-to-use platform which can be readily used for AV testing and validation.
△ Less
Submitted 23 September, 2021;
originally announced September 2021.
-
Vehicle Energy Dataset (VED), A Large-scale Dataset for Vehicle Energy Consumption Research
Authors:
G. S. Oh,
David J. Leblanc,
Huei Peng
Abstract:
We present Vehicle Energy Dataset (VED), a novel large-scale dataset of fuel and energy data collected from 383 personal cars in Ann Arbor, Michigan, USA. This open dataset captures GPS trajectories of vehicles along with their time-series data of fuel, energy, speed, and auxiliary power usage. A diverse fleet consisting of 264 gasoline vehicles, 92 HEVs, and 27 PHEV/EVs drove in real-world from N…
▽ More
We present Vehicle Energy Dataset (VED), a novel large-scale dataset of fuel and energy data collected from 383 personal cars in Ann Arbor, Michigan, USA. This open dataset captures GPS trajectories of vehicles along with their time-series data of fuel, energy, speed, and auxiliary power usage. A diverse fleet consisting of 264 gasoline vehicles, 92 HEVs, and 27 PHEV/EVs drove in real-world from Nov, 2017 to Nov, 2018, where the data were collected through onboard OBD-II loggers. Driving scenarios range from highways to traffic-dense downtown area in various driving conditions and seasons. In total, VED accumulates approximately 374,000 miles. We discuss participant privacy protection and develop a method to de-identify personally identifiable information while preserving the quality of the data. After the de-identification, we conducted case studies on the dataset to investigate the impacts of factors known to affect fuel economy and identify energy-saving opportunities that hybrid-electric vehicles and eco-driving techniques can provide. The case studies are supplemented with a number of examples to demonstrate how VED can be utilized for vehicle energy and behavior studies. Potential research opportunities include data-driven vehicle energy consumption modeling, driver behavior modeling, machine and deep learning, calibration of traffic simulators, optimal route choice modeling, prediction of human driver behaviors, and decision making of self-driving cars. We believe that VED can be an instrumental asset to the development of future automotive technologies. The dataset can be accessed at https://github.com/gsoh/VED.
△ Less
Submitted 19 April, 2019;
originally announced May 2019.
-
Impact of further-range exchange and cubic anisotropy on magnetic excitations in the fcc kagome antiferromagnet IrMn3
Authors:
M. D. LeBlanc,
A. A. Aczel,
G. E. Granroth,
B. W. Southern,
J. -Q. Yan,
S. E. Nagler,
J. P. Whitehead,
M. L. Plumer
Abstract:
Exchange interactions up to fourth nearest neighbor are shown within a classical local-moment Heisenberg approach to be important to model inelastic neutron scattering data on the fcc kagome antiferromagnet IrMn$_3$. Spin wave frequencies are calculated using the torque equation and the magnetic scattering function, $S({\bf Q},ω)$, is determined by a Green's function method, as an extension of our…
▽ More
Exchange interactions up to fourth nearest neighbor are shown within a classical local-moment Heisenberg approach to be important to model inelastic neutron scattering data on the fcc kagome antiferromagnet IrMn$_3$. Spin wave frequencies are calculated using the torque equation and the magnetic scattering function, $S({\bf Q},ω)$, is determined by a Green's function method, as an extension of our previous work, LeBlanc et al, Phys. Rev. B 90, 144403 (2014). Results are compared with intensity contour data on powder samples of ordered IrMn$_3$, where magnetic Mn ions occupy lattice sites of ABC stacked kagome planes. Values of exchange parameters taken from DFT calculations used in our model provide good agreement with the experimental results only if further-neighbor exchange is included. Estimates of the observed energy gap support the existence of strong cubic anisotropy predicted by DFT calculations.
△ Less
Submitted 17 July, 2018;
originally announced July 2018.
-
Gap Acceptance During Lane Changes by Large-Truck Drivers-An Image-Based Analysis
Authors:
Kazutoshi Nobukawa,
Shan Bao,
David J. LeBlanc,
Ding Zhao,
Huei Peng,
Christopher S. Pan
Abstract:
This paper presents an analysis of rearward gap acceptance characteristics of drivers of large trucks in highway lane change scenarios. The range between the vehicles was inferred from camera images using the estimated lane width obtained from the lane tracking camera as the reference. Six-hundred lane change events were acquired from a large-scale naturalistic driving data set. The kinematic vari…
▽ More
This paper presents an analysis of rearward gap acceptance characteristics of drivers of large trucks in highway lane change scenarios. The range between the vehicles was inferred from camera images using the estimated lane width obtained from the lane tracking camera as the reference. Six-hundred lane change events were acquired from a large-scale naturalistic driving data set. The kinematic variables from the image-based gap analysis were filtered by the weighted linear least squares in order to extrapolate them at the lane change time. In addition, the time-to-collision and required deceleration were computed, and potential safety threshold values are provided. The resulting range and range rate distributions showed directional discrepancies, i.e., in left lane changes, large trucks are often slower than other vehicles in the target lane, whereas they are usually faster in right lane changes. Video observations have confirmed that major motivations for changing lanes are different depending on the direction of move, i.e., moving to the left (faster) lane occurs due to a slower vehicle ahead or a merging vehicle on the right-hand side, whereas right lane changes are frequently made to return to the original lane after passing.
△ Less
Submitted 28 July, 2017;
originally announced July 2017.
-
Analysis of mandatory and discretionary lane change behaviors for heavy trucks
Authors:
Ding Zhao,
Huei Peng,
Kazutoshi Nobukawa,
Shan Bao,
David J LeBlanc,
Christopher S Pan
Abstract:
The behaviors of heavy vehicles drivers in mandatory and discretionary lane changes are analyzed in this paper. 640 mandatory and 2,035 discretionary lane change events were extracted from a naturalistic driving database. Variations in gap acceptance and lane change duration were investigated. Statistical analysis showed that mandatory lane changes are more aggressive in gap acceptance and lane ch…
▽ More
The behaviors of heavy vehicles drivers in mandatory and discretionary lane changes are analyzed in this paper. 640 mandatory and 2,035 discretionary lane change events were extracted from a naturalistic driving database. Variations in gap acceptance and lane change duration were investigated. Statistical analysis showed that mandatory lane changes are more aggressive in gap acceptance and lane change execution than discretionary lane changes. The results can be used for microscopic simulations, and design and evaluation of driver-assistant systems.
△ Less
Submitted 28 July, 2017;
originally announced July 2017.
-
Development and Evaluation of Two Learning-Based Personalized Driver Models for Car-Following Behaviors
Authors:
Wenshuo Wang,
Ding Zhao,
Junqiang Xi,
David J. LeBlanc,
J. Karl Hedrick
Abstract:
Personalized driver models play a key role in the development of advanced driver assistance systems and automated driving systems. Traditionally, physical-based driver models with fixed structures usually lack the flexibility to describe the uncertainties and high non-linearity of driver behaviors. In this paper, two kinds of learning-based car-following personalized driver models were developed u…
▽ More
Personalized driver models play a key role in the development of advanced driver assistance systems and automated driving systems. Traditionally, physical-based driver models with fixed structures usually lack the flexibility to describe the uncertainties and high non-linearity of driver behaviors. In this paper, two kinds of learning-based car-following personalized driver models were developed using naturalistic driving data collected from the University of Michigan Safety Pilot Model Deployment program. One model is developed by combining the Gaussian Mixture Model (GMM) and the Hidden Markov Model (HMM), and the other one is developed by combining the Gaussian Mixture Model (GMM) and Probability Density Functions (PDF). Fitting results between the two approaches were analyzed with different model inputs and numbers of GMM components. Statistical analyses show that both models provide good performance of fitting while the GMM--PDF approach shows a higher potential to increase the model accuracy given a higher dimension of training data.
△ Less
Submitted 9 March, 2017;
originally announced March 2017.
-
Evaluation of A Semi-Autonomous Lane Departure Correction System Using Naturalistic Driving Data
Authors:
Ding Zhao,
Wenshuo Wang,
David J. LeBlanc
Abstract:
Evaluating the effectiveness and benefits of driver assistance systems is essential for improving the system performance. In this paper, we propose an efficient evaluation method for a semi-autonomous lane departure correction system. To achieve this, we apply a bounded Gaussian mixture model to describe drivers' stochastic lane departure behavior learned from naturalistic driving data, which can…
▽ More
Evaluating the effectiveness and benefits of driver assistance systems is essential for improving the system performance. In this paper, we propose an efficient evaluation method for a semi-autonomous lane departure correction system. To achieve this, we apply a bounded Gaussian mixture model to describe drivers' stochastic lane departure behavior learned from naturalistic driving data, which can regenerate departure behaviors to evaluate the lane departure correction system. In the stochastic lane departure model, we conduct a dimension reduction to reduce the computation cost. Finally, to show the advantages of our proposed evaluation approach, we compare steering systems with and without lane departure assistance based on the stochastic lane departure model. The simulation results show that the proposed method can effectively evaluate the lane departure correction system.
△ Less
Submitted 21 February, 2017;
originally announced February 2017.
-
Analysis of Unprotected Intersection Left-Turn Conflicts based on Naturalistic Driving Data
Authors:
Xinpeng Wang,
Ding Zhao,
Huei Peng,
David J. LeBlanc
Abstract:
Analyzing and reconstructing driving scenarios is crucial for testing and evaluating automated vehicles. This research analyzed left turn / straight-driving conflicts at unprotected intersections by extracting actual vehicle motion data from a naturalistic driving database collected by the University of Michigan. Nearly 7,000 Left turn across path opposite direction (LTAP/OD) events involving heav…
▽ More
Analyzing and reconstructing driving scenarios is crucial for testing and evaluating automated vehicles. This research analyzed left turn / straight-driving conflicts at unprotected intersections by extracting actual vehicle motion data from a naturalistic driving database collected by the University of Michigan. Nearly 7,000 Left turn across path opposite direction (LTAP/OD) events involving heavy trucks and light vehicles were extracted and used to build a stochastic model of such LTAP/OD scenarios. Statistical analysis showed that vehicle type is a significant factor, whereas the change of season seems to have limited influence on the statistical nature of the conflict. The results can be used to build HAV testing environments to simulate the LTAP/OD crash cases in a stochastic manner, which is among the top NHTSA identified priority light-vehicle pre-crash scenarios.
△ Less
Submitted 3 April, 2017; v1 submitted 1 February, 2017;
originally announced February 2017.
-
Accelerated Evaluation of Automated Vehicles Using Piecewise Mixture Models
Authors:
Zhiyuan Huang,
Ding Zhao,
Henry Lam,
David J. LeBlanc
Abstract:
The process to certify highly Automated Vehicles has not yet been defined by any country in the world. Currently, companies test Automated Vehicles on public roads, which is time-consuming and inefficient. We proposed the Accelerated Evaluation concept, which uses a modified statistics of the surrounding vehicles and the Importance Sampling theory to reduce the evaluation time by several orders of…
▽ More
The process to certify highly Automated Vehicles has not yet been defined by any country in the world. Currently, companies test Automated Vehicles on public roads, which is time-consuming and inefficient. We proposed the Accelerated Evaluation concept, which uses a modified statistics of the surrounding vehicles and the Importance Sampling theory to reduce the evaluation time by several orders of magnitude, while ensuring the evaluation results are statistically accurate. In this paper, we further improve the accelerated evaluation concept by using Piecewise Mixture Distribution models, instead of Single Parametric Distribution models. We developed and applied this idea to forward collision control system reacting to vehicles making cut-in lane changes. The behavior of the cut-in vehicles was modeled based on more than 403,581 lane changes collected by the University of Michigan Safety Pilot Model Deployment Program. Simulation results confirm that the accuracy and efficiency of the Piecewise Mixture Distribution method outperformed single parametric distribution methods in accuracy and efficiency, and accelerated the evaluation process by almost four orders of magnitude.
△ Less
Submitted 30 January, 2017;
originally announced January 2017.
-
Evaluation of Automated Vehicles in the Frontal Cut-in Scenario - an Enhanced Approach using Piecewise Mixture Models
Authors:
Zhiyuan Huang,
Ding Zhao,
Henry Lam,
David J. LeBlanc,
Huei Peng
Abstract:
Evaluation and testing are critical for the development of Automated Vehicles (AVs). Currently, companies test AVs on public roads, which is very time-consuming and inefficient. We proposed the Accelerated Evaluation concept which uses a modified statistics of the surrounding vehicles and the Importance Sampling theory to reduce the evaluation time by several orders of magnitude, while ensuring th…
▽ More
Evaluation and testing are critical for the development of Automated Vehicles (AVs). Currently, companies test AVs on public roads, which is very time-consuming and inefficient. We proposed the Accelerated Evaluation concept which uses a modified statistics of the surrounding vehicles and the Importance Sampling theory to reduce the evaluation time by several orders of magnitude, while ensuring the final evaluation results are accurate. In this paper, we further extend this idea by using Piecewise Mixture Distribution models instead of Single Distribution models. We demonstrate this idea to evaluate vehicle safety in lane change scenarios. The behavior of the cut-in vehicles was modeled based on more than 400,000 naturalistic driving lane changes collected by the University of Michigan Safety Pilot Model Deployment Program. Simulation results confirm that the accuracy and efficiency of the Piecewise Mixture Distribution method are better than the single distribution.
△ Less
Submitted 30 January, 2017; v1 submitted 28 October, 2016;
originally announced October 2016.
-
Accelerated Evaluation of Automated Vehicles in Car-Following Maneuvers
Authors:
Ding Zhao,
Xianan Huang,
Huei Peng,
Henry Lam,
David J. LeBlanc
Abstract:
The safety of Automated Vehicles (AVs) must be assured before their release and deployment. The current approach to evaluation relies primarily on (i) testing AVs on public roads or (ii) track testing with scenarios defined in a test matrix. These two methods have completely opposing drawbacks: the former, while offering realistic scenarios, takes too much time to execute; the latter, though it ca…
▽ More
The safety of Automated Vehicles (AVs) must be assured before their release and deployment. The current approach to evaluation relies primarily on (i) testing AVs on public roads or (ii) track testing with scenarios defined in a test matrix. These two methods have completely opposing drawbacks: the former, while offering realistic scenarios, takes too much time to execute; the latter, though it can be completed in a short amount of time, has no clear correlation to safety benefits in the real world. To avoid the aforementioned problems, we propose Accelerated Evaluation, focusing on the car-following scenario. The stochastic human-controlled vehicle (HV) motions are modeled based on 1.3 million miles of naturalistic driving data collected by the University of Michigan Safety Pilot Model Deployment Program. The statistics of the HV behaviors are then modified to generate more intense interactions between HVs and AVs to accelerate the evaluation procedure. The Importance Sampling theory was used to ensure that the safety benefits of AVs are accurately assessed under accelerated tests. Crash, injury and conflict rates for a simulated AV are simulated to demonstrate the proposed approach. Results show that test duration is reduced by a factor of 300 to 100,000 compared with the non-accelerated (naturalistic) evaluation. In other words, the proposed techniques have great potential for accelerating the AV evaluation process.
△ Less
Submitted 19 February, 2017; v1 submitted 9 July, 2016;
originally announced July 2016.
-
Accelerated Evaluation of Automated Vehicles Safety in Lane Change Scenarios Based on Importance Sampling Techniques
Authors:
Ding Zhao,
Henry Lam,
Huei Peng,
Shan Bao,
David J. LeBlanc,
Kazutoshi Nobukawa,
Christopher S. Pan
Abstract:
Automated vehicles (AVs) must be evaluated thoroughly before their release and deployment. A widely-used evaluation approach is the Naturalistic-Field Operational Test (N-FOT), which tests prototype vehicles directly on the public roads. Due to the low exposure to safety-critical scenarios, N-FOTs are time-consuming and expensive to conduct. In this paper, we propose an accelerated evaluation appr…
▽ More
Automated vehicles (AVs) must be evaluated thoroughly before their release and deployment. A widely-used evaluation approach is the Naturalistic-Field Operational Test (N-FOT), which tests prototype vehicles directly on the public roads. Due to the low exposure to safety-critical scenarios, N-FOTs are time-consuming and expensive to conduct. In this paper, we propose an accelerated evaluation approach for AVs. The results can be used to generate motions of the primary other vehicles to accelerate the verification of AVs in simulations and controlled experiments. Frontal collision due to unsafe cut-ins is the target crash type of this paper. Human-controlled vehicles making unsafe lane changes are modeled as the primary disturbance to AVs based on data collected by the University of Michigan Safety Pilot Model Deployment Program. The cut-in scenarios are generated based on skewed statistics of collected human driver behaviors, which generate risky testing scenarios while preserving the statistical information so that the safety benefits of AVs in non-accelerated cases can be accurately estimated. The Cross Entropy method is used to recursively search for the optimal skewing parameters. The frequencies of occurrence of conflicts, crashes and injuries are estimated for a modeled automated vehicle, and the achieved accelerated rate is around 2,000 to 20,000. In other words, in the accelerated simulations, driving for 1,000 miles will expose the AV with challenging scenarios that will take about 2 to 20 million miles of real-world driving to encounter. This technique thus has the potential to reduce greatly the development and validation time for AVs.
△ Less
Submitted 15 June, 2016; v1 submitted 16 May, 2016;
originally announced May 2016.
-
Spin waves in the anisotropic fcc kagome antiferromagnet
Authors:
M. D. LeBlanc,
B. W. Southern,
M. L. Plumer,
J. P. Whitehead
Abstract:
Spin wave calculations demonstrate that the macroscopic continuous degeneracy associated with the two-dimensional kagome Heisenberg spin lattice persists in the case of the stacked fcc structure giving rise to zero energy modes in three dimensions. The addition of an effective local cubic anisotropy is shown to remove this continuous degeneracy and introduce a gap in the spectrum as well as modify…
▽ More
Spin wave calculations demonstrate that the macroscopic continuous degeneracy associated with the two-dimensional kagome Heisenberg spin lattice persists in the case of the stacked fcc structure giving rise to zero energy modes in three dimensions. The addition of an effective local cubic anisotropy is shown to remove this continuous degeneracy and introduce a gap in the spectrum as well as modify the inelastic scattering function $S({\bf q},ω)$. This scenario supports earlier Monte Carlo simulations which indicate that the phase transition to long range $q=0$ magnetic order is driven to be discontinuous by critical fluctuations associated with the large degeneracy in the absence of anisotropy, but becomes continuous with the addition of anisotropy. The results are relevant to Ir-Mn alloys which are widely used in the magnetic storage industry in thin film form as the antiferromagnetic pinning layer in spin-valve structures.
△ Less
Submitted 25 March, 2014;
originally announced March 2014.
-
Micromagnetic simulations of sweep-rate dependent coercivity in perpendicular recording media
Authors:
M. L. Plumer,
M. D. Leblanc,
J. P. Whitehead,
J. van Ek
Abstract:
The results of micromagnetic simulations are presented which examine the impact of thermal fluctuations on sweep rate dependent coercivities of both single-layer and exchange-coupled-composite (ECC) perpendicular magnetic recording media. M-H loops are calculated at four temperatures and sweep rates spanning five decades with fields applied normal to the plane and at 45 degrees. The impact of inte…
▽ More
The results of micromagnetic simulations are presented which examine the impact of thermal fluctuations on sweep rate dependent coercivities of both single-layer and exchange-coupled-composite (ECC) perpendicular magnetic recording media. M-H loops are calculated at four temperatures and sweep rates spanning five decades with fields applied normal to the plane and at 45 degrees. The impact of interactions between grains is evaluated. The results indicate a significantly weaker sweep-rate dependence for ECC media suggesting more robustness to long-term thermal effects. Fitting the modeled results to Sharrock-like scaling proposed by Feng and Visscher [J. Appl. Phys. 95, 7043 (2004)] is successful only in the case of single-layer media with the field normal to the plane.
△ Less
Submitted 15 March, 2012;
originally announced March 2012.