-
Sample size for developing a prediction model with a binary outcome: targeting precise individual risk estimates to improve clinical decisions and fairness
Authors:
Richard D Riley,
Gary S Collins,
Rebecca Whittle,
Lucinda Archer,
Kym IE Snell,
Paula Dhiman,
Laura Kirton,
Amardeep Legha,
Xiaoxuan Liu,
Alastair Denniston,
Frank E Harrell Jr,
Laure Wynants,
Glen P Martin,
Joie Ensor
Abstract:
When developing a clinical prediction model, the sample size of the development dataset is a key consideration. Small sample sizes lead to greater concerns of overfitting, instability, poor performance and lack of fairness. Previous research has outlined minimum sample size calculations to minimise overfitting and precisely estimate the overall risk. However even when meeting these criteria, the u…
▽ More
When developing a clinical prediction model, the sample size of the development dataset is a key consideration. Small sample sizes lead to greater concerns of overfitting, instability, poor performance and lack of fairness. Previous research has outlined minimum sample size calculations to minimise overfitting and precisely estimate the overall risk. However even when meeting these criteria, the uncertainty (instability) in individual-level risk estimates may be considerable. In this article we propose how to examine and calculate the sample size required for developing a model with acceptably precise individual-level risk estimates to inform decisions and improve fairness. We outline a five-step process to be used before data collection or when an existing dataset is available. It requires researchers to specify the overall risk in the target population, the (anticipated) distribution of key predictors in the model, and an assumed 'core model' either specified directly (i.e., a logistic regression equation is provided) or based on specified C-statistic and relative effects of (standardised) predictors. We produce closed-form solutions that decompose the variance of an individual's risk estimate into Fisher's unit information matrix, predictor values and total sample size; this allows researchers to quickly calculate and examine individual-level uncertainty interval widths and classification instability for specified sample sizes. Such information can be presented to key stakeholders (e.g., health professionals, patients, funders) using prediction and classification instability plots to help identify the (target) sample size required to improve trust, reliability and fairness in individual predictions. Our proposal is implemented in software module pmstabilityss. We provide real examples and emphasise the importance of clinical context including any risk thresholds for decision making.
△ Less
Submitted 12 July, 2024;
originally announced July 2024.
-
Extended sample size calculations for evaluation of prediction models using a threshold for classification
Authors:
Rebecca Whittle,
Joie Ensor,
Lucinda Archer,
Gary S. Collins,
Paula Dhiman,
Alastair Denniston,
Joseph Alderman,
Amardeep Legha,
Maarten van Smeden,
Karel G. Moons,
Jean-Baptiste Cazier,
Richard D. Riley,
Kym I. E. Snell
Abstract:
When evaluating the performance of a model for individualised risk prediction, the sample size needs to be large enough to precisely estimate the performance measures of interest. Current sample size guidance is based on precisely estimating calibration, discrimination, and net benefit, which should be the first stage of calculating the minimum required sample size. However, when a clinically impo…
▽ More
When evaluating the performance of a model for individualised risk prediction, the sample size needs to be large enough to precisely estimate the performance measures of interest. Current sample size guidance is based on precisely estimating calibration, discrimination, and net benefit, which should be the first stage of calculating the minimum required sample size. However, when a clinically important threshold is used for classification, other performance measures can also be used. We extend the previously published guidance to precisely estimate threshold-based performance measures. We have developed closed-form solutions to estimate the sample size required to target sufficiently precise estimates of accuracy, specificity, sensitivity, PPV, NPV, and F1-score in an external evaluation study of a prediction model with a binary outcome. This approach requires the user to pre-specify the target standard error and the expected value for each performance measure. We describe how the sample size formulae were derived and demonstrate their use in an example. Extension to time-to-event outcomes is also considered. In our examples, the minimum sample size required was lower than that required to precisely estimate the calibration slope, and we expect this would most often be the case. Our formulae, along with corresponding Python code and updated R and Stata commands (pmvalsampsize), enable researchers to calculate the minimum sample size needed to precisely estimate threshold-based performance measures in an external evaluation study. These criteria should be used alongside previously published criteria to precisely estimate the calibration, discrimination, and net-benefit.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
Physical properties of asteroid Dimorphos as derived from the DART impact
Authors:
S. D. Raducan,
M. Jutzi,
A. F. Cheng,
Y. Zhang,
O. Barnouin,
G. S. Collins,
R. T. Daly,
T. M. Davison,
C. M. Ernst,
T. L. Farnham,
F. Ferrari,
M. Hirabayashi,
K. M. Kumamoto,
P. Michel,
N. Murdoch,
R. Nakano,
M. Pajola,
A. Rossi,
H. F. Agrusa,
B. W. Barbee,
M. Bruck Syal,
N. L. Chabot,
E. Dotto,
E. G. Fahnestock,
P. H. Hasselmann
, et al. (17 additional authors not shown)
Abstract:
On September 26, 2022, NASA's Double Asteroid Redirection Test (DART) mission successfully impacted Dimorphos, the natural satellite of the binary near-Earth asteroid (65803) Didymos. Numerical simulations of the impact provide a means to explore target surface material properties and structures, consistent with the observed momentum deflection efficiency, ejecta cone geometry, and ejected mass. O…
▽ More
On September 26, 2022, NASA's Double Asteroid Redirection Test (DART) mission successfully impacted Dimorphos, the natural satellite of the binary near-Earth asteroid (65803) Didymos. Numerical simulations of the impact provide a means to explore target surface material properties and structures, consistent with the observed momentum deflection efficiency, ejecta cone geometry, and ejected mass. Our simulation, which best matches observations, indicates that Dimorphos is weak, with a cohesive strength of less than a few pascals (Pa), similar to asteroids (162173) Ryugu and (101955) Bennu. We find that a bulk density of Dimorphos, rhoB, lower than 2400 kg/m3, and a low volume fraction of boulders (<40 vol%) on the surface and in the shallow subsurface, are consistent with measured data from the DART experiment. These findings suggest Dimorphos is a rubble pile that might have formed through rotational mass shedding and re-accumulation from Didymos. Our simulations indicate that the DART impact caused global deformation and resurfacing of Dimorphos. ESA's upcoming Hera mission may find a re-shaped asteroid, rather than a well-defined crater.
△ Less
Submitted 1 March, 2024;
originally announced March 2024.
-
The distribution of impactor core material during large impacts on Earth-like planets
Authors:
Jonathan P. Itcovitz,
Auriol S. P. Rae,
Thomas M. Davison,
Gareth S. Collins,
Oliver Shorttle
Abstract:
Large impacts onto young rocky planets may transform their compositions, creating highly reducing conditions at their surfaces and reintroducing highly siderophile metals to their mantles. Key to these processes is the availability of an impactor's chemically reduced core material (metallic iron). It is, therefore, important to constrain how much of an impactor's core remains accessible to a plane…
▽ More
Large impacts onto young rocky planets may transform their compositions, creating highly reducing conditions at their surfaces and reintroducing highly siderophile metals to their mantles. Key to these processes is the availability of an impactor's chemically reduced core material (metallic iron). It is, therefore, important to constrain how much of an impactor's core remains accessible to a planet's mantle/surface, how much is sequestered to its core, and how much escapes. Here, we present 3D simulations of such impact scenarios using the shock physics code iSALE to determine the fate of impactor iron. iSALE's inclusion of material strength is vital in capturing the behavior of both solid and fluid components of the planet and thus characterizing iron sequestration to the core. We find that the mass fractions of impactor core material that accretes to the planet core ($f_{core}$) or escapes ($f_{esc}$) can be readily parameterized as a function of a modified specific impact energy, with $f_{core} > f_{esc}$ for a wide set of impacts. These results differ from previous works that do not incorporate material strength. Our work shows that large impacts can place substantial reducing impactor core material in the mantles of young rocky planets. Impact-generated reducing atmospheres may thus be common for such worlds. However, through escape and sequestration to a planet's core, large fractions of an impactor's core can be geochemically hidden from a planet's mantle. Consequently, geochemical estimates of late bombardments of planets based on mantle siderophile element abundances may be underestimates.
△ Less
Submitted 19 December, 2023;
originally announced December 2023.
-
Bibliometric Analysis of Publisher and Journal Instructions to Authors on Generative-AI in Academic and Scientific Publishing
Authors:
Conner Ganjavi,
Michael B. Eppler,
Asli Pekcan,
Brett Biedermann,
Andre Abreu,
Gary S. Collins,
Inderbir S. Gill,
Giovanni E. Cacciamani
Abstract:
We aim to determine the extent and content of guidance for authors regarding the use of generative-AI (GAI), Generative Pretrained models (GPTs) and Large Language Models (LLMs) powered tools among the top 100 academic publishers and journals in science. The websites of these publishers and journals were screened from between 19th and 20th May 2023. Among the largest 100 publishers, 17% provided g…
▽ More
We aim to determine the extent and content of guidance for authors regarding the use of generative-AI (GAI), Generative Pretrained models (GPTs) and Large Language Models (LLMs) powered tools among the top 100 academic publishers and journals in science. The websites of these publishers and journals were screened from between 19th and 20th May 2023. Among the largest 100 publishers, 17% provided guidance on the use of GAI, of which 12 (70.6%) were among the top 25 publishers. Among the top 100 journals, 70% have provided guidance on GAI. Of those with guidance, 94.1% of publishers and 95.7% of journals prohibited the inclusion of GAI as an author. Four journals (5.7%) explicitly prohibit the use of GAI in the generation of a manuscript, while 3 (17.6%) publishers and 15 (21.4%) journals indicated their guidance exclusively applies to the writing process. When disclosing the use of GAI, 42.8% of publishers and 44.3% of journals included specific disclosure criteria. There was variability in guidance of where to disclose the use of GAI, including in the methods, acknowledgments, cover letter, or a new section. There was also variability in how to access GAI guidance and the linking of journal and publisher instructions to authors. There is a lack of guidance by some top publishers and journals on the use of GAI by authors. Among those publishers and journals that provide guidance, there is substantial heterogeneity in the allowable uses of GAI and in how it should be disclosed, with this heterogeneity persisting among affiliated publishers and journals in some instances. The lack of standardization burdens authors and threatens to limit the effectiveness of these regulations. There is a need for standardized guidelines in order to protect the integrity of scientific output as GAI continues to grow in popularity.
△ Less
Submitted 21 July, 2023;
originally announced July 2023.
-
Development of the ChatGPT, Generative Artificial Intelligence and Natural Large Language Models for Accountable Reporting and Use (CANGARU) Guidelines
Authors:
Giovanni E. Cacciamani,
Michael B. Eppler,
Conner Ganjavi,
Asli Pekan,
Brett Biedermann,
Gary S. Collins,
Inderbir S. Gill
Abstract:
The swift progress and ubiquitous adoption of Generative AI (GAI), Generative Pre-trained Transformers (GPTs), and large language models (LLMs) like ChatGPT, have spurred queries about their ethical application, use, and disclosure in scholarly research and scientific productions. A few publishers and journals have recently created their own sets of rules; however, the absence of a unified approac…
▽ More
The swift progress and ubiquitous adoption of Generative AI (GAI), Generative Pre-trained Transformers (GPTs), and large language models (LLMs) like ChatGPT, have spurred queries about their ethical application, use, and disclosure in scholarly research and scientific productions. A few publishers and journals have recently created their own sets of rules; however, the absence of a unified approach may lead to a 'Babel Tower Effect,' potentially resulting in confusion rather than desired standardization. In response to this, we present the ChatGPT, Generative Artificial Intelligence, and Natural Large Language Models for Accountable Reporting and Use Guidelines (CANGARU) initiative, with the aim of fostering a cross-disciplinary global inclusive consensus on the ethical use, disclosure, and proper reporting of GAI/GPT/LLM technologies in academia. The present protocol consists of four distinct parts: a) an ongoing systematic review of GAI/GPT/LLM applications to understand the linked ideas, findings, and reporting standards in scholarly research, and to formulate guidelines for its use and disclosure, b) a bibliometric analysis of existing author guidelines in journals that mention GAI/GPT/LLM, with the goal of evaluating existing guidelines, analyzing the disparity in their recommendations, and identifying common rules that can be brought into the Delphi consensus process, c) a Delphi survey to establish agreement on the items for the guidelines, ensuring principled GAI/GPT/LLM use, disclosure, and reporting in academia, and d) the subsequent development and dissemination of the finalized guidelines and their supplementary explanation and elaboration documents.
△ Less
Submitted 18 July, 2023;
originally announced July 2023.
-
The Winchcombe Fireball -- that Lucky Survivor
Authors:
Sarah McMullan,
Denis Vida,
Hadrien A. R. Devillepoix,
Jim Rowe,
Luke Daly,
Ashley J. King,
Martin Cupák,
Robert M. Howie,
Eleanor K. Sansom,
Patrick Shober,
Martin C. Towner,
Seamus Anderson,
Luke McFadden,
Jana Horák,
Andrew R. D. Smedley,
Katherine H. Joy,
Alan Shuttleworth,
Francois Colas,
Brigitte Zanda,
Áine C. O'Brien,
Ian McMullan,
Clive Shaw,
Adam Suttle,
Martin D. Suttle,
John S. Young
, et al. (12 additional authors not shown)
Abstract:
On February 28, 2021, a fireball dropped $\sim0.6$ kg of recovered CM2 carbonaceous chondrite meteorites in South-West England near the town of Winchcombe. We reconstruct the fireball's atmospheric trajectory, light curve, fragmentation behaviour, and pre-atmospheric orbit from optical records contributed by five networks. The progenitor meteoroid was three orders of magnitude less massive (…
▽ More
On February 28, 2021, a fireball dropped $\sim0.6$ kg of recovered CM2 carbonaceous chondrite meteorites in South-West England near the town of Winchcombe. We reconstruct the fireball's atmospheric trajectory, light curve, fragmentation behaviour, and pre-atmospheric orbit from optical records contributed by five networks. The progenitor meteoroid was three orders of magnitude less massive ($\sim13$ kg) than any previously observed carbonaceous fall. The Winchcombe meteorite survived entry because it was exposed to a very low peak atmospheric dynamic pressure ($\sim0.6$ MPa) due to a fortuitous combination of entry parameters, notably low velocity (13.9 km/s). A near-catastrophic fragmentation at $\sim0.07$ MPa points to the body's fragility. Low entry speeds which cause low peak dynamic pressures are likely necessary conditions for a small carbonaceous meteoroid to survive atmospheric entry, strongly constraining the radiant direction to the general antapex direction. Orbital integrations show that the meteoroid was injected into the near-Earth region $\sim0.08$ Myr ago and it never had a perihelion distance smaller than $\sim0.7$ AU, while other CM2 meteorites with known orbits approached the Sun closer ($\sim0.5$ AU) and were heated to at least 100 K higher temperatures.
△ Less
Submitted 28 March, 2023; v1 submitted 21 March, 2023;
originally announced March 2023.
-
Diversity of new Martian crater clusters informs meteoroid atmospheric interactions
Authors:
T. Neidhart,
E. K. Sansom,
K. Miljković,
G. S. Collins,
J. Eschenfelder,
I. J. Daubar
Abstract:
We investigated 634 crater clusters on Mars detected between 2007 and 2021, which represent more than half of all impacts discovered in this period. Crater clusters form when meteoroids in the 10 kg to 10 ton mass range break-up in Mars' atmosphere to produce a few to a few hundred fragments that hit the ground. The properties of the clusters can inform our understanding of meteoroid properties an…
▽ More
We investigated 634 crater clusters on Mars detected between 2007 and 2021, which represent more than half of all impacts discovered in this period. Crater clusters form when meteoroids in the 10 kg to 10 ton mass range break-up in Mars' atmosphere to produce a few to a few hundred fragments that hit the ground. The properties of the clusters can inform our understanding of meteoroid properties and the processes that govern their fragmentation. We mapped individual craters $>$1 m within each cluster and defined a range of cluster properties based on the spatial and size distributions of the craters. The large data set, with over eight times more cluster observations than previous work, provides a more robust statistical investigation of crater cluster parameters and their correlations. Trends in size, dispersion and large crater fraction with elevation support weak atmospheric filtering of material. The diversity in the number of individual craters within a cluster, and their size-frequency distributions, may reflect either a diversity in fragmentation style, fragility or internal particle sizes.
△ Less
Submitted 12 March, 2023;
originally announced March 2023.
-
Momentum Transfer from the DART Mission Kinetic Impact on Asteroid Dimorphos
Authors:
Andrew F. Cheng,
Harrison F. Agrusa,
Brent W. Barbee,
Alex J. Meyer,
Tony L. Farnham,
Sabina D. Raducan,
Derek C. Richardson,
Elisabetta Dotto,
Angelo Zinzi,
Vincenzo Della Corte,
Thomas S. Statler,
Steven Chesley,
Shantanu P. Naidu,
Masatoshi Hirabayashi,
Jian-Yang Li,
Siegfried Eggl,
Olivier S. Barnouin,
Nancy L. Chabot,
Sidney Chocron,
Gareth S. Collins,
R. Terik Daly,
Thomas M. Davison,
Mallory E. DeCoster,
Carolyn M. Ernst,
Fabio Ferrari
, et al. (44 additional authors not shown)
Abstract:
The NASA Double Asteroid Redirection Test (DART) mission performed a kinetic impact on asteroid Dimorphos, the satellite of the binary asteroid (65803) Didymos, at 23:14 UTC on September 26, 2022 as a planetary defense test. DART was the first hypervelocity impact experiment on an asteroid at size and velocity scales relevant to planetary defense, intended to validate kinetic impact as a means of…
▽ More
The NASA Double Asteroid Redirection Test (DART) mission performed a kinetic impact on asteroid Dimorphos, the satellite of the binary asteroid (65803) Didymos, at 23:14 UTC on September 26, 2022 as a planetary defense test. DART was the first hypervelocity impact experiment on an asteroid at size and velocity scales relevant to planetary defense, intended to validate kinetic impact as a means of asteroid deflection. Here we report the first determination of the momentum transferred to an asteroid by kinetic impact. Based on the change in the binary orbit period, we find an instantaneous reduction in Dimorphos's along-track orbital velocity component of 2.70 +/- 0.10 mm/s, indicating enhanced momentum transfer due to recoil from ejecta streams produced by the impact. For a Dimorphos bulk density range of 1,500 to 3,300 kg/m$^3$, we find that the expected value of the momentum enhancement factor, $β$, ranges between 2.2 and 4.9, depending on the mass of Dimorphos. If Dimorphos and Didymos are assumed to have equal densities of 2,400 kg/m$^3$, $β$= 3.61 +0.19/-0.25 (1 $σ$). These $β$ values indicate that significantly more momentum was transferred to Dimorphos from the escaping impact ejecta than was incident with DART. Therefore, the DART kinetic impact was highly effective in deflecting the asteroid Dimorphos.
△ Less
Submitted 6 March, 2023;
originally announced March 2023.
-
Successful Kinetic Impact into an Asteroid for Planetary Defense
Authors:
R. Terik Daly,
Carolyn M. Ernst,
Olivier S. Barnouin,
Nancy L. Chabot,
Andrew S. Rivkin,
Andrew F. Cheng,
Elena Y. Adams,
Harrison F. Agrusa,
Elisabeth D. Abel,
Amy L. Alford,
Erik I. Asphaug,
Justin A. Atchison,
Andrew R. Badger,
Paul Baki,
Ronald-L. Ballouz,
Dmitriy L. Bekker,
Julie Bellerose,
Shyam Bhaskaran,
Bonnie J. Buratti,
Saverio Cambioni,
Michelle H. Chen,
Steven R. Chesley,
George Chiu,
Gareth S. Collins,
Matthew W. Cox
, et al. (76 additional authors not shown)
Abstract:
While no known asteroid poses a threat to Earth for at least the next century, the catalog of near-Earth asteroids is incomplete for objects whose impacts would produce regional devastation. Several approaches have been proposed to potentially prevent an asteroid impact with Earth by deflecting or disrupting an asteroid. A test of kinetic impact technology was identified as the highest priority sp…
▽ More
While no known asteroid poses a threat to Earth for at least the next century, the catalog of near-Earth asteroids is incomplete for objects whose impacts would produce regional devastation. Several approaches have been proposed to potentially prevent an asteroid impact with Earth by deflecting or disrupting an asteroid. A test of kinetic impact technology was identified as the highest priority space mission related to asteroid mitigation. NASA's Double Asteroid Redirection Test (DART) mission is the first full-scale test of kinetic impact technology. The mission's target asteroid was Dimorphos, the secondary member of the S-type binary near-Earth asteroid (65803) Didymos. This binary asteroid system was chosen to enable ground-based telescopes to quantify the asteroid deflection caused by DART's impact. While past missions have utilized impactors to investigate the properties of small bodies those earlier missions were not intended to deflect their targets and did not achieve measurable deflections. Here we report the DART spacecraft's autonomous kinetic impact into Dimorphos and reconstruct the impact event, including the timeline leading to impact, the location and nature of the DART impact site, and the size and shape of Dimorphos. The successful impact of the DART spacecraft with Dimorphos and the resulting change in Dimorphos's orbit demonstrates that kinetic impactor technology is a viable technique to potentially defend Earth if necessary.
△ Less
Submitted 3 March, 2023;
originally announced March 2023.
-
Understanding metric-related pitfalls in image analysis validation
Authors:
Annika Reinke,
Minu D. Tizabi,
Michael Baumgartner,
Matthias Eisenmann,
Doreen Heckmann-Nötzel,
A. Emre Kavur,
Tim Rädsch,
Carole H. Sudre,
Laura Acion,
Michela Antonelli,
Tal Arbel,
Spyridon Bakas,
Arriel Benis,
Matthew Blaschko,
Florian Buettner,
M. Jorge Cardoso,
Veronika Cheplygina,
Jianxu Chen,
Evangelia Christodoulou,
Beth A. Cimini,
Gary S. Collins,
Keyvan Farahani,
Luciana Ferrer,
Adrian Galdran,
Bram van Ginneken
, et al. (53 additional authors not shown)
Abstract:
Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately in relation to the underlying research problem. This could be attributed to a lack of accessibilit…
▽ More
Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately in relation to the underlying research problem. This could be attributed to a lack of accessibility of metric-related knowledge: While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Focusing on biomedical image analysis but with the potential of transfer to other fields, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. To facilitate comprehension, illustrations and specific examples accompany each pitfall. As a structured body of information accessible to researchers of all levels of expertise, this work enhances global comprehension of a key topic in image analysis validation.
△ Less
Submitted 23 February, 2024; v1 submitted 3 February, 2023;
originally announced February 2023.
-
Stability of clinical prediction models developed using statistical or machine learning methods
Authors:
Richard D Riley,
Gary S Collins
Abstract:
Clinical prediction models estimate an individual's risk of a particular health outcome, conditional on their values of multiple predictors. A developed model is a consequence of the development dataset and the chosen model building strategy, including the sample size, number of predictors and analysis method (e.g., regression or machine learning). Here, we raise the concern that many models are d…
▽ More
Clinical prediction models estimate an individual's risk of a particular health outcome, conditional on their values of multiple predictors. A developed model is a consequence of the development dataset and the chosen model building strategy, including the sample size, number of predictors and analysis method (e.g., regression or machine learning). Here, we raise the concern that many models are developed using small datasets that lead to instability in the model and its predictions (estimated risks). We define four levels of model stability in estimated risks moving from the overall mean to the individual level. Then, through simulation and case studies of statistical and machine learning approaches, we show instability in a model's estimated risks is often considerable, and ultimately manifests itself as miscalibration of predictions in new data. Therefore, we recommend researchers should always examine instability at the model development stage and propose instability plots and measures to do so. This entails repeating the model building steps (those used in the development of the original prediction model) in each of multiple (e.g., 1000) bootstrap samples, to produce multiple bootstrap models, and then deriving (i) a prediction instability plot of bootstrap model predictions (y-axis) versus original model predictions (x-axis), (ii) a calibration instability plot showing calibration curves for the bootstrap models in the original sample; and (iii) the instability index, which is the mean absolute difference between individuals' original and bootstrap model predictions. A case study is used to illustrate how these instability assessments help reassure (or not) whether model predictions are likely to be reliable (or not), whilst also informing a model's critical appraisal (risk of bias rating), fairness assessment and further validation requirements.
△ Less
Submitted 2 November, 2022;
originally announced November 2022.
-
Effects of impact and target parameters on the results of a kinetic impactor: predictions for the Double Asteroid Redirection Test (DART) mission
Authors:
Angela M. Stickle,
Mallory E. DeCoster,
Christoph Burger,
Wendy K. Caldwell,
Dawn Graninger,
Kathryn M. Kumamoto,
Robert Luther,
Jens Ormö,
Sabina Raducan,
Emma Rainey,
Christoph M. Schäfer,
James D. Walker,
Yun Zhang,
Patrick Michel,
J. Michael Owen,
Olivier Barnouin,
Andy F. Cheng,
Sidney Cochron,
Gareth S. Collins,
Thomas M. Davison,
Elisabetta Dotto,
Fabio Ferrari,
M. Isabel Herreros,
Stavro L. Ivanovski,
Martin Jutzi
, et al. (8 additional authors not shown)
Abstract:
The Double Asteroid Redirection Test (DART) spacecraft will impact into the asteroid Dimorphos on September 26, 2022 as a test of the kinetic impactor technique for planetary defense. The efficiency of the deflection following a kinetic impactor can be represented using the momentum enhancement factor, Beta, which is dependent on factors such as impact geometry and the specific target material pro…
▽ More
The Double Asteroid Redirection Test (DART) spacecraft will impact into the asteroid Dimorphos on September 26, 2022 as a test of the kinetic impactor technique for planetary defense. The efficiency of the deflection following a kinetic impactor can be represented using the momentum enhancement factor, Beta, which is dependent on factors such as impact geometry and the specific target material properties. Currently, very little is known about Dimorphos and its material properties that introduces uncertainty in the results of the deflection efficiency observables, including crater formation, ejecta distribution, and Beta. The DART Impact Modeling Working Group (IWG) is responsible for using impact simulations to better understand the results of the DART impact. Pre-impact simulation studies also provide considerable insight into how different properties and impact scenarios affect momentum enhancement following a kinetic impact. This insight provides a basis for predicting the effects of the DART impact and the first understanding of how to interpret results following the encounter. Following the DART impact, the knowledge gained from these studies will inform the initial simulations that will recreate the impact conditions, including providing estimates for potential material properties of Dimorphos and Beta resulting from DARTs impact. This paper summarizes, at a high level, what has been learned from the IWG simulations and experiments in preparation for the DART impact. While unknown, estimates for reasonable potential material properties of Dimorphos provide predictions for Beta of 1-5, depending on end-member cases in the strength regime.
△ Less
Submitted 14 September, 2022;
originally announced September 2022.
-
Complex crater formation by oblique impacts on the Earth and Moon
Authors:
T. M. Davison,
G. S. Collins
Abstract:
Almost all meteorite impacts occur at oblique incidence angles, but the effect of impact angle on crater size is not well understood, especially for large craters. To improve oblique impact crater scaling, we present a suite of simulations of complex crater formation on Earth and the Moon over a range of impact angles, velocities and impactor sizes. We show that crater diameter is larger than pred…
▽ More
Almost all meteorite impacts occur at oblique incidence angles, but the effect of impact angle on crater size is not well understood, especially for large craters. To improve oblique impact crater scaling, we present a suite of simulations of complex crater formation on Earth and the Moon over a range of impact angles, velocities and impactor sizes. We show that crater diameter is larger than predicted by existing scaling relationships for oblique impacts and for impacts steeper than 45$^{\circ}$ shows little dependence on obliquity. Crater depth, volume and diameter depend on impact angle in different ways such that relatively shallower craters are formed by more oblique impacts. Our simulation results have implications for how crater populations are determined from impactor populations and vice-versa. Our results suggest that existing approaches to account for impact obliquity may underestimate the number of craters larger than a given size by as much as 40%.
△ Less
Submitted 8 September, 2022;
originally announced September 2022.
-
Minimum Sample Size for Developing a Multivariable Prediction Model using Multinomial Logistic Regression
Authors:
Alexander Pate,
Richard D Riley,
Gary S Collins,
Maarten van Smeden,
Ben Van Calster,
Joie Ensor,
Glen P Martin
Abstract:
Multinomial logistic regression models allow one to predict the risk of a categorical outcome with more than 2 categories. When developing such a model, researchers should ensure the number of participants (n) is appropriate relative to the number of events (E.k) and the number of predictor parameters (p.k) for each category k. We propose three criteria to determine the minimum n required in light…
▽ More
Multinomial logistic regression models allow one to predict the risk of a categorical outcome with more than 2 categories. When developing such a model, researchers should ensure the number of participants (n) is appropriate relative to the number of events (E.k) and the number of predictor parameters (p.k) for each category k. We propose three criteria to determine the minimum n required in light of existing criteria developed for binary outcomes. The first criteria aims to minimise the model overfitting. The second aims to minimise the difference between the observed and adjusted R2 Nagelkerke. The third criterion aims to ensure the overall risk is estimated precisely. For criterion (i), we show the sample size must be based on the anticipated Cox-snell R2 of distinct one-to-one logistic regression models corresponding to the sub-models of the multinomial logistic regression, rather than on the overall Cox-snell R2 of the multinomial logistic regression. We tested the performance of the proposed criteria (i) through a simulation study, and found that it resulted in the desired level of overfitting. Criterion (ii) and (iii) are natural extensions from previously proposed criteria for binary outcomes. We illustrate how to implement the sample size criteria through a worked example considering the development of a multinomial risk prediction model for tumour type when presented with an ovarian mass. Code is provided for the simulation and worked example. We will embed our proposed criteria within the pmsampsize R library and Stata modules.
△ Less
Submitted 26 July, 2022;
originally announced July 2022.
-
Metrics reloaded: Recommendations for image analysis validation
Authors:
Lena Maier-Hein,
Annika Reinke,
Patrick Godau,
Minu D. Tizabi,
Florian Buettner,
Evangelia Christodoulou,
Ben Glocker,
Fabian Isensee,
Jens Kleesiek,
Michal Kozubek,
Mauricio Reyes,
Michael A. Riegler,
Manuel Wiesenfarth,
A. Emre Kavur,
Carole H. Sudre,
Michael Baumgartner,
Matthias Eisenmann,
Doreen Heckmann-Nötzel,
Tim Rädsch,
Laura Acion,
Michela Antonelli,
Tal Arbel,
Spyridon Bakas,
Arriel Benis,
Matthew Blaschko
, et al. (49 additional authors not shown)
Abstract:
Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, our large international ex…
▽ More
Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, our large international expert consortium created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. The framework was developed in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint - a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), data set and algorithm output. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as a classification task at image, object or pixel level, namely image-level classification, object detection, semantic segmentation, and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool, which also provides a point of access to explore weaknesses, strengths and specific recommendations for the most common validation metrics. The broad applicability of our framework across domains is demonstrated by an instantiation for various biological and medical image analysis use cases.
△ Less
Submitted 23 February, 2024; v1 submitted 3 June, 2022;
originally announced June 2022.
-
Influence of the projectile geometry on the momentum transfer from a kinetic impactor and implications for the DART mission
Authors:
S. D. Raducan,
M. Jutzi,
T. M. Davison,
M. E. DeCoster,
D. M. Graninger,
J. M. Owen,
A. M. Stickle,
G. S. Collins
Abstract:
The DART spacecraft will impact Didymos's secondary, Dimorphos, at the end of 2022 and cause a change in the orbital period of the secondary. For simplicity, most previous numerical simulations of the impact used a spherical projectile geometry to model the DART spacecraft. To investigate the effects of alternative, simple projectile geometries on the DART impact outcome we used the iSALE shock ph…
▽ More
The DART spacecraft will impact Didymos's secondary, Dimorphos, at the end of 2022 and cause a change in the orbital period of the secondary. For simplicity, most previous numerical simulations of the impact used a spherical projectile geometry to model the DART spacecraft. To investigate the effects of alternative, simple projectile geometries on the DART impact outcome we used the iSALE shock physics code in two and thee-dimensions to model vertical impacts of projectiles with a mass and speed equivalent to the nominal DART impact, into porous basalt targets. We found that the simple projectile geometries investigated here have minimal effects on the crater morphology and momentum enhancement. Projectile geometries modelled in two-dimensions that have similar surface areas at the point of impact, affect the crater radius and the crater volume by less than 5%. In the case of a more extreme projectile geometry (i.e., a rod, modelled in three-dimensions), the crater was elliptical and 50% shallower compared to the crater produced by a spherical projectile of the same momentum. The momentum enhancement factor in these test cases, commonly referred to as beta, was within 7% for the 2D simulations and within 10% for the 3D simulations, of the value obtained for a uniform spherical projectile. The most prominent effects of projectile geometry are seen in the ejection velocity as a function of launch position and ejection angle of the fast ejecta that resides in the so-called `coupling zone'. These results will inform the LICIACube ejecta cone analysis.
△ Less
Submitted 5 January, 2022;
originally announced January 2022.
-
Ejecta distribution and momentum transfer from oblique impacts on asteroid surfaces
Authors:
S. D. Raducan,
T. M. Davison,
G. S. Collins
Abstract:
NASA's Double Asteroid Redirection Test (DART) mission will impact its target asteroid, Dimorphos, at an oblique angle that will not be known prior to the impact. We computed iSALE-3D simulations of DART-like impacts on asteroid surfaces at different impact angles and found that the the vertical momentum transfer efficiency, $β$, is similar for different impact angles, however, the imparted moment…
▽ More
NASA's Double Asteroid Redirection Test (DART) mission will impact its target asteroid, Dimorphos, at an oblique angle that will not be known prior to the impact. We computed iSALE-3D simulations of DART-like impacts on asteroid surfaces at different impact angles and found that the the vertical momentum transfer efficiency, $β$, is similar for different impact angles, however, the imparted momentum is reduced as the impact angle decreases. It is expected that the momentum imparted from a 45$^\circ$ impact is reduced by up to 50\% compared to a vertical impact. The direction of the ejected momentum is not normal to the surface, however it is observed to `straighten up' with crater growth. iSALE-2D simulations of vertical impacts provide context for the iSALE-3D simulation results and show that the ejection angle varies with both target properties and with crater growth. While the ejection angle is relatively insensitive to the target porosity, it varies by up to 30$^\circ$ with target coefficient of internal friction. The simulation results presented in this paper can help constrain target properties from the DART crater ejecta cone, which will be imaged by the LICIACube. The results presented here represent the basis for an empirical scaling relationship for oblique impacts and can be used as a framework to determine an analytical approximation of the vertical component of the ejecta momentum, $β-1$, given known target properties.
△ Less
Submitted 4 May, 2021;
originally announced May 2021.
-
Common Limitations of Image Processing Metrics: A Picture Story
Authors:
Annika Reinke,
Minu D. Tizabi,
Carole H. Sudre,
Matthias Eisenmann,
Tim Rädsch,
Michael Baumgartner,
Laura Acion,
Michela Antonelli,
Tal Arbel,
Spyridon Bakas,
Peter Bankhead,
Arriel Benis,
Matthew Blaschko,
Florian Buettner,
M. Jorge Cardoso,
Jianxu Chen,
Veronika Cheplygina,
Evangelia Christodoulou,
Beth Cimini,
Gary S. Collins,
Sandy Engelhardt,
Keyvan Farahani,
Luciana Ferrer,
Adrian Galdran,
Bram van Ginneken
, et al. (68 additional authors not shown)
Abstract:
While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are particularly key for meaningful, objective, and transparent performance assessment and validation of the used automatic algorithms, but relatively little attention has been given to the practical pitfalls when using spe…
▽ More
While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are particularly key for meaningful, objective, and transparent performance assessment and validation of the used automatic algorithms, but relatively little attention has been given to the practical pitfalls when using specific metrics for a given image analysis task. These are typically related to (1) the disregard of inherent metric properties, such as the behaviour in the presence of class imbalance or small target structures, (2) the disregard of inherent data set properties, such as the non-independence of the test cases, and (3) the disregard of the actual biomedical domain interest that the metrics should reflect. This living dynamically document has the purpose to illustrate important limitations of performance metrics commonly applied in the field of image analysis. In this context, it focuses on biomedical image analysis problems that can be phrased as image-level classification, semantic segmentation, instance segmentation, or object detection task. The current version is based on a Delphi process on metrics conducted by an international consortium of image analysis experts from more than 60 institutions worldwide.
△ Less
Submitted 6 December, 2023; v1 submitted 12 April, 2021;
originally announced April 2021.
-
A Global Fireball Observatory
Authors:
H. A. R. Devillepoix,
M. Cupák,
P. A. Bland,
E. K. Sansom,
M. C. Towner,
R. M. Howie,
B. A. D. Hartig,
T. Jansen-Sturgeon,
P. M. Shober,
S. L. Anderson,
G. K. Benedix,
D. Busan,
R. Sayers,
P. Jenniskens,
J. Albers,
C. D. K. Herd,
P. J. A. Hill,
P. G. Brown,
Z. Krzeminski,
G. R. Osinski,
H. Chennaoui Aoudjehane,
Z. Benkhaldoun,
A. Jabiri,
M. Guennoun,
A. Barka
, et al. (24 additional authors not shown)
Abstract:
The world's meteorite collections contain a very rich picture of what the early Solar System would have been made of, however the lack of spatial context with respect to their parent population for these samples is an issue. The asteroid population is equally as rich in surface mineralogies, and mapping these two populations (meteorites and asteroids) together is a major challenge for planetary sc…
▽ More
The world's meteorite collections contain a very rich picture of what the early Solar System would have been made of, however the lack of spatial context with respect to their parent population for these samples is an issue. The asteroid population is equally as rich in surface mineralogies, and mapping these two populations (meteorites and asteroids) together is a major challenge for planetary science. Directly probing asteroids achieves this at a high cost. Observing meteorite falls and calculating their pre-atmospheric orbit on the other hand, is a cheaper way to approach the problem. The Global Fireball Observatory (GFO) collaboration was established in 2017 and brings together multiple institutions (from Australia, USA, Canada, Morocco, Saudi Arabia, the UK, and Argentina) to maximise the area for fireball observation time and therefore meteorite recoveries. The members have a choice to operate independently, but they can also choose to work in a fully collaborative manner with other GFO partners. This efficient approach leverages the experience gained from the Desert Fireball Network (DFN) pathfinder project in Australia. The state-of-the art technology (DFN camera systems and data reduction) and experience of the support teams is shared between all partners, freeing up time for science investigations and meteorite searching. With all networks combined together, the GFO collaboration already covers 0.6% of the Earth's surface for meteorite recovery as of mid-2019, and aims to reach 2% in the early 2020s. We estimate that after 5 years of operation, the GFO will have observed a fireball from virtually every meteorite type. This combined effort will bring new, fresh, extra-terrestrial material to the labs, yielding new insights about the formation of the Solar System.
△ Less
Submitted 12 June, 2020; v1 submitted 2 April, 2020;
originally announced April 2020.
-
Atom motion in solids following nuclear transmutation
Authors:
Gary S. Collins
Abstract:
Following nuclear decay, a daughter atom in a solid will "stay in place" if the recoil energy is less than the threshold for displacement. At high temperature, it may subsequently undergo long-range diffusion or some other kind of atomic motion. In this paper, motion of 111Cd tracer probe atoms is reconsidered following electron-capture decay of 111In in the series of In3R phases (R= rare-earth).…
▽ More
Following nuclear decay, a daughter atom in a solid will "stay in place" if the recoil energy is less than the threshold for displacement. At high temperature, it may subsequently undergo long-range diffusion or some other kind of atomic motion. In this paper, motion of 111Cd tracer probe atoms is reconsidered following electron-capture decay of 111In in the series of In3R phases (R= rare-earth). The motion produces nuclear relaxation that was measured using the method of perturbed angular correlation. Previous measurements along the entire series of In3R phases appeared to show a crossover between two diffusional regimes. While relaxation for R= Lu-Tb is consistent with a simple vacancy diffusion mechanism, relaxation for R= Nd-La is not. More recent measurements in Pd3R phases demonstrate that the site-preference of the parent In-probe changes along the series and suggests that the same behavior occurs for daughter Cd-probes. The anomalous motion observed for R= Nd-La is attributed to "lanthanide expansion" occurring towards La end-member phases. For In3La, the Cd-tracer is found to jump away from its original location on the In-sublattice in an extremely short time, of order 0.5 ns at 1000 K and 1.2 ms at room temperature, a residence time too short to be consistent with defect-mediated diffusion. Several scenarios that can explain the relaxation are presented based on the hypothesis that daughter Cd-probes first jump to neighboring interstitial sites and then are either trapped and immobilized, undergo long-range diffusion, or persist in a localized motion in a cage.
△ Less
Submitted 5 December, 2019; v1 submitted 16 July, 2019;
originally announced July 2019.
-
Machine learning and AI research for Patient Benefit: 20 Critical Questions on Transparency, Replicability, Ethics and Effectiveness
Authors:
Sebastian Vollmer,
Bilal A. Mateen,
Gergo Bohner,
Franz J Király,
Rayid Ghani,
Pall Jonsson,
Sarah Cumbers,
Adrian Jonas,
Katherine S. L. McAllister,
Puja Myles,
David Granger,
Mark Birse,
Richard Branson,
Karel GM Moons,
Gary S Collins,
John P. A. Ioannidis,
Chris Holmes,
Harry Hemingway
Abstract:
Machine learning (ML), artificial intelligence (AI) and other modern statistical methods are providing new opportunities to operationalize previously untapped and rapidly growing sources of data for patient benefit. Whilst there is a lot of promising research currently being undertaken, the literature as a whole lacks: transparency; clear reporting to facilitate replicability; exploration for pote…
▽ More
Machine learning (ML), artificial intelligence (AI) and other modern statistical methods are providing new opportunities to operationalize previously untapped and rapidly growing sources of data for patient benefit. Whilst there is a lot of promising research currently being undertaken, the literature as a whole lacks: transparency; clear reporting to facilitate replicability; exploration for potential ethical concerns; and, clear demonstrations of effectiveness. There are many reasons for why these issues exist, but one of the most important that we provide a preliminary solution for here is the current lack of ML/AI- specific best practice guidance. Although there is no consensus on what best practice looks in this field, we believe that interdisciplinary groups pursuing research and impact projects in the ML/AI for health domain would benefit from answering a series of questions based on the important issues that exist when undertaking work of this nature. Here we present 20 questions that span the entire project life cycle, from inception, data analysis, and model evaluation, to implementation, as a means to facilitate project planning and post-hoc (structured) independent evaluation. By beginning to answer these questions in different settings, we can start to understand what constitutes a good answer, and we expect that the resulting discussion will be central to developing an international consensus framework for transparent, replicable, ethical and effective research in artificial intelligence (AI-TREE) for health.
△ Less
Submitted 21 December, 2018;
originally announced December 2018.
-
Diffusion and equilibration of site-preferences following transmutation of tracer atoms
Authors:
Gary S. Collins
Abstract:
Using the method of perturbed angular correlation of gamma rays, diffusional jump-frequencies of probe atoms can be measured through relaxation of the nuclear quadrupole interaction. This was first shown in 2004 for jumps of tracer atoms that lead to reorientation of the local electric field-gradient, such as jumps on the connected a-sublattice in the L12 crystal structure. Studies on many such ph…
▽ More
Using the method of perturbed angular correlation of gamma rays, diffusional jump-frequencies of probe atoms can be measured through relaxation of the nuclear quadrupole interaction. This was first shown in 2004 for jumps of tracer atoms that lead to reorientation of the local electric field-gradient, such as jumps on the connected a-sublattice in the L12 crystal structure. Studies on many such phases using the 111In/Cd PAC probe are reviewed in this paper. A major finding from a 2009 study of indides of rare-earth elements, In3R, was the apparent observation of two diffusional regimes: one dominant for heavy-lanthanide phases, R= Lu, Tm, Er, Dy, Tb, Gd, that was consistent with a simple model of vacancy diffusion on the In a-sublattice, and another for light-lanthanides, R= La, Ce, Pr, Nd, that had no obvious explanation but for which several alternative diffusion mechanisms were suggested. It is herein proposed that the latter regime arises not from a diffusion mechanism but from transfer of Cd-probes from In-sites where they originate to R-sites as a consequence of a change in site-preference of 111Cd-daughter atoms from In-sites to R-sites following transmutation of 111In. Support for this transfer mechanism comes from a study of site-preferences and jump-frequencies of 111In/Cd probes in Pd3R phases. Possible mechanisms for transfer are described, with the most likely mechanism identified as one in which Cd-probes on a-sites transfer to interstitial sites, diffuse interstitially, and then react with vacancies on b-sites. Implications of this proposal are discussed. For indides of heavy-lanthanide elements, the Cd-tracer remains on the In-sublattice and relaxation gives the diffusional jump-frequency.
△ Less
Submitted 8 May, 2018;
originally announced May 2018.
-
Site occupation of indium and jump frequencies of cadmium in FeGa3
Authors:
Randal Newhouse,
Gary S. Collins,
Matthew O. Zacate
Abstract:
Perturbed angular correlation (PAC) measurements using the In-111 probe were carried out on FeGa3 as part of a broader investigation of indium site occupation and cadmium diffusion in intermetallic compounds. One PAC signal was observed with hyperfine parameters w1 = 513.8(1) Mrad/s and eta = 0.939(2) at room temperature. By comparison with quadrupole frequencies observed in PAC measurements on is…
▽ More
Perturbed angular correlation (PAC) measurements using the In-111 probe were carried out on FeGa3 as part of a broader investigation of indium site occupation and cadmium diffusion in intermetallic compounds. One PAC signal was observed with hyperfine parameters w1 = 513.8(1) Mrad/s and eta = 0.939(2) at room temperature. By comparison with quadrupole frequencies observed in PAC measurements on isostructural RuIn3, it was determined that indium occupies only the 8j site in the FeGa3 structure, denoted Ga(2) below because two out of the three Ga sites have this point symmetry. PAC spectra at elevated temperature exhibited damping characteristic of electric field gradients (EFGs) that fluctuate as Cd probes jump among Ga(2) sites within the lifetime of the excited PAC level. A stochastic model for the EFG fluctuations based on four conceivable, single-step jump-pathways connecting one Ga(2) site to neighboring Ga(2) sites was developed and used to fit PAC spectra. The four pathways lead to two observable EFG reorientation rates, and these reorientation rates were found to be strongly dependent on EFG orientation. Calculations using density functional theory were used to reduce the number of unknowns in the model with respect to EFG orientation. This made it possible to determine with reasonable precision the total jump rate of Cd among Ga(2) sites that correspond to a change in mirror plane orientation of site-symmetry. This total jump rate was found to be thermally activated with an activation enthalpy of 1.8(1) eV.
△ Less
Submitted 25 August, 2016;
originally announced August 2016.
-
Trapping of solute atoms at grain boundaries in GdNi2
Authors:
Ryan Murray,
Debashis Banerjee,
Gary S. Collins
Abstract:
Lattice locations of 111In impurity probe atoms in intermetallic GdNi2 were studied as a function of alloy composition and temperature using perturbed angular correlation spectroscopy (PAC). Three nuclear quadrupole interaction signals were detected and their equilibrium site fractions were measured up to 700 oC. Two signals have well-defined electric field gradients (EFGs) and are attributed to I…
▽ More
Lattice locations of 111In impurity probe atoms in intermetallic GdNi2 were studied as a function of alloy composition and temperature using perturbed angular correlation spectroscopy (PAC). Three nuclear quadrupole interaction signals were detected and their equilibrium site fractions were measured up to 700 oC. Two signals have well-defined electric field gradients (EFGs) and are attributed to In-probes on Gd- and Ni-sites in a well-ordered lattice. A third, inhomogeneously broadened signal was observed at low temperature. This is attributed to trapping, or segregation, of In-probes to lattice sinks such as grain boundaries (GB) that have a large multiplicity of local environments and EFGs. Changes in site fractions were reversible above 300oC. Measurements were made on a pair of samples that were richer and poorer in Gd. Remarkably, the GB-site was populated only in the more Gd-rich sample. This is explained by the hypothesis that excess Gd segregates to the grain boundaries and provides a lower enthalpy environment for In-probe atoms. Observations are discussed in relation to a three-level quantum system. Enthalpy differences between levels were determined from measurements of temperature dependences of ratios of site fractions. The enthalpy of transfer of In-probes from the Gd- to Ni-sublattice was found to be much smaller in the Gd-rich sample. This is attributed to a large temperature-dependence in the degeneracies of levels available to In-solutes in the phase, leading to an effective transfer enthalpy that differs greatly from the difference in site-enthalpies. A possible scenario is discussed. Different segregation enthalpies were measured for In-solute transferring from GB sites to Gd- and Ni-sites, whereas only an average value can be determined through macroscopic measurements.
△ Less
Submitted 1 July, 2016;
originally announced July 2016.
-
Solute-solute interactions in intermetallic compounds
Authors:
Debashis Banerjee,
Ryan Murray,
Gary S. Collins
Abstract:
Two types of solute-solute interactions are investigated in this work. Quadrupole interactions caused by nearby Ag-solute atoms were measured at nuclei of 111In/Cd solute probe atoms in the binary compound GdAl2 using the method of perturbed angular correlation of gamma rays (PAC). Locations of In-probes and Ag-solutes on both Gd- and Al-sublattices were identified by comparing site fractions in G…
▽ More
Two types of solute-solute interactions are investigated in this work. Quadrupole interactions caused by nearby Ag-solute atoms were measured at nuclei of 111In/Cd solute probe atoms in the binary compound GdAl2 using the method of perturbed angular correlation of gamma rays (PAC). Locations of In-probes and Ag-solutes on both Gd- and Al-sublattices were identified by comparing site fractions in Gd-poor and Gd-rich GdAl2(Ag) samples. Interaction enthalpies between solute-atom pairs were determined from temperature dependences of observed site fractions. Repulsive interactions were observed for close-neighbor complexes In/Gd/+Ag/Gd/ and In/Gd/+Ag/Al/ pairs, whereas a slightly attractive interaction was observed for In/Al/+Ag/Al/. Interaction enthalpies were all in the range +/- 0.15 eV. Temperature dependences of site fractions of In-probes on locally defect-free Gd- and Al-sites yields a transfer enthalpy that was found to be 0.343 eV in a previous study of undoped GdAl2. The corresponding values in GdAl2(Ag) samples are much smaller. This is attributed to competition of In- and Ag-solutes to occupy sites of the same sublattice. While the difference in site-enthalpies of In-solutes on Gd- and Al-sites is temperature independent, it is proposed that the transfer of Ag-solutes from Gd- to Al-sites leads to a large temperature dependence of degeneracies of levels available to In-solutes, resulting in an effective transfer enthalpy that is much smaller than the difference in site-enthalpies.
△ Less
Submitted 1 July, 2016;
originally announced July 2016.
-
Mesoscale Modeling of Impact Compaction of Primitive Solar System Solids
Authors:
Thomas M Davison,
Gareth S Collins,
Philip A Bland
Abstract:
We have developed a method for simulating the mesoscale compaction of early solar system solids in low velocity impact events, using the iSALE shock physics code. Chondrules are represented by nonporous disks, placed within a porous matrix. By simulating impacts into bimodal mixtures over a wide range of parameter space (including the chondrule-to-matrix ratio, the matrix porosity and composition…
▽ More
We have developed a method for simulating the mesoscale compaction of early solar system solids in low velocity impact events, using the iSALE shock physics code. Chondrules are represented by nonporous disks, placed within a porous matrix. By simulating impacts into bimodal mixtures over a wide range of parameter space (including the chondrule-to-matrix ratio, the matrix porosity and composition and the impact velocity), we have shown how each of these parameters influences the shock processing of heterogeneous materials. The temperature after shock processing shows a strong dichotomy: matrix temperatures are elevated much higher than the chondrules, which remain largely cold. Chondrules can protect some matrix from shock compaction, with shadow regions in the lee side of chondrules exhibiting higher porosity that elsewhere in the matrix. Using the results from this mesoscale modelling, we show how the $\varepsilon-α$ porous compaction model parameters depend on initial bulk porosity. We also show that the timescale for the temperature dichotomy to equilibrate is highly dependent on the porosity of the matrix after the shock, and will be on the order of seconds for matrix porosities of less than 0.1, and on the order of 10's to 100's seconds for matrix porosities of $\sim$ 0.3--0.5. Finally, we have shown that the composition of the post-shock material is able to match the bulk porosity and chondrule-to-matrix ratios of meteorite groups such as carbonaceous chondrites and unequilibrated ordinary chondrites.
△ Less
Submitted 3 March, 2016; v1 submitted 1 March, 2016;
originally announced March 2016.
-
Thermodynamic model of solute site preferences in ordered alloys
Authors:
Gary S. Collins,
Matthew O. Zacate
Abstract:
A thermodynamic model based on the law of mass action is used to calculate concentrations of elementary point defects and to determine site preferences of solute atoms in ordered alloys. Combinations of lattice vacancies, antisite atoms and host interstitials that form equilibrium defects are enumerated for the CsCl (B2) and Ni2Al3 structures. For CsCl, in addition to the two substitutional sites,…
▽ More
A thermodynamic model based on the law of mass action is used to calculate concentrations of elementary point defects and to determine site preferences of solute atoms in ordered alloys. Combinations of lattice vacancies, antisite atoms and host interstitials that form equilibrium defects are enumerated for the CsCl (B2) and Ni2Al3 structures. For CsCl, in addition to the two substitutional sites, a distorted tetrahedral interstitial site is considered. For Ni2Al3, the Ni site, two distinct Al sites and a vacant, insterstitial-type Ni-site are considered. An equation of constraint among concentrations of elementary defects is derived that is valid for any crystal structure. The concentration of a selected defect can be solved using the equation of constraint in conjunction with mass-action equations for defect combinations. The method leads directly to defect concentrations without the need to evaluate composition-dependent chemical potentials, resulting in a more transparent formalism.
The model is used to explore the phenomenology of site-preferences of dilute ternary solute atoms. Findings are in agreement with previous treatments restricted to substitutional sites. General rules for how site-preferences depend on temperature and on composition in non-stoichiometric compounds are obtained through algebraic analysis and numerical simulations: (1) Solute S tends to occupy substitutional sites of the element in which there is a deficiency. (2) If the difference of energies of S on sites A and B is very positive or negative, then S will occupy site B or A exclusively, independent of composition. If the difference of site energies is intermediate, the solute will switch from one site to the other as the composition changes. (3) Solutes have a tendency to occupy interstitial or empty-lattice sites with a maximum site-fraction near the stoichiometric composition.
△ Less
Submitted 27 January, 2015;
originally announced March 2015.
-
Impurity diffusion in highly-ordered intermetallic compounds studied by nuclear quadrupole interactions
Authors:
Gary S. Collins,
Qiaoming Wang,
John P. Bevington
Abstract:
Diffusion of impurity atoms depends on the sublattices occupied, active diffusion mechanisms, and jump frequencies to neighboring sites. The method of perturbed angular correlation of gamma rays (PAC) has been applied over the past decade to study impurity diffusion through measurement of nuclear quadrupole interactions (NQI) at nuclei of 111In/Cd probe atoms. Extensive measurements have been made…
▽ More
Diffusion of impurity atoms depends on the sublattices occupied, active diffusion mechanisms, and jump frequencies to neighboring sites. The method of perturbed angular correlation of gamma rays (PAC) has been applied over the past decade to study impurity diffusion through measurement of nuclear quadrupole interactions (NQI) at nuclei of 111In/Cd probe atoms. Extensive measurements have been made on highly-ordered compounds having the L12 crystal structure, including In3R, Sn3R, Ga3R, Al3R and Pd3R phases (R= rare-earth element). Measurements in thermal equilibrium at high temperature served to determine lattice locations of 111In parent probe-atoms, through characteristic NQIs, and to measure diffusional jump-frequencies of 111Cd daughter probe-atoms, through relaxation of the NQI. This paper summarizes results of the jump-frequency measurements and relates them to the conventional diffusivity. ... A change in diffusion mechanism was proposed in 2009 to explain jump-frequency systematics for In3R phases. An alternative explanation is proposed in the present paper based on site-preferences of 111Cd daughter probes newly observed along the parallel Pd3R series. The diffusivity can be expressed as the product of a jump-frequency such as measured in these studies and a correlation factor for diffusion that depends on the diffusion mechanism. The correlation factor can be modeled for the L12 structure and diffusion sublattice of interest using a five-frequency model originally proposed for metals. Although the correlation factor is an essential parameter for the diffusion of impurities, it has never been measured. It is suggested that values of the correlation factor can be determined feasibly by combining results of jump-frequency measurements such as the present ones with diffusivity measurements made for the same host-impurity systems.
△ Less
Submitted 25 March, 2014;
originally announced March 2014.
-
The early impact histories of meteorite parent bodies
Authors:
Thomas M Davison,
David P O'Brien,
Fred J Ciesla,
Gareth S Collins
Abstract:
We have developed a statistical framework that uses collisional evolution models, shock physics modeling and scaling laws to determine the range of plausible collisional histories for individual meteorite parent bodies. It is likely that those parent bodies that were not catastrophically disrupted sustained hundreds of impacts on their surfaces - compacting, heating, and mixing the outer layers; i…
▽ More
We have developed a statistical framework that uses collisional evolution models, shock physics modeling and scaling laws to determine the range of plausible collisional histories for individual meteorite parent bodies. It is likely that those parent bodies that were not catastrophically disrupted sustained hundreds of impacts on their surfaces - compacting, heating, and mixing the outer layers; it is highly unlikely that many parent bodies escaped without any impacts processing the outer few kilometers. The first 10 - 20 Myr were the most important time for impacts, both in terms of the number of impacts and the increase of specific internal energy due to impacts. The model has been applied to evaluate the proposed impact histories of several meteorite parent bodies: up to 10 parent bodies that were not disrupted in the first 100 Myr experienced a vaporizing collision of the type necessary to produce the metal inclusions and chondrules on the CB chondrite parent; around 1 - 5% of bodies that were catastrophically disrupted after 12 Myr sustained impacts at times that match the heating events recorded on the IAB/winonaite parent body; more than 75% of 100 km radius parent bodies which survived past 100 Myr without being disrupted sustained an impact that excavates to the depth required for mixing in the outer layers of the H chondrite parent body; and to protect the magnetic field on the CV chondrite parent body, the crust would have had to have been thick (~ 20 km) in order to prevent it being punctured by impacts.
△ Less
Submitted 10 September, 2013; v1 submitted 29 July, 2013;
originally announced July 2013.
-
Determination of the crystal structures of In70-Ni30 and In70-Pd30 using perturbed angular correlation
Authors:
Lee Aspitarte,
Egbert R. Nieuwenhuis,
Gary S. Collins
Abstract:
According to phase diagrams based on x-ray measurements, In70-Pt30 has the cubic Sn7Ir3 crystal structure (D8f, cI40) but the alloys In70-Ni30 and In70-Pd30 have been variously reported to have either a cubic gamma-brass (D81-3, cI52) or the Sn7Ir3 structures. In this study, hyperfine interaction measurements are applied as an alternate method to identify phases. Perturbed angular correlation (PAC…
▽ More
According to phase diagrams based on x-ray measurements, In70-Pt30 has the cubic Sn7Ir3 crystal structure (D8f, cI40) but the alloys In70-Ni30 and In70-Pd30 have been variously reported to have either a cubic gamma-brass (D81-3, cI52) or the Sn7Ir3 structures. In this study, hyperfine interaction measurements are applied as an alternate method to identify phases. Perturbed angular correlation (PAC) measurements were made of characteristic nuclear quadrupole interactions of 111In/Cd probe atoms, and demonstrated a common, characteristic "signature" of the Sn7Ir3 structure in all three alloys. The Sn7Ir3 structure has two inequivalent Sn-sites with a 3:4 ratio of atoms and point symmetries indicate that the electric-field gradients at both sites should be axially symmetric. Measured perturbation functions for all three alloys exhibited two axially symmetric quadrupole interaction signals having the expected 3:4 ratio of amplitudes, as expected for the structure. Furthermore, ratios of the two quadrupole interaction frequencies in each alloy were characteristically large, with frequencies for probe atoms on In(3) sites roughly five times greater than on In(4) sites. Taken together, these observations confirm that all three phases have the Sn7Ir3 structure. Quadrupole interaction frequencies are also reported for isostructural alloys of gallium with Pt, Pd and Ni. Negligible inhomogeneous broadening was observed in measurements near room temperature in all six phases, indicating excellent atomic ordering at the stoichiometric 70:30 compositions.
△ Less
Submitted 10 October, 2012;
originally announced October 2012.
-
Nuclear quadrupole interactions of 111In/Cd solute atoms in a series of rare-earth palladium alloys
Authors:
Qiaoming Wang,
Gary S. Collins
Abstract:
Nuclear quadrupole interactions were measured at 111In/Cd probe atoms in rare-earth palladium phases RPd3 having the L12 structure using the technique of perturbed angular correlation of gamma rays (PAC). Measurements were made for pairs of samples having compositions of the Pd-poorer and Pd-rich boundaries of the RPd3 phase fields, typically 75 and 78 at.% Pd. Two signals were detected in most ph…
▽ More
Nuclear quadrupole interactions were measured at 111In/Cd probe atoms in rare-earth palladium phases RPd3 having the L12 structure using the technique of perturbed angular correlation of gamma rays (PAC). Measurements were made for pairs of samples having compositions of the Pd-poorer and Pd-rich boundaries of the RPd3 phase fields, typically 75 and 78 at.% Pd. Two signals were detected in most phases, corresponding to probe atoms on cubic R- and non-cubic Pd-sublattices. Site preferences of parent In-probe atoms were characterized by site-fractions of probes on the R- and Pd-sublattices. For all Pd-rich samples, probes exclusively occupied the R-sublattice, consistent with a heuristic rule that solute atoms tend to occupy the sublattice of an element in which there is a deficiency. For Pd-poorer alloys with R= Tb, Er, Yb, Lu, Y and Sc, probes exclusively occupied the Pd-sublattice. For Pd-poorer alloys with R= Ce, Pr, Nd, Sm and Eu, probes occupied both sublattices, with site fractions varying as a function of temperature. In contrast, probes only occupied the R-sublattice in Pd-poorer LaPd3. Jump frequencies on the Pd-sublattice of daughter Cd-probes were determined from nuclear relaxation caused by fluctuating electric field gradients. Activation enthalpies for diffusional jumps were determined from temperature dependences and found to increase linearly as the lattice parameter decreases along the series Pr, Nd, Eu and Sm. Jump frequencies are believed to have been even higher in CePd3 than in PrPd3, but were too low to be detectable in Tb, Er, Yb, Lu, Y and Sc palladides. A correlation between site preferences and jump frequencies is noted and discussed. This paper provides a complete account of measurements of jump frequencies of Cd-probe atoms and comparisons with similar measurements made on other series of L12 phases.
△ Less
Submitted 12 October, 2012; v1 submitted 17 September, 2012;
originally announced September 2012.
-
Post-Impact Thermal Evolution of Porous Planetesimals
Authors:
T. M. Davison,
F. J. Ciesla,
G. S. Collins
Abstract:
Impacts between planetesimals have largely been ruled out as a heat source in the early Solar System, by calculations that show them to be an inefficient heat source and unlikely to cause global heating. However, the long-term, localized thermal effects of impacts on planetesimals have never been fully quantified. Here, we simulate a range of impact scenarios between planetesimals to determine the…
▽ More
Impacts between planetesimals have largely been ruled out as a heat source in the early Solar System, by calculations that show them to be an inefficient heat source and unlikely to cause global heating. However, the long-term, localized thermal effects of impacts on planetesimals have never been fully quantified. Here, we simulate a range of impact scenarios between planetesimals to determine the post-impact thermal histories of the parent bodies, and hence the importance of impact heating in the thermal evolution of planetesimals. We find on a local scale that heating material to petrologic type 6 is achievable for a range of impact velocities and initial porosities, and impact melting is possible in porous material at a velocity of > 4 km/s. Burial of heated impactor material beneath the impact crater is common, insulating that material and allowing the parent body to retain the heat for extended periods (~ millions of years). Cooling rates at 773 K are typically 1 - 1000 K/Ma, matching a wide range of measurements of metallographic cooling rates from chondritic materials. While the heating presented here is localized to the impact site, multiple impacts over the lifetime of a parent body are likely to have occurred. Moreover, as most meteorite samples are on the centimeter to meter scale, the localized effects of impact heating cannot be ignored.
△ Less
Submitted 12 July, 2012;
originally announced July 2012.
-
Comparison of jump frequencies of 111In/Cd tracer atoms in Sn3R and In3R phases having the L12 structure (R = rare-earth)
Authors:
Megan Lockwood Harberts,
Benjamin Norman,
Randal Newhouse,
Gary S. Collins
Abstract:
Measurements were made of jump frequencies of 111In/Cd tracer atoms on the Sn-sublattice in rare-earth tri-stannides having the L12 crystal structure via perturbed angular correlation spectroscopy (PAC). Phases studied were Sn3R (R= La, Ce, Pr, Nd, Sm and Gd). Earlier measurements on isostructural rare-earth tri-indides showed that the dominant diffusion mechanism changed along that series. The do…
▽ More
Measurements were made of jump frequencies of 111In/Cd tracer atoms on the Sn-sublattice in rare-earth tri-stannides having the L12 crystal structure via perturbed angular correlation spectroscopy (PAC). Phases studied were Sn3R (R= La, Ce, Pr, Nd, Sm and Gd). Earlier measurements on isostructural rare-earth tri-indides showed that the dominant diffusion mechanism changed along that series. The dominant mechanism was determined by comparing jump frequencies measured at opposing phase boundary compositions (that is, more In-rich and more In-poor). Jump frequencies were observed to be greater at the In-rich boundary composition in light lanthanide indides and greater at the In-poor boundary composition in heavy-lanthanide indides. These observations were attributed to predominance of diffusion via rare-earth vacancies in the former case and indium vacancies in the latter. Contrary to results for the indides, jump frequencies found in the present work are greater for the Sn-poor boundary compositions of the stannides, signaling that diffusive jumps are controlled by Sn-vacancies. Possible origins of these differences in diffusion mechanisms are discussed.
△ Less
Submitted 13 September, 2011;
originally announced September 2011.
-
The solubility of indium in liquid gallium supercooled to 12 K
Authors:
Xiangyu Yin,
Gary S. Collins
Abstract:
The method of perturbed angular correlation (PAC) was used to determine lattice locations of 111In impurity probe atoms present in extreme dilution in the intermetallic compound FeGa3. In slightly Ga-poor samples, probes were found to strongly prefer one of two inequivalent Ga-sites. In slightly Ga-rich samples at room temperature, 293 K, the PAC spectrum exhibited an unperturbed quadrupole intera…
▽ More
The method of perturbed angular correlation (PAC) was used to determine lattice locations of 111In impurity probe atoms present in extreme dilution in the intermetallic compound FeGa3. In slightly Ga-poor samples, probes were found to strongly prefer one of two inequivalent Ga-sites. In slightly Ga-rich samples at room temperature, 293 K, the PAC spectrum exhibited an unperturbed quadrupole interaction signal that is consistent with indium probes dissolved in small liquid pools of the excess Ga. A myriad of such pools are probably located along grain boundaries in the sample. Cooling from 293 K down to 12 K, the site fraction of indium in liquid decreased, being offset by the increase in a signal attributed to indium solutes in precipitates with other impurities at the sides of the Ga pools. However, these changes were completely reversible upon heating, and no crystallization of the liquid gallium pools was observed down to 12 K. This is attributed to the extraordinarily small volumes for the pools, which, while not measured directly, are orders of magnitude smaller than cubic microns. The measured temperature dependence of the site fraction of indium in the liquid was used to extend the metastable solubility curve for indium in liquid gallium down to a temperature of 150 K, much lower than the eutectic temperature of Ga-In at 288.5 K.
△ Less
Submitted 10 September, 2011;
originally announced September 2011.
-
Diffusion in LanCoIn3n+2 phases studied by perturbed angular correlation
Authors:
Randal Newhouse,
Gary S. Collins
Abstract:
Jump frequencies of 111In/Cd tracer atoms were measured for a series of layered phases LanCoIn3n+2 using the technique of perturbed angular correlation of gamma rays (PAC). The frequencies were determined by analysis of nuclear quadrupole relaxation produced by fluctuating electric field gradients. Samples were synthesized having nominal values n= 1, 2, 3, 5 and \infty, with n=\infty corresponding…
▽ More
Jump frequencies of 111In/Cd tracer atoms were measured for a series of layered phases LanCoIn3n+2 using the technique of perturbed angular correlation of gamma rays (PAC). The frequencies were determined by analysis of nuclear quadrupole relaxation produced by fluctuating electric field gradients. Samples were synthesized having nominal values n= 1, 2, 3, 5 and \infty, with n=\infty corresponding to the L12 phase LaIn3. The phases form heuristically from LaIn3 by replacing every (n+1)th (100) mixed plane of La and In atoms with a plane of Co-atoms. For the n=1 phase, LaCoIn5, jump frequencies were too small to detect. Two signals were observed, one for indium atoms next to the Co-planes and the other for more distant indium atoms. No relaxation was observed for atoms next to the Co-planes, indicating that there is no diffusion across the Co-planes. With increasing n, jump rates for the other In-atoms increased toward values observed for LaIn3. Jump frequency activation enthalpies for n= 3 and 5 were observed to be the same as for n=\infty, suggesting the same diffusion mechanism. However, the jump-frequency prefactors were found to be smaller for small n, which is attributed to reductions in the connectivity of the diffusion sublattice. We conclude that diffusion in the layered phases is remarkably similar to diffusion in LaIn3 once the reduced connectivity is taken into account.
△ Less
Submitted 10 September, 2011;
originally announced September 2011.
-
Diffusion in binary and pseudo-binary L12 indides, stannides, gallides and aluminides of rare-earth elements as studied using perturbed angular correlation of 111In/Cd
Authors:
Randal Newhouse,
Justine Minish,
Gary S. Collins
Abstract:
Diffusional jumps can produce fluctuating electric field gradients at nuclei of jumping atoms. Using perturbed angular correlation of gamma rays (PAC), jumps of probe atoms cause nuclear quadrupole relaxation that can be fitted to obtain the mean jump frequency. An overview is given of the application of this approach to highly ordered intermetallic compounds having the L12 (Cu3Au) crystal structu…
▽ More
Diffusional jumps can produce fluctuating electric field gradients at nuclei of jumping atoms. Using perturbed angular correlation of gamma rays (PAC), jumps of probe atoms cause nuclear quadrupole relaxation that can be fitted to obtain the mean jump frequency. An overview is given of the application of this approach to highly ordered intermetallic compounds having the L12 (Cu3Au) crystal structure. New results are then presented for jump frequencies of 111In/Cd probe atoms in pseudo-binary L12 compounds of the forms In3(La1-xPrx) and (In1-xSnx)3La. For the mixed rare-earth system, jump frequencies are found to scale with composition between jump frequencies of the end-member phases In3La and In3Pr. However, for the mixed sp-element system, a large decrease in jump frequency is observed as Sn atoms substitute for In-atoms. This difference in behavior appears to depend on whether atomic disorder is on the diffusion sublattice (In-Sn substitution), as opposed to a neighboring sublattice (La-Pr substitution), whether or not there is a difference in diffusion mechanism between end-member phases, and/or whether or not there is a valence difference between the mixing atoms. All three conditions apply for only (In1-xSnx)3La.
△ Less
Submitted 10 September, 2011;
originally announced September 2011.