-
MEMPSEP III. A machine learning-oriented multivariate data set for forecasting the Occurrence and Properties of Solar Energetic Particle Events using a Multivariate Ensemble Approach
Authors:
Kimberly Moreland,
Maher Dayeh,
Hazel M. Bain,
Subhamoy Chatterjee,
Andres Munoz-Jaramillo,
Samuel Hart
Abstract:
We introduce a new multivariate data set that utilizes multiple spacecraft collecting in-situ and remote sensing heliospheric measurements shown to be linked to physical processes responsible for generating solar energetic particles (SEPs). Using the Geostationary Operational Environmental Satellites (GOES) flare event list from Solar Cycle (SC) 23 and part of SC 24 (1998-2013), we identify 252 so…
▽ More
We introduce a new multivariate data set that utilizes multiple spacecraft collecting in-situ and remote sensing heliospheric measurements shown to be linked to physical processes responsible for generating solar energetic particles (SEPs). Using the Geostationary Operational Environmental Satellites (GOES) flare event list from Solar Cycle (SC) 23 and part of SC 24 (1998-2013), we identify 252 solar events (flares) that produce SEPs and 17,542 events that do not. For each identified event, we acquire the local plasma properties at 1 au, such as energetic proton and electron data, upstream solar wind conditions, and the interplanetary magnetic field vector quantities using various instruments onboard GOES and the Advanced Composition Explorer (ACE) spacecraft. We also collect remote sensing data from instruments onboard the Solar Dynamic Observatory (SDO), Solar and Heliospheric Observatory (SoHO), and the Wind solar radio instrument WAVES. The data set is designed to allow for variations of the inputs and feature sets for machine learning (ML) in heliophysics and has a specific purpose for forecasting the occurrence of SEP events and their subsequent properties. This paper describes a dataset created from multiple publicly available observation sources that is validated, cleaned, and carefully curated for our machine-learning pipeline. The dataset has been used to drive the newly-developed Multivariate Ensemble of Models for Probabilistic Forecast of Solar Energetic Particles (MEMPSEP; see MEMPSEP I (Chatterjee et al., 2023) and MEMPSEP II (Dayeh et al., 2023) for associated papers).
△ Less
Submitted 26 October, 2023; v1 submitted 23 October, 2023;
originally announced October 2023.
-
MEMPSEP I : Forecasting the Probability of Solar Energetic Particle Event Occurrence using a Multivariate Ensemble of Convolutional Neural Networks
Authors:
Subhamoy Chatterjee,
Maher Dayeh,
Andrés Muñoz-Jaramillo,
Hazel M. Bain,
Kimberly Moreland,
Samuel Hart
Abstract:
The Sun continuously affects the interplanetary environment through a host of interconnected and dynamic physical processes. Solar flares, Coronal Mass Ejections (CMEs), and Solar Energetic Particles (SEPs) are among the key drivers of space weather in the near-Earth environment and beyond. While some CMEs and flares are associated with intense SEPs, some show little to no SEP association. To date…
▽ More
The Sun continuously affects the interplanetary environment through a host of interconnected and dynamic physical processes. Solar flares, Coronal Mass Ejections (CMEs), and Solar Energetic Particles (SEPs) are among the key drivers of space weather in the near-Earth environment and beyond. While some CMEs and flares are associated with intense SEPs, some show little to no SEP association. To date, robust long-term (hours-days) forecasting of SEP occurrence and associated properties (e.g., onset, peak intensities) does not effectively exist and the search for such development continues. Through an Operations-2-Research support, we developed a self-contained model that utilizes a comprehensive dataset and provides a probabilistic forecast for SEP event occurrence and its properties. The model is named Multivariate Ensemble of Models for Probabilistic Forecast of Solar Energetic Particles (MEMPSEP). MEMPSEP workhorse is an ensemble of Convolutional Neural Networks that ingests a comprehensive dataset (MEMPSEP III - (Moreland et al., 2023)) of full-disc magnetogram-sequences and in-situ data from different sources to forecast the occurrence (MEMPSEP I - this work) and properties (MEMPSEP II - Dayeh et al. (2023)) of a SEP event. This work focuses on estimating true SEP occurrence probabilities achieving a 2.5% improvement in reliability and a Brier score of 0.14. The outcome provides flexibility for the end-users to determine their own acceptable level of risk, rather than imposing a detection threshold that optimizes an arbitrary binary classification metric. Furthermore, the model-ensemble, trained to utilize the large class-imbalance between events and non-events, provides a clear measure of uncertainty in our forecast
△ Less
Submitted 25 September, 2023;
originally announced September 2023.
-
MEMPSEP II. -- Forecasting the Properties of Solar Energetic Particle Events using a Multivariate Ensemble Approach
Authors:
Maher A. Dayeh,
Subhamoy Chatterjee,
Andres Munoz-Jaramillo,
Kimberly Moreland,
Hazel M. Bain,
Samuel Hart
Abstract:
Solar Energetic Particles (SEPs) form a critical component of Space Weather. The complex, intertwined dynamics of SEP sources, acceleration, and transport make their forecasting very challenging. Yet, information about SEP arrival and their properties (e.g., peak flux) is crucial for space exploration on many fronts. We have recently introduced a novel probabilistic ensemble model called the Multi…
▽ More
Solar Energetic Particles (SEPs) form a critical component of Space Weather. The complex, intertwined dynamics of SEP sources, acceleration, and transport make their forecasting very challenging. Yet, information about SEP arrival and their properties (e.g., peak flux) is crucial for space exploration on many fronts. We have recently introduced a novel probabilistic ensemble model called the Multivariate Ensemble of Models for Probabilistic Forecast of Solar Energetic Particles (MEMPSEP). Its primary aim is to forecast the occurrence and physical properties of SEPs. The occurrence forecasting, thoroughly discussed in a preceding paper (Chatterjee et al., 2023), is complemented by the work presented here, which focuses on forecasting the physical properties of SEPs. The MEMPSEP model relies on an ensemble of Convolutional Neural Networks, which leverage a multi-variate dataset comprising full-disc magnetogram sequences and numerous derived and in-situ data from various sources. Skill scores demonstrate that MEMPSEP exhibits improved predictions on SEP properties for the test set data with SEP occurrence probability above 50%, compared to those with a probability below 50%. Results present a promising approach to address the challenging task of forecasting SEP physical properties, thus improving our forecasting capabilities and advancing our understanding of the dominant parameters and processes that govern SEP production.
△ Less
Submitted 25 September, 2023;
originally announced September 2023.
-
Particle Radiation Environment in the Heliosphere: Status, limitations and recommendations
Authors:
Jingnan Guo,
Bingbing Wang,
Kathryn Whitman,
Christina Plainaki,
Lingling Zhao,
Hazel M. Bain,
Christina Cohen,
Silvia Dalla,
Mateja Dumbovic,
Miho Janvier,
Insoo Jun,
Janet Luhmann,
Olga E. Malandraki,
M. Leila Mays,
Jamie S. Rankin,
Linghua Wang,
Yihua Zheng
Abstract:
Space weather is a multidisciplinary research area connecting scientists from across heliophysics domains seeking a coherent understanding of our space environment that can also serve modern life and society's needs. COSPAR's ISWAT (International Space Weather Action Teams) 'clusters' focus attention on different areas of space weather study while ensuring the coupled system is broadly addressed v…
▽ More
Space weather is a multidisciplinary research area connecting scientists from across heliophysics domains seeking a coherent understanding of our space environment that can also serve modern life and society's needs. COSPAR's ISWAT (International Space Weather Action Teams) 'clusters' focus attention on different areas of space weather study while ensuring the coupled system is broadly addressed via regular communications and interactions. The ISWAT cluster "H3: Radiation Environment in the Heliosphere" (https://www.iswat-cospar.org/h3) has been working to provide a scientific platform to understand, characterize and predict the energetic particle radiation in the heliosphere with the practical goal of mitigating radiation risks associated with areospace activities, satellite industry and human space explorations. In particular, present approaches help us understand the physical phenomena at large, optimizing the output of multi-viewpoint observations and pushing current models to their limits.
In this paper, we review the scientific aspects of the radiation environment in the heliosphere covering four different radiation types: Solar Energetic Particles (SEPs), Ground Level Enhancement (GLE, a type of SEP events with energies high enough to trigger the enhancement of ground-level detectors), Galactic Cosmic Rays (GCRs) and Anomalous Cosmic Rays (ACRs). We focus on related advances in the research community in the past 10-20 years and what we still lack in terms of understanding and predictive capabilities. Finally we also consider some recommendations related to the improvement of both observational and modeling capabilities in the field of space radiation environment.
△ Less
Submitted 23 August, 2023;
originally announced August 2023.
-
Homogenising SoHO/EIT and SDO/AIA 171Å$~$ Images: A Deep Learning Approach
Authors:
Subhamoy Chatterjee,
Andrés Muñoz-Jaramillo,
Maher Dayeh,
Hazel M. Bain,
Kimberly Moreland
Abstract:
Extreme Ultraviolet images of the Sun are becoming an integral part of space weather prediction tasks. However, having different surveys requires the development of instrument-specific prediction algorithms. As an alternative, it is possible to combine multiple surveys to create a homogeneous dataset. In this study, we utilize the temporal overlap of SoHO/EIT and SDO/AIA 171~Å~surveys to train an…
▽ More
Extreme Ultraviolet images of the Sun are becoming an integral part of space weather prediction tasks. However, having different surveys requires the development of instrument-specific prediction algorithms. As an alternative, it is possible to combine multiple surveys to create a homogeneous dataset. In this study, we utilize the temporal overlap of SoHO/EIT and SDO/AIA 171~Å~surveys to train an ensemble of deep learning models for creating a single homogeneous survey of EUV images for 2 solar cycles. Prior applications of deep learning have focused on validating the homogeneity of the output while overlooking the systematic estimation of uncertainty. We use an approach called `Approximate Bayesian Ensembling' to generate an ensemble of models whose uncertainty mimics that of a fully Bayesian neural network at a fraction of the cost. We find that ensemble uncertainty goes down as the training set size increases. Additionally, we show that the model ensemble adds immense value to the prediction by showing higher uncertainty in test data that are not well represented in the training data.
△ Less
Submitted 20 August, 2023;
originally announced August 2023.
-
Heliophysics Discovery Tools for the 21st Century: Data Science and Machine Learning Structures and Recommendations for 2020-2050
Authors:
R. M. McGranaghan,
B. Thompson,
E. Camporeale,
J. Bortnik,
M. Bobra,
G. Lapenta,
S. Wing,
B. Poduval,
S. Lotz,
S. Murray,
M. Kirk,
T. Y. Chen,
H. M. Bain,
P. Riley,
B. Tremblay,
M. Cheung,
V. Delouille
Abstract:
Three main points: 1. Data Science (DS) will be increasingly important to heliophysics; 2. Methods of heliophysics science discovery will continually evolve, requiring the use of learning technologies [e.g., machine learning (ML)] that are applied rigorously and that are capable of supporting discovery; and 3. To grow with the pace of data, technology, and workforce changes, heliophysics requires…
▽ More
Three main points: 1. Data Science (DS) will be increasingly important to heliophysics; 2. Methods of heliophysics science discovery will continually evolve, requiring the use of learning technologies [e.g., machine learning (ML)] that are applied rigorously and that are capable of supporting discovery; and 3. To grow with the pace of data, technology, and workforce changes, heliophysics requires a new approach to the representation of knowledge.
△ Less
Submitted 26 December, 2022;
originally announced December 2022.
-
Ground-based Synoptic Studies of the Sun
Authors:
Sanjay Gosain,
V. Martinez Pillet,
A. Pevtsov,
H. Gilbert,
S. Gibson,
A. G. de Wijn,
J. Burkepile,
A. Asai,
H. M. Bain,
C. J. Henney,
Y. Katsukawa,
H. Lin,
W. Manchester,
J. McAteer,
K. Muglach,
M. Rast,
M. Roth,
J. Zhang
Abstract:
Ground-based synoptic solar observations provide critical contextual data used to model the large-scale state of the heliosphere. The next decade will see a combination of ground-based telescopes and space missions that will study our Sun's atmosphere microscopic processes with unprecedented detail. This white paper describes contextual observations from a ground-based network needed to fully expl…
▽ More
Ground-based synoptic solar observations provide critical contextual data used to model the large-scale state of the heliosphere. The next decade will see a combination of ground-based telescopes and space missions that will study our Sun's atmosphere microscopic processes with unprecedented detail. This white paper describes contextual observations from a ground-based network needed to fully exploit this new knowledge of the underlying physics that leads to the magnetic linkages between the heliosphere and the Sun. This combination of a better understanding of small-scale processes and the appropriate global context will enable a physics-based approach to Space Weather comparable to Terrestrial Weather forecasting.
△ Less
Submitted 18 February, 2023; v1 submitted 6 December, 2022;
originally announced December 2022.
-
Real-time solar image classification: assessing spectral, pixel-based approaches
Authors:
J. Marcus Hughes,
Vicki W. Hsu,
Daniel B. Seaton,
Hazel M. Bain,
Jonathan M. Darnel,
Larisza Krista
Abstract:
In order to utilize solar imagery for real-time feature identification and large-scale data science investigations of solar structures, we need maps of the Sun where phenomena, or themes, are labeled. Since solar imagers produce observations every few minutes, it is not feasible to label all images by hand. Here, we compare three machine learning algorithms performing solar image classification us…
▽ More
In order to utilize solar imagery for real-time feature identification and large-scale data science investigations of solar structures, we need maps of the Sun where phenomena, or themes, are labeled. Since solar imagers produce observations every few minutes, it is not feasible to label all images by hand. Here, we compare three machine learning algorithms performing solar image classification using extreme ultraviolet and Hydrogen-alpha images: a maximum likelihood model assuming a single normal probability distribution for each theme from Rigler et al. (2012), a maximum-likelihood model with an underlying Gaussian mixtures distribution, and a random forest model. We create a small database of expert-labeled maps to train and test these algorithms. Due to the ambiguity between the labels created by different experts, a collaborative labeling is used to include all inputs. We find the random forest algorithm performs the best amongst the three algorithms. The advantages of this algorithm are best highlighted in: comparison of outputs to hand-drawn maps; response to short-term variability; and tracking long-term changes on the Sun. Our work indicates that the next generation of solar image classification algorithms would benefit significantly from using spatial structure recognition, compared to only using spectral, pixel-by-pixel brightness distributions.
△ Less
Submitted 30 September, 2019;
originally announced October 2019.
-
Astro2020 Science White Paper: Synoptic Studies of the Sun as a Key to Understanding Stellar Astrospheres
Authors:
Valentin Martinez Pillet,
Frank Hill,
Heidi Hammel,
Dr. Alfred G. de Wijn,
Sanjay Gosain,
Joan Burkepile,
Carl J. Henney,
James R. T. McAteer,
Hazel M. Bain,
Ward B. Manchester IV,
Haosheng Lin,
Markus Roth,
Kiyoshi Ichimoto,
Yoshinori Suematsu
Abstract:
Ground-based solar observations provide key contextual data (i.e., the 'big picture') to produce a complete description of the only astrosphere we can study in situ: our Sun's heliosphere. The next decade will see the beginning of operations of the Daniel K. Inouye Solar Telescope (DKIST). DKIST will join NASA's Parker Solar Probe and the NASA/ESA Solar Orbital mission, which together will study o…
▽ More
Ground-based solar observations provide key contextual data (i.e., the 'big picture') to produce a complete description of the only astrosphere we can study in situ: our Sun's heliosphere. The next decade will see the beginning of operations of the Daniel K. Inouye Solar Telescope (DKIST). DKIST will join NASA's Parker Solar Probe and the NASA/ESA Solar Orbital mission, which together will study our Sun's atmosphere with unprecedented detail. This white paper outlines the current paradigm for ground-based solar synoptic observations, and indicates those areas that will benefit from focused attention.
△ Less
Submitted 16 March, 2019;
originally announced March 2019.
-
First flight of the Gamma-Ray Imager/Polarimeter for Solar flares (GRIPS) instrument
Authors:
Nicole Duncan,
P. Saint-Hilaire,
A. Y. Shih,
G. J. Hurford,
H. M. Bain,
M. Amman,
B. A. Mochizuki,
J. Hoberman,
J. Olson,
B. A. Maruca,
N. M. Godbole,
D. M. Smith,
J. Sample,
N. A. Kelley,
A. Zoglauer,
A. Caspi,
P. Kaufmann,
S. Boggs,
R. P. Lin
Abstract:
The Gamma-Ray Imager/Polarimeter for Solar flares (GRIPS) is a balloon-borne telescope designed to study solar-flare particle acceleration and transport. We describe GRIPS's first Antarctic long-duration flight in Jan 2016 and report preliminary calibration and science results.
Electron and ion dynamics, particle abundances and the ambient plasma conditions in solar flares can be understood by e…
▽ More
The Gamma-Ray Imager/Polarimeter for Solar flares (GRIPS) is a balloon-borne telescope designed to study solar-flare particle acceleration and transport. We describe GRIPS's first Antarctic long-duration flight in Jan 2016 and report preliminary calibration and science results.
Electron and ion dynamics, particle abundances and the ambient plasma conditions in solar flares can be understood by examining hard X-ray (HXR) and gamma-ray emission (20 keV to 10 MeV) with enhanced imaging, spectroscopy and polarimetry. GRIPS is specifically designed to answer questions including: What causes the spatial separation between energetic electrons producing HXRs and energetic ions producing gamma-ray lines? How anisotropic are the relativistic electrons, and why can they dominate in the corona? How do the compositions of accelerated and ambient material vary with space and time, and why?
GRIPS's key technological improvements over the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI) include 3D position-sensitive germanium detectors (3D-GeDs) and a single-grid, multi-pitch rotating modulator (MPRM) collimator. The 3D-GeDs have spectral FWHM resolution of a few hundred keV and spatial resolution $<$1 mm$^3$. For photons that Compton scatter, usually $\gtrsim$150 keV, the energy deposition sites can be tracked, providing polarization measurements as well as enhanced background reduction. The MPRM single-grid design provides twice the throughput of a bi-grid imaging system like RHESSI. The grid is composed of 2.5 cm thick W/Cu slats with 1-13 mm variable slit pitch, achieving quasi-continuous FWHM angular coverage over 12.5-162 arcsecs. This resolution is capable of imaging the separate magnetic loop footpoint emissions in a variety of flare sizes.
(Abstract edited down from source.)
△ Less
Submitted 27 September, 2016;
originally announced September 2016.
-
Bridging EUV and white-light observations to inspect the initiation phase of a "two-stage" solar eruptive event
Authors:
Jason P. Byrne,
Huw Morgan,
Dan B. Seaton,
Hazel M. Bain,
Shadia R. Habbal
Abstract:
The initiation phase of CMEs is a very important aspect of solar physics, as these phenomena ultimately drive space weather in the heliosphere. This phase is known to occur between the photosphere and low corona, where many models introduce an instability and/or magnetic reconnection that triggers a CME, often with associated flaring activity. To this end, it is important to obtain a variety of ob…
▽ More
The initiation phase of CMEs is a very important aspect of solar physics, as these phenomena ultimately drive space weather in the heliosphere. This phase is known to occur between the photosphere and low corona, where many models introduce an instability and/or magnetic reconnection that triggers a CME, often with associated flaring activity. To this end, it is important to obtain a variety of observations of the low corona in order to build as clear a picture as possible of the dynamics that occur therein. Here, we combine the EUV imagery of the SWAP instrument on board PROBA2 with the white-light imagery of the ground-based Mk4 coronameter at MLSO in order to bridge the observational gap that exists between the disk imagery of AIA on board SDO and the coronal imagery of LASCO on board SOHO. Methods of multiscale image analysis were applied to the observations to better reveal the coronal signal while suppressing noise and other features. This allowed an investigation into the initiation phase of a CME that was driven by a rising flux rope structure from a "two-stage" flaring active region underlying an extended helmet streamer. It was found that the initial outward motion of the erupting loop system in the EUV observations coincided with the first X-ray flare peak, and led to a plasma pile-up of the white-light CME core material. The characterized CME core then underwent a strong jerk in its motion, as the early acceleration increased abruptly, simultaneous with the second X-ray flare peak. The overall system expanded into the helmet streamer to become the larger CME structure observed in the LASCO coronagraph images, which later became concave-outward in shape. Theoretical models for the event are discussed in light of these unique observations, and it is concluded that the formation of either a kink-unstable or torus-unstable flux rope may be the likeliest scenario.
△ Less
Submitted 18 June, 2014;
originally announced June 2014.
-
The 2010 August 01 type II burst: A CME-CME Interaction, and its radio and white-light manifestations
Authors:
Juan Carlos Martínez Oliveros,
Claire L. Raftery,
Hazel M. Bain,
Ying Liu,
Vratislav Krupar,
Stuart Bale,
Säm Krucker
Abstract:
We present observational results of a type II burst associated with a CME-CME interaction observed in the radio and white-light wavelength range. We applied radio direction-finding techniques to observations from the STEREO and Wind spacecraft, the results of which were interpreted using white-light coronagraphic measurements for context. The results of the multiple radio-direction finding techniq…
▽ More
We present observational results of a type II burst associated with a CME-CME interaction observed in the radio and white-light wavelength range. We applied radio direction-finding techniques to observations from the STEREO and Wind spacecraft, the results of which were interpreted using white-light coronagraphic measurements for context. The results of the multiple radio-direction finding techniques applied were found to be consistent both with each other and with those derived from the white-light observations of coronal mass ejections (CMEs). The results suggest that the Type II burst radio emission is causally related to the CMEs interaction.
△ Less
Submitted 10 February, 2012;
originally announced February 2012.