-
Co-estimation of core and lithospheric magnetic fields by a maximum entropy method
Authors:
Mikkel Otzen,
Christopher C. Finlay,
Clemens Kloss
Abstract:
Satellite observations of the geomagnetic field contain signals generated in Earth's interior by electrical currents in the core and by magnetized rocks in the lithosphere. At short wavelengths the lithospheric signal dominates, obscuring the signal from the core. Here we present details of a method to co-estimate separate models for the core and lithospheric fields, which are allowed to overlap i…
▽ More
Satellite observations of the geomagnetic field contain signals generated in Earth's interior by electrical currents in the core and by magnetized rocks in the lithosphere. At short wavelengths the lithospheric signal dominates, obscuring the signal from the core. Here we present details of a method to co-estimate separate models for the core and lithospheric fields, which are allowed to overlap in spherical harmonic degree, that makes use of prior information to aid the separation. Using a maximum entropy method we estimate probabilistic models for the time-dependent core field and the static lithospheric field that satisfy constraints provided by satellite observations while being consistent with prior knowledge of the spatial covariance and expected magnitude of each field at its source surface.
△ Less
Submitted 3 February, 2024;
originally announced February 2024.
-
Polar ionospheric currents and high temporal resolution geomagnetic field models
Authors:
Clemens Kloss,
Christopher C. Finlay,
Karl M. Laundal,
Nils Olsen
Abstract:
Estimating high resolution models of the Earth's core magnetic field and its time variation in the polar regions requires that one can adequately account for magnetic signals produced by polar ionospheric currents, which vary on a wide range of time and length scales. Limitations of existing ionospheric field models in the challenging polar regions can adversely affect core field models, which in…
▽ More
Estimating high resolution models of the Earth's core magnetic field and its time variation in the polar regions requires that one can adequately account for magnetic signals produced by polar ionospheric currents, which vary on a wide range of time and length scales. Limitations of existing ionospheric field models in the challenging polar regions can adversely affect core field models, which in turn has important implications for studies of the core flow dynamics in those regions. Here we implement a new approach to co-estimate a climatological model of the ionospheric field together with a model of the internal and magnetospheric fields within the CHAOS geomagnetic field modelling framework. The parametrization of the ionospheric field exploits non-orthogonal magnetic coordinates and scales linearly with external driving parameters related to the solar wind and the interplanetary magnetic field. Using this approach we derive a new geomagnetic field model from measurements of the magnetic field collected by low Earth orbit satellites, which in addition to the internal field provides estimates of the typical current system in the polar ionosphere. We find that the time derivative of the estimated internal field is less contaminated by the polar currents, which is mostly visible in the zonal and near-zonal terms at high spherical harmonic degrees. Distinctive patches of strong secular variation at the core-mantle boundary, which have important implications for core dynamics, persist. Relaxing the temporal regularisation reveals annual oscillations, which could indicate remaining ionospheric field or related induced signals in the internal field model. Using principal component analysis we find that the annual oscillations mostly affect the zonal low-degree spherical harmonics of the internal field.
△ Less
Submitted 8 September, 2023;
originally announced September 2023.
-
Boundary Graph Neural Networks for 3D Simulations
Authors:
Andreas Mayr,
Sebastian Lehner,
Arno Mayrhofer,
Christoph Kloss,
Sepp Hochreiter,
Johannes Brandstetter
Abstract:
The abundance of data has given machine learning considerable momentum in natural sciences and engineering, though modeling of physical processes is often difficult. A particularly tough problem is the efficient representation of geometric boundaries. Triangularized geometric boundaries are well understood and ubiquitous in engineering applications. However, it is notoriously difficult to integrat…
▽ More
The abundance of data has given machine learning considerable momentum in natural sciences and engineering, though modeling of physical processes is often difficult. A particularly tough problem is the efficient representation of geometric boundaries. Triangularized geometric boundaries are well understood and ubiquitous in engineering applications. However, it is notoriously difficult to integrate them into machine learning approaches due to their heterogeneity with respect to size and orientation. In this work, we introduce an effective theory to model particle-boundary interactions, which leads to our new Boundary Graph Neural Networks (BGNNs) that dynamically modify graph structures to obey boundary conditions. The new BGNNs are tested on complex 3D granular flow processes of hoppers, rotating drums and mixers, which are all standard components of modern industrial machinery but still have complicated geometry. BGNNs are evaluated in terms of computational efficiency as well as prediction accuracy of particle flows and mixing entropies. BGNNs are able to accurately reproduce 3D granular flows within simulation uncertainties over hundreds of thousands of simulation timesteps. Most notably, in our experiments, particles stay within the geometric objects without using handcrafted conditions or restrictions.
△ Less
Submitted 20 April, 2023; v1 submitted 21 June, 2021;
originally announced June 2021.
-
Learning 3D Granular Flow Simulations
Authors:
Andreas Mayr,
Sebastian Lehner,
Arno Mayrhofer,
Christoph Kloss,
Sepp Hochreiter,
Johannes Brandstetter
Abstract:
Recently, the application of machine learning models has gained momentum in natural sciences and engineering, which is a natural fit due to the abundance of data in these fields. However, the modeling of physical processes from simulation data without first principle solutions remains difficult. Here, we present a Graph Neural Networks approach towards accurate modeling of complex 3D granular flow…
▽ More
Recently, the application of machine learning models has gained momentum in natural sciences and engineering, which is a natural fit due to the abundance of data in these fields. However, the modeling of physical processes from simulation data without first principle solutions remains difficult. Here, we present a Graph Neural Networks approach towards accurate modeling of complex 3D granular flow simulation processes created by the discrete element method LIGGGHTS and concentrate on simulations of physical systems found in real world applications like rotating drums and hoppers. We discuss how to implement Graph Neural Networks that deal with 3D objects, boundary conditions, particle - particle, and particle - boundary interactions such that an accurate modeling of relevant physical quantities is made possible. Finally, we compare the machine learning based trajectories to LIGGGHTS trajectories in terms of particle flows and mixing entropies.
△ Less
Submitted 4 May, 2021;
originally announced May 2021.
-
Co-estimating geomagnetic field and calibration parameters: modeling Earth's magnetic field with platform magnetometer data
Authors:
Clemens Kloss,
Christopher C. Finlay,
Nils Olsen
Abstract:
Models of the geomagnetic field rely on magnetic data of high spatial and temporal resolution. The magnetic data from low-Earth orbit satellites of dedicated magnetic survey missions such as CHAMP and Swarm play a key role in the construction of such models. Unfortunately, there are no magnetic data from such satellites after the end of CHAMP in 2010 and before the launch of Swarm in late 2013. Th…
▽ More
Models of the geomagnetic field rely on magnetic data of high spatial and temporal resolution. The magnetic data from low-Earth orbit satellites of dedicated magnetic survey missions such as CHAMP and Swarm play a key role in the construction of such models. Unfortunately, there are no magnetic data from such satellites after the end of CHAMP in 2010 and before the launch of Swarm in late 2013. This limits our ability to recover signals on timescales of 3 years and less during this gap period. The magnetic data from platform magnetometers carried by satellites for navigational purposes may help address this data gap provided that they are carefully calibrated. Earlier studies have demonstrated that platform magnetometer data can be calibrated using a fixed reference field model. However, this approach can lead to biased calibration parameters. An alternative has been developed in the form of a co-estimation scheme which consists of simultaneously estimating both the calibration parameters and a model of the internal geomagnetic field. Here, we develop a scheme, based on the CHAOS framework, that involves the co-estimation of a geomagnetic field model along with calibration parameters of platform magnetometers. Using our implementation, we are able to derive a geomagnetic field model from 2008 to 2018 with satellite magnetic data from CHAMP, Swarm, secular variation data from ground observatories, and platform magnetometer data from CryoSat-2 and GRACE. Through experiments, we explore correlations between the estimates of the geomagnetic field and the calibration parameters, and suggest how these may be avoided. We find that platform magnetometer data provide additional information on the secular acceleration, especially in the Pacific during the gap period. This study adds to the evidence that it is beneficial to use platform magnetometer data in geomagnetic field modeling.
△ Less
Submitted 16 March, 2021;
originally announced March 2021.
-
Time-scale dependence of solar wind-based regression models of ionospheric electrodynamics
Authors:
K. M. Laundal,
J. P. Reistad,
S. M. Hatch,
T. Moretto,
A. Ohma,
N. Østgaard,
P. A. R. Tenfjord,
C. C. Finlay,
C. Kloss
Abstract:
The solar wind influence on geospace can be described as the sum of a directly driven component, or dayside reconnection, and an unloading component, associated with the release of magnetic energy via nightside reconnection. The two processes are poorly correlated on short time scales, but exactly equal when averaged over long time windows. Because of this peculiar property, regression models of i…
▽ More
The solar wind influence on geospace can be described as the sum of a directly driven component, or dayside reconnection, and an unloading component, associated with the release of magnetic energy via nightside reconnection. The two processes are poorly correlated on short time scales, but exactly equal when averaged over long time windows. Because of this peculiar property, regression models of ionospheric electrodynamics that are based on solar wind data are time scale specific: Models derived from 1 min resolution data will be different from models derived from hourly, daily, or monthly data. We explain and quantify this effect on simple linear regression models of various geomagnetic indices. We also derive a time scale-dependent correction factor that can be used with the Average Magnetic field and Polar current System model. Finally, we show how absolute estimates of the nightside reconnection rate can be calculated from solar wind measurements and geomagnetic indices.
△ Less
Submitted 2 November, 2020;
originally announced November 2020.
-
The CHAOS-7 geomagnetic field model and observed changes in the South Atlantic Anomaly
Authors:
Christopher C. Finlay,
Clemens Kloss,
Nils Olsen,
Magnus D. Hammer,
Lars Tøffner-Clausen,
Alexander Grayver,
Alexey Kuvshinov
Abstract:
We present the CHAOS-7 model of the time-dependent near-Earth geomagnetic field between 1999 and 2020 based on magnetic field observations collected by the low-Earth orbit satellites {\it Swarm}, CryoSat-2, CHAMP, SAC-C and Ørsted, and on annual differences of monthly means of ground observatory measurements. The CHAOS-7 model consists of a time-dependent internal field up to spherical harmonic de…
▽ More
We present the CHAOS-7 model of the time-dependent near-Earth geomagnetic field between 1999 and 2020 based on magnetic field observations collected by the low-Earth orbit satellites {\it Swarm}, CryoSat-2, CHAMP, SAC-C and Ørsted, and on annual differences of monthly means of ground observatory measurements. The CHAOS-7 model consists of a time-dependent internal field up to spherical harmonic degree 20, a static internal field which merges to the LCS-1 lithospheric field model above degree 25, a model of the magnetospheric field and its induced counterpart, estimates of Euler angles describing the alignment of satellite vector magnetometers, and magnetometer calibration parameters for CryoSat-2. Only data from dark regions satisfying strict geomagnetic quiet-time criteria (including conditions on IMF $B_z$ and $B_y$ at all latitudes) were used in the field estimation. Model parameters were estimated using an iteratively-reweighted regularized least-squares procedure; regularization of the time-dependent internal field was relaxed at high spherical harmonic degree compared with previous versions of the CHAOS model. We use CHAOS-7 to investigate recent changes in the geomagnetic field, studying the evolution of the South Atlantic weak field anomaly and rapid field changes in the Pacific region since 2014. At Earth's surface a secondary minimum of the South Atlantic Anomaly is now evident to the south west of Africa. Green's functions relating the core-mantle boundary radial field to the surface intensity show this feature is connected with the movement and evolution of a reversed flux feature under South Africa. The continuing growth in size and weakening of the main anomaly is linked to the westward motion and gathering of reversed flux under South America.
△ Less
Submitted 21 October, 2020;
originally announced October 2020.
-
Time-dependent low latitude core flow and geomagnetic field acceleration pulses
Authors:
Clemens Kloss,
Christopher Finlay
Abstract:
We present a new model of time-dependent flow at low latitudes in the Earth's core between 2000 and 2018, derived from magnetic field measurements made on board the {\it Swarm} and CHAMP satellites and at ground magnetic observatories. The model, called {\it CoreFlo-LL.1}, consists of a steady background flow without imposed symmetry plus a time-dependent flow that is dominated by geostrophic and…
▽ More
We present a new model of time-dependent flow at low latitudes in the Earth's core between 2000 and 2018, derived from magnetic field measurements made on board the {\it Swarm} and CHAMP satellites and at ground magnetic observatories. The model, called {\it CoreFlo-LL.1}, consists of a steady background flow without imposed symmetry plus a time-dependent flow that is dominated by geostrophic and quasi-geostrophic components but also allows weak departures from equatorial symmetry. We find that the equatorial region beneath the core-mantle boundary is a place of vigorous, localised, fluid motions; time-dependent flow focused at low latitudes close to the core surface is able to reproduce rapid field variations observed at non-polar latitudes at and above Earth's surface. Magnetic field acceleration pulses are produced by alternating bursts of non-zonal azimuthal flow acceleration in this region. Such acceleration sign changes can occur within a year or less, and when the structures involved are of large spatial scale they can give rise to geomagnetic jerks at the Earth's surface.
△ Less
Submitted 7 November, 2019;
originally announced November 2019.
-
Flexpoint: An Adaptive Numerical Format for Efficient Training of Deep Neural Networks
Authors:
Urs Köster,
Tristan J. Webb,
Xin Wang,
Marcel Nassar,
Arjun K. Bansal,
William H. Constable,
Oğuz H. Elibol,
Scott Gray,
Stewart Hall,
Luke Hornof,
Amir Khosrowshahi,
Carey Kloss,
Ruby J. Pai,
Naveen Rao
Abstract:
Deep neural networks are commonly developed and trained in 32-bit floating point format. Significant gains in performance and energy efficiency could be realized by training and inference in numerical formats optimized for deep learning. Despite advances in limited precision inference in recent years, training of neural networks in low bit-width remains a challenging problem. Here we present the F…
▽ More
Deep neural networks are commonly developed and trained in 32-bit floating point format. Significant gains in performance and energy efficiency could be realized by training and inference in numerical formats optimized for deep learning. Despite advances in limited precision inference in recent years, training of neural networks in low bit-width remains a challenging problem. Here we present the Flexpoint data format, aiming at a complete replacement of 32-bit floating point format training and inference, designed to support modern deep network topologies without modifications. Flexpoint tensors have a shared exponent that is dynamically adjusted to minimize overflows and maximize available dynamic range. We validate Flexpoint by training AlexNet, a deep residual network and a generative adversarial network, using a simulator implemented with the neon deep learning framework. We demonstrate that 16-bit Flexpoint closely matches 32-bit floating point in training all three models, without any need for tuning of model hyperparameters. Our results suggest Flexpoint as a promising numerical format for future hardware for training and inference.
△ Less
Submitted 2 December, 2017; v1 submitted 6 November, 2017;
originally announced November 2017.
