-
Sparse $L^1$-Autoencoders for Scientific Data Compression
Authors:
Matthias Chung,
Rick Archibald,
Paul Atzberger,
Jack Michael Solomon
Abstract:
Scientific datasets present unique challenges for machine learning-driven compression methods, including more stringent requirements on accuracy and mitigation of potential invalidating artifacts. Drawing on results from compressed sensing and rate-distortion theory, we introduce effective data compression methods by developing autoencoders using high dimensional latent spaces that are $L^1$-regul…
▽ More
Scientific datasets present unique challenges for machine learning-driven compression methods, including more stringent requirements on accuracy and mitigation of potential invalidating artifacts. Drawing on results from compressed sensing and rate-distortion theory, we introduce effective data compression methods by developing autoencoders using high dimensional latent spaces that are $L^1$-regularized to obtain sparse low dimensional representations. We show how these information-rich latent spaces can be used to mitigate blurring and other artifacts to obtain highly effective data compression methods for scientific data. We demonstrate our methods for short angle scattering (SAS) datasets showing they can achieve compression ratios around two orders of magnitude and in some cases better. Our compression methods show promise for use in addressing current bottlenecks in transmission, storage, and analysis in high-performance distributed computing environments. This is central to processing the large volume of SAS data being generated at shared experimental facilities around the world to support scientific investigations. Our approaches provide general ways for obtaining specialized compression methods for targeted scientific datasets.
△ Less
Submitted 23 May, 2024;
originally announced May 2024.
-
Geometric Neural Operators (GNPs) for Data-Driven Deep Learning of Non-Euclidean Operators
Authors:
Blaine Quackenbush,
Paul J. Atzberger
Abstract:
We introduce Geometric Neural Operators (GNPs) for accounting for geometric contributions in data-driven deep learning of operators. We show how GNPs can be used (i) to estimate geometric properties, such as the metric and curvatures, (ii) to approximate Partial Differential Equations (PDEs) on manifolds, (iii) learn solution maps for Laplace-Beltrami (LB) operators, and (iv) to solve Bayesian inv…
▽ More
We introduce Geometric Neural Operators (GNPs) for accounting for geometric contributions in data-driven deep learning of operators. We show how GNPs can be used (i) to estimate geometric properties, such as the metric and curvatures, (ii) to approximate Partial Differential Equations (PDEs) on manifolds, (iii) learn solution maps for Laplace-Beltrami (LB) operators, and (iv) to solve Bayesian inverse problems for identifying manifold shapes. The methods allow for handling geometries of general shape including point-cloud representations. The developed GNPs provide approaches for incorporating the roles of geometry in data-driven learning of operators.
△ Less
Submitted 16 April, 2024;
originally announced April 2024.
-
SDYN-GANs: Adversarial Learning Methods for Multistep Generative Models for General Order Stochastic Dynamics
Authors:
Panos Stinis,
Constantinos Daskalakis,
Paul J. Atzberger
Abstract:
We introduce adversarial learning methods for data-driven generative modeling of the dynamics of $n^{th}$-order stochastic systems. Our approach builds on Generative Adversarial Networks (GANs) with generative model classes based on stable $m$-step stochastic numerical integrators. We introduce different formulations and training methods for learning models of stochastic dynamics based on observat…
▽ More
We introduce adversarial learning methods for data-driven generative modeling of the dynamics of $n^{th}$-order stochastic systems. Our approach builds on Generative Adversarial Networks (GANs) with generative model classes based on stable $m$-step stochastic numerical integrators. We introduce different formulations and training methods for learning models of stochastic dynamics based on observation of trajectory samples. We develop approaches using discriminators based on Maximum Mean Discrepancy (MMD), training protocols using conditional and marginal distributions, and methods for learning dynamic responses over different time-scales. We show how our approaches can be used for modeling physical systems to learn force-laws, damping coefficients, and noise-related parameters. The adversarial learning approaches provide methods for obtaining stable generative models for dynamic tasks including long-time prediction and developing simulations for stochastic systems.
△ Less
Submitted 7 February, 2023;
originally announced February 2023.
-
Incorporating Shear into Stochastic Eulerian Lagrangian Methods for Rheological Studies of Complex Fluids and Soft Materials
Authors:
Paul J. Atzberger
Abstract:
We develop computational methods that incorporate shear into fluctuating hydrodynamics methods. We are motivated by the rheological responses of complex fluids and soft materials. Our approach is based on continuum stochastic hydrodynamic equations that are subject to shear boundary conditions on the unit periodic cell in a manner similar to the Lees-Edwards conditions of molecular dynamics. Our m…
▽ More
We develop computational methods that incorporate shear into fluctuating hydrodynamics methods. We are motivated by the rheological responses of complex fluids and soft materials. Our approach is based on continuum stochastic hydrodynamic equations that are subject to shear boundary conditions on the unit periodic cell in a manner similar to the Lees-Edwards conditions of molecular dynamics. Our methods take into account consistently the microstructure elastic mechanics, fluid-structure hydrodynamic coupling, and thermal fluctuations. For practical simulations, we develop numerical methods for efficient stochastic field generation that handle the sheared generalized periodic boundary conditions. We show that our numerical methods are consistent with fluctuation dissipation balance and near-equilibrium statistical mechanics. As a demonstration in practice, we present several prototype rheological response studies. These include (i) shear thinning of a polymeric fluid, (ii) complex moduli for the oscillatory responses of a polymerized lipid vesicle, and (iii) aging under shear of a gel-like material.
△ Less
Submitted 20 December, 2022;
originally announced December 2022.
-
Magnus Exponential Integrators for Stiff Time-Varying Stochastic Systems
Authors:
Dev Jasuja,
P. J. Atzberger
Abstract:
We introduce exponential numerical integration methods for stiff stochastic dynamical systems of the form $d\mathbf{z}_t = L(t)\mathbf{z}_tdt + \mathbf{f}(t)dt + Q(t)d\mathbf{W}_t$. We consider the setting of time-varying operators $L(t), Q(t)$ where they may not commute $L(t_1)L(t_2) \neq L(t_2)L(t_1)$, raising challenges for exponentiation. We develop stochastic numerical integration methods usi…
▽ More
We introduce exponential numerical integration methods for stiff stochastic dynamical systems of the form $d\mathbf{z}_t = L(t)\mathbf{z}_tdt + \mathbf{f}(t)dt + Q(t)d\mathbf{W}_t$. We consider the setting of time-varying operators $L(t), Q(t)$ where they may not commute $L(t_1)L(t_2) \neq L(t_2)L(t_1)$, raising challenges for exponentiation. We develop stochastic numerical integration methods using Mangus expansions for preserving statistical structures and for maintaining fluctuation-dissipation balance for physical systems. For computing the contributions of the fluctuation terms, our methods provide alternative approaches without needing directly to evaluate stochastic integrals. We present results for our methods for a class of SDEs arising in particle simulations and for SPDEs for fluctuations of concentration fields in spatially-extended systems. For time-varying stochastic dynamical systems, our introduced discretization approaches provide general exponential numerical integrators for preserving statistical structures while handling stiffness.
△ Less
Submitted 17 December, 2022;
originally announced December 2022.
-
GD-VAEs: Geometric Dynamic Variational Autoencoders for Learning Nonlinear Dynamics and Dimension Reductions
Authors:
Ryan Lopez,
Paul J. Atzberger
Abstract:
We develop data-driven methods incorporating geometric and topological information to learn parsimonious representations of nonlinear dynamics from observations. We develop approaches for learning nonlinear state space models of the dynamics for general manifold latent spaces using training strategies related to Variational Autoencoders (VAEs). Our methods are referred to as Geometric Dynamic (GD)…
▽ More
We develop data-driven methods incorporating geometric and topological information to learn parsimonious representations of nonlinear dynamics from observations. We develop approaches for learning nonlinear state space models of the dynamics for general manifold latent spaces using training strategies related to Variational Autoencoders (VAEs). Our methods are referred to as Geometric Dynamic (GD) Variational Autoencoders (GD-VAEs). We learn encoders and decoders for the system states and evolution based on deep neural network architectures that include general Multilayer Perceptrons (MLPs), Convolutional Neural Networks (CNNs), and Transpose CNNs (T-CNNs). Motivated by problems arising in parameterized PDEs and physics, we investigate the performance of our methods on tasks for learning low dimensional representations of the nonlinear Burgers equations, constrained mechanical systems, and spatial fields of reaction-diffusion systems. GD-VAEs provide methods for obtaining representations for use in diverse learning tasks involving dynamics.
△ Less
Submitted 19 December, 2022; v1 submitted 10 June, 2022;
originally announced June 2022.
-
Drift-Diffusion Dynamics and Phase Separation in Curved Cell Membranes and Dendritic Spines: Hybrid Discrete-Continuum Methods
Authors:
Patrick D. Tran,
Thomas A. Blanpied,
Paul J. Atzberger
Abstract:
We develop methods for investigating protein drift-diffusion dynamics in heterogeneous cell membranes and the roles played by geometry, diffusion, chemical kinetics, and phase separation. Our hybrid stochastic numerical methods combine discrete particle descriptions with continuum-level models for tracking the individual protein drift-diffusion dynamics when coupled to continuum fields. We show ho…
▽ More
We develop methods for investigating protein drift-diffusion dynamics in heterogeneous cell membranes and the roles played by geometry, diffusion, chemical kinetics, and phase separation. Our hybrid stochastic numerical methods combine discrete particle descriptions with continuum-level models for tracking the individual protein drift-diffusion dynamics when coupled to continuum fields. We show how our approaches can be used to investigate phenomena motivated by protein kinetics within dendritic spines. The spine geometry is hypothesized to play an important biological role regulating synaptic strength, protein kinetics, and self-assembly of clusters. We perform simulation studies for model spine geometries varying the neck size to investigate how phase-separation and protein organization is influenced by different shapes. We also show how our methods can be used to study the roles of geometry in reaction-diffusion systems including Turing instabilities. Our methods provide general approaches for investigating protein kinetics and drift-diffusion dynamics within curved membrane structures.
△ Less
Submitted 18 August, 2022; v1 submitted 2 October, 2021;
originally announced October 2021.
-
MLMOD: Machine Learning Methods for Data-Driven Modeling in LAMMPS
Authors:
Paul J. Atzberger
Abstract:
MLMOD is a software package for incorporating machine learning approaches and models into simulations of microscale mechanics and molecular dynamics in LAMMPS. Recent machine learning approaches provide promising data-driven approaches for learning representations for system behaviors from experimental data and high fidelity simulations. The package faciliates learning and using data-driven models…
▽ More
MLMOD is a software package for incorporating machine learning approaches and models into simulations of microscale mechanics and molecular dynamics in LAMMPS. Recent machine learning approaches provide promising data-driven approaches for learning representations for system behaviors from experimental data and high fidelity simulations. The package faciliates learning and using data-driven models for (i) dynamics of the system at larger spatial-temporal scales (ii) interactions between system components, (iii) features yielding coarser degrees of freedom, and (iv) features for new quantities of interest characterizing system behaviors. MLMOD provides hooks in LAMMPS for (i) modeling dynamics and time-step integration, (ii) modeling interactions, and (iii) computing quantities of interest characterizing system states. The package allows for use of machine learning methods with general model classes including Neural Networks, Gaussian Process Regression, Kernel Models, and other approaches. Here we discuss our prototype C++/Python package, aims, and example usage. The package is integrated currently with the mesocale and molecular dynamics simulation package LAMMPS and PyTorch. For related papers, examples, updates, and additional information see https://github.com/atzberg/mlmod and http://atzberger.org/.
△ Less
Submitted 20 October, 2023; v1 submitted 29 July, 2021;
originally announced July 2021.
-
First-Passage Time Statistics on Surfaces of General Shape: Surface PDE Solvers using Generalized Moving Least Squares (GMLS)
Authors:
B. J. Gross,
P. Kuberry,
P. J. Atzberger
Abstract:
We develop numerical methods for computing statistics of stochastic processes on surfaces of general shape with drift-diffusion dynamics $d\mathbf{X}_t = a(\mathbf{X}_t)dt + \mathbf{b}(\mathbf{X}_t)d\mathbf{W}_t$. We formulate descriptions of Brownian motion and general drift-diffusion processes on surfaces. We consider statistics of the form…
▽ More
We develop numerical methods for computing statistics of stochastic processes on surfaces of general shape with drift-diffusion dynamics $d\mathbf{X}_t = a(\mathbf{X}_t)dt + \mathbf{b}(\mathbf{X}_t)d\mathbf{W}_t$. We formulate descriptions of Brownian motion and general drift-diffusion processes on surfaces. We consider statistics of the form $u(\mathbf{x}) = \mathbb{E}^{\mathbf{x}}\left[\int_0^τg(\mathbf{X}_t)dt \right] + \mathbb{E}^{\mathbf{x}}\left[f(\mathbf{X}_τ)\right]$ for a domain $Ω$ and the exit stopping time $τ= \inf_t \{t > 0 \; |\; \mathbf{X}_t \not\in Ω\}$, where $f,g$ are general smooth functions. For computing these statistics, we develop high-order Generalized Moving Least Squares (GMLS) solvers for associated surface PDE boundary-value problems based on Backward-Kolmogorov equations. We focus particularly on the mean First Passage Times (FPTs) given by the case $f = 0,\, g = 1$ where $u(\mathbf{x}) = \mathbb{E}^{\mathbf{x}}\left[τ\right]$. We perform studies for a variety of shapes showing our methods converge with high-order accuracy both in capturing the geometry and the surface PDE solutions. We then perform studies showing how statistics are influenced by the surface geometry, drift dynamics, and spatially dependent diffusivities.
△ Less
Submitted 3 January, 2022; v1 submitted 4 February, 2021;
originally announced February 2021.
-
Variational Autoencoders for Learning Nonlinear Dynamics of Physical Systems
Authors:
Ryan Lopez,
Paul J. Atzberger
Abstract:
We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders (VAEs) for learning from observations nonlinear state space models. We develop ways to incorporate geometric and topological priors through general manifold latent…
▽ More
We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders (VAEs) for learning from observations nonlinear state space models. We develop ways to incorporate geometric and topological priors through general manifold latent space representations. We investigate the performance of our methods for learning low dimensional representations for the nonlinear Burgers equation and constrained mechanical systems.
△ Less
Submitted 15 March, 2021; v1 submitted 7 December, 2020;
originally announced December 2020.
-
GMLS-Nets: A framework for learning from unstructured data
Authors:
Nathaniel Trask,
Ravi G. Patel,
Ben J. Gross,
Paul J. Atzberger
Abstract:
Data fields sampled on irregularly spaced points arise in many applications in the sciences and engineering. For regular grids, Convolutional Neural Networks (CNNs) have been successfully used to gaining benefits from weight sharing and invariances. We generalize CNNs by introducing methods for data on unstructured point clouds based on Generalized Moving Least Squares (GMLS). GMLS is a non-parame…
▽ More
Data fields sampled on irregularly spaced points arise in many applications in the sciences and engineering. For regular grids, Convolutional Neural Networks (CNNs) have been successfully used to gaining benefits from weight sharing and invariances. We generalize CNNs by introducing methods for data on unstructured point clouds based on Generalized Moving Least Squares (GMLS). GMLS is a non-parametric technique for estimating linear bounded functionals from scattered data, and has recently been used in the literature for solving partial differential equations. By parameterizing the GMLS estimator, we obtain learning methods for operators with unstructured stencils. In GMLS-Nets the necessary calculations are local, readily parallelizable, and the estimator is supported by a rigorous approximation theory. We show how the framework may be used for unstructured physical data sets to perform functional regression to identify associated differential operators and to regress quantities of interest. The results suggest the architectures to be an attractive foundation for data-driven model development in scientific machine learning applications.
△ Less
Submitted 13 September, 2019; v1 submitted 6 September, 2019;
originally announced September 2019.
-
Surface Fluctuating Hydrodynamics Methods for the Drift-Diffusion Dynamics of Particles and Microstructures within Curved Fluid Interfaces
Authors:
David Rower,
Misha Padidar,
Paul J. Atzberger
Abstract:
We introduce fluctuating hydrodynamics approaches on surfaces for capturing the drift-diffusion dynamics of particles and microstructures immersed within curved fluid interfaces of spherical shape. We take into account the interfacial hydrodynamic coupling, traction coupling with the surrounding bulk fluid, and thermal fluctuations. For fluid-structure interactions, we introduce Immersed Boundary…
▽ More
We introduce fluctuating hydrodynamics approaches on surfaces for capturing the drift-diffusion dynamics of particles and microstructures immersed within curved fluid interfaces of spherical shape. We take into account the interfacial hydrodynamic coupling, traction coupling with the surrounding bulk fluid, and thermal fluctuations. For fluid-structure interactions, we introduce Immersed Boundary Methods (IBM) and related Stochastic Eulerian-Lagrangian Methods (SELM) for curved surfaces. We use these approaches to investigate the statistics of surface fluctuating hydrodynamics and microstructures. For velocity autocorrelations, we find characteristic power-law scalings $τ^{-1}$, $τ^{-2}$, and plateaus can emerge. This depends on the physical regime associated with the geometry, surface viscosity, and bulk viscosity. This differs from the characteristic $τ^{-3/2}$ scaling for bulk three dimensional fluids. We develop theory explaining these observed power-laws associated with time-scales for dissipation within the fluid interface and coupling to the surrounding fluid. We then use our introduced methods to investigate a few example systems and roles of hydrodynamic coupling and thermal fluctuations including for the kinetics of passive particles and active microswimmers in curved fluid interfaces.
△ Less
Submitted 21 October, 2023; v1 submitted 3 June, 2019;
originally announced June 2019.
-
Meshfree Methods on Manifolds for Hydrodynamic Flows on Curved Surfaces: A Generalized Moving Least-Squares (GMLS) Approach
Authors:
B. J. Gross,
N. Trask,
P. Kuberry,
P. J. Atzberger
Abstract:
We utilize generalized moving least squares (GMLS) to develop meshfree techniques for discretizing hydrodynamic flow problems on manifolds. We use exterior calculus to formulate incompressible hydrodynamic equations in the Stokesian regime and handle the divergence-free constraints via a generalized vector potential. This provides less coordinate-centric descriptions and enables the development of…
▽ More
We utilize generalized moving least squares (GMLS) to develop meshfree techniques for discretizing hydrodynamic flow problems on manifolds. We use exterior calculus to formulate incompressible hydrodynamic equations in the Stokesian regime and handle the divergence-free constraints via a generalized vector potential. This provides less coordinate-centric descriptions and enables the development of efficient numerical methods and splitting schemes for the fourth-order governing equations in terms of a system of second-order elliptic operators. Using a Hodge decomposition, we develop methods for manifolds having spherical topology. We show the methods exhibit high-order convergence rates for solving hydrodynamic flows on curved surfaces. The methods also provide general high-order approximations for the metric, curvature, and other geometric quantities of the manifold and associated exterior calculus operators. The approaches also can be utilized to develop high-order solvers for other scalar-valued and vector-valued problems on manifolds.
△ Less
Submitted 18 January, 2020; v1 submitted 24 May, 2019;
originally announced May 2019.
-
Coarse-Grained Methods for Heterogeneous Vesicles with Phase-Separated Domains: Elastic Mechanics of Shape Fluctuations, Plate Compression, and Channel Insertion
Authors:
David A. Rower,
Paul J. Atzberger
Abstract:
We develop coarse-grained particle approaches for studying the elastic mechanics of vesicles with heterogeneous membranes having phase-separated domains. We perform simulations both of passive shape fluctuations and of active systems where vesicles are subjected to compression between two plates or subjected to insertion into narrow channels. Analysis methods are developed for mapping particle con…
▽ More
We develop coarse-grained particle approaches for studying the elastic mechanics of vesicles with heterogeneous membranes having phase-separated domains. We perform simulations both of passive shape fluctuations and of active systems where vesicles are subjected to compression between two plates or subjected to insertion into narrow channels. Analysis methods are developed for mapping particle configurations to continuum fields with spherical harmonics representations. Heterogeneous vesicles are found to exhibit rich behaviors where the heterogeneity can amplify surface two-point correlations, reduce resistance during compression, and augment vesicle transport times in channels. The developed methods provide general approaches for characterizing the mechanics of coarse-grained heterogeneous systems taking into account the roles of thermal fluctuations, geometry, and phase separation.
△ Less
Submitted 26 February, 2023; v1 submitted 15 January, 2019;
originally announced January 2019.
-
Importance of the Mathematical Foundations of Machine Learning Methods for Scientific and Engineering Applications
Authors:
Paul J. Atzberger
Abstract:
There has been a lot of recent interest in adopting machine learning methods for scientific and engineering applications. This has in large part been inspired by recent successes and advances in the domains of Natural Language Processing (NLP) and Image Classification (IC). However, scientific and engineering problems have their own unique characteristics and requirements raising new challenges fo…
▽ More
There has been a lot of recent interest in adopting machine learning methods for scientific and engineering applications. This has in large part been inspired by recent successes and advances in the domains of Natural Language Processing (NLP) and Image Classification (IC). However, scientific and engineering problems have their own unique characteristics and requirements raising new challenges for effective design and deployment of machine learning approaches. There is a strong need for further mathematical developments on the foundations of machine learning methods to increase the level of rigor of employed methods and to ensure more reliable and interpretable results. Also as reported in the recent literature on state-of-the-art results and indicated by the No Free Lunch Theorems of statistical learning theory incorporating some form of inductive bias and domain knowledge is essential to success. Consequently, even for existing and widely used methods there is a strong need for further mathematical work to facilitate ways to incorporate prior scientific knowledge and related inductive biases into learning frameworks and algorithms. We briefly discuss these topics and discuss some ideas proceeding in this direction.
△ Less
Submitted 7 August, 2018;
originally announced August 2018.
-
Stochastic Discontinuous Galerkin Methods (SDGM) Based on Fluctuation-Dissipation Balance
Authors:
Will Pazner,
Nathaniel Trask,
Paul J. Atzberger
Abstract:
We introduce a general framework for approximating parabolic Stochastic Partial Differential Equations (SPDEs) based on fluctuation-dissipation balance. Using this approach we formulate Stochastic Discontinuous Galerkin Methods (SDGM). We show how methods with linear-time computational complexity can be developed for handling domains with general geometry and generating stochastic terms handling b…
▽ More
We introduce a general framework for approximating parabolic Stochastic Partial Differential Equations (SPDEs) based on fluctuation-dissipation balance. Using this approach we formulate Stochastic Discontinuous Galerkin Methods (SDGM). We show how methods with linear-time computational complexity can be developed for handling domains with general geometry and generating stochastic terms handling both Dirichlet and Neumann boundary conditions. We demonstrate our approach on example systems and contrast with alternative approaches using direct stochastic discretizations based on random fluxes. We show how our Fluctuation-Dissipation Discretizations (FDD) framework allows for compensating for differences in dissipative properties of discrete numerical operators relative to their continuum counter-parts. This allows us to handle general heterogeneous discretizations capturing accurately statistical relations. Our FDD framework provides a general approach for formulating SDGM discretizations and other numerical methods for robust approximation of stochastic differential equations.
△ Less
Submitted 12 June, 2018;
originally announced June 2018.
-
Hydrodynamic Flows on Curved Surfaces: Spectral Numerical Methods for Radial Manifold Shapes
Authors:
Ben J. Gross,
Paul J. Atzberger
Abstract:
We formulate hydrodynamic equations and spectrally accurate numerical methods for investigating the role of geometry in flows within two-dimensional fluid interfaces. To achieve numerical approximations having high precision and level of symmetry for radial manifold shapes, we develop spectral Galerkin methods based on hyperinterpolation with Lebedev quadratures for $L^2$-projection to spherical h…
▽ More
We formulate hydrodynamic equations and spectrally accurate numerical methods for investigating the role of geometry in flows within two-dimensional fluid interfaces. To achieve numerical approximations having high precision and level of symmetry for radial manifold shapes, we develop spectral Galerkin methods based on hyperinterpolation with Lebedev quadratures for $L^2$-projection to spherical harmonics. We demonstrate our methods by investigating hydrodynamic responses as the surface geometry is varied. Relative to the case of a sphere, we find significant changes can occur in the observed hydrodynamic flow responses as exhibited by quantitative and topological transitions in the structure of the flow. We present numerical results based on the Rayleigh-Dissipation principle to gain further insights into these flow responses. We investigate the roles played by the geometry especially concerning the positive and negative Gaussian curvature of the interface. We provide general approaches for taking geometric effects into account for investigations of hydrodynamic phenomena within curved fluid interfaces.
△ Less
Submitted 7 June, 2018; v1 submitted 20 March, 2018;
originally announced March 2018.
-
Bayesian Inference over the Stiefel Manifold via the Givens Representation
Authors:
Arya A Pourzanjani,
Richard M Jiang,
Brian Mitchell,
Paul J Atzberger,
Linda R Petzold
Abstract:
We introduce an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens representation can be used to develop practical methods for transforming densities over the Stiefel manifold into densities over subsets of Euclidean space. We…
▽ More
We introduce an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens representation can be used to develop practical methods for transforming densities over the Stiefel manifold into densities over subsets of Euclidean space. We show how to deal with issues arising from the topology of the Stiefel manifold and how to inexpensively compute the change-of-measure terms. We introduce an auxiliary parameter approach that limits the impact of topological issues. We provide both analysis of our methods and numerical examples demonstrating the effectiveness of the approach. We also discuss how our Givens representation can be used to define general classes of distributions over the space of orthogonal matrices. We then give demonstrations on several examples showing how the Givens approach performs in practice in comparison with other methods.
△ Less
Submitted 2 November, 2019; v1 submitted 25 October, 2017;
originally announced October 2017.
-
Topological Methods for Polymeric Materials: Characterizing the Relationship Between Polymer Entanglement and Viscoelasticity
Authors:
Eleni Panagiotou,
Ken Millett,
Paul J. Atzberger
Abstract:
We develop topological methods for characterizing the relationship between polymer chain entanglement and bulk viscoelastic responses. We introduce generalized Linking Number and Writhe characteristics that are applicable to open linear chains. We investigate the rheology of polymeric chains entangled into weaves with varying topologies and levels of chain density. To investigate viscoelastic resp…
▽ More
We develop topological methods for characterizing the relationship between polymer chain entanglement and bulk viscoelastic responses. We introduce generalized Linking Number and Writhe characteristics that are applicable to open linear chains. We investigate the rheology of polymeric chains entangled into weaves with varying topologies and levels of chain density. To investigate viscoelastic responses, we perform non-equilibrium molecular simulations over a range of frequencies using sheared Lees-Edwards boundary conditions. We show how our topological characteristics can be used to capture key features of the polymer entanglements related to the viscoelastic responses. We find there is a linear relation over a significant range of frequencies between the mean absolute Writhe $Wr$ and the Loss Tangent $\tan(δ)$. We also find an approximate inverse linear relationship between the mean absolute Periodic Linking Number $LK_P$ and the Loss Tangent $\tan(δ)$. Our results show some of the ways topological methods can be used to characterize chain entanglements to better understand the origins of mechanical responses in polymeric materials.
△ Less
Submitted 30 January, 2019; v1 submitted 11 October, 2017;
originally announced October 2017.
-
Electrostatics of Colloidal Particles Confined in Nanochannels: Role of Double-Layer Interactions and Ion-Ion Correlations
Authors:
Inderbir S. Sidhu,
Amalie L. Frischknecht,
Paul J. Atzberger
Abstract:
We perform computational investigations of electrolyte-mediated interactions of charged colloidal particles confined within nanochannels. We investigate the role of discrete ion effects, valence, and electrolyte strength on colloid-wall interactions. We find for some of the multivalent charge regimes that the like-charged colloids and walls can have attractive interactions. We study in detail thes…
▽ More
We perform computational investigations of electrolyte-mediated interactions of charged colloidal particles confined within nanochannels. We investigate the role of discrete ion effects, valence, and electrolyte strength on colloid-wall interactions. We find for some of the multivalent charge regimes that the like-charged colloids and walls can have attractive interactions. We study in detail these interactions and the free energy profile for the colloid-wall separation. We find there are energy barriers and energy minima giving preferred colloid locations in the channel near the center and at a distance near to but separated from the channel walls. We characterize contributions from surface overcharging, condensed layers, and overlap of ion double-layers. We perform our investigations using Coarse-Grained Brownian Dynamics simulations (BD), classical Density Functional Theory (cDFT), and mean-field Poisson-Boltzmann Theory (PB). We discuss the implications of our results for phenomena in nanoscale devices.
△ Less
Submitted 28 March, 2018; v1 submitted 5 August, 2017;
originally announced August 2017.
-
Spectral Numerical Exterior Calculus Methods for Differential Equations on Radial Manifolds
Authors:
Ben J. Gross,
Paul J. Atzberger
Abstract:
We develop exterior calculus approaches for partial differential equations on radial manifolds. We introduce numerical methods that approximate with spectral accuracy the exterior derivative $\mathbf{d}$, Hodge star $\star$, and their compositions. To achieve discretizations with high precision and symmetry, we develop hyperinterpolation methods based on spherical harmonics and Lebedev quadrature.…
▽ More
We develop exterior calculus approaches for partial differential equations on radial manifolds. We introduce numerical methods that approximate with spectral accuracy the exterior derivative $\mathbf{d}$, Hodge star $\star$, and their compositions. To achieve discretizations with high precision and symmetry, we develop hyperinterpolation methods based on spherical harmonics and Lebedev quadrature. We perform convergence studies of our numerical exterior derivative operator $\overline{\mathbf{d}}$ and Hodge star operator $\overline{\star}$ showing each converge spectrally to $\mathbf{d}$ and $\star$. We show how the numerical operators can be naturally composed to formulate general numerical approximations for solving differential equations on manifolds. We present results for the Laplace-Beltrami equations demonstrating our approach.
△ Less
Submitted 10 March, 2017; v1 submitted 2 March, 2017;
originally announced March 2017.
-
Hydrodynamic Coupling of Particle Inclusions Embedded in Curved Lipid Bilayer Membranes
Authors:
Jon Karl Sigurdsson,
Paul J. Atzberger
Abstract:
We develop theory and computational methods to investigate particle inclusions embedded within curved lipid bilayer membranes. We consider the case of spherical lipid vesicles where inclusion particles are coupled through (i) intramembrane hydrodynamics, (ii) traction stresses with the external and trapped solvent fluid, and (iii) intermonolayer slip between the two leaflets of the bilayer. We inv…
▽ More
We develop theory and computational methods to investigate particle inclusions embedded within curved lipid bilayer membranes. We consider the case of spherical lipid vesicles where inclusion particles are coupled through (i) intramembrane hydrodynamics, (ii) traction stresses with the external and trapped solvent fluid, and (iii) intermonolayer slip between the two leaflets of the bilayer. We investigate relative to flat membranes how the membrane curvature and topology augment hydrodynamic responses. We show how both the translational and rotational mobility of protein inclusions are effected by the membrane curvature, ratio of intramembrane viscosity to solvent viscosity, and inter-monolayer slip. For general investigations of many-particle dynamics, we also discuss how our approaches can be used to treat the collective diffusion and hydrodynamic coupling within spherical bilayers.
△ Less
Submitted 24 January, 2016;
originally announced January 2016.
-
Spatially Adaptive Stochastic Methods for Fluid-Structure Interactions Subject to Thermal Fluctuations in Domains with Complex Geometries
Authors:
Pat Plunkett,
Jon Hu,
Chris Siefert,
Paul J. Atzberger
Abstract:
We develop stochastic mixed finite element methods for spatially adaptive simulations of fluid-structure interactions when subject to thermal fluctuations. To account for thermal fluctuations, we introduce a discrete fluctuation-dissipation balance condition to develop compatible stochastic driving fields for our discretization. We perform analysis that shows our condition is sufficient to ensure…
▽ More
We develop stochastic mixed finite element methods for spatially adaptive simulations of fluid-structure interactions when subject to thermal fluctuations. To account for thermal fluctuations, we introduce a discrete fluctuation-dissipation balance condition to develop compatible stochastic driving fields for our discretization. We perform analysis that shows our condition is sufficient to ensure results consistent with statistical mechanics. We show the Gibbs-Boltzmann distribution is invariant under the stochastic dynamics of the semi-discretization. To generate efficiently the required stochastic driving fields, we develop a Gibbs sampler based on iterative methods and multigrid to generate fields with $O(N)$ computational complexity. Our stochastic methods provide an alternative to uniform discretizations on periodic domains that rely on Fast Fourier Transforms. To demonstrate in practice our stochastic computational methods, we investigate within channel geometries having internal obstacles and no-slip walls how the mobility/diffusivity of particles depends on location. Our methods extend the applicability of fluctuating hydrodynamic approaches by allowing for spatially adaptive resolution of the mechanics and for domains that have complex geometries relevant in many applications.
△ Less
Submitted 22 November, 2013;
originally announced November 2013.
-
A First-Passage Kinetic Monte Carlo Method for Reaction-Drift-Diffusion Processes
Authors:
Ava J. Mauro,
Jon Karl Sigurdsson,
Justin Shrake,
Paul J. Atzberger,
Samuel A. Isaacson
Abstract:
Stochastic reaction-diffusion models are now a popular tool for studying physical systems in which both the explicit diffusion of molecules and noise in the chemical reaction process play important roles. The Smoluchowski diffusion-limited reaction model (SDLR) is one of several that have been used to study biological systems. Exact realizations of the underlying stochastic process described by th…
▽ More
Stochastic reaction-diffusion models are now a popular tool for studying physical systems in which both the explicit diffusion of molecules and noise in the chemical reaction process play important roles. The Smoluchowski diffusion-limited reaction model (SDLR) is one of several that have been used to study biological systems. Exact realizations of the underlying stochastic process described by the SDLR model can be generated by the recently proposed First-Passage Kinetic Monte Carlo (FPKMC) method. This exactness relies on sampling analytical solutions to one and two-body diffusion equations in simplified protective domains.
In this work we extend the FPKMC to allow for drift arising from fixed, background potentials. As the corresponding Fokker-Planck equations that describe the motion of each molecule can no longer be solved analytically, we develop a hybrid method that discretizes the protective domains. The discretization is chosen so that the drift-diffusion of each molecule within its protective domain is approximated by a continuous-time random walk on a lattice. New lattices are defined dynamically as the protective domains are updated, hence we will refer to our method as Dynamic Lattice FPKMC or DL-FPKMC. We focus primarily on the one-dimensional case in this manuscript, and demonstrate the numerical convergence and accuracy of our method in this case for both smooth and discontinuous potentials. We also present applications of our method, which illustrate the impact of drift on reaction kinetics.
△ Less
Submitted 24 September, 2013; v1 submitted 4 February, 2013;
originally announced February 2013.
-
Dynamic Implicit-Solvent Coarse-Grained Models of Lipid Bilayer Membranes : Fluctuating Hydrodynamics Thermostat
Authors:
Yaohong Wang,
Jon Karl Sigurdsson,
Paul J. Atzberger
Abstract:
Many coarse-grained models have been developed for equilibrium studies of lipid bilayer membranes. To achieve in simulations access to length-scales and time-scales difficult to attain in fully atomistic molecular dynamics, these coarse-grained models provide a reduced description of the molecular degrees of freedom and often remove entirely representation of the solvent degrees of freedom. In suc…
▽ More
Many coarse-grained models have been developed for equilibrium studies of lipid bilayer membranes. To achieve in simulations access to length-scales and time-scales difficult to attain in fully atomistic molecular dynamics, these coarse-grained models provide a reduced description of the molecular degrees of freedom and often remove entirely representation of the solvent degrees of freedom. In such implicit-solvent models the solvent contributions are treated through effective interaction terms within an effective potential for the free energy. For investigations of kinetics, Langevin dynamics is often used. However, for many dynamical processes within bilayers this approach is insufficient since it neglects important correlations and dynamical contributions that are missing as a result of the momentum transfer that would have occurred through the solvent. To address this issue, we introduce a new thermostat based on fluctuating hydrodynamics for dynamic simulations of implicit-solvent coarse-grained models. Our approach couples the coarse-grained degrees of freedom to a stochastic continuum field that accounts for both the solvent hydrodynamics and thermal fluctuations. We show our approach captures important correlations in the dynamics of lipid bilayers that are missing in simulations performed using conventional Langevin dynamics. For both planar bilayer sheets and bilayer vesicles, we investigate the diffusivity of lipids, spatial correlations, and lipid flow within the bilayer. The presented fluctuating hydrodynamics approaches provide a promising way to extend implicit-solvent coarse-grained lipid models for use in studies of dynamical processes within bilayers.
△ Less
Submitted 3 December, 2012;
originally announced December 2012.
-
Systematic Stochastic Reduction of Inertial Fluid-Structure Interactions subject to Thermal Fluctuations
Authors:
Gil Tabak,
Paul J. Atzberger
Abstract:
We investigate the dynamics of elastic microstructures within a fluid that are subjected to thermal fluctuations. We perform analysis to obtain systematically simplified descriptions of the mechanics in the limiting regimes when (i) the coupling forces that transfer momentum between the fluid and microstructures is strong, (ii) the mass of the microstructures is small relative to the displaced mas…
▽ More
We investigate the dynamics of elastic microstructures within a fluid that are subjected to thermal fluctuations. We perform analysis to obtain systematically simplified descriptions of the mechanics in the limiting regimes when (i) the coupling forces that transfer momentum between the fluid and microstructures is strong, (ii) the mass of the microstructures is small relative to the displaced mass of the fluid, and (iii) the response to stresses results in hydrodynamics that relax rapidly to a quasi-steady-state relative to the motions of the microstructure. We derive effective equations using a singular perturbation analysis of the Backward Kolmogorov equations of the stochastic process. Our continuum mechanics description is based on the Stochastic Eulerian Lagrangian Method (SELM) which provides a framework for approximation of the fluid-structure interactions when subject to thermal fluctuations.
△ Less
Submitted 21 October, 2023; v1 submitted 16 November, 2012;
originally announced November 2012.
-
Stochastic Eulerian Lagrangian Methods for Fluid-Structure Interactions with Thermal Fluctuations
Authors:
Paul J. Atzberger
Abstract:
We present approaches for the study of fluid-structure interactions subject to thermal fluctuations. A mixed mechanical description is utilized combining Eulerian and Lagrangian reference frames. We establish general conditions for operators coupling these descriptions. Stochastic driving fields for the formalism are derived using principles from statistical mechanics. The stochastic differential…
▽ More
We present approaches for the study of fluid-structure interactions subject to thermal fluctuations. A mixed mechanical description is utilized combining Eulerian and Lagrangian reference frames. We establish general conditions for operators coupling these descriptions. Stochastic driving fields for the formalism are derived using principles from statistical mechanics. The stochastic differential equations of the formalism are found to exhibit significant stiffness in some physical regimes. To cope with this issue, we derive reduced stochastic differential equations for several physical regimes. We also present stochastic numerical methods for each regime to approximate the fluid-structure dynamics and to generate efficiently the required stochastic driving fields. To validate the methodology in each regime, we perform analysis of the invariant probability distribution of the stochastic dynamics of the fluid-structure formalism. We compare this analysis with results from statistical mechanics. To further demonstrate the applicability of the methodology, we perform computational studies for spherical particles having translational and rotational degrees of freedom. We compare these studies with results from fluid mechanics. The presented approach provides for fluid-structure systems a set of rather general computational methods for treating consistently structure mechanics, hydrodynamic coupling, and thermal fluctuations.
△ Less
Submitted 28 September, 2010;
originally announced September 2010.
-
Spatially Adaptive Stochastic Multigrid Methods for Fluid-Structure Systems with Thermal Fluctuations
Authors:
Paul J. Atzberger
Abstract:
In microscopic mechanical systems interactions between elastic structures are often mediated by the hydrodynamics of a solvent fluid. At microscopic scales the elastic structures are also subject to thermal fluctuations. Stochastic numerical methods are developed based on multigrid which allow for the efficient computation of both the hydrodynamic interactions in the presence of walls and the th…
▽ More
In microscopic mechanical systems interactions between elastic structures are often mediated by the hydrodynamics of a solvent fluid. At microscopic scales the elastic structures are also subject to thermal fluctuations. Stochastic numerical methods are developed based on multigrid which allow for the efficient computation of both the hydrodynamic interactions in the presence of walls and the thermal fluctuations. The presented stochastic multigrid approach provides efficient real-space numerical methods for generating the required stochastic driving fields with long-range correlations consistent with statistical mechanics. The presented approach also allows for the use of spatially adaptive meshes in resolving the hydrodynamic interactions. Numerical results are presented which show the methods perform in practice with a computational complexity of O(N log(N)).
△ Less
Submitted 13 March, 2010;
originally announced March 2010.
-
A Brownian Dynamics Model of Kinesin in Three Dimensions Incorporating the Force-Extension Profile of the Coiled-Coil Cargo Tether
Authors:
P. J. Atzberger,
C. S. Peskin
Abstract:
The Kinesin family of motor proteins are involved in a variety of cellular processes that transport materials and generate force. With recent advances in experimental techniques, such as optical tweezers which can probe individual molecules, there has been an increasing interest in understanding the mechanisms by which motor proteins convert chemical energy into mechanical work. Here we present…
▽ More
The Kinesin family of motor proteins are involved in a variety of cellular processes that transport materials and generate force. With recent advances in experimental techniques, such as optical tweezers which can probe individual molecules, there has been an increasing interest in understanding the mechanisms by which motor proteins convert chemical energy into mechanical work. Here we present a mathematical model for the chemistry and three dimensional mechanics of the Kinesin motor protein which captures many of the force dependent features of the motor. For the elasticity of the tether that attaches cargo to the motor we develop a method for deriving the non-linear force-extension relationship from optical trap data. For the Kinesin heads, cargo, and microscope stage we formulate a three dimensional Brownian Dynamics model that takes into account excluded volume interactions. To efficiently compute statistics from the model an algorithm is proposed that uses a two step protocol that separates the simulation of the mechanical features of the model from the chemical kinetics of the model. Using this approach for a bead transported by the motor, the force dependent average velocity and randomness parameter are computed and compared with the experimental data.
△ Less
Submitted 29 October, 2009;
originally announced October 2009.
-
A Stochastic Immersed Boundary Method for Fluid-Structure Dynamics at Microscopic Length Scales
Authors:
P. J. Atzberger,
P. R. Kramer,
C. S. Peskin
Abstract:
In this work it is shown how the immersed boundary method of (Peskin2002) for modeling flexible structures immersed in a fluid can be extended to include thermal fluctuations. A stochastic numerical method is proposed which deals with stiffness in the system of equations by handling systematically the statistical contributions of the fastest dynamics of the fluid and immersed structures over lon…
▽ More
In this work it is shown how the immersed boundary method of (Peskin2002) for modeling flexible structures immersed in a fluid can be extended to include thermal fluctuations. A stochastic numerical method is proposed which deals with stiffness in the system of equations by handling systematically the statistical contributions of the fastest dynamics of the fluid and immersed structures over long time steps. An important feature of the numerical method is that time steps can be taken in which the degrees of freedom of the fluid are completely underresolved, partially resolved, or fully resolved while retaining a good level of accuracy. Error estimates in each of these regimes are given for the method. A number of theoretical and numerical checks are furthermore performed to assess its physical fidelity. For a conservative force, the method is found to simulate particles with the correct Boltzmann equilibrium statistics. It is shown in three dimensions that the diffusion of immersed particles simulated with the method has the correct scaling in the physical parameters. The method is also shown to reproduce a well-known hydrodynamic effect of a Brownian particle in which the velocity autocorrelation function exhibits an algebraic tau^(-3/2) decay for long times. A few preliminary results are presented for more complex systems which demonstrate some potential application areas of the method.
△ Less
Submitted 29 October, 2009;
originally announced October 2009.
-
Theoretical Framework for Microscopic Osmotic Phenomena
Authors:
P. J. Atzberger,
P. R. Kramer
Abstract:
The basic ingredients of osmotic pressure are a solvent fluid with a soluble molecular species which is restricted to a chamber by a boundary which is permeable to the solvent fluid but impermeable to the solute molecules. For macroscopic systems at equilibrium, the osmotic pressure is given by the classical van't Hoff Law, which states that the pressure is proportional to the product of the tem…
▽ More
The basic ingredients of osmotic pressure are a solvent fluid with a soluble molecular species which is restricted to a chamber by a boundary which is permeable to the solvent fluid but impermeable to the solute molecules. For macroscopic systems at equilibrium, the osmotic pressure is given by the classical van't Hoff Law, which states that the pressure is proportional to the product of the temperature and the difference of the solute concentrations inside and outside the chamber. For microscopic systems the diameter of the chamber may be comparable to the length-scale associated with the solute-wall interactions or solute molecular interactions. In each of these cases, the assumptions underlying the classical van't Hoff Law may no longer hold. In this paper we develop a general theoretical framework which captures corrections to the classical theory for the osmotic pressure under more general relationships between the size of the chamber and the interaction length scales. We also show that notions of osmotic pressure based on the hydrostatic pressure of the fluid and the mechanical pressure on the bounding walls of the chamber must be distinguished for microscopic systems. To demonstrate how the theoretical framework can be applied, numerical results are presented for the osmotic pressure associated with a polymer of N monomers confined in a spherical chamber as the bond strength is varied.
△ Less
Submitted 29 October, 2009;
originally announced October 2009.
-
Stochastic Eulerian-Lagrangian Methods for Fluid-Structure Interactions with Thermal Fluctuations and Shear Boundary Conditions
Authors:
P. J. Atzberger
Abstract:
A computational approach is introduced for the study of the rheological properties of complex fluids and soft materials. The approach allows for a consistent treatment of microstructure elastic mechanics, hydrodynamic coupling, thermal fluctuations, and externally driven shear flows. A mixed description in terms of Eulerian and Lagrangian reference frames is used for the physical system. Microst…
▽ More
A computational approach is introduced for the study of the rheological properties of complex fluids and soft materials. The approach allows for a consistent treatment of microstructure elastic mechanics, hydrodynamic coupling, thermal fluctuations, and externally driven shear flows. A mixed description in terms of Eulerian and Lagrangian reference frames is used for the physical system. Microstructure configurations are represented in a Lagrangian reference frame. Conserved quantities, such as momentum of the fluid and microstructures, are represented in an Eulerian reference frame. The mathematical formalism couples these different descriptions using general operators subject to consistency conditions. Thermal fluctuations are taken into account in the formalism by stochastic driving fields introduced in accordance with the principles of statistical mechanics. To study the rheological responses of materials subject to shear, generalized periodic boundary conditions are developed where periodic images are shifted relative to the unit cell to induce shear. Stochastic numerical methods are developed for the formalism. As a demonstration of the methods, results are presented for the shear responses of a polymeric fluid, lipid vesicle fluid, and a gel-like material.
△ Less
Submitted 29 October, 2009;
originally announced October 2009.
-
Hybrid Elastic/Discrete-Particle Approach to Biomembrane Dynamics with Application to the Mobility of Curved Integral Membrane Proteins
Authors:
Ali Naji,
Paul J. Atzberger,
Frank L. H. Brown
Abstract:
We introduce a simulation strategy to consistently couple continuum biomembrane dynamics to the motion of discrete biological macromolecules residing within or on the membrane. The methodology is used to study the diffusion of integral membrane proteins that impart a curvature on the bilayer surrounding them. Such proteins exhibit a substantial reduction in diffusion coefficient relative to "fla…
▽ More
We introduce a simulation strategy to consistently couple continuum biomembrane dynamics to the motion of discrete biological macromolecules residing within or on the membrane. The methodology is used to study the diffusion of integral membrane proteins that impart a curvature on the bilayer surrounding them. Such proteins exhibit a substantial reduction in diffusion coefficient relative to "flat" proteins; this effect is explained by elementary hydrodynamic considerations.
△ Less
Submitted 23 May, 2009;
originally announced May 2009.