-
Transferring a molecular foundation model for polymer property predictions
Authors:
Pei Zhang,
Logan Kearney,
Debsindhu Bhowmik,
Zachary Fox,
Amit K. Naskar,
John Gounley
Abstract:
Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and materials discovery. Self-supervised pretraining of transformer models requires large-scale datasets, which are often sparsely populated in topical areas such as polymer science. State-of-the-art approaches for polymers conduct data augmentation to gener…
▽ More
Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and materials discovery. Self-supervised pretraining of transformer models requires large-scale datasets, which are often sparsely populated in topical areas such as polymer science. State-of-the-art approaches for polymers conduct data augmentation to generate additional samples but unavoidably incurs extra computational costs. In contrast, large-scale open-source datasets are available for small molecules and provide a potential solution to data scarcity through transfer learning. In this work, we show that using transformers pretrained on small molecules and fine-tuned on polymer properties achieve comparable accuracy to those trained on augmented polymer datasets for a series of benchmark prediction tasks.
△ Less
Submitted 25 October, 2023;
originally announced October 2023.
-
Episodic fluid venting from sedimentary basins fuelled by pressurised mudstones
Authors:
Luke M. Kearney,
Richard F. Katz,
Christopher W. MacMinn,
Chris Kirkham,
Joe Cartwright
Abstract:
Subsurface sandstone reservoirs sealed by overlying, low-permeability layers provide capacity for long-term sequestration of anthropogenic waste. Leakage can occur if reservoir pressures rise sufficiently to fracture the seal. Such pressures can be generated within the reservoir by vigorous injection of waste or, over thousands of years, by natural processes. In either case, the precise role of in…
▽ More
Subsurface sandstone reservoirs sealed by overlying, low-permeability layers provide capacity for long-term sequestration of anthropogenic waste. Leakage can occur if reservoir pressures rise sufficiently to fracture the seal. Such pressures can be generated within the reservoir by vigorous injection of waste or, over thousands of years, by natural processes. In either case, the precise role of intercalated mudstones in the long-term evolution of reservoir pressure remains unclear; these layers have variously been viewed as seals, as pressure sinks or as pressure sources. Here, we use the geological record of episodic fluid venting in the Levant Basin to provide striking evidence for the pressure-source hypothesis. We use a Bayesian framework to combine recently published venting data, which record critical subsurface pressures since $\sim$2~Ma, with a stochastic model of pressure evolution to infer a pressure-recharge rate of $\sim$30~MPa/Myr. To explain this large rate, we quantify and compare a range of candidate mechanisms. We find that poroelastic pressure diffusion from mudstones provides the most plausible explanation for these observations, amplifying the $\sim$3~MPa/Myr recharge caused primarily by tectonic compression. Since pressurised mudstones are ubiquitous in sedimentary basins, pressure diffusion from mudstones is likely to promote seal failure globally.
△ Less
Submitted 2 February, 2024; v1 submitted 29 June, 2023;
originally announced June 2023.
-
Episodic, compression-driven fluid venting in layered sedimentary basins
Authors:
Luke M. Kearney,
Christopher W. MacMinn,
Richard F. Katz,
Chris Kirkham,
Joe Cartwright
Abstract:
Fluid venting phenomena are prevalent in sedimentary basins globally. Offshore, these localised fluid-expulsion events are archived in the geologic record by the resulting pockmarks at the sea-floor. Venting is widely interpreted to occur via hydraulic fracturing, which requires near-lithostatic pore pressures for initiation. One common driver for these extreme pressures is horizontal tectonic com…
▽ More
Fluid venting phenomena are prevalent in sedimentary basins globally. Offshore, these localised fluid-expulsion events are archived in the geologic record by the resulting pockmarks at the sea-floor. Venting is widely interpreted to occur via hydraulic fracturing, which requires near-lithostatic pore pressures for initiation. One common driver for these extreme pressures is horizontal tectonic compression, which pressurises the entire sedimentary column over a wide region. Fluid expulsion leads to a sudden, local relief of this pressure, which then gradually recharges through continued compression, leading to episodic venting. Pressure recharge will also occur through pressure diffusion from neighbouring regions that remain pressurised, but the combined role of compression and pressure diffusion in episodic venting has not previously been considered. Here, we develop a novel poroelastic model for episodic, compression-driven venting. We show that compression and pressure diffusion together set the resulting venting period. We derive a simple analytical expression for this venting period, demonstrating that pressure diffusion can significantly reduce the venting period associated with a given rate of compression. Our expression allows this rate of compression to be inferred from observations of episodic venting. We conclude that pressure diffusion is a major contributor to episodic fluid venting in mudstone-dominated basins.
△ Less
Submitted 31 May, 2023; v1 submitted 7 October, 2022;
originally announced October 2022.
-
The effect of solidification direction with respect to gravity on ice-templated TiO2 micro-structures
Authors:
Kristen L. Scotti,
Lauren G. Kearney,
Jared Burns,
Matthew Ocana,
Lucas Duros,
Aaron Shelhamer,
David C. Dunand
Abstract:
Ice-templating produces materials with aligned, elongated pores via directional solidification of particle suspensions, sublimation of the solidified fluid, and sintering of the particle walls. Most ice-templating studies utilize upward solidification techniques, where solid ice is located at the bottom of the solidification mold, the liquid suspension is on top of the ice, and the solidification…
▽ More
Ice-templating produces materials with aligned, elongated pores via directional solidification of particle suspensions, sublimation of the solidified fluid, and sintering of the particle walls. Most ice-templating studies utilize upward solidification techniques, where solid ice is located at the bottom of the solidification mold, the liquid suspension is on top of the ice, and the solidification front advances upward, against gravity. Liquid water reaches its maximum density at 4°C; thus, liquid nearest the cold source is less dense than warmer liquid above. The lower density liquid nearest the cold source is expected to rise due to buoyancy, promoting convective fluid motion during solidification. Here, we investigate the effect of solidification direction with respect to the direction of gravity on ice-templated microstructures to study the role of buoyancy-driven fluid motion during solidification. We hypothesize that, for upward solidification, the convective fluid motion that results from a liquid density gradient occurs near the solidification front. For downward solidification, we expect that this fluid motion occurs farther away from the solidification front. Aqueous suspensions of TiO2 nanoparticles are solidified upward (against gravity, with ice on bottom and water on top), downward (water on bottom, ice on top), and horizontally (perpendicular to gravity). Microstructural investigation of sintered samples shows evidence of buoyancy-driven, convective fluid flow during solidification for samples solidified upwards (against gravity), including tilting of the wall (and pore) orientation with respect to the induced temperature gradient, ice lens defects, and radial macrosegregation. These features are not observed for downward nor horizontal solidification configurations.
△ Less
Submitted 28 December, 2018;
originally announced December 2018.
