-
Deep reinforcement learning for the management of the wall regeneration cycle in wall-bounded turbulent flows
Authors:
Giorgio Maria Cavallazzi,
Luca Guastoni,
Ricardo Vinuesa,
Alfredo Pinelli
Abstract:
The wall cycle in wall-bounded turbulent flows is a complex turbulence regeneration mechanism that remains not fully understood. This study explores the potential of deep reinforcement learning (DRL) for managing the wall regeneration cycle to achieve desired flow dynamics. We integrate the StableBaselines3 DRL libraries with the open-source DNS solver CaNS to create a robust platform for dynamic…
▽ More
The wall cycle in wall-bounded turbulent flows is a complex turbulence regeneration mechanism that remains not fully understood. This study explores the potential of deep reinforcement learning (DRL) for managing the wall regeneration cycle to achieve desired flow dynamics. We integrate the StableBaselines3 DRL libraries with the open-source DNS solver CaNS to create a robust platform for dynamic flow control. The DRL agent interacts with the DNS environment, learning policies that modify wall boundary conditions to optimize objectives such as the reduction of the skin-friction coefficient or the enhancement of certain coherent structures features.
Initial experiments demonstrate the capability of DRL to achieve drag-reduction rates comparable with those achieved via traditional methods, though limited to short time periods. We also propose a strategy to enhance the coherence of velocity streaks, assuming that maintaining straight streaks can inhibit instability and further reduce skin friction. The implementation makes use of the message-passing-interface (MPI) wrappers for efficient communication between the Python-based DRL agent and the DNS solver, ensuring scalability on high-performance computing architectures.
Our results highlight the promise of DRL in flow control applications and underscore the need for more advanced control laws and objective functions. Future work will focus on optimizing actuation periods and exploring new computational architectures to extend the applicability and the efficiency of DRL in turbulent flow management.
△ Less
Submitted 13 August, 2024;
originally announced August 2024.
-
Drag-reduction strategies in wall-bounded turbulent flows using deep reinforcement learning
Authors:
L. Guastoni,
J. Rabault,
H. Azizpour,
R. Vinuesa
Abstract:
In this work we compare different drag-reduction strategies that compute their actuation based on the fluctuations at a given wall-normal location in turbulent open channel flow. In order to perform this study, we implement and describe in detail the reinforcement-learning interface to a computationally-efficient, parallelized, high-fidelity solver for fluid-flow simulations. We consider oppositio…
▽ More
In this work we compare different drag-reduction strategies that compute their actuation based on the fluctuations at a given wall-normal location in turbulent open channel flow. In order to perform this study, we implement and describe in detail the reinforcement-learning interface to a computationally-efficient, parallelized, high-fidelity solver for fluid-flow simulations. We consider opposition control (Choi, Moin, and Kim, Journal of Fluid Mechanics 262, 1994) and the policies learnt using deep reinforcement learning (DRL) based on the state of the flow at two inner-scaled locations ($y^+ = 10$ and $y^+ = 15$). By using deep deterministic policy gradient (DDPG) algorithm, we are able to discover control strategies that outperform existing control methods. This represents a first step in the exploration of the capability of DRL algorithm to discover effective drag-reduction policies using information from different locations in the flow.
△ Less
Submitted 6 September, 2023;
originally announced September 2023.
-
Predicting the wall-shear stress and wall pressure through convolutional neural networks
Authors:
Arivazhagan G. Balasubramanian,
Luca Guastoni,
Philipp Schlatter,
Hossein Azizpour,
Ricardo Vinuesa
Abstract:
The objective of this study is to assess the capability of convolution-based neural networks to predict wall quantities in a turbulent open channel flow. The first tests are performed by training a fully-convolutional network (FCN) to predict the 2D velocity-fluctuation fields at the inner-scaled wall-normal location $y^{+}_{\rm target}$, using the sampled velocity fluctuations in wall-parallel pl…
▽ More
The objective of this study is to assess the capability of convolution-based neural networks to predict wall quantities in a turbulent open channel flow. The first tests are performed by training a fully-convolutional network (FCN) to predict the 2D velocity-fluctuation fields at the inner-scaled wall-normal location $y^{+}_{\rm target}$, using the sampled velocity fluctuations in wall-parallel planes located farther from the wall, at $y^{+}_{\rm input}$. The predictions from the FCN are compared against the predictions from a proposed R-Net architecture. Since the R-Net model is found to perform better than the FCN model, the former architecture is optimized to predict the 2D streamwise and spanwise wall-shear-stress components and the wall pressure from the sampled velocity-fluctuation fields farther from the wall. The dataset is obtained from DNS of open channel flow at $Re_τ = 180$ and $550$. The turbulent velocity-fluctuation fields are sampled at various inner-scaled wall-normal locations, along with the wall-shear stress and the wall pressure. At $Re_τ=550$, both FCN and R-Net can take advantage of the self-similarity in the logarithmic region of the flow and predict the velocity-fluctuation fields at $y^{+} = 50$ using the velocity-fluctuation fields at $y^{+} = 100$ as input with about 10% error in prediction of streamwise-fluctuations intensity. Further, the R-Net is also able to predict the wall-shear-stress and wall-pressure fields using the velocity-fluctuation fields at $y^+ = 50$ with around 10% error in the intensity of the corresponding fluctuations at both $Re_τ = 180$ and $550$. These results are an encouraging starting point to develop neural-network-based approaches for modelling turbulence near the wall in large-eddy simulations.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
Direct numerical simulation of a zero-pressure-gradient thermal turbulent boundary layer up to $\textrm{Pr = 6}$
Authors:
Arivazhagan G. Balasubramanian,
Luca Guastoni,
Philipp Schlatter,
Ricardo Vinuesa
Abstract:
The objective of the present study is to provide a numerical database of thermal boundary layers and to contribute to the understanding of the dynamics of passive scalars at different Prandtl numbers. In this regard, a direct numerical simulation (DNS) of an incompressible zero-pressure-gradient turbulent boundary layer is performed with the Reynolds number based on momentum thickness $Re_θ$ up to…
▽ More
The objective of the present study is to provide a numerical database of thermal boundary layers and to contribute to the understanding of the dynamics of passive scalars at different Prandtl numbers. In this regard, a direct numerical simulation (DNS) of an incompressible zero-pressure-gradient turbulent boundary layer is performed with the Reynolds number based on momentum thickness $Re_θ$ up to $1080$. Four passive scalars, characterized by the Prandtl numbers $Pr = 1,2,4,6$ are simulated with constant Dirichlet boundary conditions, using the pseudo-spectral code SIMSON (Chevalier et al. 2007). To the best of our knowledge, the present direct numerical simulation provides the thermal boundary layer with the highest Prandtl number available in the literature. It corresponds to that of water at $\sim$24$^{o}C$, when the fluid temperature is considered as a passive scalar. Turbulence statistics for the flow and thermal fields are computed and compared with available numerical simulations at similar Reynolds numbers. The mean flow and temperature profiles, root-mean squared (RMS) velocity and temperature fluctuations, turbulent heat flux, turbulent Prandtl number and higher-order statistics agree well with the numerical data reported in the literature. Furthermore, the pre-multiplied two-dimensional spectra of the velocity and of the passive scalars are computed, providing a quantitative description of the energy distribution at the different lengthscales for various wall-normal locations. The energy distribution of the heat flux fields at the wall is concentrated on longer temporal structures and exhibits different footprint at the wall, with increasing Prandtl number.
△ Less
Submitted 30 January, 2023;
originally announced January 2023.
-
Deep reinforcement learning for turbulent drag reduction in channel flows
Authors:
L. Guastoni,
J. Rabault,
P. Schlatter,
H. Azizpour,
R. Vinuesa
Abstract:
We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient, parallelized, high-fidelity fluid simulations, ready to interface with established RL agent programming interfaces. This allows for both testing existing deep rein…
▽ More
We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient, parallelized, high-fidelity fluid simulations, ready to interface with established RL agent programming interfaces. This allows for both testing existing deep reinforcement learning (DRL) algorithms against a challenging task, and advancing our knowledge of a complex, turbulent physical system that has been a major topic of research for over two centuries, and remains, even today, the subject of many unanswered questions. The control is applied in the form of blowing and suction at the wall, while the observable state is configurable, allowing to choose different variables such as velocity and pressure, in different locations of the domain. Given the complex nonlinear nature of turbulent flows, the control strategies proposed so far in the literature are physically grounded, but too simple. DRL, by contrast, enables leveraging the high-dimensional data that can be sampled from flow simulations to design advanced control strategies. In an effort to establish a benchmark for testing data-driven control strategies, we compare opposition control, a state-of-the-art turbulence-control strategy from the literature, and a commonly-used DRL algorithm, deep deterministic policy gradient. Our results show that DRL leads to 43% and 46% drag reduction in a minimal and a larger channel (at a friction Reynolds number of 180), respectively, outperforming the classical opposition control by around 20 percentage points.
△ Less
Submitted 8 February, 2023; v1 submitted 24 January, 2023;
originally announced January 2023.
-
Non-intrusive sensing in turbulent boundary layers via deep fully-convolutional neural networks
Authors:
L. Guastoni,
A. G. Balasubramanian,
A. Güemes,
A. Ianiro,
S. Discetti,
P. Schlatter,
H. Azizpour,
R. Vinuesa
Abstract:
Fully-convolutional neural networks (FCN) were proven to be effective for predicting the instantaneous state of a fully-developed turbulent flow at different wall-normal locations using quantities measured at the wall. In Guastoni et al. [J. Fluid Mech. 928, A27 (2021)], we focused on wall-shear-stress distributions as input, which are difficult to measure in experiments. In order to overcome this…
▽ More
Fully-convolutional neural networks (FCN) were proven to be effective for predicting the instantaneous state of a fully-developed turbulent flow at different wall-normal locations using quantities measured at the wall. In Guastoni et al. [J. Fluid Mech. 928, A27 (2021)], we focused on wall-shear-stress distributions as input, which are difficult to measure in experiments. In order to overcome this limitation, we introduce a model that can take as input the heat-flux field at the wall from a passive scalar. Four different Prandtl numbers $Pr = ν/α= (1,2,4,6)$ are considered (where $ν$ is the kinematic viscosity and $α$ is the thermal diffusivity of the scalar quantity). A turbulent boundary layer is simulated since accurate heat-flux measurements can be performed in experimental settings, paving the way for the implementation of a non-intrusive sensing approach for the flow in practical applications. This is particularly important for closed-loop flow control, which requires an accurate representation of the state of the flow to compute the actuation.
△ Less
Submitted 22 March, 2023; v1 submitted 11 August, 2022;
originally announced August 2022.
-
Predicting the temporal dynamics of turbulent channels through deep learning
Authors:
Giuseppe Borrelli,
Luca Guastoni,
Hamidreza Eivazi,
Philipp Schlatter,
Ricardo Vinuesa
Abstract:
The success of recurrent neural networks (RNNs) has been demonstrated in many applications related to turbulence, including flow control, optimization, turbulent features reproduction as well as turbulence prediction and modeling. With this study we aim to assess the capability of these networks to reproduce the temporal evolution of a minimal turbulent channel flow. We first obtain a data-driven…
▽ More
The success of recurrent neural networks (RNNs) has been demonstrated in many applications related to turbulence, including flow control, optimization, turbulent features reproduction as well as turbulence prediction and modeling. With this study we aim to assess the capability of these networks to reproduce the temporal evolution of a minimal turbulent channel flow. We first obtain a data-driven model based on a modal decomposition in the Fourier domain (which we denote as FFT-POD) of the time series sampled from the flow. This particular case of turbulent flow allows us to accurately simulate the most relevant coherent structures close to the wall. Long-short-term-memory (LSTM) networks and a Koopman-based framework (KNF) are trained to predict the temporal dynamics of the minimal-channel-flow modes. Tests with different configurations highlight the limits of the KNF method compared to the LSTM, given the complexity of the flow under study. Long-term prediction for LSTM show excellent agreement from the statistical point of view, with errors below 2% for the best models with respect to the reference. Furthermore, the analysis of the chaotic behaviour through the use of the Lyapunov exponents and of the dynamic behaviour through Poincaré maps emphasizes the ability of the LSTM to reproduce the temporal dynamics of turbulence. Alternative reduced-order models (ROMs), based on the identification of different turbulent structures, are explored and they continue to show a good potential in predicting the temporal dynamics of the minimal channel.
△ Less
Submitted 2 March, 2022;
originally announced March 2022.
-
Predicting the near-wall region of turbulence through convolutional neural networks
Authors:
A. G. Balasubramanian,
L. Guastoni,
A. Güemes,
A. Ianiro,
S. Discetti,
P. Schlatter,
H. Azizpour,
R. Vinuesa
Abstract:
Modelling the near-wall region of wall-bounded turbulent flows is a widespread practice to reduce the computational cost of large-eddy simulations (LESs) at high Reynolds number. As a first step towards a data-driven wall-model, a neural-network-based approach to predict the near-wall behaviour in a turbulent open channel flow is investigated. The fully-convolutional network (FCN) proposed by Guas…
▽ More
Modelling the near-wall region of wall-bounded turbulent flows is a widespread practice to reduce the computational cost of large-eddy simulations (LESs) at high Reynolds number. As a first step towards a data-driven wall-model, a neural-network-based approach to predict the near-wall behaviour in a turbulent open channel flow is investigated. The fully-convolutional network (FCN) proposed by Guastoni et al. [preprint, arXiv:2006.12483] is trained to predict the two-dimensional velocity-fluctuation fields at $y^{+}_{\rm target}$, using the sampled fluctuations in wall-parallel planes located farther from the wall, at $y^{+}_{\rm input}$. The data for training and testing is obtained from a direct numerical simulation (DNS) at friction Reynolds numbers $Re_τ = 180$ and $550$. The turbulent velocity-fluctuation fields are sampled at various wall-normal locations, i.e. $y^{+} = \{15, 30, 50, 80, 100, 120, 150\}$. At $Re_τ=550$, the FCN can take advantage of the self-similarity in the logarithmic region of the flow and predict the velocity-fluctuation fields at $y^{+} = 50$ using the velocity-fluctuation fields at $y^{+} = 100$ as input with less than 20% error in prediction of streamwise-fluctuations intensity. These results are an encouraging starting point to develop a neural-network based approach for modelling turbulence at the wall in numerical simulations.
△ Less
Submitted 18 August, 2021; v1 submitted 15 July, 2021;
originally announced July 2021.
-
Convolutional-network models to predict wall-bounded turbulence from wall quantities
Authors:
L. Guastoni,
A. Güemes,
A. Ianiro,
S. Discetti,
P. Schlatter,
H. Azizpour,
R. Vinuesa
Abstract:
Two models based on convolutional neural networks are trained to predict the two-dimensional velocity-fluctuation fields at different wall-normal locations in a turbulent open channel flow, using the wall-shear-stress components and the wall pressure as inputs. The first model is a fully-convolutional neural network (FCN) which directly predicts the fluctuations, while the second one reconstructs…
▽ More
Two models based on convolutional neural networks are trained to predict the two-dimensional velocity-fluctuation fields at different wall-normal locations in a turbulent open channel flow, using the wall-shear-stress components and the wall pressure as inputs. The first model is a fully-convolutional neural network (FCN) which directly predicts the fluctuations, while the second one reconstructs the flow fields using a linear combination of orthonormal basis functions, obtained through proper orthogonal decomposition (POD), hence named FCN-POD. Both models are trained using data from two direct numerical simulations (DNS) at friction Reynolds numbers $Re_τ = 180$ and $550$. Thanks to their ability to predict the nonlinear interactions in the flow, both models show a better prediction performance than the extended proper orthogonal decomposition (EPOD), which establishes a linear relation between input and output fields. The performance of the various models is compared based on predictions of the instantaneous fluctuation fields, turbulence statistics and power-spectral densities. The FCN exhibits the best predictions closer to the wall, whereas the FCN-POD model provides better predictions at larger wall-normal distances. We also assessed the feasibility of performing transfer learning for the FCN model, using the weights from $Re_τ=180$ to initialize those of the $Re_τ=550$ case. Our results indicate that it is possible to obtain a performance similar to that of the reference model up to $y^{+}=50$, with $50\%$ and $25\%$ of the original training data. These non-intrusive sensing models will play an important role in applications related to closed-loop control of wall-bounded turbulence.
△ Less
Submitted 22 June, 2020;
originally announced June 2020.
-
Recurrent neural networks and Koopman-based frameworks for temporal predictions in a low-order model of turbulence
Authors:
Hamidreza Eivazi,
Luca Guastoni,
Philipp Schlatter,
Hossein Azizpour,
Ricardo Vinuesa
Abstract:
The capabilities of recurrent neural networks and Koopman-based frameworks are assessed in the prediction of temporal dynamics of the low-order model of near-wall turbulence by Moehlis et al. (New J. Phys. 6, 56, 2004). Our results show that it is possible to obtain excellent reproductions of the long-term statistics and the dynamic behavior of the chaotic system with properly trained long-short-t…
▽ More
The capabilities of recurrent neural networks and Koopman-based frameworks are assessed in the prediction of temporal dynamics of the low-order model of near-wall turbulence by Moehlis et al. (New J. Phys. 6, 56, 2004). Our results show that it is possible to obtain excellent reproductions of the long-term statistics and the dynamic behavior of the chaotic system with properly trained long-short-term memory (LSTM) networks, leading to relative errors in the mean and the fluctuations below $1\%$. Besides, a newly developed Koopman-based framework, called Koopman with nonlinear forcing (KNF), leads to the same level of accuracy in the statistics at a significantly lower computational expense. Furthermore, the KNF framework outperforms the LSTM network when it comes to short-term predictions. We also observe that using a loss function based only on the instantaneous predictions of the chaotic system can lead to suboptimal reproductions in terms of long-term statistics. Thus, we propose a model-selection criterion based on the computed statistics which allows to achieve excellent statistical reconstruction even on small datasets, with minimal loss of accuracy in the instantaneous predictions.
△ Less
Submitted 14 April, 2021; v1 submitted 1 May, 2020;
originally announced May 2020.
-
On the use of recurrent neural networks for predictions of turbulent flows
Authors:
Luca Guastoni,
Prem A. Srinivasan,
Hossein Azizpour,
Philipp Schlatter,
Ricardo Vinuesa
Abstract:
In this paper, the prediction capabilities of recurrent neural networks are assessed in the low-order model of near-wall turbulence by Moehlis {\it et al.} (New J. Phys. {\bf 6}, 56, 2004). Our results show that it is possible to obtain excellent predictions of the turbulence statistics and the dynamic behavior of the flow with properly trained long short-term memory (LSTM) networks, leading to re…
▽ More
In this paper, the prediction capabilities of recurrent neural networks are assessed in the low-order model of near-wall turbulence by Moehlis {\it et al.} (New J. Phys. {\bf 6}, 56, 2004). Our results show that it is possible to obtain excellent predictions of the turbulence statistics and the dynamic behavior of the flow with properly trained long short-term memory (LSTM) networks, leading to relative errors in the mean and the fluctuations below $1\%$. We also observe that using a loss function based only on the instantaneous predictions of the flow may not lead to the best predictions in terms of turbulence statistics, and it is necessary to define a stopping criterion based on the computed statistics. Furthermore, more sophisticated loss functions, including not only the instantaneous predictions but also the averaged behavior of the flow, may lead to much faster neural network training.
△ Less
Submitted 4 February, 2020;
originally announced February 2020.
-
Prediction of wall-bounded turbulence from wall quantities using convolutional neural networks
Authors:
L. Guastoni,
M. P. Encinar,
P. Schlatter,
H. Azizpour,
R. Vinuesa
Abstract:
A fully-convolutional neural-network model is used to predict the streamwise velocity fields at several wall-normal locations by taking as input the streamwise and spanwise wall-shear-stress planes in a turbulent open channel flow. The training data are generated by performing a direct numerical simulation (DNS) at a friction Reynolds number of $Re_τ=180$. Various networks are trained for predicti…
▽ More
A fully-convolutional neural-network model is used to predict the streamwise velocity fields at several wall-normal locations by taking as input the streamwise and spanwise wall-shear-stress planes in a turbulent open channel flow. The training data are generated by performing a direct numerical simulation (DNS) at a friction Reynolds number of $Re_τ=180$. Various networks are trained for predictions at three inner-scaled locations ($y^+ = 15,~30,~50$) and for different time steps between input samples $Δt^{+}_{s}$. The inherent non-linearity of the neural-network model enables a better prediction capability than linear methods, with a lower error in both the instantaneous flow fields and turbulent statistics. Using a dataset with higher $Δt^+_{s}$ improves the generalization at all the considered wall-normal locations, as long as the network capacity is sufficient to generalize over the dataset. The use of a multiple-output network, with parallel dedicated branches for two wall-normal locations, does not provide any improvement over two separated single-output networks, other than a moderate saving in training time. Training time can be effectively reduced, by a factor of 4, via a transfer learning method that initializes the network parameters using the optimized parameters of a previously-trained network.
△ Less
Submitted 30 December, 2019;
originally announced December 2019.
-
Predictions of turbulent shear flows using deep neural networks
Authors:
P. A. Srinivasan,
L. Guastoni,
H. Azizpour,
P. Schlatter,
R. Vinuesa
Abstract:
In the present work we assess the capabilities of neural networks to predict temporally evolving turbulent flows. In particular, we use the nine-equation shear flow model by Moehlis et al. [New J. Phys. 6, 56 (2004)] to generate training data for two types of neural networks: the multilayer perceptron (MLP) and the long short-term memory (LSTM) network. We tested a number of neural network archite…
▽ More
In the present work we assess the capabilities of neural networks to predict temporally evolving turbulent flows. In particular, we use the nine-equation shear flow model by Moehlis et al. [New J. Phys. 6, 56 (2004)] to generate training data for two types of neural networks: the multilayer perceptron (MLP) and the long short-term memory (LSTM) network. We tested a number of neural network architectures by varying the number of layers, number of units per layer, dimension of the input, weight initialization and activation functions in order to obtain the best configurations for flow prediction. Due to its ability to exploit the sequential nature of the data, the LSTM network outperformed the MLP. The LSTM led to excellent predictions of turbulence statistics (with relative errors of 0.45% and 2.49% in mean and fluctuating quantities, respectively) and of the dynamical behavior of the system (characterized by Poincaré maps and Lyapunov exponents). This is an exploratory study where we consider a low-order representation of near-wall turbulence. Based on the present results, the proposed machine-learning framework may underpin future applications aimed at developing accurate and efficient data-driven subgrid-scale models for large-eddy simulations of more complex wall-bounded turbulent flows, including channels and developing boundary layers.
△ Less
Submitted 7 May, 2019;
originally announced May 2019.
