Multi-agent reinforcement learning for wall modeling in LES of flow over periodic hills

• URL: http://arxiv.org/abs/2211.16427v1
• Date: Tue, 29 Nov 2022 17:57:36 GMT
• Title: Multi-agent reinforcement learning for wall modeling in LES of flow over periodic hills
• Authors: Di Zhou, Michael P. Whitmore, Kevin P. Griffin, H. Jane Bae
• Abstract summary: We develop a wall model for large-eddy simulation (LES) that takes into account various pressure-gradient effects using multi-agent reinforcement learning (MARL) The model is trained using low-Reynolds-number flow over periodic hills with agents distributed on the wall along the computational grid points. The analysis of the trained model indicates that the model is capable of distinguishing between the various pressure gradient regimes present in the flow.
• Score: 9.804725867671264
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We develop a wall model for large-eddy simulation (LES) that takes into account various pressure-gradient effects using multi-agent reinforcement learning (MARL). The model is trained using low-Reynolds-number flow over periodic hills with agents distributed on the wall along the computational grid points. The model utilizes a wall eddy-viscosity formulation as the boundary condition, which is shown to provide better predictions of the mean velocity field, rather than the typical wall-shear stress formulation. Each agent receives states based on local instantaneous flow quantities at an off-wall location, computes a reward based on the estimated wall-shear stress, and provides an action to update the wall eddy viscosity at each time step. The trained wall model is validated in wall-modeled LES (WMLES) of flow over periodic hills at higher Reynolds numbers, and the results show the effectiveness of the model on flow with pressure gradients. The analysis of the trained model indicates that the model is capable of distinguishing between the various pressure gradient regimes present in the flow.

Related papers

• A deep learning approach to wall-shear stress quantification: From numerical training to zero-shot experimental application [2.2284889035802036]
  We introduce a deep learning architecture that ingests wall-parallel velocity fields from the logarithmic layer of turbulent wall-bounded flows. The presented framework lays the groundwork for extracting inaccessible experimental wall-shear stress information from readily available velocity measurements.
  arXiv  Detail & Related papers  (2024-09-05T22:59:23Z)
• Provable Statistical Rates for Consistency Diffusion Models [87.28777947976573]
  Despite the state-of-the-art performance, diffusion models are known for their slow sample generation due to the extensive number of steps involved. This paper contributes towards the first statistical theory for consistency models, formulating their training as a distribution discrepancy minimization problem.
  arXiv  Detail & Related papers  (2024-06-23T20:34:18Z)
• Generative Modeling with Phase Stochastic Bridges [49.4474628881673]
  Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. We introduce a novel generative modeling framework grounded in textbfphase space dynamics Our framework demonstrates the capability to generate realistic data points at an early stage of dynamics propagation.
  arXiv  Detail & Related papers  (2023-10-11T18:38:28Z)
• Modeling the space-time correlation of pulsed twin beams [68.8204255655161]
  Entangled twin-beams generated by parametric down-conversion are among the favorite sources for imaging-oriented applications. We propose a semi-analytic model which aims to bridge the gap between time-consuming numerical simulations and the unrealistic plane-wave pump theory.
  arXiv  Detail & Related papers  (2023-01-18T11:29:49Z)
• Deep Learning Closure Models for Large-Eddy Simulation of Flows around Bluff Bodies [0.0]
  deep learning model for large-eddy simulation (LES) is developed and evaluated for incompressible flows around a rectangular cylinder at moderate Reynolds numbers. DL-LES model is trained using adjoint PDE optimization methods to match, as closely as possible, direct numerical simulation (DNS) data. We study the accuracy of the DL-LES model for predicting the drag coefficient, mean flow, and Reynolds stress.
  arXiv  Detail & Related papers  (2022-08-06T11:25:50Z)
• How Much is Enough? A Study on Diffusion Times in Score-based Generative Models [76.76860707897413]
  Current best practice advocates for a large T to ensure that the forward dynamics brings the diffusion sufficiently close to a known and simple noise distribution. We show how an auxiliary model can be used to bridge the gap between the ideal and the simulated forward dynamics, followed by a standard reverse diffusion process.
  arXiv  Detail & Related papers  (2022-06-10T15:09:46Z)
• Posterior Coreset Construction with Kernelized Stein Discrepancy for Model-Based Reinforcement Learning [78.30395044401321]
  We develop a novel model-based approach to reinforcement learning (MBRL) It relaxes the assumptions on the target transition model to belong to a generic family of mixture models. It can achieve up-to 50 percent reduction in wall clock time in some continuous control environments.
  arXiv  Detail & Related papers  (2022-06-02T17:27:49Z)
• Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Loss [6.381149074212898]
  We present a lightweight neural model for remote heart rate estimation. We focus on the efficient-temporal learning of facial photoplethysmography. Compared to existing models, our approach shows competitive accuracy with a much lower number of parameters and lower computational cost.
  arXiv  Detail & Related papers  (2022-03-21T11:08:06Z)
• Embedded training of neural-network sub-grid-scale turbulence models [0.0]
  The weights of a deep neural network model are optimized in conjunction with the governing flow equations to provide a model for sub-grid-scale stresses. The training is by a gradient descent method, which uses the adjoint Navier-Stokes equations to provide the end-to-end sensitivities of the model weights to the velocity fields.
  arXiv  Detail & Related papers  (2021-05-03T17:28:39Z)
• Machine learning for rapid discovery of laminar flow channel wall modifications that enhance heat transfer [56.34005280792013]
  We present a combination of accurate numerical simulations of arbitrary, flat, and non-flat channels and machine learning models predicting drag coefficient and Stanton number. We show that convolutional neural networks (CNN) can accurately predict the target properties at a fraction of the time of numerical simulations.
  arXiv  Detail & Related papers  (2021-01-19T16:14:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.