Residual-based physics-informed transfer learning: A hybrid method for
accelerating long-term CFD simulations via deep learning
- URL: http://arxiv.org/abs/2206.06817v3
- Date: Sun, 26 Nov 2023 21:59:47 GMT
- Title: Residual-based physics-informed transfer learning: A hybrid method for
accelerating long-term CFD simulations via deep learning
- Authors: Joongoo Jeon, Juhyeong Lee, Ricardo Vinuesa, Sung Joong Kim
- Abstract summary: The feasibility of RePIT strategy was verified through a CFD case study on natural convection.
Our RePIT strategy is a promising technique to reduce the cost of CFD simulations in industry.
- Score: 0.9217021281095907
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: While a big wave of artificial intelligence (AI) has propagated to the field
of computational fluid dynamics (CFD) acceleration studies, recent research has
highlighted that the development of AI techniques that reconciles the following
goals remains our primary task: (1) accurate prediction of unseen (future) time
series in long-term CFD simulations (2) acceleration of simulations (3) an
acceptable amount of training data and time (4) within a multiple PDEs
condition. In this study, we propose a residual-based physics-informed transfer
learning (RePIT) strategy to achieve these four objectives using ML-CFD hybrid
computation. Our hypothesis is that long-term CFD simulation is feasible with
the hybrid method where CFD and AI alternately calculate time series while
monitoring the first principle's residuals. The feasibility of RePIT strategy
was verified through a CFD case study on natural convection. In a single
training approach, a residual scale change occurred around 100th timestep,
resulting in predicted time series exhibiting non-physical patterns as well as
a significant deviations from the ground truth. Conversely, RePIT strategy
maintained the residuals within the defined range and demonstrated good
accuracy throughout the entire simulation period. The maximum error from the
ground truth was below 0.4 K for temperature and 0.024 m/s for x-axis velocity.
Furthermore, the average time for 1 timestep by the ML-GPU and CFD-CPU
calculations was 0.171 s and 0.015 s, respectively. Including the
parameter-updating time, the simulation was accelerated by a factor of 1.9. In
conclusion, our RePIT strategy is a promising technique to reduce the cost of
CFD simulations in industry. However, more vigorous optimization and
improvement studies are still necessary.
Related papers
- Beyond Force Metrics: Pre-Training MLFFs for Stable MD Simulations [5.913538953257869]
Machine-learning force fields (MLFFs) have emerged as a promising solution for speeding up ab initio molecular dynamics (MD) simulations.<n>In this work, we employ GemNet-T, a graph neural network model, as an MLFF and investigate two training strategies.<n>We find that lower force errors do not necessarily guarantee stable MD simulations.
arXiv Detail & Related papers (2025-06-17T00:58:56Z) - Hybrid Neural-MPM for Interactive Fluid Simulations in Real-Time [57.30651532625017]
We present a novel hybrid method that integrates numerical simulation, neural physics, and generative control.<n>Our system demonstrates robust performance across diverse 2D/3D scenarios, material types, and obstacle interactions.<n>We promise to release both models and data upon acceptance.
arXiv Detail & Related papers (2025-05-25T01:27:18Z) - Accelerating Transient CFD through Machine Learning-Based Flow Initialization [0.9754425335596745]
We present a machine learning-based initialization method that aims to reduce the cost of transient solve by providing more accurate initial fields.<n>We demonstrate 50% reductions in time-to-convergence compared to traditional uniform and potential flow-based initializations.
arXiv Detail & Related papers (2025-03-20T00:51:59Z) - Comparison of CNN-based deep learning architectures for unsteady CFD acceleration on small datasets [0.0]
This study compares advanced convolutional neural network (CNN) architectures for accelerating unsteady computational fluid dynamics (CFD) simulations.
CNNs were evaluated under identical conditions to determine their predictive accuracy and robustness in autoregressive time-series predictions.
ConvLSTM-UNet consistently outperformed other models, particularly in difference value calculation, achieving lower maximum errors and stable residuals.
arXiv Detail & Related papers (2025-02-06T03:30:49Z) - MultiPDENet: PDE-embedded Learning with Multi-time-stepping for Accelerated Flow Simulation [48.41289705783405]
We propose a PDE-embedded network with multiscale time stepping (MultiPDENet)
In particular, we design a convolutional filter based on the structure of finite difference with a small number of parameters to optimize.
A Physics Block with a 4th-order Runge-Kutta integrator at the fine time scale is established that embeds the structure of PDEs to guide the prediction.
arXiv Detail & Related papers (2025-01-27T12:15:51Z) - FlowTS: Time Series Generation via Rectified Flow [67.41208519939626]
FlowTS is an ODE-based model that leverages rectified flow with straight-line transport in probability space.
For unconditional setting, FlowTS achieves state-of-the-art performance, with context FID scores of 0.019 and 0.011 on Stock and ETTh datasets.
For conditional setting, we have achieved superior performance in solar forecasting.
arXiv Detail & Related papers (2024-11-12T03:03:23Z) - Trajectory Flow Matching with Applications to Clinical Time Series Modeling [77.58277281319253]
Trajectory Flow Matching (TFM) trains a Neural SDE in a simulation-free manner, bypassing backpropagation through the dynamics.
We demonstrate improved performance on three clinical time series datasets in terms of absolute performance and uncertainty prediction.
arXiv Detail & Related papers (2024-10-28T15:54:50Z) - Coupling Machine Learning Local Predictions with a Computational Fluid Dynamics Solver to Accelerate Transient Buoyant Plume Simulations [0.0]
This study presents a versatile and scalable hybrid methodology, combining CFD and machine learning.
The objective was to leverage local features to predict the temporal changes in the pressure field in comparable scenarios.
Pressure estimates were employed as initial values to accelerate the pressure-velocity coupling procedure.
arXiv Detail & Related papers (2024-09-11T10:38:30Z) - Inverse-Free Fast Natural Gradient Descent Method for Deep Learning [52.0693420699086]
We present a fast natural gradient descent (FNGD) method that only requires inversion during the first epoch.
FNGD exhibits similarities to the average sum in first-order methods, leading to the computational complexity of FNGD being comparable to that of first-order methods.
arXiv Detail & Related papers (2024-03-06T05:13:28Z) - A Multi-Grained Symmetric Differential Equation Model for Learning Protein-Ligand Binding Dynamics [73.35846234413611]
In drug discovery, molecular dynamics (MD) simulation provides a powerful tool for predicting binding affinities, estimating transport properties, and exploring pocket sites.
We propose NeuralMD, the first machine learning (ML) surrogate that can facilitate numerical MD and provide accurate simulations in protein-ligand binding dynamics.
We demonstrate the efficiency and effectiveness of NeuralMD, achieving over 1K$times$ speedup compared to standard numerical MD simulations.
arXiv Detail & Related papers (2024-01-26T09:35:17Z) - Simulation-free Schr\"odinger bridges via score and flow matching [89.4231207928885]
We present simulation-free score and flow matching ([SF]$2$M)
Our method generalizes both the score-matching loss used in the training of diffusion models and the recently proposed flow matching loss used in the training of continuous flows.
Notably, [SF]$2$M is the first method to accurately model cell dynamics in high dimensions and can recover known gene regulatory networks simulated data.
arXiv Detail & Related papers (2023-07-07T15:42:35Z) - Learning Controllable Adaptive Simulation for Multi-resolution Physics [86.8993558124143]
We introduce Learning controllable Adaptive simulation for Multi-resolution Physics (LAMP) as the first full deep learning-based surrogate model.
LAMP consists of a Graph Neural Network (GNN) for learning the forward evolution, and a GNN-based actor-critic for learning the policy of spatial refinement and coarsening.
We demonstrate that our LAMP outperforms state-of-the-art deep learning surrogate models, and can adaptively trade-off computation to improve long-term prediction error.
arXiv Detail & Related papers (2023-05-01T23:20:27Z) - Learning to Accelerate Partial Differential Equations via Latent Global
Evolution [64.72624347511498]
Latent Evolution of PDEs (LE-PDE) is a simple, fast and scalable method to accelerate the simulation and inverse optimization of PDEs.
We introduce new learning objectives to effectively learn such latent dynamics to ensure long-term stability.
We demonstrate up to 128x reduction in the dimensions to update, and up to 15x improvement in speed, while achieving competitive accuracy.
arXiv Detail & Related papers (2022-06-15T17:31:24Z) - Demystifying the Data Need of ML-surrogates for CFD Simulations [3.0168882791480978]
We propose an ML-based surrogate model to predict the temperature distribution inside the cabin of a passenger vehicle.
Our results show that the prediction accuracy is high and stable even when the training size is gradually reduced from 2000 to 200.
Even when only 50 CFD simulations are used for training, the temperature trend predicted by the ML-surrogate matches quite well with the results from CFD simulations.
arXiv Detail & Related papers (2022-05-05T04:37:59Z) - Real-time simulation of parameter-dependent fluid flows through deep
learning-based reduced order models [0.2538209532048866]
Reduced order models (ROMs) provide reliable approximations to parameter-dependent fluid dynamics problems in rapid times.
Deep learning (DL)-based ROMs overcome all these limitations by learning in a non-intrusive way both the nonlinear trial manifold and the reduced dynamics.
The resulting POD-DL-ROMs are shown to provide accurate results in almost real-time for the flow around a cylinder benchmark, the fluid-structure interaction between an elastic beam attached to a fixed, rigid block and a laminar incompressible flow, and the blood flow in a cerebral aneurysm.
arXiv Detail & Related papers (2021-06-10T13:07:33Z) - Finite volume method network for acceleration of unsteady computational
fluid dynamics: non-reacting and reacting flows [0.0]
A neural network model with a unique network architecture and physics-informed loss function was developed to accelerate CFD simulations.
Under the reacting flow dataset, the computational speed of this network model was measured to be about 10 times faster than that of the CFD solver.
arXiv Detail & Related papers (2021-05-07T15:33:49Z) - A Physics-Constrained Deep Learning Model for Simulating Multiphase Flow
in 3D Heterogeneous Porous Media [1.4050836886292868]
A physics-constrained deep learning model is developed for solving multiphase flow in 3D heterogeneous porous media.
The model is trained from physics-based simulation data and emulates the physics process.
The model performs prediction with a speedup of 1400 times compared to physics-based simulations.
arXiv Detail & Related papers (2021-04-30T02:15:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.