Improved Surrogate Modeling of Fluid Dynamics with Physics-Informed
Neural Networks
- URL: http://arxiv.org/abs/2105.01838v1
- Date: Wed, 5 May 2021 02:23:20 GMT
- Title: Improved Surrogate Modeling of Fluid Dynamics with Physics-Informed
Neural Networks
- Authors: Jian Cheng Wong, Chinchun Ooi, Pao-Hsiung Chiu, My Ha Dao
- Abstract summary: PINNs have recently shown great promise as a way of incorporating physics-based domain knowledge, including fundamental governing equations, into neural network models.
Here, we explore the use of this modeling methodology to surrogate modeling of a fluid dynamical system.
We show that the inclusion of a physics-based regularization term can substantially improve the equivalent data-driven surrogate model.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Physics-Informed Neural Networks (PINNs) have recently shown great promise as
a way of incorporating physics-based domain knowledge, including fundamental
governing equations, into neural network models for many complex engineering
systems. They have been particularly effective in the area of inverse problems,
where boundary conditions may be ill-defined, and data-absent scenarios, where
typical supervised learning approaches will fail. Here, we further explore the
use of this modeling methodology to surrogate modeling of a fluid dynamical
system, and demonstrate additional undiscussed and interesting advantages of
such a modeling methodology over conventional data-driven approaches: 1)
improving the model's predictive performance even with incomplete description
of the underlying physics; 2) improving the robustness of the model to noise in
the dataset; 3) reduced effort to convergence during optimization for a new,
previously unseen scenario by transfer optimization of a pre-existing model.
Hence, we noticed the inclusion of a physics-based regularization term can
substantially improve the equivalent data-driven surrogate model in many
substantive ways, including an order of magnitude improvement in test error
when the dataset is very noisy, and a 2-3x improvement when only partial
physics is included. In addition, we propose a novel transfer optimization
scheme for use in such surrogate modeling scenarios and demonstrate an
approximately 3x improvement in speed to convergence and an order of magnitude
improvement in predictive performance over conventional Xavier initialization
for training of new scenarios.
Related papers
- Generalized Factor Neural Network Model for High-dimensional Regression [50.554377879576066]
We tackle the challenges of modeling high-dimensional data sets with latent low-dimensional structures hidden within complex, non-linear, and noisy relationships.
Our approach enables a seamless integration of concepts from non-parametric regression, factor models, and neural networks for high-dimensional regression.
arXiv Detail & Related papers (2025-02-16T23:13:55Z) - Hybrid Adaptive Modeling using Neural Networks Trained with Nonlinear Dynamics Based Features [5.652228574188242]
This paper introduces a novel approach that departs from standard techniques by uncovering information from nonlinear dynamical modeling and embedding it in data-based models.
By explicitly incorporating nonlinear dynamic phenomena through perturbation methods, the predictive capabilities are more realistic and insightful compared to knowledge obtained from brute-force numerical simulations.
arXiv Detail & Related papers (2025-01-21T02:38:28Z) - An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training [50.71892161377806]
DFIT-OccWorld is an efficient 3D occupancy world model that leverages decoupled dynamic flow and image-assisted training strategy.
Our model forecasts future dynamic voxels by warping existing observations using voxel flow, whereas static voxels are easily obtained through pose transformation.
arXiv Detail & Related papers (2024-12-18T12:10:33Z) - Solving Inverse Problems with Model Mismatch using Untrained Neural Networks within Model-based Architectures [14.551812310439004]
We introduce an untrained forward model residual block within the model-based architecture to match the data consistency in the measurement domain for each instance.
Our approach offers a unified solution that is less parameter-sensitive, requires no additional data, and enables simultaneous fitting of the forward model and reconstruction in a single pass.
arXiv Detail & Related papers (2024-03-07T19:02:13Z) - Enhancing Dynamical System Modeling through Interpretable Machine
Learning Augmentations: A Case Study in Cathodic Electrophoretic Deposition [0.8796261172196743]
We introduce a comprehensive data-driven framework aimed at enhancing the modeling of physical systems.
As a demonstrative application, we pursue the modeling of cathodic electrophoretic deposition (EPD), commonly known as e-coating.
arXiv Detail & Related papers (2024-01-16T14:58:21Z) - Physics Informed Piecewise Linear Neural Networks for Process
Optimization [0.0]
It is proposed to upgrade piece-wise linear neural network models with physics informed knowledge for optimization problems with neural network models embedded.
For all cases, physics-informed trained neural network based optimal results are closer to global optimality.
arXiv Detail & Related papers (2023-02-02T10:14:54Z) - When to Update Your Model: Constrained Model-based Reinforcement
Learning [50.74369835934703]
We propose a novel and general theoretical scheme for a non-decreasing performance guarantee of model-based RL (MBRL)
Our follow-up derived bounds reveal the relationship between model shifts and performance improvement.
A further example demonstrates that learning models from a dynamically-varying number of explorations benefit the eventual returns.
arXiv Detail & Related papers (2022-10-15T17:57:43Z) - Human Trajectory Prediction via Neural Social Physics [63.62824628085961]
Trajectory prediction has been widely pursued in many fields, and many model-based and model-free methods have been explored.
We propose a new method combining both methodologies based on a new Neural Differential Equation model.
Our new model (Neural Social Physics or NSP) is a deep neural network within which we use an explicit physics model with learnable parameters.
arXiv Detail & Related papers (2022-07-21T12:11:18Z) - Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate
Model Predictive Trajectory Tracking [76.27433308688592]
Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation.
We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience.
Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
arXiv Detail & Related papers (2022-06-07T13:51:35Z) - Multi-Objective Physics-Guided Recurrent Neural Networks for Identifying
Non-Autonomous Dynamical Systems [0.0]
We propose a physics-guided hybrid approach for modeling non-autonomous systems under control.
This is extended by a recurrent neural network and trained using a sophisticated multi-objective strategy.
Experiments conducted on real data reveal substantial accuracy improvements by our approach compared to a physics-based model.
arXiv Detail & Related papers (2022-04-27T14:33:02Z) - Automatically Learning Compact Quality-aware Surrogates for Optimization
Problems [55.94450542785096]
Solving optimization problems with unknown parameters requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values.
Recent work has shown that including the optimization problem as a layer in a complex training model pipeline results in predictions of iteration of unobserved decision making.
We show that we can improve solution quality by learning a low-dimensional surrogate model of a large optimization problem.
arXiv Detail & Related papers (2020-06-18T19:11:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.