Physics guided machine learning using simplified theories
- URL: http://arxiv.org/abs/2012.13343v1
- Date: Fri, 18 Dec 2020 21:30:40 GMT
- Title: Physics guided machine learning using simplified theories
- Authors: Suraj Pawar, Omer San, Burak Aksoylu, Adil Rasheed, Trond Kvamsdal
- Abstract summary: Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences.
We introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Recent applications of machine learning, in particular deep learning,
motivate the need to address the generalizability of the statistical inference
approaches in physical sciences. In this letter, we introduce a modular physics
guided machine learning framework to improve the accuracy of such data-driven
predictive engines. The chief idea in our approach is to augment the knowledge
of the simplified theories with the underlying learning process. To emphasise
on their physical importance, our architecture consists of adding certain
features at intermediate layers rather than in the input layer. To demonstrate
our approach, we select a canonical airfoil aerodynamic problem with the
enhancement of the potential flow theory. We include features obtained by a
panel method that can be computed efficiently for an unseen configuration in
our training procedure. By addressing the generalizability concerns, our
results suggest that the proposed feature enhancement approach can be
effectively used in many scientific machine learning applications, especially
for the systems where we can use a theoretical, empirical, or simplified model
to guide the learning module.
Related papers
- Understanding Machine Learning Paradigms through the Lens of Statistical Thermodynamics: A tutorial [0.0]
The tutorial delves into advanced techniques like entropy, free energy, and variational inference which are utilized in machine learning.
We show how an in-depth comprehension of physical systems' behavior can yield more effective and dependable machine learning models.
arXiv Detail & Related papers (2024-11-24T18:20:05Z) - Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond [61.18736646013446]
In pursuit of a deeper understanding of its surprising behaviors, we investigate the utility of a simple yet accurate model of a trained neural network.
Across three case studies, we illustrate how it can be applied to derive new empirical insights on a diverse range of prominent phenomena.
arXiv Detail & Related papers (2024-10-31T22:54:34Z) - Mechanistic Neural Networks for Scientific Machine Learning [58.99592521721158]
We present Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences.
It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential equations as representations.
Central to our approach is a novel Relaxed Linear Programming solver (NeuRLP) inspired by a technique that reduces solving linear ODEs to solving linear programs.
arXiv Detail & Related papers (2024-02-20T15:23:24Z) - Interpretable Meta-Learning of Physical Systems [4.343110120255532]
Recent meta-learning methods rely on black-box neural networks, resulting in high computational costs and limited interpretability.
We argue that multi-environment generalization can be achieved using a simpler learning model, with an affine structure with respect to the learning task.
We demonstrate the competitive generalization performance and the low computational cost of our method by comparing it to state-of-the-art algorithms on physical systems.
arXiv Detail & Related papers (2023-12-01T10:18:50Z) - A Survey on Physics Informed Reinforcement Learning: Review and Open
Problems [25.3906503332344]
We present a review of the literature on incorporating physics information, as known as physics priors, in reinforcement learning approaches.
We introduce a novel taxonomy with the reinforcement learning pipeline as the backbone to classify existing works.
This nascent field holds great potential for enhancing reinforcement learning algorithms by increasing their physical plausibility, precision, data efficiency, and applicability in real-world scenarios.
arXiv Detail & Related papers (2023-09-05T02:45:18Z) - Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate
Model Predictive Trajectory Tracking [76.27433308688592]
Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation.
We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience.
Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
arXiv Detail & Related papers (2022-06-07T13:51:35Z) - The Potential of Machine Learning to Enhance Computational Fluid
Dynamics [0.696194614504832]
Machine learning is rapidly becoming a core technology for scientific computing.
This paper highlights some of the areas of highest potential impact, including to accelerate direct numerical simulations.
It is essential for the community to continue to establish benchmark systems and best practices for open-source software.
arXiv Detail & Related papers (2021-10-05T14:34:16Z) - Model-Based Deep Learning [155.063817656602]
Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques.
Deep neural networks (DNNs) use generic architectures which learn to operate from data, and demonstrate excellent performance.
We are interested in hybrid techniques that combine principled mathematical models with data-driven systems to benefit from the advantages of both approaches.
arXiv Detail & Related papers (2020-12-15T16:29:49Z) - Using machine-learning modelling to understand macroscopic dynamics in a
system of coupled maps [0.0]
We consider a case study the macroscopic motion emerging from a system of globally coupled maps.
We build a coarse-grained Markov process for the macroscopic dynamics both with a machine learning approach and with a direct numerical computation of the transition probability of the coarse-grained process.
We are able to infer important information about the effective dimension of the attractor, the persistence of memory effects and the multi-scale structure of the dynamics.
arXiv Detail & Related papers (2020-11-08T15:38:12Z) - A general framework for scientifically inspired explanations in AI [76.48625630211943]
We instantiate the concept of structure of scientific explanation as the theoretical underpinning for a general framework in which explanations for AI systems can be implemented.
This framework aims to provide the tools to build a "mental-model" of any AI system so that the interaction with the user can provide information on demand and be closer to the nature of human-made explanations.
arXiv Detail & Related papers (2020-03-02T10:32:21Z) - Information Theoretic Model Predictive Q-Learning [64.74041985237105]
We present a novel theoretical connection between information theoretic MPC and entropy regularized RL.
We develop a Q-learning algorithm that can leverage biased models.
arXiv Detail & Related papers (2019-12-31T00:29:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.