Robust Regression with Highly Corrupted Data via Physics Informed Neural Networks

• URL: http://arxiv.org/abs/2210.10646v1
• Date: Wed, 19 Oct 2022 15:21:05 GMT
• Title: Robust Regression with Highly Corrupted Data via Physics Informed Neural Networks
• Authors: Wei Peng and Wen Yao and Weien Zhou and Xiaoya Zhang and Weijie Yao
• Abstract summary: Physics-informed neural networks (PINNs) have been proposed to solve two main classes of problems. We show the generalizability, accuracy and efficiency of the proposed algorithms for recovering governing equations from noisy and corrupted measurement data.
• Score: 4.642273921499256
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Physics-informed neural networks (PINNs) have been proposed to solve two main classes of problems: data-driven solutions and data-driven discovery of partial differential equations. This task becomes prohibitive when such data is highly corrupted due to the possible sensor mechanism failing. We propose the Least Absolute Deviation based PINN (LAD-PINN) to reconstruct the solution and recover unknown parameters in PDEs - even if spurious data or outliers corrupt a large percentage of the observations. To further improve the accuracy of recovering hidden physics, the two-stage Median Absolute Deviation based PINN (MAD-PINN) is proposed, where LAD-PINN is employed as an outlier detector followed by MAD screening out the highly corrupted data. Then the vanilla PINN or its variants can be subsequently applied to exploit the remaining normal data. Through several examples, including Poisson's equation, wave equation, and steady or unsteady Navier-Stokes equations, we illustrate the generalizability, accuracy and efficiency of the proposed algorithms for recovering governing equations from noisy and highly corrupted measurement data.

Related papers

• Data-Guided Physics-Informed Neural Networks for Solving Inverse Problems in Partial Differential Equations [3.231578125191615]
  Physics-informed neural networks (PINNs) represent a significant advancement in machine learning. PINNs have been successfully applied to solve various forward and inverse problems in partial differential equations (PDEs) This study proposes a novel framework termed data-guided physics-informed neural networks (DG-PINNs)
  arXiv  Detail & Related papers  (2024-07-15T15:47:24Z)
• Correcting model misspecification in physics-informed neural networks (PINNs) [2.07180164747172]
  We present a general approach to correct the misspecified physical models in PINNs for discovering governing equations. We employ other deep neural networks (DNNs) to model the discrepancy between the imperfect models and the observational data. We envision that the proposed approach will extend the applications of PINNs for discovering governing equations in problems where the physico-chemical or biological processes are not well understood.
  arXiv  Detail & Related papers  (2023-10-16T19:25:52Z)
• Deep Neural Networks Tend To Extrapolate Predictably [51.303814412294514]
  neural network predictions tend to be unpredictable and overconfident when faced with out-of-distribution (OOD) inputs. We observe that neural network predictions often tend towards a constant value as input data becomes increasingly OOD. We show how one can leverage our insights in practice to enable risk-sensitive decision-making in the presence of OOD inputs.
  arXiv  Detail & Related papers  (2023-10-02T03:25:32Z)
• Predictive Limitations of Physics-Informed Neural Networks in Vortex Shedding [0.0]
  We look at the flow around a 2D cylinder and find that data-free PINNs are unable to predict vortex shedding. Data-driven PINN exhibits vortex shedding only while the training data is available, but reverts to the steady state solution when the data flow stops. The distribution of the Koopman eigenvalues on the complex plane suggests that PINN is numerically dispersive and diffusive.
  arXiv  Detail & Related papers  (2023-05-31T22:59:52Z)
• On the uncertainty analysis of the data-enabled physics-informed neural network for solving neutron diffusion eigenvalue problem [4.0275959184316825]
  We investigate the performance of DEPINN in calculating the neutron diffusion eigenvalue problem from several perspectives. In order to reduce the effect of noise and improve the utilization of the noisy prior data, we propose innovative interval loss functions. This paper confirms the feasibility of the improved DEPINN for practical engineering applications in nuclear reactor physics.
  arXiv  Detail & Related papers  (2023-03-15T08:59:03Z)
• Implicit Stochastic Gradient Descent for Training Physics-informed Neural Networks [51.92362217307946]
  Physics-informed neural networks (PINNs) have effectively been demonstrated in solving forward and inverse differential equation problems. PINNs are trapped in training failures when the target functions to be approximated exhibit high-frequency or multi-scale features. In this paper, we propose to employ implicit gradient descent (ISGD) method to train PINNs for improving the stability of training process.
  arXiv  Detail & Related papers  (2023-03-03T08:17:47Z)
• Physics-Informed Neural Network Method for Parabolic Differential Equations with Sharply Perturbed Initial Conditions [68.8204255655161]
  We develop a physics-informed neural network (PINN) model for parabolic problems with a sharply perturbed initial condition. Localized large gradients in the ADE solution make the (common in PINN) Latin hypercube sampling of the equation's residual highly inefficient. We propose criteria for weights in the loss function that produce a more accurate PINN solution than those obtained with the weights selected via other methods.
  arXiv  Detail & Related papers  (2022-08-18T05:00:24Z)
• Auto-PINN: Understanding and Optimizing Physics-Informed Neural Architecture [77.59766598165551]
  Physics-informed neural networks (PINNs) are revolutionizing science and engineering practice by bringing together the power of deep learning to bear on scientific computation. Here, we propose Auto-PINN, which employs Neural Architecture Search (NAS) techniques to PINN design. A comprehensive set of pre-experiments using standard PDE benchmarks allows us to probe the structure-performance relationship in PINNs.
  arXiv  Detail & Related papers  (2022-05-27T03:24:31Z)
• Physics-Informed Neural Operator for Learning Partial Differential Equations [55.406540167010014]
  PINO is the first hybrid approach incorporating data and PDE constraints at different resolutions to learn the operator. The resulting PINO model can accurately approximate the ground-truth solution operator for many popular PDE families.
  arXiv  Detail & Related papers  (2021-11-06T03:41:34Z)
• Bayesian Deep Learning for Partial Differential Equation Parameter Discovery with Sparse and Noisy Data [0.0]
  We propose to use Bayesian neural networks (BNN) in order to recover the full system states from measurement data. We show that it is possible to accurately capture physics of varying complexity without overfitting. We demonstrate our approach on a handful of example applied to physics and non-linear dynamics.
  arXiv  Detail & Related papers  (2021-08-05T19:43:15Z)
• HYDRA: Hypergradient Data Relevance Analysis for Interpreting Deep Neural Networks [51.143054943431665]
  We propose Hypergradient Data Relevance Analysis, or HYDRA, which interprets predictions made by deep neural networks (DNNs) as effects of their training data. HYDRA assesses the contribution of training data toward test data points throughout the training trajectory. In addition, we quantitatively demonstrate that HYDRA outperforms influence functions in accurately estimating data contribution and detecting noisy data labels.
  arXiv  Detail & Related papers  (2021-02-04T10:00:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.