Entropy stable conservative flux form neural networks
- URL: http://arxiv.org/abs/2411.01746v1
- Date: Mon, 04 Nov 2024 02:01:31 GMT
- Title: Entropy stable conservative flux form neural networks
- Authors: Lizuo Liu, Tongtong Li, Anne Gelb, Yoonsang Lee,
- Abstract summary: We propose an entropy-stable conservative flux form neural network (CFN) that integrates classical numerical conservation laws into a data-driven framework.
Numerical experiments demonstrate that the entropy-stable CFN achieves both stability and conservation while maintaining accuracy over extended time domains.
- Score: 3.417730578086946
- License:
- Abstract: We propose an entropy-stable conservative flux form neural network (CFN) that integrates classical numerical conservation laws into a data-driven framework using the entropy-stable, second-order, and non-oscillatory Kurganov-Tadmor (KT) scheme. The proposed entropy-stable CFN uses slope limiting as a denoising mechanism, ensuring accurate predictions in both noisy and sparse observation environments, as well as in both smooth and discontinuous regions. Numerical experiments demonstrate that the entropy-stable CFN achieves both stability and conservation while maintaining accuracy over extended time domains. Furthermore, it successfully predicts shock propagation speeds in long-term simulations, {\it without} oracle knowledge of later-time profiles in the training data.
Related papers
- Convergence of mean-field Langevin dynamics: Time and space
discretization, stochastic gradient, and variance reduction [49.66486092259376]
The mean-field Langevin dynamics (MFLD) is a nonlinear generalization of the Langevin dynamics that incorporates a distribution-dependent drift.
Recent works have shown that MFLD globally minimizes an entropy-regularized convex functional in the space of measures.
We provide a framework to prove a uniform-in-time propagation of chaos for MFLD that takes into account the errors due to finite-particle approximation, time-discretization, and gradient approximation.
arXiv Detail & Related papers (2023-06-12T16:28:11Z) - Machine learning in and out of equilibrium [58.88325379746631]
Our study uses a Fokker-Planck approach, adapted from statistical physics, to explore these parallels.
We focus in particular on the stationary state of the system in the long-time limit, which in conventional SGD is out of equilibrium.
We propose a new variation of Langevin dynamics (SGLD) that harnesses without replacement minibatching.
arXiv Detail & Related papers (2023-06-06T09:12:49Z) - Privacy Risk for anisotropic Langevin dynamics using relative entropy
bounds [1.911678487931003]
We show how anisotropic noise can lead to better privacy-accuracy trade-offs.
We show how anisotropic noise can lead to better privacy-accuracy trade-offs.
arXiv Detail & Related papers (2023-02-01T21:32:22Z) - Forecasting subcritical cylinder wakes with Fourier Neural Operators [58.68996255635669]
We apply a state-of-the-art operator learning technique to forecast the temporal evolution of experimentally measured velocity fields.
We find that FNOs are capable of accurately predicting the evolution of experimental velocity fields throughout the range of Reynolds numbers tested.
arXiv Detail & Related papers (2023-01-19T20:04:36Z) - Ensemble Reservoir Computing for Dynamical Systems: Prediction of
Phase-Space Stable Region for Hadron Storage Rings [0.0]
Echo State Networks (ESN) are a class of recurrent neural networks that are computationally effective.
We present the performance reached by ESN based on the prediction of the phase-space stability region.
We observe that the proposed ESN approach is capable of effectively predicting the time evolution of the extent of the dynamic aperture.
arXiv Detail & Related papers (2023-01-17T10:29:07Z) - Real-time high-resolution CO$_2$ geological storage prediction using
nested Fourier neural operators [58.728312684306545]
Carbon capture and storage (CCS) plays an essential role in global decarbonization.
Scaling up CCS deployment requires accurate and high-resolution modeling of the storage reservoir pressure buildup and the gaseous plume migration.
We introduce Nested Fourier Neural Operator (FNO), a machine-learning framework for high-resolution dynamic 3D CO2 storage modeling at a basin scale.
arXiv Detail & Related papers (2022-10-31T04:04:03Z) - Clean two-dimensional Floquet time-crystal [68.8204255655161]
We consider the two-dimensional quantum Ising model, in absence of disorder, subject to periodic imperfect global spin flips.
We show by a combination of exact diagonalization and tensor-network methods that the system can sustain a spontaneously broken discrete time-translation symmetry.
We observe a non-perturbative change in the decay rate of the order parameter, which is related to the long-lived stability of the magnetic domains in 2D.
arXiv Detail & Related papers (2022-05-10T13:04:43Z) - Role of stochastic noise and generalization error in the time
propagation of neural-network quantum states [0.0]
Neural-network quantum states (NQS) have been shown to be a suitable variational ansatz to simulate out-of-equilibrium dynamics.
We show that stable and accurate time propagation can be achieved in regimes of sufficiently regularized variational dynamics.
arXiv Detail & Related papers (2021-05-03T17:55:09Z) - Stochastically forced ensemble dynamic mode decomposition for
forecasting and analysis of near-periodic systems [65.44033635330604]
We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system.
We show that its use of intrinsic linear dynamics offers a number of desirable properties in terms of interpretability and parsimony.
Results are presented for a test case using load data from an electrical grid.
arXiv Detail & Related papers (2020-10-08T20:25:52Z) - Inference, Prediction, and Entropy-Rate Estimation of Continuous-time,
Discrete-event Processes [0.0]
Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground.
Here, we provide new methods for inferring, predicting, and estimating them.
arXiv Detail & Related papers (2020-05-07T20:54:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.