A Surrogate Data Assimilation Model for the Estimation of Dynamical
System in a Limited Area
- URL: http://arxiv.org/abs/2307.07178v1
- Date: Fri, 14 Jul 2023 06:10:00 GMT
- Title: A Surrogate Data Assimilation Model for the Estimation of Dynamical
System in a Limited Area
- Abstract summary: We propose a learning-based surrogate data assimilation model for efficient state estimation in a limited area.
Our model employs a feedforward neural network for online computation, eliminating the need for integrating high-dimensional limited-area models.
- Score: 12.849290207344422
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We propose a novel learning-based surrogate data assimilation (DA) model for
efficient state estimation in a limited area. Our model employs a feedforward
neural network for online computation, eliminating the need for integrating
high-dimensional limited-area models. This approach offers significant
computational advantages over traditional DA algorithms. Furthermore, our
method avoids the requirement of lateral boundary conditions for the
limited-area model in both online and offline computations. The design of our
surrogate DA model is built upon a robust theoretical framework that leverages
two fundamental concepts: observability and effective region. The concept of
observability enables us to quantitatively determine the optimal amount of
observation data necessary for accurate DA. Meanwhile, the concept of effective
region substantially reduces the computational burden associated with computing
observability and generating training data.
Related papers
- Direct Advantage Estimation for Scalable and Sample-efficient Deep Reinforcement Learning [54.916555668983726]
We introduce discrete latent dynamics models that efficiently approximate transition probabilities.<n>We find that DAE scales effectively with function approximator capacity while retaining high sample efficiency.
arXiv Detail & Related papers (2026-06-18T15:58:48Z) - Hybrid twinning using PBDW and DeepONet for the effective state estimation and prediction on partially known systems [0.0]
We propose an effective hybrid approach that combines physics-based modeling with data-driven learning to enhance state estimation.<n>We validate the proposed approach on a representative problem involving the Helmholtz equation.
arXiv Detail & Related papers (2025-12-03T12:19:00Z) - Data-Driven Surrogate Modeling Techniques to Predict the Effective Contact Area of Rough Surface Contact Problems [39.979007027634196]
The effective contact area plays a critical role in multi-physics phenomena such as wear, sealing, and thermal or electrical conduction.
This study proposes a surrogate modeling framework for predicting the effective contact area using fast-to-evaluate data-driven techniques.
arXiv Detail & Related papers (2025-04-24T08:15:46Z) - OTClean: Data Cleaning for Conditional Independence Violations using
Optimal Transport [51.6416022358349]
sys is a framework that harnesses optimal transport theory for data repair under Conditional Independence (CI) constraints.
We develop an iterative algorithm inspired by Sinkhorn's matrix scaling algorithm, which efficiently addresses high-dimensional and large-scale data.
arXiv Detail & Related papers (2024-03-04T18:23:55Z) - A novel data generation scheme for surrogate modelling with deep
operator networks [0.0]
We propose a novel methodology to alleviate the computational burden associated with training data generation for DeepONets.
Unlike existing literature, the proposed framework for data generation does not use any partial differential equation integration strategy.
The proposed methodology can be extended to other operator learning methods, making the approach widely applicable.
arXiv Detail & Related papers (2024-02-24T14:42:42Z) - Large-Scale OD Matrix Estimation with A Deep Learning Method [70.78575952309023]
The proposed method integrates deep learning and numerical optimization algorithms to infer matrix structure and guide numerical optimization.
We conducted tests to demonstrate the good generalization performance of our method on a large-scale synthetic dataset.
arXiv Detail & Related papers (2023-10-09T14:30:06Z) - Towards a Better Theoretical Understanding of Independent Subnetwork Training [56.24689348875711]
We take a closer theoretical look at Independent Subnetwork Training (IST)
IST is a recently proposed and highly effective technique for solving the aforementioned problems.
We identify fundamental differences between IST and alternative approaches, such as distributed methods with compressed communication.
arXiv Detail & Related papers (2023-06-28T18:14:22Z) - Neural Fields with Hard Constraints of Arbitrary Differential Order [61.49418682745144]
We develop a series of approaches for enforcing hard constraints on neural fields.
The constraints can be specified as a linear operator applied to the neural field and its derivatives.
Our approaches are demonstrated in a wide range of real-world applications.
arXiv Detail & Related papers (2023-06-15T08:33:52Z) - Learnability of Competitive Threshold Models [11.005966612053262]
We study the learnability of the competitive threshold model from a theoretical perspective.
We demonstrate how competitive threshold models can be seamlessly simulated by artificial neural networks.
arXiv Detail & Related papers (2022-05-08T01:11:51Z) - Scalable computation of prediction intervals for neural networks via
matrix sketching [79.44177623781043]
Existing algorithms for uncertainty estimation require modifying the model architecture and training procedure.
This work proposes a new algorithm that can be applied to a given trained neural network and produces approximate prediction intervals.
arXiv Detail & Related papers (2022-05-06T13:18:31Z) - Safe Continuous Control with Constrained Model-Based Policy Optimization [0.0]
We introduce a model-based safe exploration algorithm for constrained high-dimensional control.
We also introduce a practical algorithm that accelerates policy search with model-generated data.
arXiv Detail & Related papers (2021-04-14T15:20:55Z) - COMBO: Conservative Offline Model-Based Policy Optimization [120.55713363569845]
Uncertainty estimation with complex models, such as deep neural networks, can be difficult and unreliable.
We develop a new model-based offline RL algorithm, COMBO, that regularizes the value function on out-of-support state-actions.
We find that COMBO consistently performs as well or better as compared to prior offline model-free and model-based methods.
arXiv Detail & Related papers (2021-02-16T18:50:32Z) - A probabilistic generative model for semi-supervised training of
coarse-grained surrogates and enforcing physical constraints through virtual
observables [3.8073142980733]
This paper provides a flexible, probabilistic framework that accounts for physical structure and information both in the training objectives and in the surrogate model itself.
We advocate a probabilistic model in which equalities that are available from the physics can be introduced as virtual observables and can provide additional information through the likelihood.
arXiv Detail & Related papers (2020-06-02T17:14:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.