DNS: Data-driven Nonlinear Smoother for Complex Model-free Process

• URL: http://arxiv.org/abs/2602.08560v1
• Date: Mon, 09 Feb 2026 11:57:46 GMT
• Title: DNS: Data-driven Nonlinear Smoother for Complex Model-free Process
• Abstract summary: We propose a data-driven nonlinear smoother (DNS) to estimate a hidden state sequence from a noisy, linear measurement sequence.<n>DNS learns in an unsupervised manner, meaning the training dataset consists of only measurement data and no state data.<n> Experimental results show that the DNS is significantly better than a deep Kalman smoother (DKS) and an iterative data-driven nonlinear state estimation (iDANSE) smoother.
• Score: 11.427765730918034
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose data-driven nonlinear smoother (DNS) to estimate a hidden state sequence of a complex dynamical process from a noisy, linear measurement sequence. The dynamical process is model-free, that is, we do not have any knowledge of the nonlinear dynamics of the complex process. There is no state-transition model (STM) of the process available. The proposed DNS uses a recurrent architecture that helps to provide a closed-form posterior of the hidden state sequence given the measurement sequence. DNS learns in an unsupervised manner, meaning the training dataset consists of only measurement data and no state data. We demonstrate DNS using simulations for smoothing of several stochastic dynamical processes, including a benchmark Lorenz system. Experimental results show that the DNS is significantly better than a deep Kalman smoother (DKS) and an iterative data-driven nonlinear state estimation (iDANSE) smoother.

Related papers

• Disordered Dynamics in High Dimensions: Connections to Random Matrices and Machine Learning [52.26396748560348]
  We provide an overview of high dimensional dynamical systems driven by random matrices.<n>We focus on applications to simple models of learning and generalization in machine learning theory.
  arXiv  Detail & Related papers  (2026-01-03T00:12:32Z)
• pDANSE: Particle-based Data-driven Nonlinear State Estimation from Nonlinear Measurements [55.95348868409957]
  We consider the problem of designing a data-driven nonlinear state estimation (DANSE) method that uses (noisy) nonlinear measurements.<n>A recurrent neural network (RNN) provides parameters of a Gaussian prior that characterize the state of the model-free process.<n>The second-order statistics of the state posterior are computed using the nonlinear measurements observed at the time point.
  arXiv  Detail & Related papers  (2025-10-31T14:26:48Z)
• oRANS: Online optimisation of RANS machine learning models with embedded DNS data generation [0.0]
  Closures trained in the conventional offline paradigm tend to overfit and fail to generalise to new regimes.<n>We introduce an online optimisation framework for DL-based Navier-Stokes (RANS) closures which seeks to address the challenge of limited high-fidelity datasets.
  arXiv  Detail & Related papers  (2025-10-03T13:19:01Z)
• Data Denoising and Derivative Estimation for Data-Driven Modeling of Nonlinear Dynamical Systems [7.364096151612954]
  Data-driven modeling of nonlinear dynamical systems is often hampered by measurement noise.<n>We propose a denoising framework that represents the state trajectory with an implicit neural representation fitted directly to noisy observations.<n>Experiments demonstrate effective noise suppression, precise derivative estimation, and reliable system identification.
  arXiv  Detail & Related papers  (2025-09-17T17:51:43Z)
• Semi-Supervised Model-Free Bayesian State Estimation from Compressed Measurements [57.04370580292727]
  We consider data-driven Bayesian state estimation from compressed measurements.<n>The dimension of the temporal measurement vector is lower than that of the temporal state vector to be estimated.<n>The underlying dynamical model of the state's evolution is unknown for a'model-free process'
  arXiv  Detail & Related papers  (2024-07-10T05:03:48Z)
• Dynamic Deep Learning LES Closures: Online Optimization With Embedded DNS [0.0]
  We develop a new online training method for deep learning closure models in large-eddy simulation (LES) Deep learning closure model is dynamically trained during LES calculation using embedded direct numerical simulation (DNS) data. An online optimization algorithm is developed to dynamically train the deep learning closure model in the coupled, LES-embedded DNS calculation.
  arXiv  Detail & Related papers  (2023-03-04T06:20:47Z)
• Score-based Diffusion Models in Function Space [137.70916238028306]
  Diffusion models have recently emerged as a powerful framework for generative modeling.<n>This work introduces a mathematically rigorous framework called Denoising Diffusion Operators (DDOs) for training diffusion models in function space.<n>We show that the corresponding discretized algorithm generates accurate samples at a fixed cost independent of the data resolution.
  arXiv  Detail & Related papers  (2023-02-14T23:50:53Z)
• Neural Abstractions [72.42530499990028]
  We present a novel method for the safety verification of nonlinear dynamical models that uses neural networks to represent abstractions of their dynamics. We demonstrate that our approach performs comparably to the mature tool Flow* on existing benchmark nonlinear models.
  arXiv  Detail & Related papers  (2023-01-27T12:38:09Z)
• A Priori Denoising Strategies for Sparse Identification of Nonlinear Dynamical Systems: A Comparative Study [68.8204255655161]
  We investigate and compare the performance of several local and global smoothing techniques to a priori denoise the state measurements. We show that, in general, global methods, which use the entire measurement data set, outperform local methods, which employ a neighboring data subset around a local point.
  arXiv  Detail & Related papers  (2022-01-29T23:31:25Z)
• Reconstructing High-resolution Turbulent Flows Using Physics-Guided Neural Networks [3.9548535445908928]
  Direct numerical simulation (DNS) of turbulent flows is computationally expensive and cannot be applied to flows with large Reynolds numbers. Large eddy simulation (LES) is an alternative that is computationally less demanding, but is unable to capture all of the scales of turbulent transport accurately. We build a new data-driven methodology based on super-resolution techniques to reconstruct DNS data from LES predictions.
  arXiv  Detail & Related papers  (2021-09-06T03:01:24Z)
• Neural ODE Processes [64.10282200111983]
  We introduce Neural ODE Processes (NDPs), a new class of processes determined by a distribution over Neural ODEs. We show that our model can successfully capture the dynamics of low-dimensional systems from just a few data-points.
  arXiv  Detail & Related papers  (2021-03-23T09:32:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.