Non-Asymptotic Bounds for Closed-Loop Identification of Unstable Nonlinear Stochastic Systems

• URL: http://arxiv.org/abs/2412.04157v1
• Date: Thu, 05 Dec 2024 13:45:35 GMT
• Title: Non-Asymptotic Bounds for Closed-Loop Identification of Unstable Nonlinear Stochastic Systems
• Authors: Seth Siriya, Jingge Zhu, Dragan Nešić, Ye Pu,
• Abstract summary: We consider the problem of least squares parameter estimation from single-trajectory data. We establish non-asymptotic guarantees on the estimation error at times where the state trajectory evolves in this region. If the whole state space is informative, high probability guarantees on the error hold for all times.
• Score: 5.102311052155507
• License:
• Abstract: We consider the problem of least squares parameter estimation from single-trajectory data for discrete-time, unstable, closed-loop nonlinear stochastic systems, with linearly parameterised uncertainty. Assuming a region of the state space produces informative data, and the system is sub-exponentially unstable, we establish non-asymptotic guarantees on the estimation error at times where the state trajectory evolves in this region. If the whole state space is informative, high probability guarantees on the error hold for all times. Examples are provided where our results are useful for analysis, but existing results are not.

Related papers

• Real-Time Tube-Based Non-Gaussian Risk Bounded Motion Planning for Stochastic Nonlinear Systems in Uncertain Environments via Motion Primitives [9.088960941718]
  We consider the motion planning problem for nonlinear systems in uncertain environments. Unlike [1], we present a real-time online motion planning algorithm. We verify the safety of the tubes against deterministic risk using sum-of-squares programming.
  arXiv  Detail & Related papers  (2023-03-02T23:36:26Z)
• Non-Gaussian Uncertainty Minimization Based Control of Stochastic Nonlinear Robotic Systems [9.088960941718]
  We design a state feedback controller that minimizes deviations of the states of the system from the nominal state trajectories due to uncertainties and disturbances. We use moments and characteristic functions to propagate uncertainties throughout the nonlinear motion model of robotic systems.
  arXiv  Detail & Related papers  (2023-03-02T23:31:32Z)
• Information-Theoretic Safe Exploration with Gaussian Processes [89.31922008981735]
  We consider a sequential decision making task where we are not allowed to evaluate parameters that violate an unknown (safety) constraint. Most current methods rely on a discretization of the domain and cannot be directly extended to the continuous case. We propose an information-theoretic safe exploration criterion that directly exploits the GP posterior to identify the most informative safe parameters to evaluate.
  arXiv  Detail & Related papers  (2022-12-09T15:23:58Z)
• Numerically Stable Sparse Gaussian Processes via Minimum Separation using Cover Trees [57.67528738886731]
  We study the numerical stability of scalable sparse approximations based on inducing points. For low-dimensional tasks such as geospatial modeling, we propose an automated method for computing inducing points satisfying these conditions.
  arXiv  Detail & Related papers  (2022-10-14T15:20:17Z)
• Finite Sample Identification of Bilinear Dynamical Systems [29.973598501311233]
  We show how to estimate the unknown bilinear system up to a desired accuracy with high probability. Our sample complexity and statistical error rates are optimal in terms of the trajectory length, the dimensionality of the system and the input size.
  arXiv  Detail & Related papers  (2022-08-29T22:34:22Z)
• A Priori Denoising Strategies for Sparse Identification of Nonlinear Dynamical Systems: A Comparative Study [68.8204255655161]
  We investigate and compare the performance of several local and global smoothing techniques to a priori denoise the state measurements. We show that, in general, global methods, which use the entire measurement data set, outperform local methods, which employ a neighboring data subset around a local point.
  arXiv  Detail & Related papers  (2022-01-29T23:31:25Z)
• Bayesian Algorithms Learn to Stabilize Unknown Continuous-Time Systems [0.0]
  Linear dynamical systems are canonical models for learning-based control of plants with uncertain dynamics. A reliable stabilization procedure for this purpose that can effectively learn from unstable data to stabilize the system in a finite time is not currently available. In this work, we propose a novel learning algorithm that stabilizes unknown continuous-time linear systems.
  arXiv  Detail & Related papers  (2021-12-30T15:31:35Z)
• Nonlinear Discrete-time Systems' Identification without Persistence of Excitation: A Finite-time Concurrent Learning [0.0]
  A finite-time concurrent learning approach is presented to approximate the uncertainties of the discrete-time nonlinear systems. Rigorous proofs guarantee the finite-time convergence of the estimated parameters to their optimal values.
  arXiv  Detail & Related papers  (2021-12-14T22:19:20Z)
• Dense Uncertainty Estimation via an Ensemble-based Conditional Latent Variable Model [68.34559610536614]
  We argue that the aleatoric uncertainty is an inherent attribute of the data and can only be correctly estimated with an unbiased oracle model. We propose a new sampling and selection strategy at train time to approximate the oracle model for aleatoric uncertainty estimation. Our results show that our solution achieves both accurate deterministic results and reliable uncertainty estimation.
  arXiv  Detail & Related papers  (2021-11-22T08:54:10Z)
• Stability and Identification of Random Asynchronous Linear Time-Invariant Systems [81.02274958043883]
  We show the additional benefits of randomization and asynchrony on the stability of linear dynamical systems. For unknown randomized LTI systems, we propose a systematic identification method to recover the underlying dynamics.
  arXiv  Detail & Related papers  (2020-12-08T02:00:04Z)
• Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent [55.85456985750134]
  We introduce a new stability measure called on-average model stability, for which we develop novel bounds controlled by the risks of SGD iterates. This yields generalization bounds depending on the behavior of the best model, and leads to the first-ever-known fast bounds in the low-noise setting. To our best knowledge, this gives the firstever-known stability and generalization for SGD with even non-differentiable loss functions.
  arXiv  Detail & Related papers  (2020-06-15T06:30:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.