Active Learning for Nonlinear System Identification with Guarantees

• URL: http://arxiv.org/abs/2006.10277v1
• Date: Thu, 18 Jun 2020 04:54:11 GMT
• Title: Active Learning for Nonlinear System Identification with Guarantees
• Authors: Horia Mania, Michael I. Jordan, Benjamin Recht
• Abstract summary: We study a class of nonlinear dynamical systems whose state transitions depend linearly on a known feature embedding of state-action pairs. We propose an active learning approach that achieves this by repeating three steps: trajectory planning, trajectory tracking, and re-estimation of the system from all available data. We show that our method estimates nonlinear dynamical systems at a parametric rate, similar to the statistical rate of standard linear regression.
• Score: 102.43355665393067
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: While the identification of nonlinear dynamical systems is a fundamental building block of model-based reinforcement learning and feedback control, its sample complexity is only understood for systems that either have discrete states and actions or for systems that can be identified from data generated by i.i.d. random inputs. Nonetheless, many interesting dynamical systems have continuous states and actions and can only be identified through a judicious choice of inputs. Motivated by practical settings, we study a class of nonlinear dynamical systems whose state transitions depend linearly on a known feature embedding of state-action pairs. To estimate such systems in finite time identification methods must explore all directions in feature space. We propose an active learning approach that achieves this by repeating three steps: trajectory planning, trajectory tracking, and re-estimation of the system from all available data. We show that our method estimates nonlinear dynamical systems at a parametric rate, similar to the statistical rate of standard linear regression.

Related papers

• Learning System Dynamics without Forgetting [60.08612207170659]
  Predicting trajectories of systems with unknown dynamics is crucial in various research fields, including physics and biology. We present a novel framework of Mode-switching Graph ODE (MS-GODE), which can continually learn varying dynamics. We construct a novel benchmark of biological dynamic systems, featuring diverse systems with disparate dynamics.
  arXiv  Detail & Related papers  (2024-06-30T14:55:18Z)
• Modeling Unknown Stochastic Dynamical System Subject to External Excitation [4.357350642401934]
  We present a numerical method for learning unknown nonautonomous dynamical system. Our basic assumption is that the governing equations for the system are unavailable. When a sufficient amount of such I/O data are available, our method is capable of learning the unknown dynamics.
  arXiv  Detail & Related papers  (2024-06-22T06:21:44Z)
• Non-asymptotic System Identification for Linear Systems with Nonlinear Policies [17.420749574975368]
  This paper considers a single-trajectory system identification problem for linear systems under general nonlinear and/or time-varying policies. We provide a non-asymptotic error bound for least square estimation when the data trajectory is generated by any nonlinear and/or time-varying policies.
  arXiv  Detail & Related papers  (2023-06-17T15:05:59Z)
• Interactive System-wise Anomaly Detection [66.3766756452743]
  Anomaly detection plays a fundamental role in various applications. It is challenging for existing methods to handle the scenarios where the instances are systems whose characteristics are not readily observed as data. We develop an end-to-end approach which includes an encoder-decoder module that learns system embeddings.
  arXiv  Detail & Related papers  (2023-04-21T02:20:24Z)
• Deep active learning for nonlinear system identification [0.4485566425014746]
  We develop a novel deep active learning acquisition scheme for nonlinear system identification. Global exploration acquires a batch of initial states corresponding to the most informative state-action trajectories. Local exploration solves an optimal control problem, finding the control trajectory that maximizes some measure of information.
  arXiv  Detail & Related papers  (2023-02-24T14:46:36Z)
• Learning Control-Oriented Dynamical Structure from Data [25.316358215670274]
  We discuss a state-dependent nonlinear tracking controller formulation for general nonlinear control-affine systems. We empirically demonstrate the efficacy of learned versions of this controller in stable trajectory tracking.
  arXiv  Detail & Related papers  (2023-02-06T02:01:38Z)
• Capturing Actionable Dynamics with Structured Latent Ordinary Differential Equations [68.62843292346813]
  We propose a structured latent ODE model that captures system input variations within its latent representation. Building on a static variable specification, our model learns factors of variation for each input to the system, thus separating the effects of the system inputs in the latent space.
  arXiv  Detail & Related papers  (2022-02-25T20:00:56Z)
• Supervised DKRC with Images for Offline System Identification [77.34726150561087]
  Modern dynamical systems are becoming increasingly non-linear and complex. There is a need for a framework to model these systems in a compact and comprehensive representation for prediction and control. Our approach learns these basis functions using a supervised learning approach.
  arXiv  Detail & Related papers  (2021-09-06T04:39:06Z)
• Controlling nonlinear dynamical systems into arbitrary states using machine learning [77.34726150561087]
  We propose a novel and fully data driven control scheme which relies on machine learning (ML) Exploiting recently developed ML-based prediction capabilities of complex systems, we demonstrate that nonlinear systems can be forced to stay in arbitrary dynamical target states coming from any initial state. Having this highly flexible control scheme with little demands on the amount of required data on hand, we briefly discuss possible applications that range from engineering to medicine.
  arXiv  Detail & Related papers  (2021-02-23T16:58:26Z)
• Knowledge-Based Learning of Nonlinear Dynamics and Chaos [3.673994921516517]
  We present a universal learning framework for extracting predictive models from nonlinear systems based on observations. Our framework can readily incorporate first principle knowledge because it naturally models nonlinear systems as continuous-time systems.
  arXiv  Detail & Related papers  (2020-10-07T13:50:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.