Ensemble Kalman-Bucy filtering for nonlinear model predictive control

• URL: http://arxiv.org/abs/2503.12474v1
• Date: Sun, 16 Mar 2025 12:04:28 GMT
• Title: Ensemble Kalman-Bucy filtering for nonlinear model predictive control
• Authors: Sebastian Reich,
• Abstract summary: We extend the popular ensemble Kalman filter to receding horizon optimal control problems in the spirit of nonlinear model predictive control.<n>We provide an interacting particle approximation to the forward-backward differential equations arising from Pontryagin's maximum principle.<n>The receding horizon control laws are approximated as linear and are continuously updated as in nonlinear model predictive control.
• Score: 0.32634122554914
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We consider the problem of optimal control for partially observed dynamical systems. Despite its prevalence in practical applications, there are still very few algorithms available, which take uncertainties in the current state estimates and future observations into account. In other words, most current approaches separate state estimation from the optimal control problem. In this paper, we extend the popular ensemble Kalman filter to receding horizon optimal control problems in the spirit of nonlinear model predictive control. We provide an interacting particle approximation to the forward-backward stochastic differential equations arising from Pontryagin's maximum principle with the forward stochastic differential equation provided by the time-continuous ensemble Kalman-Bucy filter equations. The receding horizon control laws are approximated as linear and are continuously updated as in nonlinear model predictive control. We illustrate the performance of the proposed methodology for an inverted pendulum example.

Related papers

• Sub-optimality of the Separation Principle for Quadratic Control from Bilinear Observations [16.7109402673221]
  We consider the problem of controlling a numerical dynamical system from bilinear observations with minimal quadratic cost. Despite the similarity of this problem to standard linear quadratic Gaussian (LQG) filters, we show that when neither is bilinear the Separation Principle model. We illustrate our results through experiments in multiple synthetic settings.
  arXiv  Detail & Related papers  (2025-04-15T18:53:51Z)
• Nonlinear Bayesian Update via Ensemble Kernel Regression with Clustering and Subsampling [0.87024326813104]
  We propose to extend traditional ensemble Kalman filtering to settings characterized by non-Gaussian priors and nonlinear measurement operators. In this framework, the observed component is first denoised via a standard Kalman update, while the unobserved component is estimated using a nonlinear regression approach.
  arXiv  Detail & Related papers  (2025-03-19T12:35:28Z)
• Long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems [2.5245286741414663]
  This paper establishes long-time accuracy of ensemble Kalman filters.<n>Our theory covers a wide class of partially-observed chaotic dynamical systems.<n>We prove long-time accuracy of ensemble Kalman filters with surrogate dynamics.
  arXiv  Detail & Related papers  (2024-12-18T20:35:21Z)
• Kernel-Based Optimal Control: An Infinitesimal Generator Approach [3.7411439050030393]
  We present a novel approach for optimal control of nonlinear systems using infinitesimal generator learning within infinite-dimensional reproducing Hilbert kernel spaces.<n>Our learning framework leverages data samples of system dynamics and stage cost functions, with only control penalties and constraints provided.<n>We demonstrate that this approach seamlessly integrates with modern convex operator-theoretic Hamilton-Jacobi-Bellman recursions, enabling a data-driven solution to the optimal control problem.
  arXiv  Detail & Related papers  (2024-12-02T15:08:55Z)
• Multirotor Ensemble Model Predictive Control I: Simulation Experiments [0.0]
  An ensemble-represented Gaussian process performs the backward calculations to determine optimal gains for the initial time. We construct the EMPC for terminal control and regulation problems and apply it to the control of a simulated, identical-twin study.
  arXiv  Detail & Related papers  (2023-05-22T01:32:17Z)
• Stochastic Nonlinear Control via Finite-dimensional Spectral Dynamic Embedding [21.38845517949153]
  This paper presents an approach, Spectral Dynamics Embedding Control (SDEC), to optimal control for nonlinear systems. We use an infinite-dimensional feature to linearly represent the state-action value function and exploits finite-dimensional truncation approximation for practical implementation.
  arXiv  Detail & Related papers  (2023-04-08T04:23:46Z)
• A Priori Denoising Strategies for Sparse Identification of Nonlinear Dynamical Systems: A Comparative Study [68.8204255655161]
  We investigate and compare the performance of several local and global smoothing techniques to a priori denoise the state measurements. We show that, in general, global methods, which use the entire measurement data set, outperform local methods, which employ a neighboring data subset around a local point.
  arXiv  Detail & Related papers  (2022-01-29T23:31:25Z)
• Regret-optimal Estimation and Control [52.28457815067461]
  We show that the regret-optimal estimator and regret-optimal controller can be derived in state-space form. We propose regret-optimal analogs of Model-Predictive Control (MPC) and the Extended KalmanFilter (EKF) for systems with nonlinear dynamics.
  arXiv  Detail & Related papers  (2021-06-22T23:14:21Z)
• Combining Gaussian processes and polynomial chaos expansions for stochastic nonlinear model predictive control [0.0]
  We introduce a new algorithm to explicitly consider time-invariant uncertainties in optimal control problems. The main novelty in this paper is to use this combination in an efficient fashion to obtain mean and variance estimates of nonlinear transformations. It is shown how to formulate both chance-constraints and a probabilistic objective for the optimal control problem.
  arXiv  Detail & Related papers  (2021-03-09T14:25:08Z)
• Policy Analysis using Synthetic Controls in Continuous-Time [101.35070661471124]
  Counterfactual estimation using synthetic controls is one of the most successful recent methodological developments in causal inference. We propose a continuous-time alternative that models the latent counterfactual path explicitly using the formalism of controlled differential equations.
  arXiv  Detail & Related papers  (2021-02-02T16:07:39Z)
• Regret-Optimal Filtering [57.51328978669528]
  We consider the problem of filtering in linear state-space models through the lens of regret optimization. We formulate a novel criterion for filter design based on the concept of regret between the estimation error energy of a clairvoyant estimator. We show that the regret-optimal estimator can be easily implemented by solving three Riccati equations and a single Lyapunov equation.
  arXiv  Detail & Related papers  (2021-01-25T19:06:52Z)
• Gaussian Process-based Min-norm Stabilizing Controller for Control-Affine Systems with Uncertain Input Effects and Dynamics [90.81186513537777]
  We propose a novel compound kernel that captures the control-affine nature of the problem. We show that this resulting optimization problem is convex, and we call it Gaussian Process-based Control Lyapunov Function Second-Order Cone Program (GP-CLF-SOCP)
  arXiv  Detail & Related papers  (2020-11-14T01:27:32Z)
• Adaptive Control and Regret Minimization in Linear Quadratic Gaussian (LQG) Setting [91.43582419264763]
  We propose LqgOpt, a novel reinforcement learning algorithm based on the principle of optimism in the face of uncertainty. LqgOpt efficiently explores the system dynamics, estimates the model parameters up to their confidence interval, and deploys the controller of the most optimistic model.
  arXiv  Detail & Related papers  (2020-03-12T19:56:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.