Introducing a Deep Neural Network-based Model Predictive Control
Framework for Rapid Controller Implementation
- URL: http://arxiv.org/abs/2310.08392v1
- Date: Thu, 12 Oct 2023 15:03:50 GMT
- Title: Introducing a Deep Neural Network-based Model Predictive Control
Framework for Rapid Controller Implementation
- Authors: David C. Gordon, Alexander Winkler, Julian Bedei, Patrick Schaber,
Jakob Andert and Charles R. Koch
- Abstract summary: This work presents the experimental implementation of a deep neural network (DNN) based nonlinear MPC for Homogeneous Charge Compression Ignition (HCCI) combustion control.
Using the acados software package to enable the real-time implementation of the MPC on an ARM Cortex A72, the optimization calculations are completed within 1.4 ms.
The IMEP trajectory following of the developed controller was excellent, with a root-mean-square error of 0.133 bar, in addition to observing process constraints.
- Score: 41.38091115195305
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Model Predictive Control (MPC) provides an optimal control solution based on
a cost function while allowing for the implementation of process constraints.
As a model-based optimal control technique, the performance of MPC strongly
depends on the model used where a trade-off between model computation time and
prediction performance exists. One solution is the integration of MPC with a
machine learning (ML) based process model which are quick to evaluate online.
This work presents the experimental implementation of a deep neural network
(DNN) based nonlinear MPC for Homogeneous Charge Compression Ignition (HCCI)
combustion control. The DNN model consists of a Long Short-Term Memory (LSTM)
network surrounded by fully connected layers which was trained using
experimental engine data and showed acceptable prediction performance with
under 5% error for all outputs. Using this model, the MPC is designed to track
the Indicated Mean Effective Pressure (IMEP) and combustion phasing
trajectories, while minimizing several parameters. Using the acados software
package to enable the real-time implementation of the MPC on an ARM Cortex A72,
the optimization calculations are completed within 1.4 ms. The external A72
processor is integrated with the prototyping engine controller using a UDP
connection allowing for rapid experimental deployment of the NMPC. The IMEP
trajectory following of the developed controller was excellent, with a
root-mean-square error of 0.133 bar, in addition to observing process
constraints.
Related papers
- Dropout MPC: An Ensemble Neural MPC Approach for Systems with Learned Dynamics [0.0]
We propose a novel sampling-based ensemble neural MPC algorithm that employs the Monte-Carlo dropout technique on the learned system model.
The method aims in general at uncertain systems with complex dynamics, where models derived from first principles are hard to infer.
arXiv Detail & Related papers (2024-06-04T17:15:25Z) - Parameter-Adaptive Approximate MPC: Tuning Neural-Network Controllers without Retraining [50.00291020618743]
This work introduces a novel, parameter-adaptive AMPC architecture capable of online tuning without recomputing large datasets and retraining.
We showcase the effectiveness of parameter-adaptive AMPC by controlling the swing-ups of two different real cartpole systems with a severely resource-constrained microcontroller (MCU)
Taken together, these contributions represent a marked step toward the practical application of AMPC in real-world systems.
arXiv Detail & Related papers (2024-04-08T20:02:19Z) - CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal
Covariance Design [8.943418808959494]
We characterize the convergence property of a widely used sampling-based Model Predictive Path Integral Control (MPPI) method.
We show that MPPI enjoys at least linear convergence rates when the optimization is quadratic, which covers time-varying LQR systems.
Our theoretical analysis directly leads to a novel sampling-based MPC algorithm, CoVo-MPC.
Empirically, CoVo-MPC significantly outperforms standard MPPI by 43-54% in both simulations and real-world quad agile control tasks.
arXiv Detail & Related papers (2024-01-14T21:10:59Z) - Data-Driven Model Reduction and Nonlinear Model Predictive Control of an
Air Separation Unit by Applied Koopman Theory [45.84205238554709]
We propose a data-driven reduction strategy to generate a low-order control model of an air separation unit.
We present an NMPC implementation that uses derivative tailored to the fixed block structure of reduced Koopman models.
Our reduction approach with tailored NMPC implementation enables real-time NMPC of an ASU at an average CPU time decrease by 98 %.
arXiv Detail & Related papers (2023-09-11T11:18:16Z) - A Multi-Head Ensemble Multi-Task Learning Approach for Dynamical
Computation Offloading [62.34538208323411]
We propose a multi-head ensemble multi-task learning (MEMTL) approach with a shared backbone and multiple prediction heads (PHs)
MEMTL outperforms benchmark methods in both the inference accuracy and mean square error without requiring additional training data.
arXiv Detail & Related papers (2023-09-02T11:01:16Z) - Unmatched uncertainty mitigation through neural network supported model
predictive control [7.036452261968766]
We utilize a deep neural network (DNN) as an oracle in the underlying optimization problem of learning based MPC (LBMPC)
We employ a dual-timescale adaptation mechanism, where the weights of the last layer of the neural network are updated in real time.
Results indicate that the proposed approach is implementable in real time and carries the theoretical guarantees of LBMPC.
arXiv Detail & Related papers (2023-04-22T04:49:48Z) - Real-time Neural-MPC: Deep Learning Model Predictive Control for
Quadrotors and Agile Robotic Platforms [59.03426963238452]
We present Real-time Neural MPC, a framework to efficiently integrate large, complex neural network architectures as dynamics models within a model-predictive control pipeline.
We show the feasibility of our framework on real-world problems by reducing the positional tracking error by up to 82% when compared to state-of-the-art MPC approaches without neural network dynamics.
arXiv Detail & Related papers (2022-03-15T09:38:15Z) - An Adaptive Device-Edge Co-Inference Framework Based on Soft
Actor-Critic [72.35307086274912]
High-dimension parameter model and large-scale mathematical calculation restrict execution efficiency, especially for Internet of Things (IoT) devices.
We propose a new Deep Reinforcement Learning (DRL)-Soft Actor Critic for discrete (SAC-d), which generates the emphexit point, emphexit point, and emphcompressing bits by soft policy iterations.
Based on the latency and accuracy aware reward design, such an computation can well adapt to the complex environment like dynamic wireless channel and arbitrary processing, and is capable of supporting the 5G URL
arXiv Detail & Related papers (2022-01-09T09:31:50Z) - Covert Model Poisoning Against Federated Learning: Algorithm Design and
Optimization [76.51980153902774]
Federated learning (FL) is vulnerable to external attacks on FL models during parameters transmissions.
In this paper, we propose effective MP algorithms to combat state-of-the-art defensive aggregation mechanisms.
Our experimental results demonstrate that the proposed CMP algorithms are effective and substantially outperform existing attack mechanisms.
arXiv Detail & Related papers (2021-01-28T03:28:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.