MetaTune: Adjoint-based Meta-tuning via Robotic Differentiable Dynamics

• URL: http://arxiv.org/abs/2603.27313v1
• Date: Sat, 28 Mar 2026 15:37:39 GMT
• Title: MetaTune: Adjoint-based Meta-tuning via Robotic Differentiable Dynamics
• Abstract summary: Disturbance observer-based control has shown promise in robustifying robotic systems against uncertainties.<n>We propose MetaTune, a unified framework for joint auto-tuning of feedback controllers and disturbance observers.<n>We show that MetaTune achieves consistent improvements over state-of-the-art differentiable tuning methods.
• Score: 7.048473553381187
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Disturbance observer-based control has shown promise in robustifying robotic systems against uncertainties. However, tuning such systems remains challenging due to the strong coupling between controller gains and observer parameters. In this work, we propose MetaTune, a unified framework for joint auto-tuning of feedback controllers and disturbance observers through differentiable closed-loop meta-learning. MetaTune integrates a portable neural policy with physics-informed gradients derived from differentiable system dynamics, enabling adaptive gain across tasks and operating conditions. We develop an adjoint method that efficiently computes the meta-gradients with respect to adaptive gains backward in time to directly minimize the cost-to-go. Compared to existing forward methods, our approach reduces the computational complexity to be linear in the data horizon. Experimental results on quadrotor control show that MetaTune achieves consistent improvements over state-of-the-art differentiable tuning methods while reducing gradient computation time by more than 50 percent. In high-fidelity PX4-Gazebo hardware-in-the-loop simulation, the learned adaptive policy yields 15-20 percent average tracking error reduction at aggressive flight speeds and up to 40 percent improvement under strong disturbances, while demonstrating zero-shot sim-to-sim transfer without fine-tuning.

Related papers

• Invertible Neural Network Adapter for One-Step Flow Matching in Robot Manipulation [48.77928097573051]
  This paper presents an invertible neural network adapter for general robotic manipulation.<n>Built upon a flow-matching formulation, the proposed adapter constrains the action generation trajectory within an invertible latent space.<n>Experiments are conducted across a diverse set of simulation benchmarks and real-world robotic platforms to evaluate the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2026-06-17T15:35:27Z)
• Efficient Domain-Adaptive Policy Learning via Kernel Representation with Application to Quadrotor Control under Non-Stationary Disturbances [20.919848900411857]
  We present an algorithm for efficient domain-adaptive policy learning via kernel representations.<n>Learning domain-adaptive policies is challenging since it requires an environment representation that is both sufficiently expressive to model complex sim-to-real gaps during offline training.<n>We evaluate our method on quadrotor trajectory tracking tasks across high-fidelity numerical simulations and hardware experiments using Crazyflie.
  arXiv  Detail & Related papers  (2026-06-11T19:16:02Z)
• ScoRe-Flow: Complete Distributional Control via Score-Based Reinforcement Learning for Flow Matching [14.421249343302028]
  Flow Matching (FM) policies have emerged as an efficient backbone for robotic control.<n>We propose ScoRe-Flow, a score-based RL fine-tuning method to achieve decoupled control over the mean and variance of transitions.
  arXiv  Detail & Related papers  (2026-04-13T03:56:37Z)
• Beyond Imitation: Reinforcement Learning Fine-Tuning for Adaptive Diffusion Navigation Policies [31.52910494173408]
  Diffusion-based robot navigation policies can generate multi-modal trajectories directly from the robot's visual observations.<n>We propose a reinforcement learning framework tailored for diffusion-based navigation.<n>Our approach improves the Success Rate from 52.0% to 58.7% and SPL from 0.49 to 0.54 on unseen scenes, while reducing collision frequency.
  arXiv  Detail & Related papers  (2026-03-13T10:14:32Z)
• Iterative Tuning of Nonlinear Model Predictive Control for Robotic Manufacturing Tasks [0.44040106718326594]
  This paper presents an iterative learning framework for automatic tuning of Model Predictive Control (NMPC) weighting matrices.<n>Inspired by norm-optimal Iterative Learning Control (ILC), the proposed method adaptively adjusts NMPC Q and R across task repetitions.<n>Results demonstrate that the proposed approach converges to near-optimal tracking performance.
  arXiv  Detail & Related papers  (2025-12-15T10:30:40Z)
• Relative Entropy Pathwise Policy Optimization [66.03329137921949]
  We present an on-policy algorithm that trains Q-value models purely from on-policy trajectories.<n>We show how to combine policies for exploration with constrained updates for stable training, and evaluate important architectural components that stabilize value function learning.
  arXiv  Detail & Related papers  (2025-07-15T06:24:07Z)
• Adaptive Federated Learning Over the Air [108.62635460744109]
  We propose a federated version of adaptive gradient methods, particularly AdaGrad and Adam, within the framework of over-the-air model training. Our analysis shows that the AdaGrad-based training algorithm converges to a stationary point at the rate of $mathcalO( ln(T) / T 1 - frac1alpha ).
  arXiv  Detail & Related papers  (2024-03-11T09:10:37Z)
• Tuning Legged Locomotion Controllers via Safe Bayesian Optimization [47.87675010450171]
  This paper presents a data-driven strategy to streamline the deployment of model-based controllers in legged robotic hardware platforms. We leverage a model-free safe learning algorithm to automate the tuning of control gains, addressing the mismatch between the simplified model used in the control formulation and the real system.
  arXiv  Detail & Related papers  (2023-06-12T13:10:14Z)
• Neural Moving Horizon Estimation for Robust Flight Control [6.023276947115864]
  Estimating and reacting to external disturbances is crucial for robust flight control of quadrotors. We propose a neural moving horizon estimator (NeuroMHE) that can automatically tune the MHE parameters modeled by a neural network. NeuroMHE outperforms the state-of-the-art estimator with force estimation error reductions of up to 49.4%.
  arXiv  Detail & Related papers  (2022-06-21T13:43:24Z)
• Robust Value Iteration for Continuous Control Tasks [99.00362538261972]
  When transferring a control policy from simulation to a physical system, the policy needs to be robust to variations in the dynamics to perform well. We present Robust Fitted Value Iteration, which uses dynamic programming to compute the optimal value function on the compact state domain. We show that robust value is more robust compared to deep reinforcement learning algorithm and the non-robust version of the algorithm.
  arXiv  Detail & Related papers  (2021-05-25T19:48:35Z)
• Edge Federated Learning Via Unit-Modulus Over-The-Air Computation (Extended Version) [64.76619508293966]
  This paper proposes a unit-modulus over-the-air computation (UM-AirComp) framework to facilitate efficient edge federated learning. It uploads simultaneously local model parameters and updates global model parameters via analog beamforming. We demonstrate the implementation of UM-AirComp in a vehicle-to-everything autonomous driving simulation platform.
  arXiv  Detail & Related papers  (2021-01-28T15:10:22Z)
• Neural Control Variates [71.42768823631918]
  We show that a set of neural networks can face the challenge of finding a good approximation of the integrand. We derive a theoretically optimal, variance-minimizing loss function, and propose an alternative, composite loss for stable online training in practice. Specifically, we show that the learned light-field approximation is of sufficient quality for high-order bounces, allowing us to omit the error correction and thereby dramatically reduce the noise at the cost of negligible visible bias.
  arXiv  Detail & Related papers  (2020-06-02T11:17:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.