Hybrid Feedback Sampling for Sample-Efficient Model Predictive Control

• URL: http://arxiv.org/abs/2608.19443v1
• Date: Wed, 19 Aug 2026 20:56:18 GMT
• Title: Hybrid Feedback Sampling for Sample-Efficient Model Predictive Control
• Abstract summary: This paper shows that the optimal sampling proposal distribution can be realized by sampling with an optimized feedback policy.<n>In diverse contact-rich control tasks like humanoid loco-manipulation and dexterous manipulation, we show that FS-MPC successfully tackles dynamically unstable tasks.
• Score: 19.515987245507013
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Thanks to its parallelizability and flexibility, sampling-based Model Predictive Control (MPC) has become widely popular for controlling real-world robotic systems. However, for high-dimensional and open-loop unstable dynamical systems, the required number of samples to improve the control sequence will grow exponentially with the horizon, leading to poor sample efficiency and numerical instability. This paper investigates the instability of shooting methods in sampling-based MPC and shows that the optimal sampling proposal distribution can be realized by sampling with an optimized feedback policy. We refer to this algorithm as Feedback Sampling MPC (FS-MPC). FS-MPC involves a hybrid sampling design which balances local and global search based on the system stability and the available computation budget. Our theoretical analysis shows that our hybrid sampling approach achieves faster convergence than standard MPPI and better optimality than standard feedback sampling. Empirically, in diverse contact-rich control tasks like humanoid loco-manipulation and dexterous manipulation, we show that FS-MPC successfully tackles dynamically unstable tasks where standard sample-based approaches struggle, and strictly outperforms feedback policies alone. Finally, we validate our method on humanoid robot locomotion and manipulation tasks in the real world.

Related papers

• Primitive-Informed Sampling-Based MPC for Multi-Fingered Dexterous Manipulation [3.693403461852542]
  We present a primitive-informed sampling-based model predictive control (MPC) framework for dexterous manipulation.<n>Our framework biases sampling using low-dimensional manipulation primitives that encode coordinated finger motions.<n>We evaluate the approach on a physical Allegro hand using a synchronized MuJoCo digital twin.
  arXiv  Detail & Related papers  (2026-09-14T00:36:17Z)
• Real-World Deployment of Massively Parallel Sampling-Based MPC for Contact-Rich Manipulation [21.501604407170273]
  We present an MPC framework that leverages JAX for large-scale parallelization and efficient computation.<n>We deploy it on a Franka Research 3 executing the Push-T manipulation task through a complete real-to-sim-to-real pipeline.<n>These findings highlight key challenges for sampling-based MPC in contact-rich manipulation-contact sensitivity, tight compute budgets, and the difficulty of obtaining informative domain-randomization signals in real time.
  arXiv  Detail & Related papers  (2026-06-16T12:24:05Z)
• How Sampling Shapes LLM Alignment: From One-Shot Optima to Iterative Dynamics [65.67654005892469]
  We show that proper instance-dependent sampling can yield stronger ranking guarantees, while skewed on-policy sampling can induce excessive concentration under structured preferences.<n>We then analyze iterative alignment dynamics in which the learned policy feeds back into future sampling and reference policies.<n>Our theoretical insights extend to Direct Preference Optimization, indicating the phenomena we captured are common to a broader class of preference-alignment methods.
  arXiv  Detail & Related papers  (2026-02-12T17:11:08Z)
• Sampling Strategy Design for Model Predictive Path Integral Control on Legged Robot Locomotion [6.24797585266791]
  This paper systematically investigates the role of sampling strategy design within the Model Predictive Path Integral (MPPI) framework for legged robot locomotion.<n>Through extensive simulations on a quadruped robot platform, we evaluate how different sampling strategies affect control smoothness, task performance, robustness, and sample efficiency.
  arXiv  Detail & Related papers  (2026-01-04T07:25:37Z)
• Fine-Tuning of Neural Network Approximate MPC without Retraining via Bayesian Optimization [81.35990332700389]
  Approximate model-predictive control (AMPC) aims to imitate an MPC's behavior with a neural network.<n>During deployment, the parameters of the underlying MPC must usually be fine-tuned.<n>Recent work addresses this problem by adapting AMPC without retraining using approximated sensitivities of the MPC's optimization problem.
  arXiv  Detail & Related papers  (2025-12-16T12:24:08Z)
• Reinforced sequential Monte Carlo for amortised sampling [49.92678178064033]
  We state a connection between sequential Monte Carlo (SMC) and neural sequential samplers trained by maximum-entropy reinforcement learning (MaxEnt RL)<n>We describe techniques for stable joint training of proposals and twist functions and an adaptive weight tempering scheme to reduce training signal variance.
  arXiv  Detail & Related papers  (2025-10-13T17:59:11Z)
• G$^2$RPO: Granular GRPO for Precise Reward in Flow Models [74.21206048155669]
  We propose a novel Granular-GRPO (G$2$RPO) framework that achieves precise and comprehensive reward assessments of sampling directions.<n>We introduce a Multi-Granularity Advantage Integration module that aggregates advantages computed at multiple diffusion scales.<n>Our G$2$RPO significantly outperforms existing flow-based GRPO baselines.
  arXiv  Detail & Related papers  (2025-10-02T12:57:12Z)
• Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functions [23.693610702522236]
  A common problem when using model predictive control (MPC) in practice is the satisfaction of safety specifications beyond the prediction horizon.<n>We propose a new sampling strategy that greatly reduces the variance of the estimated optimal control, improving the sample efficiency, and enabling real-time planning on a CPU.
  arXiv  Detail & Related papers  (2025-02-20T19:59:11Z)
• Equivariant Action Sampling for Reinforcement Learning and Planning [24.423370812881153]
  Reinforcement learning algorithms for continuous control tasks require accurate sampling-based action selection.<n>This work addresses the challenge of preserving symmetry in sampling-based planning and control.<n>We introduce an action sampling approach that enforces the desired symmetry.
  arXiv  Detail & Related papers  (2024-12-16T17:51:14Z)
• Bridging SFT and DPO for Diffusion Model Alignment with Self-Sampling Preference Optimization [67.8738082040299]
  Self-Sampling Preference Optimization (SSPO) is a new alignment method for post-training reinforcement learning.<n>SSPO eliminates the need for paired data and reward models while retaining the training stability of SFT.<n>SSPO surpasses all previous approaches on the text-to-image benchmarks and demonstrates outstanding performance on the text-to-video benchmarks.
  arXiv  Detail & Related papers  (2024-10-07T17:56:53Z)
• Learning Sampling Distributions for Model Predictive Control [36.82905770866734]
  Sampling-based approaches to Model Predictive Control (MPC) have become a cornerstone of contemporary approaches to MPC. We propose to carry out all operations in the latent space, allowing us to take full advantage of the learned distribution. Specifically, we frame the learning problem as bi-level optimization and show how to train the controller with backpropagation-through-time.
  arXiv  Detail & Related papers  (2022-12-05T20:35:36Z)
• Reparameterized Sampling for Generative Adversarial Networks [71.30132908130581]
  We propose REP-GAN, a novel sampling method that allows general dependent proposals by REizing the Markov chains into the latent space of the generator. Empirically, extensive experiments on synthetic and real datasets demonstrate that our REP-GAN largely improves the sample efficiency and obtains better sample quality simultaneously.
  arXiv  Detail & Related papers  (2021-07-01T10:34:55Z)
• Gaussian Process-based Min-norm Stabilizing Controller for Control-Affine Systems with Uncertain Input Effects and Dynamics [90.81186513537777]
  We propose a novel compound kernel that captures the control-affine nature of the problem. We show that this resulting optimization problem is convex, and we call it Gaussian Process-based Control Lyapunov Function Second-Order Cone Program (GP-CLF-SOCP)
  arXiv  Detail & Related papers  (2020-11-14T01:27:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.