Feedback World Model Enables Precise Guidance of Diffusion Policy

• URL: http://arxiv.org/abs/2605.15705v1
• Date: Fri, 15 May 2026 07:52:13 GMT
• Title: Feedback World Model Enables Precise Guidance of Diffusion Policy
• Abstract summary: We propose feedback world model, a new paradigm that closes the loop between prediction and observation at inference time.<n>We show that our method substantially improves both prediction accuracy and policy performance under distribution shift.<n>In particular, it reduces world model prediction error by up to 76.4% and improves out-of-distribution (OOD) success rate by 30%.
• Score: 36.965417653906535
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: World models aim to improve robotic decision making by predicting the consequences of actions. However, in practice, their predictions often become unreliable once the robot encounters states outside the training distribution, limiting their effectiveness at deployment. We observe that execution itself provides a natural but underutilized signal: after each action, the robot directly observes the true next state, revealing the mismatch between predicted and actual outcomes. Building on this insight, we propose feedback world model, a new paradigm that closes the loop between prediction and observation at inference time. Instead of treating the world model as a static open-loop predictor, our method maintains a lightweight feedback state that is updated online to iteratively correct future predictions, compensating for model errors using real-time observations without additional training data or parameter updates. We show that this process can be interpreted as a latent-space observer and admits convergence guarantees under mild conditions. We further introduce action-aware guidance to better translate corrected predictions into control by emphasizing action-controllable components while suppressing irrelevant variations. Experiments on LIBERO-Plus, Robomimic, and real-world manipulation tasks demonstrate that our method substantially improves both prediction accuracy and policy performance under distribution shift. In particular, it reduces world model prediction error by up to 76.4% and improves out-of-distribution (OOD) success rate by 30%. These results show that incorporating real-time feedback at inference time provides a simple yet powerful alternative to static world modeling.

Related papers

• Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning [53.77164209208635]
  We introduce WorldEcho, which probes action following over a broader action distribution using visual integrity and trajectory alignment.<n>We propose WorldSync, which strengthens action following along three axes: distributional coverage, representational grounding, and intervention-effect alignment.<n>Experiments on RoboTwin benchmarks and real-robot tasks show that WorldSync improves WorldEcho metrics and serves as a more reliable simulator for iterative policy improvement.
  arXiv  Detail & Related papers  (2026-08-25T17:59:49Z)
• On the Capability Separation Between World-Model Policy Learning and Imitated World-Action Models [3.79187263097166]
  We compare a direct behavior-cloning policy, an imitation-trained world-action policy, and a policy optimized with an action-conditioned world model.<n>Future prediction changes the learning factorization but not the unrestricted external policy class or ideal imitation target.
  arXiv  Detail & Related papers  (2026-08-23T03:25:31Z)
• Self-Evolving World Models for LLM Agent Planning [72.99782619992361]
  We introduce WorldEvolver, a self-evolving world model framework that revises its deployment-time context while keeping the downstream agent and all model parameters frozen.<n>WorldEvolver achieves the highest prediction accuracy across three backbones and leads other world model baselines on downstream agent success rate.
  arXiv  Detail & Related papers  (2026-06-29T17:58:43Z)
• A Path-Space Formulation of Prediction in World Models: From a Single Action to Prediction, Planning, and Irreversibility [0.0]
  We propose a path-space formulation of prediction in AI world models.<n>We decompose latent dynamics into reversible and irreversible components.<n>We find that attention asymmetry is acquired during training in proportion to the irreversibility of the data.
  arXiv  Detail & Related papers  (2026-06-27T06:00:09Z)
• HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models [58.191567345416836]
  World Action Models (WAMs) have emerged as a promising paradigm for robot control by modeling physical dynamics.<n>HarmoWAM fully leverages a world model to unify predictive and reactive control, enabling both general transit and precise manipulation.<n>We construct three training-unseen test environments across six real-world robotic tasks, covering variations in background, position, and object semantics.
  arXiv  Detail & Related papers  (2026-05-11T17:59:56Z)
• Learning Lifted Action Models from Unsupervised Visual Traces [38.479081137300945]
  We propose a deep learning framework that jointly learns state prediction, action prediction, and a lifted action model.<n>We also introduce a mixed-integer linear program (MILP) to prevent prediction collapse and self-reinforcing errors.<n>Experiments across multiple domains show that integrating MILP-based correction helps the model escape local optima and converge toward globally consistent solutions.
  arXiv  Detail & Related papers  (2026-04-21T03:49:04Z)
• World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry [82.93104394404781]
  General-purpose world models promise scalable policy evaluation, optimization, and planning.<n>We propose World Action Verifier (WAV), a framework that enables world models to identify their own prediction errors and self-improve.
  arXiv  Detail & Related papers  (2026-04-02T12:48:36Z)
• The Stability of Online Algorithms in Performative Prediction [32.283056647528845]
  We show that any no-regret algorithm deployed in performative settings converges to a (mixed) performatively stable equilibrium.<n>Our work sheds light why common algorithms, like gradient descent, are naturally stabilizing and prevent runaway feedback loops.
  arXiv  Detail & Related papers  (2026-02-27T17:35:03Z)
• Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation [31.881404705268356]
  We propose a framework for fast and predictive video-conditioned action.<n>Our approach first selects and adapts a robust video generation model to ensure reliable future predictions.<n>Our method produces temporally coherent, spatially accurate video predictions that directly support precise manipulation.
  arXiv  Detail & Related papers  (2026-02-11T10:23:52Z)
• Reimagination with Test-time Observation Interventions: Distractor-Robust World Model Predictions for Visual Model Predictive Control [51.14656121641822]
  World models enable robots to "imagine" future observations given current observations and planned actions.<n>Novel visual distractors can corrupt action outcome predictions, causing downstream failures when robots rely on the world model imaginations for planning or action verification.<n>We propose Reimagination with Observation Intervention (ReOI), a simple yet effective test-time strategy that enables world models to predict more reliable action outcomes.
  arXiv  Detail & Related papers  (2025-06-19T19:41:29Z)
• Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback [41.94295877935867]
  In automated driving, predicting trajectories of surrounding vehicles supports reasoning about scene dynamics and enables safe planning for the ego vehicle.<n>Existing models handle predictions as an instantaneous task of forecasting future trajectories based on observed information.<n>We propose a novel retrospection technique to correct its errors during inference and will repeat them.
  arXiv  Detail & Related papers  (2025-04-18T16:35:12Z)
• ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
  We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples. Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
  arXiv  Detail & Related papers  (2024-02-02T10:34:13Z)
• Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive? [93.10694819127608]
  We propose a unified evaluation pipeline for forecasting methods with real-world perception inputs. Our in-depth study uncovers a substantial performance gap when transitioning from curated to perception-based data.
  arXiv  Detail & Related papers  (2023-06-15T17:03:14Z)
• Learning Prediction Intervals for Model Performance [1.433758865948252]
  We propose a method to compute prediction intervals for model performance. We evaluate our approach across a wide range of drift conditions and show substantial improvement over competitive baselines.
  arXiv  Detail & Related papers  (2020-12-15T21:32:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.