Biased Dreams: Limitations to Epistemic Uncertainty Quantification in Latent Space Models

• URL: http://arxiv.org/abs/2604.25416v1
• Date: Tue, 28 Apr 2026 09:27:01 GMT
• Title: Biased Dreams: Limitations to Epistemic Uncertainty Quantification in Latent Space Models
• Abstract summary: We show that latent transitions are biased toward well-represented regions of latent space, exhibiting an attractor behavior that can deviate from true environment dynamics.<n>Because these attractors often lie in high-reward regions, latent rollouts systematically overestimate predicted rewards.
• Score: 21.96882320671615
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Model-Based Reinforcement Learning distinguishes between physical dynamics models operating on proprioceptive inputs and latent dynamics models operating on high-dimensional image observations. A prominent latent approach is the Recurrent State Space Model used in the Dreamer family. While epistemic uncertainty quantification to inform exploration and mitigate model exploitation is well established for physical dynamics models, its transfer to latent dynamics models has received limited scrutiny. We empirically demonstrate that latent transitions are biased toward well-represented regions of latent space, exhibiting an attractor behavior that can deviate from true environment dynamics. As a result, discrepancies in environment dynamics may not manifest in latent space, undermining the reliability of epistemic uncertainty estimates. Because these attractors often lie in high-reward regions, latent rollouts systematically overestimate predicted rewards. Our findings highlight key limitations of epistemic uncertainty estimation in latent dynamics models and motivate more critical evaluation of this method.

Related papers

• Earth-o1: A Grid-free Observation-native Atmospheric World Model [81.55899748753434]
  We present Earth-o1, an observation-native atmospheric world model that overcomes structural limitations.<n>By integrating diverse sensor inputs into a unified, grid-free dynamical field, the model autonomously advances the atmospheric state in space and time.<n>We show that this fundamentally distinct paradigm enables direct, real-time forecasting and cross-sensor inference without the overhead of explicit numerical solvers.
  arXiv  Detail & Related papers  (2026-05-07T14:27:48Z)
• Detecting Deepfakes via Hamiltonian Dynamics [58.881686693914446]
  We propose a new perspective on deepfake detection: moving from static pattern recognition to dynamical stability analysis.<n>Our approach is motivated by physics-inspired priors.<n>Hamiltonian Action Anomaly Detection (HAAD) outperforms evaluated state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-05-06T01:55:38Z)
• Generalizing Dynamics Modeling More Easily from Representation Perspective [17.958624542632947]
  We conduct a generalized Pre-trained Dynamics EncoDER (PDEDER)<n>PDEDER embeds the original state observations into a latent space where the dynamics can be captured more easily.<n>We evaluate PDEDER on 12 dynamic systems by short/long-term forecasting under both in-domain and cross-domain settings.
  arXiv  Detail & Related papers  (2026-03-24T00:15:47Z)
• Aligning Agentic World Models via Knowledgeable Experience Learning [68.85843641222186]
  We introduce WorldMind, a framework that constructs a symbolic World Knowledge Repository by synthesizing environmental feedback.<n>WorldMind achieves superior performance compared to baselines with remarkable cross-model and cross-environment transferability.
  arXiv  Detail & Related papers  (2026-01-19T17:33:31Z)
• SmallWorlds: Assessing Dynamics Understanding of World Models in Isolated Environments [15.243547292947397]
  We introduce the SmallWorld Benchmark, a testbed designed to assess world model capability under isolated and precisely controlled dynamics.<n>We conduct comprehensive experiments in the fully observable state space on representative architectures including Recurrent State Space Model, Transformer, Diffusion model, and Neural ODE.<n>The experimental results reveal how effectively these models capture environment structure and how their predictions deteriorate over extended rollouts.
  arXiv  Detail & Related papers  (2025-11-28T18:56:02Z)
• Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulation [31.868248649812088]
  Cloth manipulation is challenging due to its highly complex dynamics, near-infinite degrees of freedom, and frequent self-occlusions.<n>We propose a diffusion-based generative approach for both perception and dynamics modeling.<n>We show that our framework enables effective cloth folding on real robotic systems.
  arXiv  Detail & Related papers  (2025-03-15T05:34:26Z)
• FlowDAS: A Stochastic Interpolant-based Framework for Data Assimilation [15.64941169350615]
  Data assimilation (DA) integrates observations with a dynamical model to estimate states of PDE-governed systems.<n>FlowDAS is a generative DA framework that uses interpolants to learn state transition dynamics.<n>We show that FlowDAS surpasses model-driven methods, neural operators, and score-based baselines in accuracy and physical plausibility.
  arXiv  Detail & Related papers  (2025-01-13T05:03:41Z)
• When predict can also explain: few-shot prediction to select better neural latents [2.8933605229876664]
  One widely-used method, $textitco-smoothing$, involves jointly estimating latent variables and predicting observations along held-out channels.<n>We show that models with high co-smoothing can have arbitrary extraneous dynamics in their latent representations.<n>By cross-decoding the latent variables of all model pairs with high co-smoothing, we identify models with minimal extraneous dynamics.
  arXiv  Detail & Related papers  (2024-05-23T10:48:30Z)
• Exploring Model Transferability through the Lens of Potential Energy [78.60851825944212]
  Transfer learning has become crucial in computer vision tasks due to the vast availability of pre-trained deep learning models. Existing methods for measuring the transferability of pre-trained models rely on statistical correlations between encoded static features and task labels. We present an insightful physics-inspired approach named PED to address these challenges.
  arXiv  Detail & Related papers  (2023-08-29T07:15:57Z)
• RobustMQ: Benchmarking Robustness of Quantized Models [54.15661421492865]
  Quantization is an essential technique for deploying deep neural networks (DNNs) on devices with limited resources. We thoroughly evaluated the robustness of quantized models against various noises (adrial attacks, natural corruptions, and systematic noises) on ImageNet. Our research contributes to advancing the robust quantization of models and their deployment in real-world scenarios.
  arXiv  Detail & Related papers  (2023-08-04T14:37:12Z)
• Latent Diffusion Energy-Based Model for Interpretable Text Modeling [104.85356157724372]
  We introduce a novel symbiosis between the diffusion models and latent space EBMs in a variational learning framework. We develop a geometric clustering-based regularization jointly with the information bottleneck to further improve the quality of the learned latent space.
  arXiv  Detail & Related papers  (2022-06-13T03:41:31Z)
• SyMetric: Measuring the Quality of Learnt Hamiltonian Dynamics Inferred from Vision [73.26414295633846]
  A recently proposed class of models attempts to learn latent dynamics from high-dimensional observations. Existing methods rely on image reconstruction quality, which does not always reflect the quality of the learnt latent dynamics. We develop a set of new measures, including a binary indicator of whether the underlying Hamiltonian dynamics have been faithfully captured.
  arXiv  Detail & Related papers  (2021-11-10T23:26:58Z)
• Likelihood-Free Inference in State-Space Models with Unknown Dynamics [71.94716503075645]
  We introduce a method for inferring and predicting latent states in state-space models where observations can only be simulated, and transition dynamics are unknown. We propose a way of doing likelihood-free inference (LFI) of states and state prediction with a limited number of simulations.
  arXiv  Detail & Related papers  (2021-11-02T12:33:42Z)
• Variational Dynamic for Self-Supervised Exploration in Deep Reinforcement Learning [12.76337275628074]
  In this work, we propose a variational dynamic model based on the conditional variational inference to model the multimodality andgenerativeity. We derive an upper bound of the negative log-likelihood of the environmental transition and use such an upper bound as the intrinsic reward for exploration. Our method outperforms several state-of-the-art environment model-based exploration approaches.
  arXiv  Detail & Related papers  (2020-10-17T09:54:51Z)
• Heteroscedastic Uncertainty for Robust Generative Latent Dynamics [7.107159120605662]
  We present a method to jointly learn a latent state representation and the associated dynamics. As our main contribution, we describe how our representation is able to capture a notion of heteroscedastic or input-specific uncertainty. We present results from prediction and control experiments on two image-based tasks.
  arXiv  Detail & Related papers  (2020-08-18T21:04:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.