From Surface Forecasting to Observability Forecasting: A Latent World Model for Cloud-Aware EO Monitoring

• URL: http://arxiv.org/abs/2607.13651v1
• Date: Wed, 15 Jul 2026 09:52:22 GMT
• Title: From Surface Forecasting to Observability Forecasting: A Latent World Model for Cloud-Aware EO Monitoring
• Abstract summary: We adapt LeWorldModel, a joint-embedding predictive architecture world model, to cloud-aware Earth Observation sequences.<n>The resulting model has 18.0M trainable parameters and is trained from scratch on 23,904 training episodes.<n>LeWorldModel consistently outperforms persistence on the full frozen-bundle observability benchmark.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The bottleneck of Earth Observation processing chains is not the arrival of new imagery but whether the surface is actually visible when the image arrives. We study this as an observability forecasting problem on EarthNet2021. Given recent multispectral imagery and exogenous weather drivers, the goal is to predict whether the next acquisition will be usable and, if not, when a usable view is likely to return. To do this, we adapt LeWorldModel, a joint-embedding predictive architecture world model, to cloud-aware Earth Observation sequences. The final pipeline converts raw minicubes into episodic HDF5 sequences with five image channels (blue, green, red, near-infrared, cloud mask) and eight meteorological and calendar covariates. The resulting model has 18.0M trainable parameters and is trained from scratch on 23,904 training episodes. The trained leWorldModel is evaluated under a locked protocol: linear probes are fit on train only, calibration choices are set on an internal validation split, and the fitted heads are then frozen for valsplit, IID, OOD, and extreme evaluation. On the full frozen-bundle observability benchmark, LeWorldModel consistently outperforms persistence. For next-step usability, balanced accuracy ranges from 0.769 to 0.887, compared with 0.493 to 0.556 for persistence. For exact first-usable-horizon prediction, accuracy ranges from 0.602 to 0.806, compared with 0.120 to 0.369 for persistence. Against a frozen LightGBM baseline fit on the same training windows, LeWorldModel is better on continuous clear/cloud regression and on exact recovery timing on valsplit, IID, and extreme, while LightGBM is stronger on the simpler binary any-usable-within-six task and is more robust on OOD. In separate sampled diagnostic analyses, LeWM also produces strong ranking-based anomaly signals under synthetic temporal inconsistencies.

Related papers

• Modeling What Changes: Sparse, Residual World Models for Object-Centric Manipulation [0.0]
  We show that the sparse/residual model predicts next-state poses 2.5 to 4.6 times more accurately than a dense multilayer perceptron.<n>In autoregressive rollout it compounds far less error, hugging the no-motion floor while the dense model drifts.<n> Modeling what changes, rather than re-predicting the whole world, is a simple, effective bias for object-centric physical AI.
  arXiv  Detail & Related papers  (2026-09-02T03:20:09Z)
• RynnValue: Scaling Robotic Value Foundation Models with Temporal Distance [84.26294415726723]
  General-purpose reward models are increasingly the bottleneck for scaling robot learning.<n>We introduce RynnValue, an open-source value foundation model for robotic manipulation.<n>RynnValue scales to over 7,000 hours and roughly 3M instruction-conditioned clips without preference or progress annotations.
  arXiv  Detail & Related papers  (2026-08-10T17:09:37Z)
• Sample-Adaptive Latent Rewards for Uncertainty-Guided Diffusion Post-Training [51.18425726646089]
  We propose textscSURE, a unified latent-space framework for image and video diffusion models.<n>It learns reward distributions and directly uses their reliability to guide dense post-training.<n>textscSURE-REFL achieves the highest VBench quality, semantic, and total scores among the evaluated methods.
  arXiv  Detail & Related papers  (2026-08-06T14:55:42Z)
• What Can Latent World Models Know? Physical Parameter Identifiability in Multimodal Predictive Representations [18.546826658944806]
  POKEWORLD is an interactive environment whose visually identical objects hide mass, drag, and contact stiffness.<n>A certificate-gated protocol first certifies each parameter as recoverable from raw observations, then measures whether it enters the latent.<n>On RH20T, an input-target factorial across scaling curves reproduces both mechanisms across two robots and 4,258 episodes.
  arXiv  Detail & Related papers  (2026-07-29T15:15:30Z)
• Cycle-Consistent and Uncertainty-Aware Neural Surrogates for Tokamak Edge Plasmas [0.040071856451118486]
  Boundary and divertor plasma govern how a tokamak exhausts power and particles.<n>Machine-learning surrogates offer a fast alternative, yet most are forward-only.<n>We introduce a cycle-consistent neural surrogate for edge plasmas.
  arXiv  Detail & Related papers  (2026-07-23T15:06:57Z)
• Latent Clarity: Bridging World-Model Kinematics to Semantic Manifolds for Video Anomaly Anticipation [0.0]
  Continuous video detection is dominated by reactive Multiple Instance Learning (MIL) that collapses into features into scores.<n>We introduce PULS (Predictive Unified Latent Space), a continuous semantic world-model pipeline.<n>This translation alone yields a chunk-level AUROC of 0.8994 for UCF-Crime and 0.8162 for out-of-distribution- anomaly without MIL or hierarchical fusion.
  arXiv  Detail & Related papers  (2026-07-03T18:47:54Z)
• Iterative Visual Thinking: Teaching Vision-Language Models Spatial Self-Correction through Visual Feedback [0.023227405857540805]
  Vision-language models (VLMs) achieve strong singleshot spatial grounding, yet lack any mechanism to observe and correct their own predictions.<n>We propose Iterative Visual Thinking (IVT), a closed-loop framework in which the model predicts a bounding box, observes the prediction rendered on the image, and iteratively refines through visual feedback.<n>All training uses only 2,400 samples on a single GPU, demonstrating that spatial self-correction is a learnable capability that can be instilled at modest scale.
  arXiv  Detail & Related papers  (2026-06-11T10:27:29Z)
• Diffusion Transformer World-Action Model for AV Scene Prediction [0.0]
  Action-conditioned world models let an autonomous vehicle predict future camera scenes from its own planned controls.<n>But at compact, trainable scale the futures are ambiguous and the field's standard distortion metrics actively mislead.<n>We confront this with a compact latent world model that predicts future scene latents a frozen decoder renders to $256 times 256$ frames up to 8 seconds ahead.
  arXiv  Detail & Related papers  (2026-06-11T07:24:12Z)
• PatchWorld: Gradient-Free Optimization of Executable World Models [69.05094454437402]
  We introduce PatchWorld, a gradient-free framework that turns offline trajectories into executable Python world models.<n>Across seven AgentGym environments, PatchWorld-Simple achieves the highest code-based planning score.<n>We find that a human-specified residual-memory bias improves surface observation fidelity but weakens decision utility.
  arXiv  Detail & Related papers  (2026-05-29T06:11:14Z)
• Sat-JEPA-Diff: Bridging Self-Supervised Learning and Generative Diffusion for Remote Sensing [0.0]
  Sat-JEPA-Diff combines Self-Supervised Learning (SSL) with Hidden Diffusion Models (LDM)<n>An IJEPA module predicts stable semantic representations, which then route a frozen Stable Diffusion backbone via a lightweight cross-attention adapter.<n> Evaluated on a global Sentinel-2 dataset, Sat-JEPA-Diff excels at resolving sharp boundaries.
  arXiv  Detail & Related papers  (2026-03-14T13:30:49Z)
• LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels [49.35636088613484]
  Joint Embedding Predictive Architectures (JEPAs) offer a compelling framework for learning world models in compact latent spaces.<n>We introduce LeModelWorld, the first JEPA that trains stably end-to-end from raw pixels using only two loss terms.<n>With 15M parameters trainable on a single GPU in a few hours, LeWM plans up to 48x faster than foundation-model-based world models.
  arXiv  Detail & Related papers  (2026-03-13T19:48:14Z)
• Multi-Axis Trust Modeling for Interpretable Account Hijacking Detection [1.0152838128195467]
  This paper proposes a Hadith-inspired multi-axis trust modeling framework.<n>We translate five trust axes - long-term integrity (adalah), behavioral precision (dabt), contextual continuity (isnad), cumulative reputation, and anomaly evidence - into a compact set of 26 semantically meaningful behavioral features for user accounts.<n>We evaluate the framework on the CLUE-LDS cloud activity dataset with injected account hijacking scenarios.
  arXiv  Detail & Related papers  (2026-02-20T19:36:30Z)
• VFMF: World Modeling by Forecasting Vision Foundation Model Features [67.09340259579761]
  We introduce a generative forecaster that performs autoregressive flow matching in vision foundation models feature space.<n>We show that this latent information more effectively than previously used PCA-based alternatives, both for forecasting and other applications.<n>With matched architecture and compute, our method produces sharper and more accurate predictions than regression across all modalities.
  arXiv  Detail & Related papers  (2025-12-12T02:10:05Z)
• Unified Human Localization and Trajectory Prediction with Monocular Vision [64.19384064365431]
  MonoTransmotion is a Transformer-based framework that uses only a monocular camera to jointly solve localization and prediction tasks.<n>We show that by jointly training both tasks with our unified framework, our method is more robust in real-world scenarios made of noisy inputs.
  arXiv  Detail & Related papers  (2025-03-05T14:18:39Z)
• Robust Fine-tuning of Zero-shot Models via Variance Reduction [56.360865951192324]
  When fine-tuning zero-shot models, our desideratum is for the fine-tuned model to excel in both in-distribution (ID) and out-of-distribution (OOD) We propose a sample-wise ensembling technique that can simultaneously attain the best ID and OOD accuracy without the trade-offs.
  arXiv  Detail & Related papers  (2024-11-11T13:13:39Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.