Tracing the Unlabeled Storm: Cross-Variable Transfer in a Lagrangian Atmospheric JEPA Framework
- URL: http://arxiv.org/abs/2608.22358v1
- Date: Sun, 23 Aug 2026 10:50:21 GMT
- Title: Tracing the Unlabeled Storm: Cross-Variable Transfer in a Lagrangian Atmospheric JEPA Framework
- Abstract summary: Deep atmospheric convection governs South Asian monsoon variability.<n>Yet attempting to learn its latent world model directly from zero-inflated, heavy-tailed precipitation yields suboptimal predictive representations.<n>We address this mismatch with emphcross-variable proxy learning.
- Score: 2.887393074590696
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep atmospheric convection governs South Asian monsoon variability, yet attempting to learn its latent world model directly from zero-inflated, heavy-tailed precipitation yields suboptimal predictive representations. Continuous atmospheric proxies, such as outgoing longwave radiation (OLR), express this convective organization far more coherently. We address this mismatch with \emph{cross-variable proxy learning}: M-JEPA, a multiscale Monsoon Joint-Embedding Predictive Architecture, is pretrained on five continuous proxy fields over Lagrangian patches tracking moving convective systems---without rainfall supervision at any point. The resulting frozen representation is transferred to daily precipitation forecasts through a shared decoder trunk featuring parallel probabilistic and deterministic branches. Because rainfall is strictly unobserved during pretraining, downstream skill directly measures the predictive information captured in the latent rollout. A frozen-backbone probing framework with two controls (an identical architecture trained on rainfall alone, and a randomly initialized backbone) attributes the transfer specifically to proxy pretraining: direct rainfall training exhibits $36\%$ higher CRPS error ($7.52$ vs.\ $5.54$\,mm/day). Against the 51-member operational ECMWF ensemble, the transferred model attains a statistically resolved CRPS advantage ($6.81$ vs.\ $6.89$\,mm/day) and higher Brier skill ($+0.05$ vs.\ $-0.04$) using $15.4$M parameters on a single consumer GPU, concentrated at heavy-rain thresholds and fine spatial scales, while the ensemble retains an advantage in neighborhood skill and deterministic references on point metrics. The result provides a competitive monsoon precipitation forecast grounded in intraseasonal dynamics and a diagnostic framework for evaluating transferred atmospheric representations.
Related papers
- TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modeling [74.915718648935]
Existing methods show limited accuracy gains and struggle with extreme events and error accumulation.<n>We propose a novel Triaxial State Space Model (TSSM) with a history-enhanced Temporal-VariableHistorical paradigm.<n>TSSM stacks historical samples into period-aligned batches, where forecasting is causally supported by historical and current observations.
arXiv Detail & Related papers (2026-07-14T07:36:19Z) - Air Quality Downscaling with Station-Guided Pseudo-Supervision [60.31045749983062]
Super-resolving coarse atmospheric fields to local PM$_2.5$ variations is uniquely challenged by a mismatch in spatial support.<n>We present a station-guided framework for high-resolution PM$_2.5$ downscaling over Europe.
arXiv Detail & Related papers (2026-07-06T16:32:25Z) - Enhancing the Forecasting Capability of Multi-Model Blending Algorithms for Extreme Precipitation via Joint Use of Station and Gridded Observations [10.058122938830389]
Traditional precipitation multi-model blending algorithms perform pixel-by-pixel blending on the forecast field based on weights.<n>This study proposes a two-stage framework: probability classification followed by value reconstruction, to blend forecasts from six major NWP models.<n>A novel station-grid joint supervision mechanism is introduced by integrating observations from 2411 national meteorological stations in China into the loss function.
arXiv Detail & Related papers (2026-07-06T09:35:58Z) - RAVEN: A Regime-Aware Variable-context Expert Network for Financial Time Series Forecasting [83.06074370551887]
A fixed context window is mismatched to the time-varying optimal look-back of non-stationary price processes.<n>We propose a Mixture-of-Experts framework designed to adaptively determine the temporal context for each input sample.<n> Experiments on cumulative log-return prediction (HS300, S&P500) and fund sales forecasting demonstrate that RAVEN achieves SOTA performances, improves Pearson correlation by 9.2% on HS300 and 20.2% on S&P500, and reduces MSE by 18.2% on fund sales forecasting.
arXiv Detail & Related papers (2026-06-23T02:11:04Z) - Performance Evaluation of GraphCast for Medium-Range Weather Forecasting over Brazil [0.7734726150561088]
This study evaluates the performance of GraphCast operational against the deterministic ECMWF IFS HRES.<n>During the austral summer wet season, GraphCast accurately captures large-scale moisture transport while intrinsically dampening the high-frequency convective variability.<n>These findings establish a baseline for Brazil and define the specific physical boundaries that will guide future tropicalization'' efforts.
arXiv Detail & Related papers (2026-06-04T16:19:29Z) - Tyche: One Step Flow for Efficient Probabilistic Weather Forecasting [48.263481135566316]
We present Tyche, a one-step conditional flow model for efficient probabilistic weather forecasting.<n>Experiments on ERA5 at 1.5$circ$ and 6-hour resolution show that our Tyche, using merely a single NFE, matches or exceeds the forecast skill and calibration of state-of-the-art multi-step generative baselines.
arXiv Detail & Related papers (2026-05-07T20:25:28Z) - IMPA-Net: Meteorology-Aware Multi-Scale Attention and Dynamic Loss for Extreme Convective Radar Nowcasting [2.405586180193259]
Short-range prediction of convective precipitation from weather radar observations is essential for severe weather warnings.<n>We propose IMPA-Net, a deterministic 0-2 hour nowcasting framework that addresses limitations through meteorologically-informed designs at the input, architecture, and loss function levels.
arXiv Detail & Related papers (2026-04-27T09:30:07Z) - Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting [52.53742727060265]
Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets.<n>Here, we introduce Earth System Foundation Model (ESFM), a fully open model building on the 3Dwin UNet backbone of the pioneering model.<n>We present findings using dense gridded data (ERA5, CMIP6), regionally masked dense data, sparse gridded MODIS satellite data, and station data.<n>Results demonstrate competitive or superior performance relative to state-of-the-art benchmarks.
arXiv Detail & Related papers (2026-04-20T11:40:39Z) - KAN-FIF: Spline-Parameterized Lightweight Physics-based Tropical Cyclone Estimation on Meteorological Satellite [22.99496587694237]
Timely monitoring of tropical cyclones is crucial for reducing loss of life and property.<n>Current physics-guided models suffer from linear feature interactions that fail to capture high-order relationships between TC attributes.<n>This study introduces the Kolmogorov-Arnold Network-based Network-based Interaction Feature Framework (KAN-FIF)
arXiv Detail & Related papers (2026-02-12T16:07:39Z) - CSU-PCAST: A Dual-Branch Transformer Framework for medium-range ensemble Precipitation Forecasting [6.540270371082014]
This study develops a deep learning-based ensemble framework for multi-step precipitation prediction.<n>The architecture employs a patch-based Swin Transformer backbone with periodic convolutions to handle longitudinal continuity.<n>Training minimizes a hybrid loss combining the Continuous Ranked Probability Score (CRPS) and weighted log1p mean squared error (log1pMSE)
arXiv Detail & Related papers (2025-10-23T17:43:38Z) - Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs.
Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative.
The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
arXiv Detail & Related papers (2023-09-24T19:57:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.