No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation

• URL: http://arxiv.org/abs/2605.22248v1
• Date: Thu, 21 May 2026 09:54:57 GMT
• Title: No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation
• Abstract summary: We show that climate change drives a statistically significant and progressively growing shift in atmospheric state distributions.<n>We introduce a novel evaluation framework that leverages seasonal shifts as a rigorous, zero-overhead testbed for emulator.<n>Our systematic characterisation confirms that current state-of-the-art hybrid-ML emulators degrade significantly under these realistic shifts.
• Score: 13.032406275216557
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Climate emulation is an out-of-distribution (OOD) projection task. This is precisely the challenge where modern Machine Learning (ML) methods are most prone to failure. Consequently, while current ML emulators trained on present climate achieve high in-distribution performance, their future reliability under the inevitable distribution shifts of a changing climate remains a critical, poorly understood blind spot. Addressing this challenge requires a fundamental shift in how we understand, evaluate, and design climate emulators. In this work, we first confirm that climate change drives a statistically significant and progressively growing shift in atmospheric state distributions, rendering standard evaluation protocols insufficient. We empirically establish that seasonal variation serves as an effective proxy for these long-term climate shifts, providing access to $\textit{real-world}$ distribution shifts without recourse to heuristics like synthetic perturbations. Motivated by this link, we introduce a novel evaluation framework that leverages seasonal shifts as a rigorous, zero-overhead testbed for emulator robustness. Our systematic characterisation confirms that current state-of-the-art hybrid-ML emulators degrade significantly under these realistic shifts. Finally, we chart a path forward by identifying compositional generalisation, the ability to form novel combinations from observed elementary components, as a principled route towards robust climate emulation. We demonstrate that physically motivated decompositions substantially improve OOD performance with only modest trade-offs against in-distribution performance, providing an avenue towards ML-driven climate emulators robust to an unknown future.

Related papers

• WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation [85.15806404962193]
  Action-conditioned world models (ACWMs) promise to provide embodied AI with scalable predictive simulators for planning, policy evaluation, and data generation.<n>We evaluate ACWMs through the observable capabilities expected of physical simulators.<n>WorldSimProbe reveals systematic action-realization degradation across control variation, structured failures in interaction grounding and dynamics.
  arXiv  Detail & Related papers  (2026-08-10T08:48:06Z)
• Assessing the Robustness of Climate Foundation Models under No-Analog Distribution Shifts [2.4329932351753114]
  "No-analog" future climate states are regimes where external forcing drives the system into conditions outside the empirical range of the historical training data.<n>We benchmark the robustness of three state-of-the-art architectures: U-Net, ConvLSTM, and the ClimaX foundation model specifically restricted to a historical-only training regime.
  arXiv  Detail & Related papers  (2026-03-24T10:29:54Z)
• Toward generative machine learning for boosting ensembles of climate simulations [0.0]
  We develop a conditional Variational Autoencoder (cVAE) trained on a limited sample of climate simulations to generate arbitrary large ensembles.<n>We show that the cVAE model learns the underlying distribution of the data and generates physically consistent samples that reproduce realistic low and high moment statistics.
  arXiv  Detail & Related papers  (2026-02-06T00:54:19Z)
• Do machine learning climate models work in changing climate dynamics? [3.912757881247533]
  This research systematically evaluates state-of-the-art ML-based climate models in diverse out-of-distribution (OOD) scenarios.<n>Experiments on large-scale datasets reveal notable performance variability across scenarios, shedding light on the strengths and limitations of current models.
  arXiv  Detail & Related papers  (2025-09-15T17:12:49Z)
• CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climates [1.205087107092304]
  Robust generalization under climate change remains a major challenge for machine learning applications in climate science.<n>We present CERA (Climate-invariant climate representation through Representation), a machine learning framework consisting of an autoencoder with explicit latent-space alignment.<n>Without training on labeled data from a +4K climate, CERA leverages labeled control-climate data and unlabeled warmer-climate inputs to improve generalization to the warmer climate.
  arXiv  Detail & Related papers  (2025-08-15T20:28:04Z)
• PACER: Physics Informed and Uncertainty Aware Climate Emulator [0.6372261626436676]
  We propose PACER, a relatively lightweight 2.1M parameter Physics Informed Uncertainty Aware Climate EmulatoR.<n> PACER is trained across is trained across varying spatial resolutions and physics based climate models.<n>We show PACER's emulation performance across 20 climate models outperforming relevant baselines.
  arXiv  Detail & Related papers  (2024-10-29T01:53:40Z)
• On conditional diffusion models for PDE simulations [53.01911265639582]
  We study score-based diffusion models for forecasting and assimilation of sparse observations. We propose an autoregressive sampling approach that significantly improves performance in forecasting. We also propose a new training strategy for conditional score-based models that achieves stable performance over a range of history lengths.
  arXiv  Detail & Related papers  (2024-10-21T18:31:04Z)
• ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
  We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples. Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
  arXiv  Detail & Related papers  (2024-02-02T10:34:13Z)
• Time-series Generation by Contrastive Imitation [87.51882102248395]
  We study a generative framework that seeks to combine the strengths of both: Motivated by a moment-matching objective to mitigate compounding error, we optimize a local (but forward-looking) transition policy. At inference, the learned policy serves as the generator for iterative sampling, and the learned energy serves as a trajectory-level measure for evaluating sample quality.
  arXiv  Detail & Related papers  (2023-11-02T16:45:25Z)
• ClimSim-Online: A Large Multi-scale Dataset and Framework for Hybrid ML-physics Climate Emulation [45.201929285600606]
  We present ClimSim-Online, which includes an end-to-end workflow for developing hybrid ML-physics simulators. The dataset is global and spans ten years at a high sampling frequency. We provide a cross-platform, containerized pipeline to integrate ML models into operational climate simulators.
  arXiv  Detail & Related papers  (2023-06-14T21:26:31Z)
• Surrogate Ensemble Forecasting for Dynamic Climate Impact Models [0.0]
  This study considers a climate driven disease model, the Liverpool Malaria Model (LMM), which predicts the malaria transmission coefficient R0. The input and output data is used to train surrogate models in the form of a Random Forest Quantile Regression (RFQR) model and a Bayesian Long Short-Term Memory (BLSTM) neural network.
  arXiv  Detail & Related papers  (2022-04-12T13:30:01Z)
• DeepClimGAN: A High-Resolution Climate Data Generator [60.59639064716545]
  Earth system models (ESMs) are often used to generate future projections of climate change scenarios. As a compromise, emulators are substantially less expensive but may not have all of the complexity of an ESM. Here we demonstrate the use of a conditional generative adversarial network (GAN) to act as an ESM emulator.
  arXiv  Detail & Related papers  (2020-11-23T20:13:37Z)
• Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts? [104.04999499189402]
  Out-of-training-distribution (OOD) scenarios are a common challenge of learning agents at deployment. We propose an uncertainty-aware planning method, called emphrobust imitative planning (RIP) Our method can detect and recover from some distribution shifts, reducing the overconfident and catastrophic extrapolations in OOD scenes. We introduce an autonomous car novel-scene benchmark, textttCARNOVEL, to evaluate the robustness of driving agents to a suite of tasks with distribution shifts.
  arXiv  Detail & Related papers  (2020-06-26T11:07:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.