A Scale-Adaptive Framework for Joint Spatiotemporal Super-Resolution with Diffusion Models

• URL: http://arxiv.org/abs/2604.21903v1
• Date: Thu, 23 Apr 2026 17:49:16 GMT
• Title: A Scale-Adaptive Framework for Joint Spatiotemporal Super-Resolution with Diffusion Models
• Abstract summary: We present a scale- adaptive framework that reuses the same architecture across factors by decomposing into a deterministic prediction conditional mean, with attention, and residual conditional diffusion model, with an optional mass-conservation (same precipitation amount in inputs and outputs) to preserve aggregated totals.<n>The same architecture spans super-resolution factors from 25 in space 1 to 6 in time, yielding a reusable architecture and tuning recipe for jointtemporal super-resolution across scales.
• Score: 15.647247740367265
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep-learning video super-resolution has progressed rapidly, but climate applications typically super-resolve (increase resolution) either space or time, and joint spatiotemporal models are often designed for a single pair of super-resolution (SR) factors (upscaling spatial and temporal ratio between the low-resolution sequence and the high-resolution sequence), limiting transfer across spatial resolutions and temporal cadences (frame rates). We present a scale-adaptive framework that reuses the same architecture across factors by decomposing spatiotemporal SR into a deterministic prediction of the conditional mean, with attention, and a residual conditional diffusion model, with an optional mass-conservation (same precipitation amount in inputs and outputs) transform to preserve aggregated totals. Assuming that larger SR factors primarily increase underdetermination (hence required context and residual uncertainty) rather than changing the conditional-mean structure, scale adaptivity is achieved by retuning three factor-dependent hyperparameters before retraining: the diffusion noise schedule amplitude beta (larger for larger factors to increase diversity), the temporal context length L (set to maintain comparable attention horizons across cadences) and optionally a third, the mass-conservation function f (tapered to limit the amplification of extremes for large factors). Demonstrated on reanalysis precipitation over France (Comephore), the same architecture spans super-resolution factors from 1 to 25 in space and 1 to 6 in time, yielding a reusable architecture and tuning recipe for joint spatiotemporal super-resolution across scales.

Related papers

• ExtraVAR: Stage-Aware RoPE Remapping for Resolution Extrapolation in Visual Autoregressive Models [52.648413887350195]
  We propose Stage-Aware RoPE Remapping to suppress global repetition, local repetition, and detail degradation.<n>We also propose Entropy-Driven Adaptive Attention, which quantifies dispersion via a resolution-invariant normalized entropy.<n>Our method consistently outperforms prior resolution-extrapolation methods in both structural coherence and fine-detail fidelity.
  arXiv  Detail & Related papers  (2026-05-11T06:14:38Z)
• Recovering Physical Dynamics from Discrete Observations via Intrinsic Differential Consistency [12.266189649117003]
  We replace local supervision with a global structural constraint.<n>We train a time-conditioned secant velocity field whose deviation from this property serves two purposes.<n>As a training regularizer, it confines the hypothesis space to flows that compose consistently across temporal scales.
  arXiv  Detail & Related papers  (2026-05-08T20:24:32Z)
• GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting [71.12303582606019]
  Continuous Video Super-Resolution (C-STVSR) aims to simultaneously enhance the spatial and frame rate of videos by arbitrary scale factors.<n>We propose GS-STVSR, an ultra-efficient C-STVSR framework based on 2D Gaussianting (2D-GS)<n>We show that GS-STVSR achieves state-of-the-art quality across all benchmarks.
  arXiv  Detail & Related papers  (2026-04-20T10:11:05Z)
• FoSS: Modeling Long Range Dependencies and Multimodal Uncertainty in Trajectory Prediction via Fourier State Space Integration [21.39395366378851]
  We present FoSS, a dual-branch framework that unifies frequency-domain reasoning with linear-time sequence modeling.<n>Experiments on Argoverse 1 and Argoverse 2 benchmarks demonstrate that FoSS achieves state-of-the-art accuracy while reducing computation by 22.5% and parameters by over 40%.
  arXiv  Detail & Related papers  (2026-03-01T21:38:59Z)
• CASR: A Robust Cyclic Framework for Arbitrary Large-Scale Super-Resolution with Distribution Alignment and Self-Similarity Awareness [14.01813573738112]
  CASR is a simple yet highly efficient cyclic SR framework that reformulates ultra-magnification as a sequence of in-distribution scale transitions.<n>This design ensures stable inference at arbitrary scales while requiring only a single model.<n>Despite using only a single model, our approach significantly reduces distribution drift, preserves long-range texture consistency, and achieves superior generalization even at extreme magnification.
  arXiv  Detail & Related papers  (2026-02-25T18:05:51Z)
• CASCADE: Cross-scale Advective Super-resolution with Climate Assimilation and Downscaling Evolution [51.56484100374058]
  CASCADE reconstructs fine structure by iteratively advecting coarse information along learned, flow-conditioned velocity warping fields.<n> evaluated on SEVIR radar data for 4x super-resolution of severe convective storms.<n> produces temporally coherent, physically consistent, and mass-conserving reconstructions well suited to advection-dominated extremes in atmospheric and oceanic applications.
  arXiv  Detail & Related papers  (2026-02-18T14:41:54Z)
• Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecasting [79.37674445572462]
  Time series forecasting (TSF) remains a challenging problem due to the intricate entanglement of intraperiod-fluctuations and interperiod-trends.<n>Treating reshaped tensors as static images results in a topological mismatch.<n> relying on uniform fixed-size representations allocates modeling capacity inefficiently.<n>TimeGS is a novel framework that fundamentally shifts the forecasting paradigm from regression to 2D generative rendering.
  arXiv  Detail & Related papers  (2026-02-10T14:13:36Z)
• A Decomposition-based State Space Model for Multivariate Time-Series Forecasting [0.0]
  We propose an end-to-end decomposition framework using three parallel deep state space model branches to capture trend, seasonal, and residual components.<n>Across standard benchmarks, DecompSSM outperformed strong baselines, indicating the effectiveness of combining component-wise deep state space models and global context refinement.
  arXiv  Detail & Related papers  (2026-02-05T07:17:08Z)
• Local-Global Temporal Difference Learning for Satellite Video Super-Resolution [53.03380679343968]
  We propose to exploit the well-defined temporal difference for efficient and effective temporal compensation.<n>To fully utilize the local and global temporal information within frames, we systematically modeled the short-term and long-term temporal discrepancies.<n> Rigorous objective and subjective evaluations conducted across five mainstream video satellites demonstrate that our method performs favorably against state-of-the-art approaches.
  arXiv  Detail & Related papers  (2023-04-10T07:04:40Z)
• Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modeling [105.69197687940505]
  We propose to explore the role of explicit temporal difference modeling in both LR and HR space. To further enhance the super-resolution result, not only spatial residual features are extracted, but the difference between consecutive frames in high-frequency domain is also computed.
  arXiv  Detail & Related papers  (2022-04-14T17:07:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.