PIMSM: Physics-Informed Multi-Scale Mamba for Stable Neural Representations under Distribution Shift

• URL: http://arxiv.org/abs/2605.16351v1
• Date: Fri, 08 May 2026 04:58:05 GMT
• Title: PIMSM: Physics-Informed Multi-Scale Mamba for Stable Neural Representations under Distribution Shift
• Abstract summary: We argue that failure to preserve scientific temporal structure contributes to brittleness under distribution shift.<n>We propose Physics-Informed Multi-Scale Mamba, a state-space architecture that maps spectrum-estimated transition points between frequency regimes.<n>On Human Connectome Project fMRI, PIMSM improves robustness and representation stability under severe temporal-context truncation.
• Score: 16.230225739605316
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Scientific foundation models are expected to reuse representations under changes in dataset, acquisition protocol, and deployment domain, yet many sequence backbones treat scientific temporal structure as an unconstrained pattern to be fitted. We argue that this misses a central property of natural dynamical systems: neural and atmospheric time series are organized by interacting processes across multiple physical timescales, and failure to preserve this multiscale structure contributes to brittleness under distribution shift. We formalize this failure mode as temporal kernel mismatch, where a model fits in-distribution dynamics with an effective memory policy that is not anchored to the signal's physical timescales, leading to representation drift and degraded transfer. We propose Physics-Informed Multi-Scale Mamba (PIMSM), a state-space architecture that maps spectrum-estimated transition points between frequency regimes (knee frequencies) to scale-specific discretization parameters and anchors them to acquisition time units. On Human Connectome Project fMRI, PIMSM improves robustness and representation stability under severe temporal-context truncation, extreme low-resource transfer, and resting-state-to-task-state generalization. Without modality-specific adaptation, the same architecture also attains the lowest variable-wise MAE across all reported horizons and variables on Weather-5K held-out-station spatial out-of-distribution forecasting. These results support temporal-scale alignment as a practical inductive bias for scientific foundation models that must preserve structure, not only fit correlations, under deployment shift.

Related papers

• DyG$^2$T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer [86.4618122245946]
  DyG$2$T is a dynamics modeling framework that infers object motion trajectories by spatially completing and temporally discriminating Key Point representations.<n>Experiments on both synthetic and real-world datasets demonstrate that DyG$2$T achieves accurate dynamics modeling and reasoning.
  arXiv  Detail & Related papers  (2026-08-19T03:44:28Z)
• FRACTAL: SSM with Fractional Recurrent Architecture for Computational Temporal Analysis of Long Sequences [13.320173396455226]
  This paper proposes a Fractional Recurrent Architecture for Computational Temporal Analysis of Long sequences (FRACTAL)<n>By deriving projection operators with analytically characterized spectral properties and a tunable index, the proposed method sensitivity to recent signal perturbations while preserving the spectral structure that encodes fractional scale-invariant memory dynamics.<n>FRACTAL achieves an average score of 87.11% on the Long Range Arena benchmark, including 61.85% on the ListOps task, outperforming the S5 model.
  arXiv  Detail & Related papers  (2026-05-09T09:38:44Z)
• TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecasting [67.91113180885601]
  TimeAPN explicitly models and predicts non-stationary factors from both the time and frequency domains.<n>TimeAPN consistently improves long-term forecasting accuracy across multiple prediction horizons.<n>It outperforms state-of-the-art reversible normalization methods.
  arXiv  Detail & Related papers  (2026-03-18T07:21:24Z)
• UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration [24.102050375727263]
  UniMamba is a unified spatial-temporal forecasting framework.<n>It integrates efficient state-space dynamics with attention-based dependency learning.<n>It consistently outperforms state-of-the-art forecasting models in both forecasting accuracy and computational efficiency.
  arXiv  Detail & Related papers  (2026-03-06T05:00:28Z)
• MEMTS: Internalizing Domain Knowledge via Parameterized Memory for Retrieval-Free Domain Adaptation of Time Series Foundation Models [51.506429027626005]
  Memory for Time Series (MEMTS) is a lightweight and plug-and-play method for retrieval-free domain adaptation in time series forecasting.<n>Key component of MEMTS is a Knowledge Persistence Module (KPM), which internalizes domain-specific temporal dynamics.<n>This paradigm shift enables MEMTS to achieve accurate domain adaptation with constant-time inference and near-zero latency.
  arXiv  Detail & Related papers  (2026-02-14T14:00:06Z)
• A Representation-Consistent Gated Recurrent Framework for Robust Medical Time-Series Classification [0.0]
  We propose a representation-consistent gated recurrent framework (RC-GRF) that introduces a principled regularization strategy to enforce temporal consistency in hidden-state representations.<n>The proposed framework is model-agnostic and can be integrated into existing gated recurrent architectures without modifying their internal gating mechanisms.
  arXiv  Detail & Related papers  (2026-02-10T17:16:49Z)
• Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecasting [79.37674445572462]
  Time series forecasting (TSF) remains a challenging problem due to the intricate entanglement of intraperiod-fluctuations and interperiod-trends.<n>Treating reshaped tensors as static images results in a topological mismatch.<n> relying on uniform fixed-size representations allocates modeling capacity inefficiently.<n>TimeGS is a novel framework that fundamentally shifts the forecasting paradigm from regression to 2D generative rendering.
  arXiv  Detail & Related papers  (2026-02-10T14:13:36Z)
• A Decomposition-based State Space Model for Multivariate Time-Series Forecasting [0.0]
  We propose an end-to-end decomposition framework using three parallel deep state space model branches to capture trend, seasonal, and residual components.<n>Across standard benchmarks, DecompSSM outperformed strong baselines, indicating the effectiveness of combining component-wise deep state space models and global context refinement.
  arXiv  Detail & Related papers  (2026-02-05T07:17:08Z)
• Multivariate Long-term Time Series Forecasting with Fourier Neural Filter [42.60778405812048]
  We introduce FNF as the backbone and DBD as architecture to provide excellent learning capabilities and optimal learning pathways for spatial-temporal modeling.<n>We show that FNF unifies local time-domain and global frequency-domain information processing within a single backbone that extends naturally to spatial modeling.
  arXiv  Detail & Related papers  (2025-06-10T18:40:20Z)
• FR-Mamba: Time-Series Physical Field Reconstruction Based on State Space Model [9.340916033226604]
  Physical field reconstruction aims to predict the state distribution of physical quantities based on limited sensor measurements.<n>Existing deep learning methods often fail to capture long-range temporal, time-evolving dependencies.<n>We propose FR-Mamba, a novel flow field reconstruction framework based on state space modeling.
  arXiv  Detail & Related papers  (2025-05-21T23:54:36Z)
• A Poisson-Gamma Dynamic Factor Model with Time-Varying Transition Dynamics [51.147876395589925]
  A non-stationary PGDS is proposed to allow the underlying transition matrices to evolve over time. A fully-conjugate and efficient Gibbs sampler is developed to perform posterior simulation. Experiments show that, in comparison with related models, the proposed non-stationary PGDS achieves improved predictive performance.
  arXiv  Detail & Related papers  (2024-02-26T04:39:01Z)
• Supporting Optimal Phase Space Reconstructions Using Neural Network Architecture for Time Series Modeling [68.8204255655161]
  We propose an artificial neural network with a mechanism to implicitly learn the phase spaces properties. Our approach is either as competitive as or better than most state-of-the-art strategies.
  arXiv  Detail & Related papers  (2020-06-19T21:04:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.