Learnable Koopman-Enhanced Transformer-Based Time Series Forecasting with Spectral Control

• URL: http://arxiv.org/abs/2602.02592v1
• Date: Sun, 01 Feb 2026 09:13:49 GMT
• Title: Learnable Koopman-Enhanced Transformer-Based Time Series Forecasting with Spectral Control
• Authors: Ali Forootani, Raffaele Iervolino,
• Abstract summary: We introduce four learnable Koopman variants-scalar-gated, per-mode, gated, linear-shaped spectral mapping, and low-rank Koopman operators.<n>Our formulation enables explicit control over the spectrum, stability, and rank of the linear transition operator.<n>Our results demonstrate that learnable Koopman operators are effective, stable, and theoretically principled components for deep forecasting.
• Score: 1.2604738912025477
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This paper proposes a unified family of learnable Koopman operator parameterizations that integrate linear dynamical systems theory with modern deep learning forecasting architectures. We introduce four learnable Koopman variants-scalar-gated, per-mode gated, MLP-shaped spectral mapping, and low-rank Koopman operators which generalize and interpolate between strictly stable Koopman operators and unconstrained linear latent dynamics. Our formulation enables explicit control over the spectrum, stability, and rank of the linear transition operator while retaining compatibility with expressive nonlinear backbones such as Patchtst, Autoformer, and Informer. We evaluate the proposed operators in a large-scale benchmark that also includes LSTM, DLinear, and simple diagonal State-Space Models (SSMs), as well as lightweight transformer variants. Experiments across multiple horizons and patch lengths show that learnable Koopman models provide a favorable bias-variance trade-off, improved conditioning, and more interpretable latent dynamics. We provide a full spectral analysis, including eigenvalue trajectories, stability envelopes, and learned spectral distributions. Our results demonstrate that learnable Koopman operators are effective, stable, and theoretically principled components for deep forecasting.

Related papers

• KoopGen: Koopman Generator Networks for Representing and Predicting Dynamical Systems with Continuous Spectra [65.11254608352982]
  We introduce a generator-based neural Koopman framework that models dynamics through a structured, state-dependent representation of Koopman generators.<n>By exploiting the intrinsic Cartesian decomposition into skew-adjoint and self-adjoint components, KoopGen separates conservative transport from irreversible dissipation.
  arXiv  Detail & Related papers  (2026-02-15T06:32:23Z)
• KoopCast: Trajectory Forecasting via Koopman Operators [12.103961182264037]
  We present KoopCast, a lightweight model for trajectory forecasting in general dynamic environments.<n>We use Koopman operator theory, which enables a linear representation of nonlinear dynamics by lifting trajectories into a higher-dimensional space.<n>Our model offers three key advantages: (i) competitive accuracy, (ii) interpretability grounded in Koopman theory, and (iii) low-latency deployment.
  arXiv  Detail & Related papers  (2025-09-19T01:27:53Z)
• DeepKoopFormer: A Koopman Enhanced Transformer Based Architecture for Time Series Forecasting [0.9217021281095907]
  Time series forecasting plays a vital role across scientific, industrial, and environmental domains.<n>DeepKoopFormer is a principled forecasting framework that combines the representational power of Transformers with the theoretical rigor of Koopman operator theory.<n>Our model features a modular encoder-propagator-decoder structure, where temporal dynamics are learned via a spectrally constrained, linear Koopman operator in a latent space.
  arXiv  Detail & Related papers  (2025-08-04T17:05:55Z)
• Efficient Parametric SVD of Koopman Operator for Stochastic Dynamical Systems [51.54065545849027]
  The Koopman operator provides a principled framework for analyzing nonlinear dynamical systems.<n>VAMPnet and DPNet have been proposed to learn the leading singular subspaces of the Koopman operator.<n>We propose a scalable and conceptually simple method for learning the top-$k$ singular functions of the Koopman operator.
  arXiv  Detail & Related papers  (2025-07-09T18:55:48Z)
• Unfolding Generative Flows with Koopman Operators: Fast and Interpretable Sampling [25.420559502119485]
  Continuous Normalizing Flows (CNFs) enable elegant generative modeling but remain bottlenecked by slow sampling.<n>Recent approaches such as Rectified Flow and OT-CFM accelerate sampling by straightening trajectories, yet the learned dynamics remain nonlinear black boxes.<n>We propose globally linearizing flow dynamics via Koopman theory.
  arXiv  Detail & Related papers  (2025-06-27T15:16:16Z)
• SKOLR: Structured Koopman Operator Linear RNN for Time-Series Forecasting [24.672521835707446]
  We establish a connection between Koopman operator approximation and linear Recurrent Neural Networks (RNNs)<n>We present SKOLR, which integrates a learnable spectral decomposition of the input signal with a multilayer perceptron (MLP) as the measurement functions.<n> Numerical experiments on various forecasting benchmarks and dynamical systems show that this streamlined, Koopman-theory-based design delivers exceptional performance.
  arXiv  Detail & Related papers  (2025-06-17T02:11:06Z)
• Koopman-Assisted Reinforcement Learning [8.812992091278668]
  The Bellman equation and its continuous form, the Hamilton-Jacobi-Bellman (HJB) equation, are ubiquitous in reinforcement learning (RL) and control theory. This paper explores the connection between the data-driven Koopman operator and Decision Processes (MDPs) We develop two new RL algorithms to address these limitations.
  arXiv  Detail & Related papers  (2024-03-04T18:19:48Z)
• Provable Guarantees for Generative Behavior Cloning: Bridging Low-Level Stability and High-Level Behavior [51.60683890503293]
  We propose a theoretical framework for studying behavior cloning of complex expert demonstrations using generative modeling. We show that pure supervised cloning can generate trajectories matching the per-time step distribution of arbitrary expert trajectories.
  arXiv  Detail & Related papers  (2023-07-27T04:27:26Z)
• Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictors [85.22004745984253]
  Real-world time series are characterized by intrinsic non-stationarity that poses a principal challenge for deep forecasting models. We tackle non-stationary time series with modern Koopman theory that fundamentally considers the underlying time-variant dynamics. We propose Koopa as a novel Koopman forecaster composed of stackable blocks that learn hierarchical dynamics.
  arXiv  Detail & Related papers  (2023-05-30T07:40:27Z)
• GFlowNet-EM for learning compositional latent variable models [115.96660869630227]
  A key tradeoff in modeling the posteriors over latents is between expressivity and tractable optimization. We propose the use of GFlowNets, algorithms for sampling from an unnormalized density. By training GFlowNets to sample from the posterior over latents, we take advantage of their strengths as amortized variational algorithms.
  arXiv  Detail & Related papers  (2023-02-13T18:24:21Z)
• KoopmanizingFlows: Diffeomorphically Learning Stable Koopman Operators [7.447933533434023]
  We propose a novel framework for constructing linear time-invariant (LTI) models for a class of stable nonlinear dynamics. We learn the Koopman operator features without assuming a predefined library of functions or knowing the spectrum. We demonstrate the superior efficacy of the proposed method in comparison to a state-of-the-art method on the well-known LASA handwriting dataset.
  arXiv  Detail & Related papers  (2021-12-08T02:40:40Z)
• Estimating Koopman operators for nonlinear dynamical systems: a nonparametric approach [77.77696851397539]
  The Koopman operator is a mathematical tool that allows for a linear description of non-linear systems. In this paper we capture their core essence as a dual version of the same framework, incorporating them into the Kernel framework. We establish a strong link between kernel methods and Koopman operators, leading to the estimation of the latter through Kernel functions.
  arXiv  Detail & Related papers  (2021-03-25T11:08:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.