Ada-MoGE: Adaptive Mixture of Gaussian Expert Model for Time Series Forecasting

• URL: http://arxiv.org/abs/2512.02061v1
• Date: Sat, 29 Nov 2025 02:08:42 GMT
• Title: Ada-MoGE: Adaptive Mixture of Gaussian Expert Model for Time Series Forecasting
• Abstract summary: We propose Ada-MoGE, an adaptive Gaussian Mixture of Experts model.<n>Ada-MoGE integrates spectral intensity and frequency response to adaptively determine the number of experts.
• Score: 16.466584215901467
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multivariate time series forecasts are widely used, such as industrial, transportation and financial forecasts. However, the dominant frequencies in time series may shift with the evolving spectral distribution of the data. Traditional Mixture of Experts (MoE) models, which employ a fixed number of experts, struggle to adapt to these changes, resulting in frequency coverage imbalance issue. Specifically, too few experts can lead to the overlooking of critical information, while too many can introduce noise. To this end, we propose Ada-MoGE, an adaptive Gaussian Mixture of Experts model. Ada-MoGE integrates spectral intensity and frequency response to adaptively determine the number of experts, ensuring alignment with the input data's frequency distribution. This approach prevents both information loss due to an insufficient number of experts and noise contamination from an excess of experts. Additionally, to prevent noise introduction from direct band truncation, we employ Gaussian band-pass filtering to smoothly decompose the frequency domain features, further optimizing the feature representation. The experimental results show that our model achieves state-of-the-art performance on six public benchmarks with only 0.2 million parameters.

Related papers

• Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Prediction [74.05279072166697]
  Exponential-Gaussian Mixture Network (EGMN) models the full conditional WT distribution.<n>EGMN is vulnerable to variance collapse, component redundancy, and inactive components.<n>We propose a Hierarchical Exponential-Gaussian Mixture (HEGM) model that addresses these failure modes.
  arXiv  Detail & Related papers  (2026-08-24T15:06:18Z)
• AnchorMoE: Interpretable Time Series Classification via Anchor-Routed MoE [51.994752158953084]
  AnchorMoE is an interpretable-by-construction classification framework.<n>It encodes multi-view representations of local patches and routes them to specialized experts.<n>Experiments on real-world and synthetic benchmarks demonstrate that AnchorMoE achieves highly competitive classification performance.
  arXiv  Detail & Related papers  (2026-06-02T13:30:54Z)
• FourierMoE: Fourier Mixture-of-Experts Adaptation of Large Language Models [15.447455377430634]
  FourierMoE is a frequency-adaptive router to dispatch tokens to experts specialized in distinct frequency bands.<n>It consistently outperforms competitive baselines in both single-task and multi-task settings.<n>Results highlight the promise of spectral-domain expert adaptation as an effective and parameter-efficient paradigm for LLM fine-tuning.
  arXiv  Detail & Related papers  (2026-04-02T08:30:06Z)
• SDMixer: Sparse Dual-Mixer for Time Series Forecasting [8.124083509364981]
  This paper proposes a dual-stream sparse prediction framework that extracts global trends and local dynamic features from sequences in both the frequency and time domains.<n>It employs a sparsity mechanism to filter out invalid information, thereby enhancing the accuracy of cross-variable dependency modeling.
  arXiv  Detail & Related papers  (2026-02-27T01:13:56Z)
• Bridging Time and Frequency: A Joint Modeling Framework for Irregular Multivariate Time Series Forecasting [7.6757168009144126]
  We propose TFMixer, a joint time-frequency modeling framework for IMTS forecasting.<n>Specifically, TFMixer incorporates a Global Frequency Module that employs a learnable Non-Uniform Discrete Fourier Transform (NUDFT) to directly extract spectral representations from irregular timestamps.<n>In parallel, the Local Time Module introduces a query-based patch mixing mechanism to adaptively aggregate informative temporal patches and alleviate information density imbalance.
  arXiv  Detail & Related papers  (2026-01-31T07:49:44Z)
• FreIE: Low-Frequency Spectral Bias in Neural Networks for Time-Series Tasks [5.215187965365735]
  We show that models tend to fit low-frequency signals before high-frequency ones.<n>We propose the FreLE algorithm, which enhances model generalization through both explicit and implicit frequency regularization.
  arXiv  Detail & Related papers  (2025-10-29T03:22:51Z)
• A Unified Frequency Domain Decomposition Framework for Interpretable and Robust Time Series Forecasting [81.73338008264115]
  Current approaches for time series forecasting, whether in the time or frequency domain, predominantly use deep learning models based on linear layers or transformers.<n>We propose FIRE, a unified frequency domain decomposition framework that provides a mathematical abstraction for diverse types of time series.<n>Fire consistently outperforms state-of-the-art models on long-term forecasting benchmarks.
  arXiv  Detail & Related papers  (2025-10-11T09:59:25Z)
• LSCD: Lomb-Scargle Conditioned Diffusion for Time series Imputation [55.800319453296886]
  Time series with missing or irregularly sampled data are a persistent challenge in machine learning.<n>We introduce a different Lombiable--Scargle layer that enables a reliable computation of the power spectrum of irregularly sampled data.
  arXiv  Detail & Related papers  (2025-06-20T14:48:42Z)
• FreqMoE: Enhancing Time Series Forecasting through Frequency Decomposition Mixture of Experts [14.01018670507771]
  We propose the Frequency Decomposition Mixture-of-Experts (FreqMoE) model, which decomposes time series data into frequency bands.<n>A gating mechanism adjusts the importance of each output of expert based on frequency characteristics.<n>Experiments demonstrate that FreqMoE outperforms state-of-the-art models.
  arXiv  Detail & Related papers  (2025-01-25T08:25:52Z)
• Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Experts [103.725112190618]
  This paper introduces Moirai-MoE, using a single input/output projection layer while delegating the modeling of diverse time series patterns to the sparse mixture of experts. Extensive experiments on 39 datasets demonstrate the superiority of Moirai-MoE over existing foundation models in both in-distribution and zero-shot scenarios.
  arXiv  Detail & Related papers  (2024-10-14T13:01:11Z)
• Mixture of Efficient Diffusion Experts Through Automatic Interval and Sub-Network Selection [63.96018203905272]
  We propose to reduce the sampling cost by pruning a pretrained diffusion model into a mixture of efficient experts. We demonstrate the effectiveness of our method, DiffPruning, across several datasets.
  arXiv  Detail & Related papers  (2024-09-23T21:27:26Z)
• Deep Frequency Derivative Learning for Non-stationary Time Series Forecasting [12.989064148254936]
  We present a deep frequency derivative learning framework, DERITS, for non-stationary time series forecasting. Specifically, DERITS is built upon a novel reversible transformation, namely Frequency Derivative Transformation (FDT)
  arXiv  Detail & Related papers  (2024-06-29T17:56:59Z)
• On the Frequency Bias of Generative Models [61.60834513380388]
  We analyze proposed measures against high-frequency artifacts in state-of-the-art GAN training. We find that none of the existing approaches can fully resolve spectral artifacts yet. Our results suggest that there is great potential in improving the discriminator.
  arXiv  Detail & Related papers  (2021-11-03T18:12:11Z)
• Deep Autoregressive Models with Spectral Attention [74.08846528440024]
  We propose a forecasting architecture that combines deep autoregressive models with a Spectral Attention (SA) module. By characterizing in the spectral domain the embedding of the time series as occurrences of a random process, our method can identify global trends and seasonality patterns. Two spectral attention models, global and local to the time series, integrate this information within the forecast and perform spectral filtering to remove time series's noise.
  arXiv  Detail & Related papers  (2021-07-13T11:08:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.