TimeMM: Time-as-Operator Spectral Filtering for Dynamic Multimodal Recommendation

• URL: http://arxiv.org/abs/2604.26247v1
• Date: Wed, 29 Apr 2026 03:04:43 GMT
• Title: TimeMM: Time-as-Operator Spectral Filtering for Dynamic Multimodal Recommendation
• Abstract summary: Multimodal recommendation improves user modeling by integrating collaborative signals with heterogeneous item content.<n>TimeMM is a time-conditioned spectral filtering framework for dynamic multimodal recommendation.<n>TimeMM consistently outperforms state-of-the-art multimodal recommenders on real-world benchmarks.
• Score: 29.47780247822949
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multimodal recommendation improves user modeling by integrating collaborative signals with heterogeneous item content. In real applications, user interests evolve over time and exhibit nonstationary dynamics, where different preference factors change at different rates. This challenge is amplified in multimodal settings because visual and textual cues can dominate decisions under different temporal regimes. Despite strong progress, most multimodal recommenders still rely on static interaction graphs or coarse temporal heuristics, which limits their ability to model continuous preference evolution with fine-grained temporal adaptation. To address these limitations, we propose TimeMM, a time-conditioned spectral filtering framework for dynamic multimodal recommendation. TimeMM instantiates Time-as-Operator by mapping interaction recency to a family of parametric temporal kernels that reweight edges on the user--item graph, producing component-specific representations without explicit eigendecomposition. To capture non-stationary interests, we introduce Adaptive Spectral Filtering that mixes the operator bank according to temporal context, yielding prediction-specific effective spectral responses. To account for modality-specific temporal sensitivity, we further propose Spectral-Aware Modality Routing that calibrates visual and textual contributions conditioned on the same temporal context. Finally, a ranking-space Spectral Diversity Regularization encourages complementary expert behaviors and prevents filter-bank collapse. Extensive experiments on real-world benchmarks demonstrate that TimeMM consistently outperforms state-of-the-art multimodal recommenders while maintaining linear-time scalability.

Related papers

• Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection [1.2072875728151518]
  weakly supervised video anomaly detection (WSVAD) has emerged as a critical research frontier.<n>Most existing approaches formulate WSVAD within a Multiple Instance Learning (MIL) framework that relies on rigid, hand-crafted temporal priors to supervise anomaly scoring.<n>We propose an adaptive temporal modeling framework for WSVAD that explicitly accounts for variations in video dynamics across multiple temporal granularities.
  arXiv  Detail & Related papers  (2026-09-04T12:27:43Z)
• Drift-Aware Multimodal User Representation Learning via Multi-Scale Temporal Modeling and Sparse Mixture-of-Experts [8.624467983444255]
  We propose DUMoE, a unified framework for drift-aware multimodal user representation learning.<n>Our model consists of (i) a temporal dynamics-aware backbone that captures and integrates static profiles, short-term behavioral signals, and long-term dependencies into a coherent representation, and (ii) a sparse mixture-of-experts (MoE) interest adapter that disentangles multiple latent interests via expert specialization and adaptive routing.<n>Experiments on real-world social media datasets show that DUMoE consistently outperforms state-of-the-art methods on both user interest prediction and interaction prediction tasks.
  arXiv  Detail & Related papers  (2026-08-26T13:15:17Z)
• Fuzzy-MoE: Interpretable Regime-Conditioned Expert Routing for Non-Stationary Multivariate Time Series Forecasting [10.050287855808307]
  Fuzzy-MoE is a fuzzy logic-based dynamic Mixture-of-Experts model.<n>It infers latent temporal states and computes expert activation strengths through learnable Gaussian membership functions.<n>It significantly outperforms mainstream forecasting methods in forecasting accuracy.
  arXiv  Detail & Related papers  (2026-08-21T05:49:32Z)
• Multi-Rate Mixture of Experts for Accelerating Liquid Neural Network Training [5.248012610915348]
  Liquid Neural Networks (LNNs) address some of these limitations through continuous-time dynamics.<n>We propose a Multi-Rate Mixture-of-Experts (MR-MoE) framework built on top of Liquid Neural Networks.<n>In the proposed architecture, multiple LNN-based experts operate at distinct time scales, enabling the model to explicitly separate fast-changing dynamics from slow-evolving temporal trends.
  arXiv  Detail & Related papers  (2026-06-10T15:43:20Z)
• Multimodal Forecasting for Commodity Prices Using Spectrogram-Based and Time Series Representations [6.409220743870009]
  This paper presents Spectrogram-Enhanced Multimodal Fusion (SEMF)<n>SEMF combines spectral and temporal representations for more accurate and robust forecasting.<n>Results demonstrate the effectiveness of multimodal fusion and spectrogram-based encoding in capturing multi-scale patterns.
  arXiv  Detail & Related papers  (2026-03-28T15:57:42Z)
• Mixture of Sequence: Theme-Aware Mixture-of-Experts for Long-Sequence Recommendation [48.98369214412951]
  We propose a model-agnostic MoE approach that achieves accurate predictions by extracting theme-specific and multi-scale subsequences from noisy raw user sequences.<n> Experimental results demonstrate that MoS consistently achieves the SOTA performance while introducing fewer FLOPs.
  arXiv  Detail & Related papers  (2026-03-01T23:20:48Z)
• GEMs: Breaking the Long-Sequence Barrier in Generative Recommendation with a Multi-Stream Decoder [54.64137490632567]
  We propose a novel and unified framework designed to capture users' sequences from long-term history.<n>Generative Multi-streamers ( GEMs) break user sequences into three streams.<n>Extensive experiments on large-scale industrial datasets demonstrate that GEMs significantly outperforms state-the-art methods in recommendation accuracy.
  arXiv  Detail & Related papers  (2026-02-14T06:42:56Z)
• FusAD: Time-Frequency Fusion with Adaptive Denoising for General Time Series Analysis [92.23551599659186]
  Time series analysis plays a vital role in fields such as finance, healthcare, industry, and meteorology.<n>FusAD is a unified analysis framework designed for diverse time series tasks.
  arXiv  Detail & Related papers  (2025-12-16T04:34:27Z)
• SEED: Spectral Entropy-Guided Evaluation of SpatialTemporal Dependencies for Multivariate Time Series Forecasting [8.507253633170947]
  We develop a Spectral Entropy-guided Evaluation framework for spatial-temporal Dependency modeling.<n>SEED provides a preliminary evaluation of the spatial and temporal dependencies of each variable, enabling the model to adaptively balance Channel Independence (CI) and Channel Dependence (CD) strategies.<n>SEED achieves state-of-the-art performance, validating its effectiveness and generality.
  arXiv  Detail & Related papers  (2025-12-09T06:18:05Z)
• FAIM: Frequency-Aware Interactive Mamba for Time Series Classification [87.84511960413715]
  Time series classification (TSC) is crucial in numerous real-world applications, such as environmental monitoring, medical diagnosis, and posture recognition.<n>We propose FAIM, a lightweight Frequency-Aware Interactive Mamba model.<n>We show that FAIM consistently outperforms existing state-of-the-art (SOTA) methods, achieving a superior trade-off between accuracy and efficiency.
  arXiv  Detail & Related papers  (2025-11-26T08:36:33Z)
• Multi-modal Adaptive Estimation for Temporal Respiratory Disease Outbreak [8.861941883057098]
  MAESTRO is a novel, unified framework that integrates spectro-temporal modeling with multi-modal data fusion.<n> Evaluated on over 11 years of Hong Kong data, MAESTRO achieves a superior model fit with an R-square of 0.956.<n>The modular and reproducible pipeline is made publicly available to facilitate deployment and extension to other regions and pathogens.
  arXiv  Detail & Related papers  (2025-09-10T13:27:40Z)
• What Makes LLMs Effective Sequential Recommenders? A Study on Preference Intensity and Temporal Context [56.590259941275434]
  RecPO is a preference optimization framework for sequential recommendation.<n>It exploits adaptive reward margins based on inferred preference hierarchies and temporal signals.<n>It mirrors key characteristics of human decision-making: favoring timely satisfaction, maintaining coherent preferences, and exercising discernment under shifting contexts.
  arXiv  Detail & Related papers  (2025-06-02T21:09:29Z)
• Investigating and Enhancing the Robustness of Large Multimodal Models Against Temporal Inconsistency [59.05753942719665]
  We propose a novel temporal robustness benchmark (TemRobBench) to assess the robustness of models.<n>We evaluate 16 mainstream LMMs and find that they exhibit over-reliance on prior knowledge and textual context in adversarial environments.<n>We design panoramic direct preference optimization (PanoDPO) to encourage LMMs to incorporate both visual and linguistic feature preferences simultaneously.
  arXiv  Detail & Related papers  (2025-05-20T14:18:56Z)
• Deep Explicit Duration Switching Models for Time Series [84.33678003781908]
  We propose a flexible model that is capable of identifying both state- and time-dependent switching dynamics. State-dependent switching is enabled by a recurrent state-to-switch connection. An explicit duration count variable is used to improve the time-dependent switching behavior.
  arXiv  Detail & Related papers  (2021-10-26T17:35:21Z)
• Kalman Filtering and Expectation Maximization for Multitemporal Spectral Unmixing [20.404244393774253]
  We propose a spectral unmixing (SU) strategy using physically motivated endmember representations to account for temporal spectral variability. By representing the multitemporal mixing process using a state-space formulation, we are able to exploit the filtering machinery to estimate endmember variability coefficients. Simulation results indicate that the proposed strategy outperforms state-of-the-art multitemporal SU algorithms.
  arXiv  Detail & Related papers  (2020-01-02T13:12:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.