WaveFormer: Wavelet Embedding Transformer for Biomedical Signals

• URL: http://arxiv.org/abs/2602.12189v1
• Date: Thu, 12 Feb 2026 17:20:43 GMT
• Title: WaveFormer: Wavelet Embedding Transformer for Biomedical Signals
• Authors: Habib Irani, Bikram De, Vangelis Metsis,
• Abstract summary: We propose a transformer architecture that integrates wavelet decomposition at two critical stages: embedding construction and positional encoding.<n>We evaluate WaveFormer on eight diverse datasets spanning human activity recognition and brain signal analysis, with sequence lengths ranging from 50 to 3000 timesteps and channel counts from 1 to 144.
• Score: 1.2922946578413579
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Biomedical signal classification presents unique challenges due to long sequences, complex temporal dynamics, and multi-scale frequency patterns that are poorly captured by standard transformer architectures. We propose WaveFormer, a transformer architecture that integrates wavelet decomposition at two critical stages: embedding construction, where multi-channel Discrete Wavelet Transform (DWT) extracts frequency features to create tokens containing both time-domain and frequency-domain information, and positional encoding, where Dynamic Wavelet Positional Encoding (DyWPE) adapts position embeddings to signal-specific temporal structure through mono-channel DWT analysis. We evaluate WaveFormer on eight diverse datasets spanning human activity recognition and brain signal analysis, with sequence lengths ranging from 50 to 3000 timesteps and channel counts from 1 to 144. Experimental results demonstrate that WaveFormer achieves competitive performance through comprehensive frequency-aware processing. Our approach provides a principled framework for incorporating frequency-domain knowledge into transformer-based time series classification.

Related papers

• TFWaveFormer: Temporal-Frequency Collaborative Multi-level Wavelet Transformer for Dynamic Link Prediction [13.707047958676482]
  We propose TFWaveFormer, a novel Transformer architecture that integrates temporal-frequency analysis with wavelet decomposition to enhance dynamic link prediction.<n>Our framework comprises three key components: (i) a temporal-frequency coordination mechanism that jointly models temporal and spectral representations, (ii) a learnable multi-resolution wavelet decomposition module that adaptively extracts multi-scale temporal patterns through parallel convolutions, and (iii) a hybrid Transformer module that effectively fuses local wavelet features with global temporal dependencies.
  arXiv  Detail & Related papers  (2026-03-04T11:47:57Z)
• AWGformer: Adaptive Wavelet-Guided Transformer for Multi-Resolution Time Series Forecasting [3.453296006042559]
  Time series forecasting requires capturing patterns across multiple temporal scales.<n>This paper introduces AWGformer, a novel architecture that integrates adaptive wavelet decomposition with cross-scale attention mechanisms.
  arXiv  Detail & Related papers  (2026-01-28T09:14:22Z)
• WaveTuner: Comprehensive Wavelet Subband Tuning for Time Series Forecasting [22.28753360953834]
  We propose a Wavelet decomposition framework empowered by full-spectrum subband Tuning for time series forecasting.<n>WaveTuner comprises two key modules: (i) Adaptive Wavelet Refinement module, that transforms time series into time-frequency coefficients, and (ii) Multi-Branch module, that employs multiple functional branches, each instantiated as a flexible Kolmogorov-Arnold Network (KAN) with a distinct functional order to model a specific spectral subband.
  arXiv  Detail & Related papers  (2025-11-24T07:33:35Z)
• WaveletDiff: Multilevel Wavelet Diffusion For Time Series Generation [15.28917997999402]
  WaveletDiff is a novel framework that trains diffusion models directly on wavelet coefficients to exploit the inherent multi-resolution structure of time series data.<n>It consistently outperforms state-of-the-art time-domain and frequency-domain generative methods on both short and long time series across five diverse performance metrics.
  arXiv  Detail & Related papers  (2025-10-13T18:47:33Z)
• DyWPE: Signal-Aware Dynamic Wavelet Positional Encoding for Time Series Transformers [1.4524096882720263]
  We introduce Dynamic Wavelet Positional.<n>time series (DyWPE), a novel signal-aware framework that generates positional embeddings directly from input time using the Discrete Wavelet Transform (DWT)<n>DyWPE consistently outperforms eight existing state-of-the-art positional encoding methods, achieving average relative improvements of 9.1% compared to baseline sinusoidal absolute position encoding in biomedical signals.
  arXiv  Detail & Related papers  (2025-09-18T05:37:33Z)
• Wavelet-Guided Dual-Frequency Encoding for Remote Sensing Change Detection [67.84730634802204]
  Change detection in remote sensing imagery plays a vital role in various engineering applications, such as natural disaster monitoring, urban expansion tracking, and infrastructure management.<n>Most existing methods still rely on spatial-domain modeling, where the limited diversity of feature representations hinders the detection of subtle change regions.<n>We observe that frequency-domain feature modeling particularly in the wavelet domain amplify fine-grained differences in frequency components, enhancing the perception of edge changes that are challenging to capture in the spatial domain.
  arXiv  Detail & Related papers  (2025-08-07T11:14:16Z)
• MFRS: A Multi-Frequency Reference Series Approach to Scalable and Accurate Time-Series Forecasting [51.94256702463408]
  Time series predictability is derived from periodic characteristics at different frequencies.<n>We propose a novel time series forecasting method based on multi-frequency reference series correlation analysis.<n> Experiments on major open and synthetic datasets show state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-03-11T11:40:14Z)
• WFTNet: Exploiting Global and Local Periodicity in Long-term Time Series Forecasting [61.64303388738395]
  We propose a Wavelet-Fourier Transform Network (WFTNet) for long-term time series forecasting. Tests on various time series datasets show WFTNet consistently outperforms other state-of-the-art baselines.
  arXiv  Detail & Related papers  (2023-09-20T13:44:18Z)
• MultiWave: Multiresolution Deep Architectures through Wavelet Decomposition for Multivariate Time Series Prediction [6.980076213134384]
  MultiWave is a novel framework that enhances deep learning time series models by incorporating components that operate at the intrinsic frequencies of signals. We show that MultiWave consistently identifies critical features and their frequency components, thus providing valuable insights into the applications studied.
  arXiv  Detail & Related papers  (2023-06-16T20:07:15Z)
• Transform Once: Efficient Operator Learning in Frequency Domain [69.74509540521397]
  We study deep neural networks designed to harness the structure in frequency domain for efficient learning of long-range correlations in space or time. This work introduces a blueprint for frequency domain learning through a single transform: transform once (T1)
  arXiv  Detail & Related papers  (2022-11-26T01:56:05Z)
• WaveTTS: Tacotron-based TTS with Joint Time-Frequency Domain Loss [74.11899135025503]
  Tacotron-based text-to-speech (TTS) systems directly synthesize speech from text input. We propose a new training scheme for Tacotron-based TTS, referred to as WaveTTS, that has 2 loss functions. WaveTTS ensures both the quality of the acoustic features and the resulting speech waveform.
  arXiv  Detail & Related papers  (2020-02-02T15:51:22Z)
• Transforming Spectrum and Prosody for Emotional Voice Conversion with Non-Parallel Training Data [91.92456020841438]
  Many studies require parallel speech data between different emotional patterns, which is not practical in real life. We propose a CycleGAN network to find an optimal pseudo pair from non-parallel training data. We also study the use of continuous wavelet transform (CWT) to decompose F0 into ten temporal scales, that describes speech prosody at different time resolution.
  arXiv  Detail & Related papers  (2020-02-01T12:36:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.