LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modeling

• URL: http://arxiv.org/abs/2603.19100v1
• Date: Thu, 19 Mar 2026 16:26:11 GMT
• Title: LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modeling
• Abstract summary: We propose textbfLuMamba (textbfLatent textbfUnified textbfMamba), a self-supervised framework combining topology-invariant encodings with linear-complexity state-space modeling.<n>With only 4.6M parameters, LuMamba attains 80.99% balanced accuracy on TUAB and achieves state-of-art performance on Alzheimer's detection.
• Score: 14.663411219312827
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Electroencephalography (EEG) enables non-invasive monitoring of brain activity across clinical and neurotechnology applications, yet building foundation models for EEG remains challenging due to \emph{differing electrode topologies} and \emph{computational scalability}, as Transformer architectures incur quadratic sequence complexity. As a joint solution, we propose \textbf{LuMamba} (\textbf{L}atent \textbf{U}nified \textbf{Mamba}), a self-supervised framework combining topology-invariant encodings with linear-complexity state-space modeling, using LUNA's learned-query cross-attention mechanism for channel unification~\cite{luna}, and FEMBA's bidirectional Mamba blocks for efficient temporal modeling~\cite{femba}. Within this architecture, we provide the first systematic investigation of the Latent-Euclidean Joint-Embedding Predictive Architecture (LeJEPA) for biosignal learning. Pre-trained on over 21,000 hours of unlabeled EEG from the TUEG corpus, LuMamba is evaluated on five downstream tasks spanning abnormality detection, artifact recognition, and mental condition classification across electrode configurations ranging from 16 to 26 channels. In the pre-training objective, masked reconstruction alone yields structured but less generalizable representations, while LeJEPA alone produces diffuse embeddings; combining both objectives achieves the most robust performance. With only 4.6M parameters, LuMamba attains 80.99\% balanced accuracy on TUAB and achieves state-of-art performance on Alzheimer's detection (0.97 AUPR), while requiring \textbf{377$\times$ fewer FLOPS} than state-of-art models at equivalent sequence lengths and scaling to \textbf{12$\times$ longer sequences} before reaching typical GPU memory limits. Code is available at https://github.com/pulp-bio/biofoundation

Related papers

• GraM-Diff: A Unified Graph-Mamba Diffusion Framework for EEG-Based Alzheimer's Disease Data Generation and Diagnosis [7.064709096702816]
  We propose GraM-Diff, a unified classifier-guided Graph-Mamba diffusion framework for EEG synthesis.<n>It embeds Graph Convolutional Networks within a diffusion U-Net to model inter-electrode connectivity and Bidirectional Mamba state-space blocks for linear-complexity long-range temporal modeling.<n>Across four EEG-based AD benchmarks, synthetic augmentation improves classification, yields superior Context-FID and correlation scores over strong generative baselines, and enhances robustness in data-scarce settings.
  arXiv  Detail & Related papers  (2026-08-30T12:37:47Z)
• MambaADv2: Evolving Duality-enhanced State Space Model for Unsupervised Anomaly Detection [108.36437360254605]
  This paper proposes MambaADv2, a framework tailored for multi-class unsupervised anomaly detection.<n>MambaADv2 comprises a pre-trained encoder and a Mamba-inspired decoder, equipped with Duality-enhanced State Space (DSS) modules across multiple scales.<n>The structure of the Hybrid State Space (HSS) block is tailored by following the SSD-based Mamba lineage and incorporating Mamba3-style position-aware state-space modeling.
  arXiv  Detail & Related papers  (2026-06-22T10:14:06Z)
• Influence-Guided Symbolic Regression: Scientific Discovery via LLM-Driven Equation Search with Granular Feedback [56.69850045068714]
  We introduce textitInfluence-Guided Regression (IGSR), a method that frames equation discovery as an iterative two-step process.<n>We demonstrate IGSRs effectiveness on a diverse suite of benchmarks, including LLM-SRBench, pharmacological PKPD models, an epidemiological simulation, and real-world genomic data.
  arXiv  Detail & Related papers  (2026-05-27T23:48:01Z)
• Beyond the Aggregation Dilemma: Prior-Retaining Decoupled Learning for Multimodal Graphs [69.56407708794845]
  MultimodalAttributed Graph Learning (MAGL) integrates node attributes with structural topology via graph aggregation.<n>As pretrained encoders evolve into Large Foundation Models (LFMs), the landscape of MAGL fundamentally shifts.<n>Under high-confidence LFM priors, mandatory aggregation introduces topological intrinsic noise that overwhelms discriminative signals.<n>We propose SUPRA (Shared-Unique Prior-Retaining Architecture), a decoupled dual-pathway paradigm.<n> SUPRA processes modality-specific features through topology-agnostics while capturing structural synergy via a lightweight shared GNN, with auxiliary deep supervision counteracting gradient starvation.
  arXiv  Detail & Related papers  (2026-05-23T17:42:25Z)
• MedMamba: Recasting Mamba for Medical Time Series Classification [6.852021597208217]
  Medical time series, such as electrocardiograms (ECG) and electroencephalograms (EEG), exhibit complex temporal dynamics.<n>We propose MedMamba, a principle-driven multi-scale bidirectional state space architecture tailored for medical time series classification.<n>Our design is guided by three key inductive biases of physiological signals: spatial centralization, multi-timescale temporal composition, and non-causal contextual dependency.
  arXiv  Detail & Related papers  (2026-04-17T01:20:02Z)
• FEMBA on the Edge: Physiologically-Aware Pre-Training, Quantization, and Deployment of a Bidirectional Mamba EEG Foundation Model on an Ultra-low Power Microcontroller [13.961569964076451]
  We present FEMBA, a bidirectional Mamba architecture pre-trained on over 21,000 hours of EEG.<n>We introduce a novel Physiologically-Aware pre-training objective, consisting of a reconstruction with low-pass filtering.<n>We employ Quantization-Aware Training (QAT) to compress the model to 2-bit weights.
  arXiv  Detail & Related papers  (2026-03-18T13:23:13Z)
• SAMBA: Toward a Long-Context EEG Foundation Model via Spatial Embedding and Differential Mamba [2.1232375739287006]
  Long-sequence electroencephalogram (EEG) modeling is essential for developing generalizable EEG representation models.<n>We propose textitSAMBA, a self-supervised learning framework with a Mamba-based U-shaped encoder-decoder architecture.<n>We show that SAMBA consistently outperforms state-of-the-art methods while maintaining low memory consumption and inference time.
  arXiv  Detail & Related papers  (2025-11-23T18:31:18Z)
• LUNA: Efficient and Topology-Agnostic Foundation Model for EEG Signal Analysis [16.431555478831143]
  We introduce LUNA, a self-supervised foundation model that reconciles disparate electrode geometries.<n>Luna compresses multi-channel EEG into a fixed-size, topology-agnostic latent space.<n>Luna transfers effectively to four downstream tasks: abnormality detection, artifact rejection, slowing classification, and emotion recognition.
  arXiv  Detail & Related papers  (2025-10-25T11:31:27Z)
• Bidirectional Representations Augmented Autoregressive Biological Sequence Generation:Application in De Novo Peptide Sequencing [51.12821379640881]
  Autoregressive (AR) models offer holistic, bidirectional representations but face challenges with generative coherence and scalability.<n>We propose a hybrid framework enhancing AR generation by dynamically integrating rich contextual information from non-autoregressive mechanisms.<n>A novel cross-decoder attention module enables the AR decoder to iteratively query and integrate these bidirectional features.
  arXiv  Detail & Related papers  (2025-10-09T12:52:55Z)
• Trained Mamba Emulates Online Gradient Descent in In-Context Linear Regression [90.93281146423378]
  Mamba is an efficient Transformer alternative with linear complexity for long-sequence modeling.<n>Recent empirical works demonstrate Mamba's in-context learning (ICL) competitive with Transformers.<n>This paper studies the training dynamics of Mamba on the linear regression ICL task.
  arXiv  Detail & Related papers  (2025-09-28T09:48:49Z)
• CodeBrain: Towards Decoupled Interpretability and Multi-Scale Architecture for EEG Foundation Model [52.466542039411515]
  EEG foundation models (EFMs) have emerged to address the scalability issues of task-specific models.<n>We present CodeBrain, a two-stage EFM designed to fill this gap.<n>In the first stage, we introduce the TFDual-Tokenizer, which decouples heterogeneous temporal and frequency EEG signals into discrete tokens.<n>In the second stage, we propose the multi-scale EEGSSM architecture, which combines structured global convolution with sliding window attention.
  arXiv  Detail & Related papers  (2025-06-10T17:20:39Z)
• BriLLM: Brain-inspired Large Language Model [40.47939901030644]
  BriLLM is a brain-inspired large language model that redefines the foundations of machine learning.<n> BriLLM incorporates two pivotal neurocognitive principles: (1) static semantic mapping, where tokens are mapped to specialized nodes analogous to cortical areas, and (2) dynamic signal propagation, which simulates electrophysiological information dynamics observed in brain activity.<n>This architecture enables multiple transformative breakthroughs: natural multi-modal compatibility, full model interpretability at the node level, context-length independent scaling, and the first global-scale simulation of brain-like information processing for language tasks.
  arXiv  Detail & Related papers  (2025-03-14T11:08:30Z)
• An Efficient Self-Supervised Framework for Long-Sequence EEG Modeling [2.1232375739287006]
  We propose EEGM2, a self-supervised framework for EEG representation learning.<n>EEGM2 achieves state-of-the-art performance in both short- and long-sequence modeling and classification.
  arXiv  Detail & Related papers  (2025-02-25T05:57:56Z)
• FEMBA: Efficient and Scalable EEG Analysis with a Bidirectional Mamba Foundation Model [14.663411219312827]
  We present FEMBA (Foundational EEG Mamba + Bidirectional Architecture), a novel self-supervised framework for EEG analysis.<n>Unlike Transformer-based models, which incur quadratic time and memory complexity, FEMBA scales linearly with sequence length.<n>It achieves competitive performance in comparison with transformer models, with significantly lower computational cost.
  arXiv  Detail & Related papers  (2025-02-10T13:15:52Z)
• SIGMA: Selective Gated Mamba for Sequential Recommendation [56.85338055215429]
  Mamba, a recent advancement, has exhibited exceptional performance in time series prediction.<n>We introduce a new framework named Selective Gated Mamba ( SIGMA) for Sequential Recommendation.<n>Our results indicate that SIGMA outperforms current models on five real-world datasets.
  arXiv  Detail & Related papers  (2024-08-21T09:12:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.