CBraMod: A Criss-Cross Brain Foundation Model for EEG Decoding

• URL: http://arxiv.org/abs/2412.07236v6
• Date: Thu, 06 Nov 2025 13:21:40 GMT
• Title: CBraMod: A Criss-Cross Brain Foundation Model for EEG Decoding
• Abstract summary: Early EEG decoding methods rely on supervised learning, limited by specific tasks and datasets, hindering model performance and generalizability.<n>We propose a novel foundation model called CBraMod, which can model spatial and temporal dependencies separately.<n>CBraMod achieves the state-of-the-art performance across the wide range of tasks, proving its strong capability and generalizability.
• Score: 26.30800080049427
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Electroencephalography (EEG) is a non-invasive technique to measure and record brain electrical activity, widely used in various BCI and healthcare applications. Early EEG decoding methods rely on supervised learning, limited by specific tasks and datasets, hindering model performance and generalizability. With the success of large language models, there is a growing body of studies focusing on EEG foundation models. However, these studies still leave challenges: Firstly, most of existing EEG foundation models employ full EEG modeling strategy. It models the spatial and temporal dependencies between all EEG patches together, but ignores that the spatial and temporal dependencies are heterogeneous due to the unique structural characteristics of EEG signals. Secondly, existing EEG foundation models have limited generalizability on a wide range of downstream BCI tasks due to varying formats of EEG data, making it challenging to adapt to. To address these challenges, we propose a novel foundation model called CBraMod. Specifically, we devise a criss-cross transformer as the backbone to thoroughly leverage the structural characteristics of EEG signals, which can model spatial and temporal dependencies separately through two parallel attention mechanisms. And we utilize an asymmetric conditional positional encoding scheme which can encode positional information of EEG patches and be easily adapted to the EEG with diverse formats. CBraMod is pre-trained on a very large corpus of EEG through patch-based masked EEG reconstruction. We evaluate CBraMod on up to 10 downstream BCI tasks (12 public datasets). CBraMod achieves the state-of-the-art performance across the wide range of tasks, proving its strong capability and generalizability. The source code is publicly available at https://github.com/wjq-learning/CBraMod.

Related papers

• EEG-AS: Instance-Level Foundation Model Selection for EEG Foundation Models via Behavior Reconstruction [0.5249805590164902]
  No single foundation model consistently performs best across datasets or individual EEG instances.<n>We propose EEG foundation model selection as an instance-level Algorithm Selection problem.<n>EEG-AS learns to reconstruct unavailable foundation-model behaviors from privileged prediction tokens conditioned on an anchor foundation model.
  arXiv  Detail & Related papers  (2026-09-01T03:30:29Z)
• Towards Robust EEG Decoding Based on Riemannian Self-Attention [49.95065559566893]
  Brain-Computer Interface (BCI) based on electroencephalography (EEG) has significant applications in assistive technologies, medical rehabilitation, and entertainment.<n>Recent EEG decoding methods based on Symmetric Positive Definite (SPD) learning have demonstrated superior performance.<n>These methods typically employ basic network architectures and do not explicitly capture local relationships between EEG signals.<n>This limitation is problematic for EEG signals due to their inherently low Signal-to-Noise Ratio (SNR)
  arXiv  Detail & Related papers  (2026-06-24T06:31:20Z)
• OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models [22.964421663748755]
  We introduce OmniEEG-Bench, a unified benchmark and downstream task roadmap for EEG foundation models (FMs)<n>It organizes evaluation of EEG FMs into six task families spanning (i) signal reliability, (ii) biometrics and disease, (iii) consciousness and state, (iv) cognition and emotion, (v) naturalistic stimulus decoding, and (vi) motor and interaction.<n>We benchmark 10 representative EEG foundation models and report a leaderboard that covers diverse evaluation settings.
  arXiv  Detail & Related papers  (2026-05-30T17:20:04Z)
• A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Models [48.385356148620815]
  Recent EEG foundation models have demonstrated promising transfer capabilities across tasks and datasets.<n>We propose a multi-dimensional evaluation framework for assessing EEG models under realistic low-resource conditions.
  arXiv  Detail & Related papers  (2026-05-27T14:51:54Z)
• EnECG: Efficient Ensemble Learning for Electrocardiogram Multi-task Foundation Model [46.84040404474695]
  EnECG is an ensemble-based framework that integrates multiple specialized foundation models, each excelling in different aspects of ECG interpretation.<n>We show that EnECG can help reduce computational and memory costs while maintaining the strong representational power of foundation models.<n>This framework not only enhances feature extraction and predictive performance but also ensures practical efficiency for real-world clinical applications.
  arXiv  Detail & Related papers  (2025-11-28T07:22:33Z)
• REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects [5.368295573908306]
  REVE (Representation for EEG with Versatile Embeddings) is a pretrained model explicitly designed to generalize across diverse EEG signals.<n>We pretrain REVE on over 60,000 hours of EEG data from 92 datasets spanning 25,000 subjects, representing the largest EEG pretraining effort to date.<n>We release code, pretrained weights, and tutorials to support standardized EEG research and accelerate progress in clinical neuroscience.
  arXiv  Detail & Related papers  (2025-10-24T15:52:46Z)
• BrainPro: Towards Large-scale Brain State-aware EEG Representation Learning [34.50028362571382]
  Recent EEG foundation models have shown improved performance and generalizability over traditional decoding methods.<n>Existing models often fail to explicitly capture channel-to-channel and region-to-region interactions.<n>BrainPro achieves state-of-the-art performance and robust generalization across nine public BCI datasets.
  arXiv  Detail & Related papers  (2025-09-26T08:34:04Z)
• CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decoding [57.90382885533593]
  We propose a Cross-scale Spatiotemporal Brain foundation model for generalized decoding EEG signals.<n>We show that CSBrain consistently outperforms task-specific and foundation model baselines.<n>These results establish cross-scale modeling as a key inductive bias and position CSBrain as a robust backbone for future brain-AI research.
  arXiv  Detail & Related papers  (2025-06-29T03:29:34Z)
• BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signals [50.76802709706976]
  This paper proposes Brain Omni, the first brain foundation model that generalises across heterogeneous EEG and MEG recordings.<n>To unify diverse data sources, we introduce BrainTokenizer, the first tokenizer that quantises neural brain activity into discrete representations.<n>A total of 1,997 hours of EEG and 656 hours of MEG data are curated and standardised from publicly available sources for pretraining.
  arXiv  Detail & Related papers  (2025-05-18T14:07:14Z)
• Large Cognition Model: Towards Pretrained EEG Foundation Model [0.0]
  We propose a transformer-based foundation model designed to generalize across diverse EEG datasets and downstream tasks. Our findings highlight the potential of pretrained EEG foundation models to accelerate advancements in neuroscience, personalized medicine, and BCI technology.
  arXiv  Detail & Related papers  (2025-02-11T04:28:10Z)
• CEReBrO: Compact Encoder for Representations of Brain Oscillations Using Efficient Alternating Attention [53.539020807256904]
  We introduce a Compact for Representations of Brain Oscillations using alternating attention (CEReBrO) Our tokenization scheme represents EEG signals at a per-channel patch. We propose an alternating attention mechanism that jointly models intra-channel temporal dynamics and inter-channel spatial correlations, achieving 2x speed improvement with 6x less memory required compared to standard self-attention.
  arXiv  Detail & Related papers  (2025-01-18T21:44:38Z)
• CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Information [61.1904164368732]
  We propose CognitionCapturer, a unified framework that fully leverages multimodal data to represent EEG signals. Specifically, CognitionCapturer trains Modality Experts for each modality to extract cross-modal information from the EEG modality. The framework does not require any fine-tuning of the generative models and can be extended to incorporate more modalities.
  arXiv  Detail & Related papers  (2024-12-13T16:27:54Z)
• Graph-Enhanced EEG Foundation Model [16.335330142000657]
  We propose a novel foundation model for EEG that integrates both temporal and inter-channel information.<n>Our architecture combines Graph Neural Networks (GNNs), which effectively capture relational structures, with a masked autoencoder to enable efficient pre-training.
  arXiv  Detail & Related papers  (2024-11-29T06:57:50Z)
• EEGPT: Unleashing the Potential of EEG Generalist Foundation Model by Autoregressive Pre-training [9.57946371147345]
  EEGPT is the first generalist EEG foundation model designed to address these challenges. First, we propose an electrode-wise modeling strategy that treats each electrode as a fundamental unit. Second, we develop the first autoregressive EEG pre-trained model. Third, we introduce a multi-task transfer learning paradigm using a learnable electrode graph network.
  arXiv  Detail & Related papers  (2024-10-14T12:17:54Z)
• EEGMamba: Bidirectional State Space Model with Mixture of Experts for EEG Multi-task Classification [1.4004287903552533]
  We introduce EEGMamba, the first universal EEG classification network to truly implement multi-task learning for EEG applications. EEGMamba seamlessly integrates the Spatio-Temporal-Adaptive (ST- adaptive) module, bidirectional Mamba, and Mixture of Experts (MoE) into a unified framework. We evaluate our model on eight publicly available EEG datasets, and the experimental results demonstrate its superior performance in four types of tasks.
  arXiv  Detail & Related papers  (2024-07-20T11:15:47Z)
• Geodesic Optimization for Predictive Shift Adaptation on EEG data [53.58711912565724]
  Domain adaptation methods struggle when distribution shifts occur simultaneously in $X$ and $y$. This paper proposes a novel method termed Geodesic Optimization for Predictive Shift Adaptation (GOPSA) to address test-time multi-source DA. GOPSA has the potential to combine the advantages of mixed-effects modeling with machine learning for biomedical applications of EEG.
  arXiv  Detail & Related papers  (2024-07-04T12:15:42Z)
• Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI [6.926908480247951]
  We propose a unified foundation model for EEG called Large Brain Model (LaBraM) LaBraM enables cross-dataset learning by segmenting the EEG signals into EEG channel patches. We then pre-train neural Transformers by predicting the original neural codes for the masked EEG channel patches.
  arXiv  Detail & Related papers  (2024-05-29T05:08:16Z)
• Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencoder [69.7813498468116]
  We propose Contrastive EEG-Text Masked Autoencoder (CET-MAE), a novel model that orchestrates compound self-supervised learning across and within EEG and text. We also develop a framework called E2T-PTR (EEG-to-Text decoding using Pretrained Transferable Representations) to decode text from EEG sequences.
  arXiv  Detail & Related papers  (2024-02-27T11:45:21Z)
• Uncovering the structure of clinical EEG signals with self-supervised learning [64.4754948595556]
  Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG) By extracting information from unlabeled data, it might be possible to reach competitive performance with deep neural networks.
  arXiv  Detail & Related papers  (2020-07-31T14:34:47Z)
• ECG-DelNet: Delineation of Ambulatory Electrocardiograms with Mixed Quality Labeling Using Neural Networks [69.25956542388653]
  Deep learning (DL) algorithms are gaining weight in academic and industrial settings. We demonstrate DL can be successfully applied to low interpretative tasks by embedding ECG detection and delineation onto a segmentation framework. The model was trained using PhysioNet's QT database, comprised of 105 ambulatory ECG recordings.
  arXiv  Detail & Related papers  (2020-05-11T16:29:12Z)
• Deep transfer learning for improving single-EEG arousal detection [63.52264764099532]
  Two datasets do not contain exactly the same setup leading to degraded performance in single-EEG models. We train a baseline model and replace the first two layers to prepare the architecture for single-channel electroencephalography data. Using a fine-tuning strategy, our model yields similar performance to the baseline model and was significantly better than a comparable single-channel model.
  arXiv  Detail & Related papers  (2020-04-10T16:51:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.