EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Models

• URL: http://arxiv.org/abs/2605.26910v1
• Date: Tue, 26 May 2026 12:06:35 GMT
• Title: EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Models
• Abstract summary: EEG-FM-Audit is a comprehensive evaluation and analysis pipeline designed to systematize the assessment of EEG-FMs.<n>We apply EEG-FM-Audit to four state-of-the-art EEG-FMs and five representative supervised models across three public datasets.
• Score: 4.121032626125547
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large EEG Foundation Models (FMs) have shown great potential for decoding EEG signals across diverse cognitive tasks. However, existing EEG-FM studies exhibit three critical limitations: opaque supervised baseline tuning, unverified contributions of complex learning paradigms, and a lack of transparency in model decision-making. To address these, we propose EEG-FM-Audit, a comprehensive evaluation and analysis pipeline designed to systematize the assessment of EEG-FMs. EEG-FM-Audit consists of three primary components: (1) an ASHA-driven benchmarking protocol that ensures fair comparisons by transparently optimizing supervised baselines; (2) paradigm-level ablation studies to evaluate the effectiveness of learning paradigms in FMs; and (3) a neurophysiological probing (NPP) framework, which explores whether FMs leverage valid temporal, spatial, and spectral EEG properties. We apply EEG-FM-Audit to four state-of-the-art EEG-FMs and five representative supervised models across three public datasets. Our results reveal that properly tuned supervised baselines can match or outperform advanced FMs, despite requiring significantly fewer parameters. Furthermore, we find that the effectiveness of learning paradigms of FMs is highly dependent on dataset scale and architecture. Finally, NPP analysis demonstrates how FMs rely on specific physiological features, establishing a framework for more interpretable neural decoding.

Related papers

• NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfaces [24.672695443264995]
  Foundation models promise to extract unified representations that generalize across downstream tasks.<n>EEG-specific FMs do not consistently outperform time-series FMs.<n>Current models do not yet deliver on the promise of an out-of-the-box unified EEG model.
  arXiv  Detail & Related papers  (2026-05-14T11:13:41Z)
• Structured Prototype-Guided Adaptation for EEG Foundation Models [56.35233377493694]
  We show that EEG foundation models exhibit poor generalization when subject-level supervision is limited.<n>This failure stems from a structural mismatch between noisy, limited supervision and the highly plastic parameter space of EFMs.<n>We propose SCOPE, a Structured COnfidence-aware Prototype-guided adaptation framework for EFM fine-tuning.
  arXiv  Detail & Related papers  (2026-02-19T10:54:29Z)
• WaveMind: Towards a Conversational EEG Foundation Model Aligned to Textual and Visual Modalities [55.00677513249723]
  EEG signals simultaneously encode both cognitive processes and intrinsic neural states.<n>We map EEG signals and their corresponding modalities into a unified semantic space to achieve generalized interpretation.<n>The resulting model demonstrates robust classification accuracy while supporting flexible, open-ended conversations.
  arXiv  Detail & Related papers  (2025-09-26T06:21:51Z)
• Hierarchical Federated Foundation Models over Wireless Networks for Multi-Modal Multi-Task Intelligence: Integration of Edge Learning with D2D/P2P-Enabled Fog Learning Architectures [58.72593025539547]
  In this paper, we unveil an unexplored variation of M3T FFMs by proposing hierarchical federated foundation models (HF-FMs)<n>HF-FMs strategically align the modular structure of M3T FMs, comprising modality encoders, prompts, mixture-of-experts (MoEs), adapters, and task heads.<n>To demonstrate their potential, we prototype HF-FMs in a wireless network setting and release the open-source code for the development of HF-FMs.
  arXiv  Detail & Related papers  (2025-09-03T20:23:19Z)
• Federated Fine-tuning of SAM-Med3D for MRI-based Dementia Classification [0.8825314772327646]
  We evaluate the impact of key design choices on foundation models (FMs) tuning using brain MRI data.<n>We find that the architecture of the classification head substantially influences performance.<n>We highlight trade-offs that should guide future method development.
  arXiv  Detail & Related papers  (2025-08-29T09:43:02Z)
• EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation of EEG Foundation Models [16.433809341013113]
  EEG-FM-Bench is the first comprehensive benchmark for the systematic and standardized evaluation of EEG foundation models (EEG-FMs)<n>Our contributions are threefold: (1) we curate a diverse suite of downstream tasks and datasets from canonical EEG paradigms, implementing standardized processing and evaluation protocols within a unified open-source framework; (2) we benchmark prominent state-of-the-art foundation models to establish comprehensive baseline results for a clear comparison of the current landscape; (3) we perform qualitative analyses to provide insights into model behavior and inform future architectural design.
  arXiv  Detail & Related papers  (2025-08-25T07:34:33Z)
• EEGDM: EEG Representation Learning via Generative Diffusion Model [17.595769291603688]
  We propose an EEG representation learning framework building upon Generative Diffusion Model (EEGDM)<n>Specifically, we developed a structured state-space model for diffusion pretraining and trained it using Denoising Diffusion Probabilistic Model (DDPM) framework.<n>The resulting latent EEG representations were then used for downstream classification tasks via our proposed latent fusion transformer (LFT)
  arXiv  Detail & Related papers  (2025-08-13T14:40:52Z)
• AdaFusion: Prompt-Guided Inference with Adaptive Fusion of Pathology Foundation Models [49.550545038402184]
  We propose AdaFusion, a novel prompt-guided inference framework.<n>Our method compresses and aligns tile-level features from diverse models.<n>AdaFusion consistently surpasses individual PFMs across both classification and regression tasks.
  arXiv  Detail & Related papers  (2025-08-07T07:09:31Z)
• EEG Foundation Models: A Critical Review of Current Progress and Future Directions [4.096453902709292]
  Self-supervised EEG encoders have sparked a transition towards general-purpose EEG foundation models (EEG-FMs)<n>This study reviews 10 early EEG-FMs and presents a critical synthesis of their methodology, empirical findings, and outstanding research gaps.
  arXiv  Detail & Related papers  (2025-07-15T22:52:44Z)
• CodeBrain: Towards Decoupled Interpretability and Multi-Scale Architecture for EEG Foundation Model [52.466542039411515]
  EEG foundation models (EFMs) have emerged to address the scalability issues of task-specific models.<n>We present CodeBrain, a two-stage EFM designed to fill this gap.<n>In the first stage, we introduce the TFDual-Tokenizer, which decouples heterogeneous temporal and frequency EEG signals into discrete tokens.<n>In the second stage, we propose the multi-scale EEGSSM architecture, which combines structured global convolution with sliding window attention.
  arXiv  Detail & Related papers  (2025-06-10T17:20:39Z)
• FedPFT: Federated Proxy Fine-Tuning of Foundation Models [55.58899993272904]
  Adapting Foundation Models (FMs) for downstream tasks through Federated Learning (FL) emerges as a promising strategy for protecting data privacy and valuable FMs. Existing methods fine-tune FM by allocating sub-FM to clients in FL, leading to suboptimal performance due to insufficient tuning and inevitable error accumulations of gradients. We propose Federated Proxy Fine-Tuning (FedPFT), a novel method enhancing FMs adaptation in downstream tasks through FL by two key modules.
  arXiv  Detail & Related papers  (2024-04-17T16:30:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.