EEG-JEPA: Structured Latent Prediction for EEG Foundation Models

• URL: http://arxiv.org/abs/2608.00114v1
• Date: Fri, 31 Jul 2026 08:57:53 GMT
• Title: EEG-JEPA: Structured Latent Prediction for EEG Foundation Models
• Abstract summary: We introduce EEG-JEPA, a structured latent-prediction framework for EEG foundation modeling.<n>EEG-JEPA organizes target design along three complementary dimensions.<n>EEG-JEPA improves the 14-task frozen macro balanced accuracy from 40.49% to 50.42% over CBraMod-style masked waveform reconstruction.
• Score: 8.073687183161216
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Electroencephalography (EEG) foundation models aim to learn reusable representations from large-scale unlabeled recordings. A common pretraining strategy is masked waveform reconstruction, but applying supervision directly to noisy EEG may encourage models to recover predictable background activity, acquisition effects, and artifacts rather than neural structure that transfers across tasks. This raises a central question: what should an EEG foundation model predict to learn transferable representations? We introduce EEG-JEPA a structured latent-prediction framework for EEG foundation modeling. Rather than reconstructing masked voltage samples, a masked context encoder and predictor infer contextual latent states produced by an exponential-moving-average target encoder that observes the complete input. EEG-JEPA organizes target design along three complementary dimensions: target content specifies what representation is predicted, target support specifies where prediction occurs over structured electrode--time regions through Neurotopology-Aware Multi-scale Electrode-Temporal Masking (N-MET), and target depth specifies at which encoder layers supervision is applied. Together, these designs shift EEG pretraining from recovering missing measurements to inferring latent states from structured electrode--time context. We evaluate EEG-JEPA through controlled objective comparisons, frozen multitask transfer, and full fine-tuning. Under the same backbone, pretraining corpus, and training duration, EEG-JEPA improves the 14-task frozen macro balanced accuracy from 40.49% to 50.42% over CBraMod-style masked waveform reconstruction. Multi-source continuation further raises this result to 52.94%, the highest average among the EEG foundation models evaluated on EEG-FM-Bench. Under protocol-matched full fine-tuning, EEG-JEPA also improves the nine-task average balanced accuracy from 68.98% to 70.65%.

Related papers

• Taming foundation model with invariance-oriented pre-training for broad-spectrum EEG analysis across signal-level, brain-state, and brain-health tasks [46.533103231728724]
  INCEPT is an invariance-oriented EEG foundation model trained on over 11,000 hours of unlabelled clinical EEG.<n>We evaluate INCEPT on a broad-spectrum benchmark of ten datasets spanning three levels of post-acquisition EEG analysis.
  arXiv  Detail & Related papers  (2026-08-25T14:20:02Z)
• APO: Unsupervised Atomic Policy Optimization for 3D Structure Prediction of Atomic Systems [64.56252173115246]
  We propose (Atomic Policy Optimization) a fully unsupervised alignment framework that eliminates the need for ground-truth reference structures.<n>APO adapts group-relative policy optimization to 3D atomic environments, utilizing a novel dual-reward mechanism.<n>Our results suggest that intrinsic physical consistency can serve as a superior guide for alignment compared to noisy, supervised coordinate matching.
  arXiv  Detail & Related papers  (2026-07-30T17:21:58Z)
• OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models [22.964421663748755]
  We introduce OmniEEG-Bench, a unified benchmark and downstream task roadmap for EEG foundation models (FMs)<n>It organizes evaluation of EEG FMs into six task families spanning (i) signal reliability, (ii) biometrics and disease, (iii) consciousness and state, (iv) cognition and emotion, (v) naturalistic stimulus decoding, and (vi) motor and interaction.<n>We benchmark 10 representative EEG foundation models and report a leaderboard that covers diverse evaluation settings.
  arXiv  Detail & Related papers  (2026-05-30T17:20:04Z)
• A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Models [48.385356148620815]
  Recent EEG foundation models have demonstrated promising transfer capabilities across tasks and datasets.<n>We propose a multi-dimensional evaluation framework for assessing EEG models under realistic low-resource conditions.
  arXiv  Detail & Related papers  (2026-05-27T14:51:54Z)
• CLEF: EEG Foundation Model for Learning Clinical Semantics [50.3767252824646]
  We introduce CLEF, a clinically grounded long-context EEG foundation model.<n>We evaluate CLEF on a new 234-task benchmark spanning disease phenotypes, medication exposures, and EEG findings.
  arXiv  Detail & Related papers  (2026-05-11T16:34:58Z)
• Structured Prototype-Guided Adaptation for EEG Foundation Models [56.35233377493694]
  We show that EEG foundation models exhibit poor generalization when subject-level supervision is limited.<n>This failure stems from a structural mismatch between noisy, limited supervision and the highly plastic parameter space of EFMs.<n>We propose SCOPE, a Structured COnfidence-aware Prototype-guided adaptation framework for EFM fine-tuning.
  arXiv  Detail & Related papers  (2026-02-19T10:54:29Z)
• REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects [5.368295573908306]
  REVE (Representation for EEG with Versatile Embeddings) is a pretrained model explicitly designed to generalize across diverse EEG signals.<n>We pretrain REVE on over 60,000 hours of EEG data from 92 datasets spanning 25,000 subjects, representing the largest EEG pretraining effort to date.<n>We release code, pretrained weights, and tutorials to support standardized EEG research and accelerate progress in clinical neuroscience.
  arXiv  Detail & Related papers  (2025-10-24T15:52:46Z)
• EEGDM: EEG Representation Learning via Generative Diffusion Model [17.595769291603688]
  We propose an EEG representation learning framework building upon Generative Diffusion Model (EEGDM)<n>Specifically, we developed a structured state-space model for diffusion pretraining and trained it using Denoising Diffusion Probabilistic Model (DDPM) framework.<n>The resulting latent EEG representations were then used for downstream classification tasks via our proposed latent fusion transformer (LFT)
  arXiv  Detail & Related papers  (2025-08-13T14:40:52Z)
• BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signals [46.121056431476156]
  This paper proposes Brain Omni, the first brain foundation model that generalises across heterogeneous EEG and MEG recordings.<n>Existing approaches typically rely on separate, modality- and dataset-specific models, which limits performance and cross-domain scalability.<n>A total of 1,997 hours of EEG and 656 hours of MEG data are curated and standardised from publicly available sources for pretraining.
  arXiv  Detail & Related papers  (2025-05-18T14:07:14Z)
• BrainGPT: Unleashing the Potential of EEG Generalist Foundation Model by Autoregressive Pre-training [15.135177893151008]
  EEGPT is the first generalist EEG foundation model designed to address these challenges.<n>First, we propose an electrode-wise modeling strategy that treats each electrode as a fundamental unit.<n>Second, we develop the first autoregressive EEG pre-trained model.<n>Third, we introduce a multi-task transfer learning paradigm using a learnable electrode graph network.
  arXiv  Detail & Related papers  (2024-10-14T12:17:54Z)
• EEG-Inception: An Accurate and Robust End-to-End Neural Network for EEG-based Motor Imagery Classification [123.93460670568554]
  This paper proposes a novel convolutional neural network (CNN) architecture for accurate and robust EEG-based motor imagery (MI) classification. The proposed CNN model, namely EEG-Inception, is built on the backbone of the Inception-Time network. The proposed network is an end-to-end classification, as it takes the raw EEG signals as the input and does not require complex EEG signal-preprocessing.
  arXiv  Detail & Related papers  (2021-01-24T19:03:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.