CLEF: EEG Foundation Model for Learning Clinical Semantics

• URL: http://arxiv.org/abs/2605.10817v1
• Date: Mon, 11 May 2026 16:34:58 GMT
• Title: CLEF: EEG Foundation Model for Learning Clinical Semantics
• Abstract summary: We introduce CLEF, a clinically grounded long-context EEG foundation model.<n>We evaluate CLEF on a new 234-task benchmark spanning disease phenotypes, medication exposures, and EEG findings.
• Score: 50.3767252824646
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Clinical EEG interpretation requires reasoning over full EEG sessions and integrating signal patterns with clinical context. Existing EEG foundation models are largely designed for short-window decoding and do not incorporate clinical context. We introduce CLEF, a clinically grounded long-context EEG foundation model. CLEF represents EEG sessions as 3D multitaper spectrogram tokens, enabling tractable Transformer modeling at session scale, and aligns embeddings with neurologist reports and structured EHR data through contrastive objectives. We evaluate CLEF on a new 234-task benchmark spanning disease phenotypes, medication exposures, and EEG findings, with more than 260k EEG sessions from over 108k patients. CLEF outperforms prior EEG foundation models on 229 of 234 tasks, improving mean AUROC from 0.65 to 0.74. Reconstruction-only pretraining surpasses prior EEG foundation models, while report and EHR alignment yields further gains. Held-out concept and external-cohort experiments suggest that these representations transfer beyond observed alignment targets. These results support session-scale, clinically grounded representation learning as a promising foundation-model paradigm for clinical EEG.

Related papers

• Taming foundation model with invariance-oriented pre-training for broad-spectrum EEG analysis across signal-level, brain-state, and brain-health tasks [46.533103231728724]
  INCEPT is an invariance-oriented EEG foundation model trained on over 11,000 hours of unlabelled clinical EEG.<n>We evaluate INCEPT on a broad-spectrum benchmark of ten datasets spanning three levels of post-acquisition EEG analysis.
  arXiv  Detail & Related papers  (2026-08-25T14:20:02Z)
• LLM4EHR: Aligning Clinical Time Series with Medical Event Sequences via Large Language Models [36.391923477672776]
  Recent research in clinical machine learning has shifted from bespoke supervised models to foundation models.<n>Here, foundation models are pre-trained on mixtures of complex clinical data modalities, useful for various downstream tasks.
  arXiv  Detail & Related papers  (2026-07-16T20:40:04Z)
• A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Models [48.385356148620815]
  Recent EEG foundation models have demonstrated promising transfer capabilities across tasks and datasets.<n>We propose a multi-dimensional evaluation framework for assessing EEG models under realistic low-resource conditions.
  arXiv  Detail & Related papers  (2026-05-27T14:51:54Z)
• Physiology as Language: Translating Respiration to Sleep EEG [43.02603129452492]
  This paper introduces a novel cross-physiology translation task: synthesizing sleep electroencephalography (EEG) from respiration signals.<n>We propose a waveform-conditional generative framework that preserves fine-grained respiratory dynamics while constraining the EEG target space through discrete tokenization.<n>Trained on over 28,000 individuals, our model achieves a 7% Mean Absolute Error in EEG spectrogram reconstruction.
  arXiv  Detail & Related papers  (2026-01-31T05:44:45Z)
• Transferring Clinical Knowledge into ECGs Representation [0.19498378931702776]
  We propose a novel three-stage training paradigm that transfers knowledge from multimodal clinical data into a powerful, yet unimodal, ECG encoder.<n>We employ a self-supervised, joint-embedding pre-training stage to create an ECG representation that is enriched with contextual clinical information.<n>As an indirect way to explain the model's output, we train it to also predict associated laboratory abnormalities directly from the ECG embedding.
  arXiv  Detail & Related papers  (2025-12-07T22:19:24Z)
• CLEF: Clinically-Guided Contrastive Learning for Electrocardiogram Foundation Models [13.613519337591507]
  Single-lead ECG recording is integrated into both clinical-grade and consumer wearables.<n>While self-supervised pretraining of foundation models on unlabeled ECGs improves diagnostic performance, existing approaches do not incorporate domain knowledge from clinical metadata.<n>We introduce a novel contrastive learning approach that utilizes an established clinical risk score to adaptively weight negative pairs.
  arXiv  Detail & Related papers  (2025-12-01T20:21:44Z)
• EEG-Bench: A Benchmark for EEG Foundation Models in Clinical Applications [25.677165987759505]
  We introduce a unified benchmarking framework focused on evaluating EEG-based foundation models in clinical applications.<n>The benchmark spans 11 well-defined diagnostic tasks across 14 publicly available datasets, including epilepsy, schizophrenia, Parkinson's disease, OCD, and mild traumatic brain injury.
  arXiv  Detail & Related papers  (2025-11-28T12:46:40Z)
• EEG-MedRAG: Enhancing EEG-based Clinical Decision-Making via Hierarchical Hypergraph Retrieval-Augmented Generation [45.031633614714]
  EEG-MedRAG is a three-layer hypergraph-based retrieval-augmented generation framework.<n>It unifies EEG domain knowledge, individual patient cases, and a large-scale repository into a traversable n-ary relational hypergraph.<n>We introduce the first cross-disease, cross-role EEG clinical QA benchmark, spanning seven disorders and five authentic clinical perspectives.
  arXiv  Detail & Related papers  (2025-08-19T11:12:58Z)
• EEG Foundation Challenge: From Cross-Task to Cross-Subject EEG Decoding [63.898595224608464]
  We introduce a large-scale, code-based competition comprising two challenges.<n>The Transfer Challenge asks participants to build and test a model that can zero-shot decode new tasks and new subjects from their EEG data.<n>The Psychopathology factor prediction Challenge asks participants to infer subject measures of mental health from EEG data.
  arXiv  Detail & Related papers  (2025-06-23T21:25:19Z)
• Bridging Electronic Health Records and Clinical Texts: Contrastive Learning for Enhanced Clinical Tasks [0.0]
  We propose a framework that aligns the latent representations of structured EHR data with unstructured discharge summary notes.<n>It works by pulling together paired EHR and text embeddings while pushing apart unpaired ones.<n>Results demonstrate the effect of integrating domain knowledge from clinical notes into EHR-based pipelines.
  arXiv  Detail & Related papers  (2025-05-23T09:04:49Z)
• EEG-Language Pretraining for Highly Label-Efficient Clinical Phenotyping [0.0]
  Multimodal language modeling has enabled breakthroughs for representation learning, yet remains unexplored in the realm of functional brain data for clinical phenotyping.<n>This paper pioneers EEG-language models (ELMs) trained on clinical reports and 15000 EEGs.
  arXiv  Detail & Related papers  (2024-09-02T10:03:03Z)
• TACCO: Task-guided Co-clustering of Clinical Concepts and Patient Visits for Disease Subtyping based on EHR Data [42.96821770394798]
  TACCO is a novel framework that jointly discovers clusters of clinical concepts and patient visits based on a hypergraph modeling of EHR data. We conduct experiments on the public MIMIC-III dataset and Emory internal CRADLE dataset over the downstream clinical tasks of phenotype classification and cardiovascular risk prediction. In-depth model analysis, clustering results analysis, and clinical case studies further validate the improved utilities and insightful interpretations delivered by TACCO.
  arXiv  Detail & Related papers  (2024-06-14T14:18:38Z)
• ECG-DelNet: Delineation of Ambulatory Electrocardiograms with Mixed Quality Labeling Using Neural Networks [69.25956542388653]
  Deep learning (DL) algorithms are gaining weight in academic and industrial settings. We demonstrate DL can be successfully applied to low interpretative tasks by embedding ECG detection and delineation onto a segmentation framework. The model was trained using PhysioNet's QT database, comprised of 105 ambulatory ECG recordings.
  arXiv  Detail & Related papers  (2020-05-11T16:29:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.