Neonatal Hypoxic-ischaemic Encephalopathy Classification from the EEG and HRV Signals Using a Conformer based Masked Autoencoder
- URL: http://arxiv.org/abs/2607.23554v1
- Date: Sun, 26 Jul 2026 09:11:03 GMT
- Title: Neonatal Hypoxic-ischaemic Encephalopathy Classification from the EEG and HRV Signals Using a Conformer based Masked Autoencoder
- Abstract summary: We propose a novel self-supervised learning framework for representation learning from unlabelled electroencephalography (EEG) and heart rate variability (HRV) signals.<n>By integrating convolutional operations with Transformer-based self-attention, MAEConformer effectively captures both local temporal patterns and long-range contextual dependencies.<n> Experimental results demonstrate that the learned representations provide strong transferability and data efficiency.
- Score: 1.2599533416395767
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we propose the MAEConformer, a novel self-supervised learning framework that combines the Conformer architecture with the Masked Autoencoder (MAE) paradigm for large-scale representation learning from unlabelled electroencephalography (EEG) and heart rate variability (HRV) signals. By integrating convolutional operations with Transformer-based self-attention, MAEConformer effectively captures both local temporal patterns and long-range contextual dependencies in physiological time series. To enhance reconstruction fidelity and representation quality, a multi-resolution short-time Fourier transform (MR-STFT) loss is incorporated alongside the reconstruction objective, enabling the model to jointly learn temporal and spectral characteristics across multiple scales. Modality-specific EEG and HRV MAEConformer models were pretrained on 6,030h and 4,868h of unlabelled recordings, respectively, and subsequently transferred to expert-annotated downstream tasks. Experimental results demonstrate that the learned representations provide strong transferability and data efficiency. In EEG-based hypoxic ischemic encephalopathy (HIE) severity classification, the pretrained MAE-EEG model achieved test AUCs of 97.19% and 96.56% for binary and four-class classification tasks, respectively, outperforming a range of state-of-the-art supervised and self-supervised baselines. On the HRV-based HIE severity classification task, MAE-HRV achieved a test AUC of 82.42%, surpassing both self-supervised Transformer-based and supervised convolutional baselines. These findings demonstrate the effectiveness of MAEConformer for learning robust and transferable representations across multiple physiological modalities.
Related papers
- Physics-Informed Deep Learning for False Ventricular Tachycardia Alarm Reduction in the ICU [44.313512671851306]
False ventricular tachycardia (VT) alarms are a leading contributor to alarm fatigue in intensive care units.<n>We propose a deep learning framework combining a 1D SE-ResNet with ICU-realistic data augmentations and a physics-informed auxiliary reconstruction task.
arXiv Detail & Related papers (2026-09-08T16:33:07Z) - ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding [47.35612571473169]
EEG visual decoding aims to recover visual semantics from non-invasive neural time-series signals.<n>Existing methods rely on fixed visual or textual anchors whose semantic relations may become misaligned with EEG representations that vary across trials, subjects, and learning stages.<n>We propose Progressive Contrastive Alignment (ProCA), a unified and model-agnostic framework for adaptive neural-semantic alignment.
arXiv Detail & Related papers (2026-09-04T12:48:25Z) - Taming foundation model with invariance-oriented pre-training for broad-spectrum EEG analysis across signal-level, brain-state, and brain-health tasks [46.533103231728724]
INCEPT is an invariance-oriented EEG foundation model trained on over 11,000 hours of unlabelled clinical EEG.<n>We evaluate INCEPT on a broad-spectrum benchmark of ten datasets spanning three levels of post-acquisition EEG analysis.
arXiv Detail & Related papers (2026-08-25T14:20:02Z) - DARE-EEG: A Foundation Model for Mining Dual-Aligned Representation of EEG [25.4837936625773]
We propose DARE-EEG, a self-supervised foundation model that enforces the mask-invariance property through dual-aligned representation learning.<n>Specifically, we introduce mask alignment that constrains representations from multiple masked views of the same EEG sample.<n>We also propose conv-linear-probing, a parameter-efficient strategy that adapts pre-trained representations to heterogeneous electrode configurations.
arXiv Detail & Related papers (2026-05-18T12:18:43Z) - MedMamba: Recasting Mamba for Medical Time Series Classification [6.852021597208217]
Medical time series, such as electrocardiograms (ECG) and electroencephalograms (EEG), exhibit complex temporal dynamics.<n>We propose MedMamba, a principle-driven multi-scale bidirectional state space architecture tailored for medical time series classification.<n>Our design is guided by three key inductive biases of physiological signals: spatial centralization, multi-timescale temporal composition, and non-causal contextual dependency.
arXiv Detail & Related papers (2026-04-17T01:20:02Z) - A Systematic Benchmark of GAN Architectures for MRI-to-CT Synthesis [38.31064949197421]
Generative Adversarial Network (GAN) architectures have been proposed for MRI-to-CT translation.<n>We present a benchmark of ten GAN evaluated on the SynthRAD2025 dataset across three anatomical districts.
arXiv Detail & Related papers (2026-03-13T18:54:20Z) - Learning Alzheimer's Disease Signatures by bridging EEG with Spiking Neural Networks and Biophysical Simulations [42.091774598477706]
Conventional deep learning approaches for EEG-based Alzheimer's disease detection are computationally intensive and mechanistically opaque.<n>We propose a neuro-bridge framework that links data-driven learning with biophysically grounded simulations.
arXiv Detail & Related papers (2026-01-30T21:54:16Z) - Interpretable and backpropagation-free Green Learning for efficient multi-task echocardiographic segmentation and classification [23.395777551262494]
Green Learning framework performs simultaneous Left Ventricle (LV) segmentation and LVEF classification.<n>On the EchoNet-Dynamic dataset, our MTGL model achieves state-of-the-art classification and segmentation performance.<n>This work demonstrates that the GL paradigm can deliver highly accurate, efficient, and interpretable solutions for complex medical image analysis.
arXiv Detail & Related papers (2026-01-27T16:04:42Z) - Synthetic Electrogram Generation with Variational Autoencoders for ECGI [0.0]
We propose variational autoencoders (VAEs) for the generation of synthetic multichannel atrial EGMs.<n>Two models are proposed: a sinus rhythm-specific VAE (VAE-S) and a class-conditioned VAE (VAE-C) trained on both sinus rhythm and AF signals.<n>VAE-S achieves higher fidelity with respect to in silico EGMs, while VAE-C enables rhythm-specific generation at the expense of reduced sinus reconstruction quality.
arXiv Detail & Related papers (2025-12-16T16:13:25Z) - Learning from Heterogeneous Structural MRI via Collaborative Domain Adaptation for Late-Life Depression Assessment [24.340328016766183]
We propose a Collaborative Domain Adaptation framework for LLD detection using T1-weighted MRIs.<n>The framework consists of three stages: supervised training on labeled source data, self-supervised target feature adaptation and collaborative training on unlabeled target data.<n>Experiments conducted on multi-site T1-weighted MRI data demonstrate that the framework consistently outperforms state-of-the-art unsupervised domain adaptation methods.
arXiv Detail & Related papers (2025-07-30T01:38:32Z) - Multimodal Latent Fusion of ECG Leads for Early Assessment of Pulmonary Hypertension [30.124231086488976]
We propose a lead-specific electrocardiogram multimodal variational autoencoder (textscLS-EMVAE)<n>textscLS-EMVAE incorporates a hierarchical modality expert (HiME) fusion mechanism and a latent representation alignment loss.<n>We validate textscLS-EMVAE across two retrospective cohorts in a 6L-ECG setting.
arXiv Detail & Related papers (2025-03-03T16:16:38Z) - FoME: A Foundation Model for EEG using Adaptive Temporal-Lateral Attention Scaling [19.85701025524892]
FoME (Foundation Model for EEG) is a novel approach using adaptive temporal-lateral attention scaling.
FoME is pre-trained on a diverse 1.7TB dataset of scalp and intracranial EEG recordings, comprising 745M parameters trained for 1,096k steps.
arXiv Detail & Related papers (2024-09-19T04:22:40Z) - PMT: Progressive Mean Teacher via Exploring Temporal Consistency for Semi-Supervised Medical Image Segmentation [51.509573838103854]
We propose a semi-supervised learning framework, termed Progressive Mean Teachers (PMT), for medical image segmentation.
Our PMT generates high-fidelity pseudo labels by learning robust and diverse features in the training process.
Experimental results on two datasets with different modalities, i.e., CT and MRI, demonstrate that our method outperforms the state-of-the-art medical image segmentation approaches.
arXiv Detail & Related papers (2024-09-08T15:02:25Z) - Dual-TSST: A Dual-Branch Temporal-Spectral-Spatial Transformer Model for EEG Decoding [2.0721229324537833]
We propose a novel decoding architecture network with a dual-branch temporal-spectral-spatial transformer (Dual-TSST)
Our proposed Dual-TSST performs superiorly in various tasks, which achieves the promising EEG classification performance of average accuracy of 80.67%.
This study provides a new approach to high-performance EEG decoding, and has great potential for future CNN-Transformer based applications.
arXiv Detail & Related papers (2024-09-05T05:08:43Z) - EEG-SCMM: Soft Contrastive Masked Modeling for Cross-Corpus EEG-Based Emotion Recognition [0.862468061241377]
We propose a novel framework termed Soft Contrastive Masked Modeling (SCMM) to tackle the challenge of cross-corpus EEG-based emotion recognition.<n>SCMM integrates soft contrastive learning with a hybrid masking strategy to effectively capture emotion dynamics.<n>In experiments, SCMM achieves an average accuracy of 4.26% under both same-class and different-class cross-corpus settings.
arXiv Detail & Related papers (2024-08-17T12:35:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.