Foundation Models for Electrocardiograms
- URL: http://arxiv.org/abs/2407.07110v1
- Date: Wed, 26 Jun 2024 02:24:13 GMT
- Title: Foundation Models for Electrocardiograms
- Authors: Junho Song, Jong-Hwan Jang, Byeong Tak Lee, DongGyun Hong, Joon-myoung Kwon, Yong-Yeon Jo,
- Abstract summary: Foundation models, enhanced by self-supervised learning (SSL) techniques, represent a cutting-edge frontier in biomedical signal analysis.
This study conducts a comprehensive analysis of foundation models for ECGs on a vast dataset of over 1.1 million ECG samples.
- Score: 2.948318253609515
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Foundation models, enhanced by self-supervised learning (SSL) techniques, represent a cutting-edge frontier in biomedical signal analysis, particularly for electrocardiograms (ECGs), crucial for cardiac health monitoring and diagnosis. This study conducts a comprehensive analysis of foundation models for ECGs by employing and refining innovative SSL methodologies - namely, generative and contrastive learning - on a vast dataset of over 1.1 million ECG samples. By customizing these methods to align with the intricate characteristics of ECG signals, our research has successfully developed foundation models that significantly elevate the precision and reliability of cardiac diagnostics. These models are adept at representing the complex, subtle nuances of ECG data, thus markedly enhancing diagnostic capabilities. The results underscore the substantial potential of SSL-enhanced foundation models in clinical settings and pave the way for extensive future investigations into their scalable applications across a broader spectrum of medical diagnostics. This work sets a benchmark in the ECG field, demonstrating the profound impact of tailored, data-driven model training on the efficacy and accuracy of medical diagnostics.
Related papers
- ECG Arrhythmia Detection Using Disease-specific Attention-based Deep Learning Model [0.0]
We propose a disease-specific attention-based deep learning model (DANet) for arrhythmia detection from short ECG recordings.
The novel idea is to introduce a soft-coding or hard-coding waveform enhanced module into existing deep neural networks.
For the soft-coding DANet, we also develop a learning framework combining self-supervised pre-training with two-stage supervised training.
arXiv Detail & Related papers (2024-07-25T13:27:10Z) - SSSD-ECG-nle: New Label Embeddings with Structured State-Space Models for ECG generation [0.0]
Diffusion models have made significant progress in recent years, creating the possibility for synthesizing data comparable to the real one.
We propose the SSSD-ECG-nle architecture based on SSSD-ECG with a modified conditioning mechanism and demonstrate its efficiency on downstream tasks.
arXiv Detail & Related papers (2024-07-15T16:31:25Z) - Self-Trained Model for ECG Complex Delineation [0.0]
Electrocardiogram (ECG) delineation plays a crucial role in assisting cardiologists with accurate diagnoses.
We introduce a dataset for ECG delineation and propose a novel self-trained method aimed at leveraging a vast amount of unlabeled ECG data.
Our approach involves the pseudolabeling of unlabeled data using a neural network trained on our dataset. Subsequently, we train the model on the newly labeled samples to enhance the quality of delineation.
arXiv Detail & Related papers (2024-06-04T18:54:10Z) - Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogram [2.2842904085777045]
We introduce ST-MEM (S-Temporal Masked Electrocardiogram Modeling), designed to learntemporal features by reconstructing 12-lead ECG data.
ST-MEM outperforms other SSL baseline methods in various experimental settings for arrhythmia.
arXiv Detail & Related papers (2024-02-02T10:04:13Z) - Recent Advances in Predictive Modeling with Electronic Health Records [73.31880579203012]
utilizing EHR data for predictive modeling presents several challenges due to its unique characteristics.
Deep learning has demonstrated its superiority in various applications, including healthcare.
arXiv Detail & Related papers (2024-02-02T00:31:01Z) - Polar-Net: A Clinical-Friendly Model for Alzheimer's Disease Detection
in OCTA Images [53.235117594102675]
Optical Coherence Tomography Angiography is a promising tool for detecting Alzheimer's disease (AD) by imaging the retinal microvasculature.
We propose a novel deep-learning framework called Polar-Net to provide interpretable results and leverage clinical prior knowledge.
We show that Polar-Net outperforms existing state-of-the-art methods and provides more valuable pathological evidence for the association between retinal vascular changes and AD.
arXiv Detail & Related papers (2023-11-10T11:49:49Z) - ElectroCardioGuard: Preventing Patient Misidentification in
Electrocardiogram Databases through Neural Networks [0.0]
In clinical practice, the assignment of captured ECG recordings to incorrect patients can occur inadvertently.
We propose a small and efficient neural-network based model for determining whether two ECGs originate from the same patient.
Our model achieves state-of-the-art performance in gallery-probe patient identification on PTB-XL while utilizing 760x fewer parameters.
arXiv Detail & Related papers (2023-06-09T18:53:25Z) - A multi-stage machine learning model on diagnosis of esophageal
manometry [50.591267188664666]
The framework includes deep-learning models at the swallow-level stage and feature-based machine learning models at the study-level stage.
This is the first artificial-intelligence-style model to automatically predict CC diagnosis of HRM study from raw multi-swallow data.
arXiv Detail & Related papers (2021-06-25T20:09:23Z) - Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for
Thoracic Disease Identification [83.6017225363714]
deep learning has become the most powerful computer-aided diagnosis technology for improving disease identification performance.
For chest X-ray imaging, annotating large-scale data requires professional domain knowledge and is time-consuming.
In this paper, we propose many-to-one distribution learning (MODL) and K-nearest neighbor smoothing (KNNS) methods to improve a single model's disease identification performance.
arXiv Detail & Related papers (2021-02-26T02:29:30Z) - ECG-DelNet: Delineation of Ambulatory Electrocardiograms with Mixed
Quality Labeling Using Neural Networks [69.25956542388653]
Deep learning (DL) algorithms are gaining weight in academic and industrial settings.
We demonstrate DL can be successfully applied to low interpretative tasks by embedding ECG detection and delineation onto a segmentation framework.
The model was trained using PhysioNet's QT database, comprised of 105 ambulatory ECG recordings.
arXiv Detail & Related papers (2020-05-11T16:29:12Z) - Opportunities and Challenges of Deep Learning Methods for
Electrocardiogram Data: A Systematic Review [62.490310870300746]
The electrocardiogram (ECG) is one of the most commonly used diagnostic tools in medicine and healthcare.
Deep learning methods have achieved promising results on predictive healthcare tasks using ECG signals.
This paper presents a systematic review of deep learning methods for ECG data from both modeling and application perspectives.
arXiv Detail & Related papers (2019-12-28T02:44:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.