Generative Pre-Trained Transformer for Cardiac Abnormality Detection

• URL: http://arxiv.org/abs/2110.04071v1
• Date: Thu, 7 Oct 2021 12:01:12 GMT
• Title: Generative Pre-Trained Transformer for Cardiac Abnormality Detection
• Authors: Pierre Louis Gaudilliere, Halla Sigurthorsdottir, Cl\'ementine Aguet, J\'er\^ome Van Zaen, Mathieu Lemay, Ricard Delgado-Gonzalo
• Abstract summary: The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings. Transformers have had great success in the field of natural language processing.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: ECG heartbeat classification plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid doctors in the diagnoses of different heart conditions. Transformers have had great success in the field of natural language processing in the past years. Our team, CinCSEM, proposes to draw the parallel between text and periodic time series signals by viewing the repeated period as words and the whole signal as a sequence of such words. In this way, the attention mechanisms of the transformers can be applied to periodic time series signals. In our implementation, we follow the Transformer Encoder architecture, which combines several encoder layers followed by a dense layer with linear or sigmoid activation for generative pre-training or classification, respectively. The use case presented here is multi-label classification of heartbeat abnormalities of ECG recordings shared by the challenge. Our best entry, not exceeding the challenge's hardware limitations, achieved a score of 0.12, 0.07, 0.10, 0.10 and 0.07 on 12-lead, 6-lead, 4-lead, 3-lead and 2-lead test set respectively. Unfortunately, our team was unable to be ranked because of a missing pre-print.

Related papers

• Self-supervised inter-intra period-aware ECG representation learning for detecting atrial fibrillation [41.82319894067087]
  We propose an inter-intra period-aware ECG representation learning approach. Considering ECGs of atrial fibrillation patients exhibit the irregularity in RR intervals and the absence of P-waves, we develop specific pre-training tasks for interperiod and intraperiod representations. Our approach demonstrates remarkable AUC performances on the BTCH dataset, textiti.e., 0.953/0.996 for paroxysmal/persistent atrial fibrillation detection.
  arXiv  Detail & Related papers  (2024-10-08T10:03:52Z)
• MEIT: Multi-Modal Electrocardiogram Instruction Tuning on Large Language Models for Report Generation [41.324530807795256]
  Electrocardiogram (ECG) is the primary non-invasive diagnostic tool for monitoring cardiac conditions. Recent studies have concentrated on classifying cardiac conditions using ECG data but have overlooked ECG report generation. We propose the Multimodal ECG Instruction Tuning (MEIT) framework, the first attempt to tackle ECG report generation with LLMs and multimodal instructions.
  arXiv  Detail & Related papers  (2024-03-07T23:20:56Z)
• ECGformer: Leveraging transformer for ECG heartbeat arrhythmia classification [0.0]
  An arrhythmia, also known as a dysrhythmia, refers to an irregular heartbeat. Deep learning has demonstrated exceptional capabilities in tackling various medical challenges. We develop the ECGformer model for the classification of various arrhythmias present in electrocardiogram data.
  arXiv  Detail & Related papers  (2024-01-06T06:14:48Z)
• Deep Learning Models for Arrhythmia Classification Using Stacked Time-frequency Scalogram Images from ECG Signals [4.659427498118277]
  This paper proposes an automated AI based system for ECG-based arrhythmia classification. Deep learning based solution has been proposed for ECG-based arrhythmia classification.
  arXiv  Detail & Related papers  (2023-12-01T03:16:32Z)
• PulseNet: Deep Learning ECG-signal classification using random augmentation policy and continous wavelet transform for canines [46.09869227806991]
  evaluating canine electrocardiograms (ECG) require skilled veterinarians. Current availability of veterinary cardiologists for ECG interpretation and diagnostic support is limited. We implement a deep convolutional neural network (CNN) approach for classifying canine electrocardiogram sequences as either normal or abnormal.
  arXiv  Detail & Related papers  (2023-05-17T09:06:39Z)
• Blind ECG Restoration by Operational Cycle-GANs [15.264145425539128]
  Continuous long-term monitoring of electrocardiography signals is crucial for the early detection of cardiac abnormalities such as arrhythmia. Non-clinical ECG recordings often suffer from severe artifacts such as baseline wander, signal cuts, motion artifacts, variations on QRS amplitude, noise, and other interferences. We propose a novel approach for blind ECG restoration using cycle-consistent generative adversarial networks (Cycle-GANs)
  arXiv  Detail & Related papers  (2022-01-29T19:47:17Z)
• Generalizing electrocardiogram delineation: training convolutional neural networks with synthetic data augmentation [63.51064808536065]
  Existing databases for ECG delineation are small, being insufficient in size and in the array of pathological conditions they represent. This article delves has two main contributions. First, a pseudo-synthetic data generation algorithm was developed, based in probabilistically composing ECG traces given "pools" of fundamental segments, as cropped from the original databases, and a set of rules for their arrangement into coherent synthetic traces. Second, two novel segmentation-based loss functions have been developed, which attempt at enforcing the prediction of an exact number of independent structures and at producing closer segmentation boundaries by focusing on a reduced number of samples.
  arXiv  Detail & Related papers  (2021-11-25T10:11:41Z)
• Noise-Resilient Automatic Interpretation of Holter ECG Recordings [67.59562181136491]
  We present a three-stage process for analysing Holter recordings with robustness to noisy signal. First stage is a segmentation neural network (NN) with gradientdecoder architecture which detects positions of heartbeats. Second stage is a classification NN which will classify heartbeats as wide or narrow. Third stage is a boosting decision trees (GBDT) on top of NN features that incorporates patient-wise features.
  arXiv  Detail & Related papers  (2020-11-17T16:15:49Z)
• Multilabel 12-Lead Electrocardiogram Classification Using Gradient Boosting Tree Ensemble [64.29529357862955]
  We build an algorithm using gradient boosted tree ensembles fitted on morphology and signal processing features to classify ECG diagnosis. For each lead, we derive features from heart rate variability, PQRST template shape, and the full signal waveform. We join the features of all 12 leads to fit an ensemble of gradient boosting decision trees to predict probabilities of ECG instances belonging to each class.
  arXiv  Detail & Related papers  (2020-10-21T18:11:36Z)
• Classification of Arrhythmia by Using Deep Learning with 2-D ECG Spectral Image Representation [3.3426603061273994]
  We propose a two-dimensional (2-D) convolutional neural network (CNN) model for the classification of ECG signals into eight classes. We achieved a state-of-the-art average classification accuracy of 99.11%, which is better than those of recently reported results in classifying similar types of arrhythmias.
  arXiv  Detail & Related papers  (2020-05-14T12:11:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.