CwA-T: A Channelwise AutoEncoder with Transformer for EEG Abnormality Detection

• URL: http://arxiv.org/abs/2412.14522v2
• Date: Tue, 24 Dec 2024 00:56:06 GMT
• Title: CwA-T: A Channelwise AutoEncoder with Transformer for EEG Abnormality Detection
• Authors: Youshen Zhao, Keiji Iramina,
• Abstract summary: CwA-T is a novel framework that combines a channelwise CNN-based autoencoder with a single-head transformer classifier for efficient EEG abnormality detection. evaluated on the TUH Abnormal EEG Corpus, the proposed model achieves 85.0% accuracy, 76.2% sensitivity, and 91.2% specificity at the per-case level. The framework retains interpretability through its channelwise design, demonstrating great potential for future applications in neuroscience research and clinical practice.
• Score: 0.4448543797168715
• License:
• Abstract: Electroencephalogram (EEG) signals are critical for detecting abnormal brain activity, but their high dimensionality and complexity pose significant challenges for effective analysis. In this paper, we propose CwA-T, a novel framework that combines a channelwise CNN-based autoencoder with a single-head transformer classifier for efficient EEG abnormality detection. The channelwise autoencoder compresses raw EEG signals while preserving channel independence, reducing computational costs and retaining biologically meaningful features. The compressed representations are then fed into the transformer-based classifier, which efficiently models long-term dependencies to distinguish between normal and abnormal signals. Evaluated on the TUH Abnormal EEG Corpus, the proposed model achieves 85.0% accuracy, 76.2% sensitivity, and 91.2% specificity at the per-case level, outperforming baseline models such as EEGNet, Deep4Conv, and FusionCNN. Furthermore, CwA-T requires only 202M FLOPs and 2.9M parameters, making it significantly more efficient than transformer-based alternatives. The framework retains interpretability through its channelwise design, demonstrating great potential for future applications in neuroscience research and clinical practice. The source code is available at https://github.com/YossiZhao/CAE-T.

Related papers

• Removing Neural Signal Artifacts with Autoencoder-Targeted Adversarial Transformers (AT-AT) [0.0]
  We present a new machine learning-based system for filtering EMG interference from EEG data using an autoencoder-targeted adversarial transformer (AT-AT) We trained AT-AT using published neural data from 67 subjects and found that the system was able to achieve comparable test performance to larger models.
  arXiv  Detail & Related papers  (2025-02-07T21:13:31Z)
• CEReBrO: Compact Encoder for Representations of Brain Oscillations Using Efficient Alternating Attention [53.539020807256904]
  We introduce a Compact for Representations of Brain Oscillations using alternating attention (CEReBrO) Our tokenization scheme represents EEG signals at a per-channel patch. We propose an alternating attention mechanism that jointly models intra-channel temporal dynamics and inter-channel spatial correlations, achieving 2x speed improvement with 6x less memory required compared to standard self-attention.
  arXiv  Detail & Related papers  (2025-01-18T21:44:38Z)
• Accelerating Error Correction Code Transformers [56.75773430667148]
  We introduce a novel acceleration method for transformer-based decoders. We achieve a 90% compression ratio and reduce arithmetic operation energy consumption by at least 224 times on modern hardware.
  arXiv  Detail & Related papers  (2024-10-08T11:07:55Z)
• Comparison of Autoencoder Encodings for ECG Representation in Downstream Prediction Tasks [2.2616169634370076]
  We introduce three novel Variational Autoencoder (VAE) variants: Autoencoder (SAE), Annealed beta-VAE (Abeta-VAE), and cyclical beta-VAE (Cbeta-VAE) The Abeta-VAE achieved superior signal reconstruction, reducing the mean absolute error (MAE) to 15.7 plus-minus 3.2 microvolts, which is at the level of signal noise. Our findings demonstrate that these VAE encodings are not only effective in simplifying ECG data but also provide a practical solution for applying deep learning in contexts with limited-scale labeled training data
  arXiv  Detail & Related papers  (2024-10-03T19:30:05Z)
• Dual-TSST: A Dual-Branch Temporal-Spectral-Spatial Transformer Model for EEG Decoding [2.0721229324537833]
  We propose a novel decoding architecture network with a dual-branch temporal-spectral-spatial transformer (Dual-TSST) Our proposed Dual-TSST performs superiorly in various tasks, which achieves the promising EEG classification performance of average accuracy of 80.67%. This study provides a new approach to high-performance EEG decoding, and has great potential for future CNN-Transformer based applications.
  arXiv  Detail & Related papers  (2024-09-05T05:08:43Z)
• Efficient Decoder-free Object Detection with Transformers [75.00499377197475]
  Vision transformers (ViTs) are changing the landscape of object detection approaches. We propose a decoder-free fully transformer-based (DFFT) object detector. DFFT_SMALL achieves high efficiency in both training and inference stages.
  arXiv  Detail & Related papers  (2022-06-14T13:22:19Z)
• Grasp-and-Lift Detection from EEG Signal Using Convolutional Neural Network [1.869097450593631]
  This article has automated the hand movement activity viz GAL detection method from the 32-channel EEG signals. The proposed pipeline essentially combines preprocessing and end-to-end detection steps, eliminating the requirement of hand-crafted feature engineering.
  arXiv  Detail & Related papers  (2022-02-12T19:27:06Z)
• Multiple Time Series Fusion Based on LSTM An Application to CAP A Phase Classification Using EEG [56.155331323304]
  Deep learning based electroencephalogram channels' feature level fusion is carried out in this work. Channel selection, fusion, and classification procedures were optimized by two optimization algorithms.
  arXiv  Detail & Related papers  (2021-12-18T14:17:49Z)
• Learning Signal Representations for EEG Cross-Subject Channel Selection and Trial Classification [0.3553493344868413]
  We introduce an algorithm for subject-independent channel selection of EEG recordings. It exploits channel-specific 1D-Convolutional Neural Networks (1D-CNNs) as feature extractors in a supervised fashion to maximize class separability. After training, the algorithm can be exploited by transferring only the parametrized subgroup of selected channel-specific 1D-CNNs to new signals from new subjects.
  arXiv  Detail & Related papers  (2021-06-20T06:22:16Z)
• Robust learning from corrupted EEG with dynamic spatial filtering [68.82260713085522]
  Building machine learning models using EEG recorded outside of the laboratory requires robust methods to noisy data and randomly missing channels. We propose dynamic spatial filtering (DSF), a multi-head attention module that can be plugged in before the first layer of a neural network. We tested DSF on public EEG data encompassing 4,000 recordings with simulated channel corruption and on a private dataset of 100 at-home recordings of mobile EEG with natural corruption.
  arXiv  Detail & Related papers  (2021-05-27T02:33:16Z)
• EEG-Inception: An Accurate and Robust End-to-End Neural Network for EEG-based Motor Imagery Classification [123.93460670568554]
  This paper proposes a novel convolutional neural network (CNN) architecture for accurate and robust EEG-based motor imagery (MI) classification. The proposed CNN model, namely EEG-Inception, is built on the backbone of the Inception-Time network. The proposed network is an end-to-end classification, as it takes the raw EEG signals as the input and does not require complex EEG signal-preprocessing.
  arXiv  Detail & Related papers  (2021-01-24T19:03:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.