EEGDiR: Electroencephalogram denoising network for temporal information storage and global modeling through Retentive Network

• URL: http://arxiv.org/abs/2404.15289v2
• Date: Mon, 20 May 2024 08:54:19 GMT
• Title: EEGDiR: Electroencephalogram denoising network for temporal information storage and global modeling through Retentive Network
• Authors: Bin Wang, Fei Deng, Peifan Jiang,
• Abstract summary: We introduce the Retnet from natural language processing to EEG denoising. Direct application of Retnet to EEG denoising is unfeasible due to the one-dimensional nature of EEG signals. We propose the signal embedding method, transforming one-dimensional EEG signals into two dimensions for use as network inputs.
• Score: 11.491355463353731
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Electroencephalogram (EEG) signals play a pivotal role in clinical medicine, brain research, and neurological disease studies. However, susceptibility to various physiological and environmental artifacts introduces noise in recorded EEG data, impeding accurate analysis of underlying brain activity. Denoising techniques are crucial to mitigate this challenge. Recent advancements in deep learningbased approaches exhibit substantial potential for enhancing the signal-to-noise ratio of EEG data compared to traditional methods. In the realm of large-scale language models (LLMs), the Retentive Network (Retnet) infrastructure, prevalent for some models, demonstrates robust feature extraction and global modeling capabilities. Recognizing the temporal similarities between EEG signals and natural language, we introduce the Retnet from natural language processing to EEG denoising. This integration presents a novel approach to EEG denoising, opening avenues for a profound understanding of brain activities and accurate diagnosis of neurological diseases. Nonetheless, direct application of Retnet to EEG denoising is unfeasible due to the one-dimensional nature of EEG signals, while natural language processing deals with two-dimensional data. To facilitate Retnet application to EEG denoising, we propose the signal embedding method, transforming one-dimensional EEG signals into two dimensions for use as network inputs. Experimental results validate the substantial improvement in denoising effectiveness achieved by the proposed method.

Related papers

• ART: Artifact Removal Transformer for Reconstructing Noise-Free Multichannel Electroencephalographic Signals [0.10499611180329801]
  Artifact removal in electroencephalography (EEG) significantly impacts neuroscientific analysis and brain-computer interface (BCI) performance. This study presents an innovative EEG denoising model employing transformer architecture to adeptly capture the transient millisecond-scale dynamics characteristic of EEG signals. Our evaluations confirm that ART surpasses other deep-learning-based artifact removal methods, setting a new benchmark in EEG signal processing.
  arXiv  Detail & Related papers  (2024-09-11T15:05:40Z)
• RISE-iEEG: Robust to Inter-Subject Electrodes Implantation Variability iEEG Classifier [0.0]
  RISE-iEEG stands for Robust Inter-Subject Electrode Implantation Variability iEEG. We developed an iEEG decoder model that can be applied across multiple patients' data without requiring the coordinates of electrode for each patient. Our analysis shows that the performance of RISE-iEEG is 10% higher than that of HTNet and EEGNet in terms of F1 score.
  arXiv  Detail & Related papers  (2024-08-12T18:33:19Z)
• A multi-artifact EEG denoising by frequency-based deep learning [5.231056284485742]
  We develop a novel EEG denoising model that operates in the frequency domain, leveraging prior knowledge about noise spectral features. Performance evaluation on the EEGdenoiseNet dataset shows that the proposed model achieves optimal results according to both temporal and spectral metrics.
  arXiv  Detail & Related papers  (2023-10-26T12:01:47Z)
• A Knowledge-Driven Cross-view Contrastive Learning for EEG Representation [48.85731427874065]
  This paper proposes a knowledge-driven cross-view contrastive learning framework (KDC2) to extract effective representations from EEG with limited labels. The KDC2 method creates scalp and neural views of EEG signals, simulating the internal and external representation of brain activity. By modeling prior neural knowledge based on neural information consistency theory, the proposed method extracts invariant and complementary neural knowledge to generate combined representations.
  arXiv  Detail & Related papers  (2023-09-21T08:53:51Z)
• DGSD: Dynamical Graph Self-Distillation for EEG-Based Auditory Spatial Attention Detection [49.196182908826565]
  Auditory Attention Detection (AAD) aims to detect target speaker from brain signals in a multi-speaker environment. Current approaches primarily rely on traditional convolutional neural network designed for processing Euclidean data like images. This paper proposes a dynamical graph self-distillation (DGSD) approach for AAD, which does not require speech stimuli as input.
  arXiv  Detail & Related papers  (2023-09-07T13:43:46Z)
• The role of noise in denoising models for anomaly detection in medical images [62.0532151156057]
  Pathological brain lesions exhibit diverse appearance in brain images. Unsupervised anomaly detection approaches have been proposed using only normal data for training. We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
  arXiv  Detail & Related papers  (2023-01-19T21:39:38Z)
• fMRI from EEG is only Deep Learning away: the use of interpretable DL to unravel EEG-fMRI relationships [68.8204255655161]
  We present an interpretable domain grounded solution to recover the activity of several subcortical regions from multichannel EEG data. We recover individual spatial and time-frequency patterns of scalp EEG predictive of the hemodynamic signal in the subcortical nuclei.
  arXiv  Detail & Related papers  (2022-10-23T15:11:37Z)
• Task-oriented Self-supervised Learning for Anomaly Detection in Electroencephalography [51.45515911920534]
  A task-oriented self-supervised learning approach is proposed to train a more effective anomaly detector. A specific two branch convolutional neural network with larger kernels is designed as the feature extractor. The effectively designed and trained feature extractor has shown to be able to extract better feature representations from EEGs.
  arXiv  Detail & Related papers  (2022-07-04T13:15:08Z)
• EEGDnet: Fusing Non-Local and Local Self-Similarity for 1-D EEG Signal Denoising with 2-D Transformer [8.295946712221845]
  We propose a novel 1-D EEG signal denoising network with 2-D transformer, EEGDnet. We take into account the non-local and local self-similarity of EEG signal through the transformer module. EEGDnet achieves much better performance in terms of both quantitative and qualitative metrics.
  arXiv  Detail & Related papers  (2021-09-09T12:55:19Z)
• Electroencephalogram Signal Processing with Independent Component Analysis and Cognitive Stress Classification using Convolutional Neural Networks [0.0]
  This paper proposes an idea of using Independent Component Analysis(ICA) along with cross-correlation to de-noise EEG signal. The results of the recorded data show that this algorithm can eliminate the EOG signal artifact with little loss in EEG data.
  arXiv  Detail & Related papers  (2021-08-22T18:38:12Z)
• A Novel Transferability Attention Neural Network Model for EEG Emotion Recognition [51.203579838210885]
  We propose a transferable attention neural network (TANN) for EEG emotion recognition. TANN learns the emotional discriminative information by highlighting the transferable EEG brain regions data and samples adaptively. This can be implemented by measuring the outputs of multiple brain-region-level discriminators and one single sample-level discriminator.
  arXiv  Detail & Related papers  (2020-09-21T02:42:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.