EEGMatch: Learning with Incomplete Labels for Semi-Supervised EEG-based
Cross-Subject Emotion Recognition
- URL: http://arxiv.org/abs/2304.06496v1
- Date: Mon, 27 Mar 2023 12:02:33 GMT
- Title: EEGMatch: Learning with Incomplete Labels for Semi-Supervised EEG-based
Cross-Subject Emotion Recognition
- Authors: Rushuang Zhou, Weishan Ye, Zhiguo Zhang, Yanyang Luo, Li Zhang,
Linling Li, Gan Huang, Yining Dong, Yuan-Ting Zhang, Zhen Liang
- Abstract summary: We propose a novel semi-supervised learning framework (EEGMatch) to leverage both labeled and unlabeled EEG data.
Extensive experiments are conducted on two benchmark databases (SEED and SEED-IV)
- Score: 9.778877715427358
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Electroencephalography (EEG) is an objective tool for emotion recognition and
shows promising performance. However, the label scarcity problem is a main
challenge in this field, which limits the wide application of EEG-based emotion
recognition. In this paper, we propose a novel semi-supervised learning
framework (EEGMatch) to leverage both labeled and unlabeled EEG data. First, an
EEG-Mixup based data augmentation method is developed to generate more valid
samples for model learning. Second, a semi-supervised two-step pairwise
learning method is proposed to bridge prototype-wise and instance-wise pairwise
learning, where the prototype-wise pairwise learning measures the global
relationship between EEG data and the prototypical representation of each
emotion class and the instance-wise pairwise learning captures the local
intrinsic relationship among EEG data. Third, a semi-supervised multi-domain
adaptation is introduced to align the data representation among multiple
domains (labeled source domain, unlabeled source domain, and target domain),
where the distribution mismatch is alleviated. Extensive experiments are
conducted on two benchmark databases (SEED and SEED-IV) under a cross-subject
leave-one-subject-out cross-validation evaluation protocol. The results show
the proposed EEGmatch performs better than the state-of-the-art methods under
different incomplete label conditions (with 6.89% improvement on SEED and 1.44%
improvement on SEED-IV), which demonstrates the effectiveness of the proposed
EEGMatch in dealing with the label scarcity problem in emotion recognition
using EEG signals. The source code is available at
https://github.com/KAZABANA/EEGMatch.
Related papers
- Joint Contrastive Learning with Feature Alignment for Cross-Corpus EEG-based Emotion Recognition [2.1645626994550664]
We propose a novel Joint Contrastive learning framework with Feature Alignment to address cross-corpus EEG-based emotion recognition.
In the pre-training stage, a joint domain contrastive learning strategy is introduced to characterize generalizable time-frequency representations of EEG signals.
In the fine-tuning stage, JCFA is refined in conjunction with downstream tasks, where the structural connections among brain electrodes are considered.
arXiv Detail & Related papers (2024-04-15T08:21:17Z) - Physics-informed and Unsupervised Riemannian Domain Adaptation for Machine Learning on Heterogeneous EEG Datasets [53.367212596352324]
We propose an unsupervised approach leveraging EEG signal physics.
We map EEG channels to fixed positions using field, source-free domain adaptation.
Our method demonstrates robust performance in brain-computer interface (BCI) tasks and potential biomarker applications.
arXiv Detail & Related papers (2024-03-07T16:17:33Z) - Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencoder [69.7813498468116]
We propose Contrastive EEG-Text Masked Autoencoder (CET-MAE), a novel model that orchestrates compound self-supervised learning across and within EEG and text.
We also develop a framework called E2T-PTR (EEG-to-Text decoding using Pretrained Transferable Representations) to decode text from EEG sequences.
arXiv Detail & Related papers (2024-02-27T11:45:21Z) - DGSD: Dynamical Graph Self-Distillation for EEG-Based Auditory Spatial
Attention Detection [49.196182908826565]
Auditory Attention Detection (AAD) aims to detect target speaker from brain signals in a multi-speaker environment.
Current approaches primarily rely on traditional convolutional neural network designed for processing Euclidean data like images.
This paper proposes a dynamical graph self-distillation (DGSD) approach for AAD, which does not require speech stimuli as input.
arXiv Detail & Related papers (2023-09-07T13:43:46Z) - Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive
Learning for Cross-Subject EEG-based Emotion Recognition [18.409596696877472]
The DS-AGC framework is proposed to tackle the challenge of limited labeled data in cross-subject EEG-based emotion recognition.
The proposed model outperforms existing methods under different incomplete label conditions.
arXiv Detail & Related papers (2023-08-13T23:54:40Z) - EEG-based Emotion Style Transfer Network for Cross-dataset Emotion
Recognition [45.26847258736848]
We propose an EEG-based Emotion Style Transfer Network (E2STN) to obtain EEG representations that contain the content information of source domain and the style information of target domain.
The E2STN can achieve the state-of-the-art performance on cross-dataset EEG emotion recognition tasks.
arXiv Detail & Related papers (2023-08-09T16:54:40Z) - PARSE: Pairwise Alignment of Representations in Semi-Supervised EEG
Learning for Emotion Recognition [23.40229188549055]
We propose PARSE, a novel semi-supervised architecture for learning strong EEG representations for emotion recognition.
To reduce the potential distribution mismatch between the large amounts of unlabeled data and the limited amount of labeled data, PARSE uses pairwise representation alignment.
arXiv Detail & Related papers (2022-02-11T01:10:17Z) - Holistic Semi-Supervised Approaches for EEG Representation Learning [14.67085109524245]
We adapt three holistic semi-supervised approaches, namely MixMatch, FixMatch, and AdaMatch, as well as five classical semi-supervised methods for EEG learning.
Experiments with different amounts of limited labeled samples show that the holistic approaches achieve strong results even when only 1 labeled sample is used per class.
arXiv Detail & Related papers (2021-09-24T03:58:13Z) - EEG-Inception: An Accurate and Robust End-to-End Neural Network for
EEG-based Motor Imagery Classification [123.93460670568554]
This paper proposes a novel convolutional neural network (CNN) architecture for accurate and robust EEG-based motor imagery (MI) classification.
The proposed CNN model, namely EEG-Inception, is built on the backbone of the Inception-Time network.
The proposed network is an end-to-end classification, as it takes the raw EEG signals as the input and does not require complex EEG signal-preprocessing.
arXiv Detail & Related papers (2021-01-24T19:03:10Z) - A Novel Transferability Attention Neural Network Model for EEG Emotion
Recognition [51.203579838210885]
We propose a transferable attention neural network (TANN) for EEG emotion recognition.
TANN learns the emotional discriminative information by highlighting the transferable EEG brain regions data and samples adaptively.
This can be implemented by measuring the outputs of multiple brain-region-level discriminators and one single sample-level discriminator.
arXiv Detail & Related papers (2020-09-21T02:42:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.