TSception: Capturing Temporal Dynamics and Spatial Asymmetry from EEG for Emotion Recognition

• URL: http://arxiv.org/abs/2104.02935v1
• Date: Wed, 7 Apr 2021 06:10:01 GMT
• Title: TSception: Capturing Temporal Dynamics and Spatial Asymmetry from EEG for Emotion Recognition
• Authors: Yi Ding, Neethu Robinson, Qiuhao Zeng, Cuntai Guan
• Abstract summary: TSception is a multi-scale convolutional neural network to learn temporal dynamics from affective electroencephalogram (EEG) The proposed method can be utilized in emotion regulation therapy for emotion recognition in the future.
• Score: 9.825158483198113
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we propose TSception, a multi-scale convolutional neural network, to learn temporal dynamics and spatial asymmetry from affective electroencephalogram (EEG). TSception consists of dynamic temporal, asymmetric spatial, and high-level fusion Layers, which learn discriminative representations in the time and channel dimensions simultaneously. The dynamic temporal layer consists of multi-scale 1D convolutional kernels whose lengths are related to the sampling rate of the EEG signal, which learns its dynamic temporal and frequency representations. The asymmetric spatial layer takes advantage of the asymmetric neural activations underlying emotional responses, learning the discriminative global and hemisphere representations. The learned spatial representations will be fused by a high-level fusion layer. With robust nested cross-validation settings, the proposed method is evaluated on two publicly available datasets DEAP and AMIGOS. And the performance is compared with prior reported methods such as FBFgMDM, FBTSC, Unsupervised learning, DeepConvNet, ShallowConvNet, and EEGNet. The results indicate that the proposed method significantly (p<0.05) outperforms others in terms of classification accuracy. The proposed methods can be utilized in emotion regulation therapy for emotion recognition in the future. The source code can be found at: https://github.com/deepBrains/TSception-New

Related papers

• Online Pseudo-Zeroth-Order Training of Neuromorphic Spiking Neural Networks [69.2642802272367]
  Brain-inspired neuromorphic computing with spiking neural networks (SNNs) is a promising energy-efficient computational approach. Most recent methods leverage spatial and temporal backpropagation (BP), not adhering to neuromorphic properties. We propose a novel method, online pseudo-zeroth-order (OPZO) training.
  arXiv  Detail & Related papers  (2024-07-17T12:09:00Z)
• Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learning [51.386945803485084]
  We focus on the task where the agent needs to learn multi-dimensional deterministic policies to control. Most existing spike-based RL methods take the firing rate as the output of SNNs, and convert it to represent continuous action space (i.e., the deterministic policy) through a fully-connected layer. To develop a fully spiking actor network without any floating-point matrix operations, we draw inspiration from the non-spiking interneurons found in insects.
  arXiv  Detail & Related papers  (2024-01-09T07:31:34Z)
• Assessing Neural Network Representations During Training Using Noise-Resilient Diffusion Spectral Entropy [55.014926694758195]
  Entropy and mutual information in neural networks provide rich information on the learning process. We leverage data geometry to access the underlying manifold and reliably compute these information-theoretic measures. We show that they form noise-resistant measures of intrinsic dimensionality and relationship strength in high-dimensional simulated data.
  arXiv  Detail & Related papers  (2023-12-04T01:32:42Z)
• Graph-Aware Contrasting for Multivariate Time-Series Classification [50.84488941336865]
  Existing contrastive learning methods mainly focus on achieving temporal consistency with temporal augmentation and contrasting techniques. We propose Graph-Aware Contrasting for spatial consistency across MTS data. Our proposed method achieves state-of-the-art performance on various MTS classification tasks.
  arXiv  Detail & Related papers  (2023-09-11T02:35:22Z)
• MASA-TCN: Multi-anchor Space-aware Temporal Convolutional Neural Networks for Continuous and Discrete EEG Emotion Recognition [11.882642356358883]
  We propose a novel model, named MASA-TCN, for EEG emotion regression and classification tasks. The space-aware temporal layer enables TCN to additionally learn from spatial relations among EEG electrodes. Experiments show MASA-TCN achieves higher results than the state-of-the-art methods for both EEG emotion regression and classification tasks.
  arXiv  Detail & Related papers  (2023-08-30T04:49:24Z)
• Motor Imagery Classification based on CNN-GRU Network with Spatio-Temporal Feature Representation [22.488536453952964]
  Recently various deep neural networks have been applied to electroencephalogram (EEG) signal. EEG is a brain signal that can be acquired in a non-invasive way and has a high temporal resolution. As the EEG signal has a high dimension of classification feature space, appropriate feature extraction methods are needed to improve performance.
  arXiv  Detail & Related papers  (2021-07-15T01:05:38Z)
• SFE-Net: EEG-based Emotion Recognition with Symmetrical Spatial Feature Extraction [1.8047694351309205]
  We present a spatial folding ensemble network (SFENet) for EEG feature extraction and emotion recognition. Motivated by the spatial symmetry mechanism of human brain, we fold the input EEG channel data with five different symmetrical strategies. With this network, the spatial features of different symmetric folding signlas can be extracted simultaneously, which greatly improves the robustness and accuracy of feature recognition.
  arXiv  Detail & Related papers  (2021-04-09T12:59:38Z)
• DS-Net: Dynamic Spatiotemporal Network for Video Salient Object Detection [78.04869214450963]
  We propose a novel dynamic temporal-temporal network (DSNet) for more effective fusion of temporal and spatial information. We show that the proposed method achieves superior performance than state-of-the-art algorithms.
  arXiv  Detail & Related papers  (2020-12-09T06:42:30Z)
• Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network [68.43026108936029]
  We propose a pure spiking neural network (SNN) based computational model for precise sound localization in the noisy real-world environment. We implement this algorithm in a real-time robotic system with a microphone array. The experiment results show a mean error azimuth of 13 degrees, which surpasses the accuracy of the other biologically plausible neuromorphic approach for sound source localization.
  arXiv  Detail & Related papers  (2020-07-07T08:22:56Z)
• TSception: A Deep Learning Framework for Emotion Detection Using EEG [11.444502210936776]
  We propose a deep learning framework, TSception, for emotion detection from electroencephalogram (EEG) TSception consists of temporal and spatial convolutional layers, which learn discriminative representations in the time and channel domains simultaneously. TSception achieves a high classification accuracy of 86.03%, which outperforms the prior methods significantly.
  arXiv  Detail & Related papers  (2020-04-02T02:10:07Z)
• Multi-Scale Neural network for EEG Representation Learning in BCI [2.105172041656126]
  We propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges. By representing EEG signals withspectral-temporal information, the proposed method can be utilized for diverse paradigms.
  arXiv  Detail & Related papers  (2020-03-02T04:06:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.