BRAIN2DEPTH: Lightweight CNN Model for Classification of Cognitive
States from EEG Recordings
- URL: http://arxiv.org/abs/2106.06688v1
- Date: Sat, 12 Jun 2021 05:06:20 GMT
- Title: BRAIN2DEPTH: Lightweight CNN Model for Classification of Cognitive
States from EEG Recordings
- Authors: Pankaj Pandey and Krishna Prasad Miyapuram
- Abstract summary: This paper proposes a simple, lightweight CNN model to classify cognitive states from EEG recordings.
We develop a novel pipeline to learn distinct cognitive representation consisting of two stages.
We attain comparable performance utilizing less than 4% of the parameters of other models.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Several Convolutional Deep Learning models have been proposed to classify the
cognitive states utilizing several neuro-imaging domains. These models have
achieved significant results, but they are heavily designed with millions of
parameters, which increases train and test time, making the model complex and
less suitable for real-time analysis. This paper proposes a simple, lightweight
CNN model to classify cognitive states from Electroencephalograph (EEG)
recordings. We develop a novel pipeline to learn distinct cognitive
representation consisting of two stages. The first stage is to generate the 2D
spectral images from neural time series signals in a particular frequency band.
Images are generated to preserve the relationship between the neighboring
electrodes and the spectral property of the cognitive events. The second is to
develop a time-efficient, computationally less loaded, and high-performing
model. We design a network containing 4 blocks and major components include
standard and depth-wise convolution for increasing the performance and followed
by separable convolution to decrease the number of parameters which maintains
the tradeoff between time and performance. We experiment on open access EEG
meditation dataset comprising expert, nonexpert meditative, and control states.
We compare performance with six commonly used machine learning classifiers and
four state of the art deep learning models. We attain comparable performance
utilizing less than 4\% of the parameters of other models. This model can be
employed in a real-time computation environment such as neurofeedback.
Related papers
- Equivariant Graph Neural Operator for Modeling 3D Dynamics [148.98826858078556]
We propose Equivariant Graph Neural Operator (EGNO) to directly models dynamics as trajectories instead of just next-step prediction.
EGNO explicitly learns the temporal evolution of 3D dynamics where we formulate the dynamics as a function over time and learn neural operators to approximate it.
Comprehensive experiments in multiple domains, including particle simulations, human motion capture, and molecular dynamics, demonstrate the significantly superior performance of EGNO against existing methods.
arXiv Detail & Related papers (2024-01-19T21:50:32Z) - Continuous time recurrent neural networks: overview and application to
forecasting blood glucose in the intensive care unit [56.801856519460465]
Continuous time autoregressive recurrent neural networks (CTRNNs) are a deep learning model that account for irregular observations.
We demonstrate the application of these models to probabilistic forecasting of blood glucose in a critical care setting.
arXiv Detail & Related papers (2023-04-14T09:39:06Z) - Characterizing and Understanding the Behavior of Quantized Models for
Reliable Deployment [32.01355605506855]
Quantization-aware training can produce more stable models than standard, adversarial, and Mixup training.
Disagreements often have closer top-1 and top-2 output probabilities, and $Margin$ is a better indicator than the other uncertainty metrics to distinguish disagreements.
We opensource our code and models as a new benchmark for further studying the quantized models.
arXiv Detail & Related papers (2022-04-08T11:19:16Z) - Dynamically-Scaled Deep Canonical Correlation Analysis [77.34726150561087]
Canonical Correlation Analysis (CCA) is a method for feature extraction of two views by finding maximally correlated linear projections of them.
We introduce a novel dynamic scaling method for training an input-dependent canonical correlation model.
arXiv Detail & Related papers (2022-03-23T12:52:49Z) - Classification of diffraction patterns using a convolutional neural
network in single particle imaging experiments performed at X-ray
free-electron lasers [53.65540150901678]
Single particle imaging (SPI) at X-ray free electron lasers (XFELs) is particularly well suited to determine the 3D structure of particles in their native environment.
For a successful reconstruction, diffraction patterns originating from a single hit must be isolated from a large number of acquired patterns.
We propose to formulate this task as an image classification problem and solve it using convolutional neural network (CNN) architectures.
arXiv Detail & Related papers (2021-12-16T17:03:14Z) - Time-Frequency Localization Using Deep Convolutional Maxout Neural
Network in Persian Speech Recognition [0.0]
Time-frequency flexibility in some mammals' auditory neurons system improves recognition performance.
This paper proposes a CNN-based structure for time-frequency localization of audio signal information in the ASR acoustic model.
The average recognition score of TFCMNN models is about 1.6% higher than the average of conventional models.
arXiv Detail & Related papers (2021-08-09T05:46:58Z) - STAR: Sparse Transformer-based Action Recognition [61.490243467748314]
This work proposes a novel skeleton-based human action recognition model with sparse attention on the spatial dimension and segmented linear attention on the temporal dimension of data.
Experiments show that our model can achieve comparable performance while utilizing much less trainable parameters and achieve high speed in training and inference.
arXiv Detail & Related papers (2021-07-15T02:53:11Z) - Combining Deep Transfer Learning with Signal-image Encoding for
Multi-Modal Mental Wellbeing Classification [2.513785998932353]
This paper proposes a framework to tackle the limitation in performing emotional state recognition on multiple multimodal datasets.
We show that model performance when inferring real-world wellbeing rated on a 5-point Likert scale can be enhanced using our framework.
arXiv Detail & Related papers (2020-11-20T13:37:23Z) - Deep learning-based classification of fine hand movements from low
frequency EEG [5.414308305392762]
The classification of different fine hand movements from EEG signals represents a relevant research challenge.
We trained and tested a newly proposed convolutional neural network (CNN)
CNN achieved good performance in both datasets and they were similar or superior to the baseline models.
arXiv Detail & Related papers (2020-11-13T07:16:06Z) - Convolutional Tensor-Train LSTM for Spatio-temporal Learning [116.24172387469994]
We propose a higher-order LSTM model that can efficiently learn long-term correlations in the video sequence.
This is accomplished through a novel tensor train module that performs prediction by combining convolutional features across time.
Our results achieve state-of-the-art performance-art in a wide range of applications and datasets.
arXiv Detail & Related papers (2020-02-21T05:00:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.