FBCNN: A Deep Neural Network Architecture for Portable and Fast
Brain-Computer Interfaces
- URL: http://arxiv.org/abs/2109.02165v1
- Date: Sun, 5 Sep 2021 20:34:15 GMT
- Title: FBCNN: A Deep Neural Network Architecture for Portable and Fast
Brain-Computer Interfaces
- Authors: Pedro R. A. S. Bassi and Romis Attux
- Abstract summary: We propose two models: the FBCNN-2D and the FBCNN-3D.
The FBCNNs surpassed traditional SSVEP classification methods in our simulated BCI.
- Score: 3.198144010381572
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Objective: To propose a novel deep neural network (DNN) architecture -- the
filter bank convolutional neural network (FBCNN) -- to improve SSVEP
classification in single-channel BCIs with small data lengths.
Methods: We propose two models: the FBCNN-2D and the FBCNN-3D. The FBCNN-2D
utilizes a filter bank to create sub-band components of the
electroencephalography (EEG) signal, which it transforms using the fast Fourier
transform (FFT) and analyzes with a 2D CNN. The FBCNN-3D utilizes the same
filter bank, but it transforms the sub-band components into spectrograms via
short-time Fourier transform (STFT), and analyzes them with a 3D CNN. We made
use of transfer learning. To train the FBCNN-3D, we proposed a new technique,
called inter-dimensional transfer learning, to transfer knowledge from a 2D DNN
to a 3D DNN. Our BCI was conceived so as not to require calibration from the
final user: therefore, the test subject data was separated from training and
validation.
Results: The mean test accuracy was 85.7% for the FBCCA-2D and 85% for the
FBCCA-3D. Mean F1-Scores were 0.858 and 0.853. Alternative classification
methods, SVM, FBCCA and a CNN, had mean accuracy of 79.2%, 80.1% and 81.4%,
respectively.
Conclusion: The FBCNNs surpassed traditional SSVEP classification methods in
our simulated BCI, by a considerable margin (about 5% higher accuracy).
Transfer learning and inter-dimensional transfer learning made training much
faster and more predictable.
Significance: We proposed a new and flexible type of DNN, which had a better
performance than standard methods in SSVEP classification for portable and fast
BCIs.
Related papers
- OA-CNNs: Omni-Adaptive Sparse CNNs for 3D Semantic Segmentation [70.17681136234202]
We reexamine the design distinctions and test the limits of what a sparse CNN can achieve.
We propose two key components, i.e., adaptive receptive fields (spatially) and adaptive relation, to bridge the gap.
This exploration led to the creation of Omni-Adaptive 3D CNNs (OA-CNNs), a family of networks that integrates a lightweight module.
arXiv Detail & Related papers (2024-03-21T14:06:38Z) - Basic Binary Convolution Unit for Binarized Image Restoration Network [146.0988597062618]
In this study, we reconsider components in binary convolution, such as residual connection, BatchNorm, activation function, and structure, for image restoration tasks.
Based on our findings and analyses, we design a simple yet efficient basic binary convolution unit (BBCU)
Our BBCU significantly outperforms other BNNs and lightweight models, which shows that BBCU can serve as a basic unit for binarized IR networks.
arXiv Detail & Related papers (2022-10-02T01:54:40Z) - Intelligent 3D Network Protocol for Multimedia Data Classification using
Deep Learning [0.0]
We implement Hybrid Deep Learning Architecture that combines STIP and 3D CNN features to enhance the performance of 3D videos effectively.
The results are compared with state-of-the-art frameworks from literature for action recognition on UCF101 with an accuracy of 95%.
arXiv Detail & Related papers (2022-07-23T12:24:52Z) - Spatial-Temporal-Fusion BNN: Variational Bayesian Feature Layer [77.78479877473899]
We design a spatial-temporal-fusion BNN for efficiently scaling BNNs to large models.
Compared to vanilla BNNs, our approach can greatly reduce the training time and the number of parameters, which contributes to scale BNNs efficiently.
arXiv Detail & Related papers (2021-12-12T17:13:14Z) - Strengthening the Training of Convolutional Neural Networks By Using
Walsh Matrix [0.0]
We have modified the training and structure of DNN to increase the classification performance.
A minimum distance network (MDN) following the last layer of the convolutional neural network (CNN) is used as the classifier.
In different areas, it has been observed that a higher classification performance was obtained by using the DivFE with less number of nodes.
arXiv Detail & Related papers (2021-03-31T18:06:11Z) - 3D CNNs with Adaptive Temporal Feature Resolutions [83.43776851586351]
Similarity Guided Sampling (SGS) module can be plugged into any existing 3D CNN architecture.
SGS empowers 3D CNNs by learning the similarity of temporal features and grouping similar features together.
Our evaluations show that the proposed module improves the state-of-the-art by reducing the computational cost (GFLOPs) by half while preserving or even improving the accuracy.
arXiv Detail & Related papers (2020-11-17T14:34:05Z) - Transfer Learning and SpecAugment applied to SSVEP Based BCI
Classification [1.9336815376402716]
We use deep convolutional neural networks (DCNNs) to classify EEG signals in a single-channel brain-computer interface (BCI)
EEG signals were converted to spectrograms and served as input to train DCNNs using the transfer learning technique.
arXiv Detail & Related papers (2020-10-08T00:30:12Z) - Improving Automated COVID-19 Grading with Convolutional Neural Networks
in Computed Tomography Scans: An Ablation Study [3.072491397378425]
This paper identifies a variety of components that increase the performance of CNN-based algorithms for COVID-19 grading from CT images.
A 3D CNN with these components achieved an area under the ROC curve (AUC) of 0.934 on our test set of 105 CT scans and an AUC of 0.923 on a publicly available set of 742 CT scans.
arXiv Detail & Related papers (2020-09-21T09:58:57Z) - Depthwise Spatio-Temporal STFT Convolutional Neural Networks for Human
Action Recognition [42.400429835080416]
Conventional 3D convolutional neural networks (CNNs) are computationally expensive, memory intensive, prone to overfitting and most importantly, there is a need to improve their feature learning capabilities.
We propose new class of convolutional blocks that can serve as an alternative to 3D convolutional layer and its variants in 3D CNNs.
Our evaluation on seven action recognition datasets, including Something-something v1 and v2, Jester, Diving Kinetics-400, UCF 101, and HMDB 51, demonstrate that STFT blocks based 3D CNNs achieve on par or even better performance compared to the state-of
arXiv Detail & Related papers (2020-07-22T12:26:04Z) - Distillation Guided Residual Learning for Binary Convolutional Neural
Networks [83.6169936912264]
It is challenging to bridge the performance gap between Binary CNN (BCNN) and Floating point CNN (FCNN)
We observe that, this performance gap leads to substantial residuals between intermediate feature maps of BCNN and FCNN.
To minimize the performance gap, we enforce BCNN to produce similar intermediate feature maps with the ones of FCNN.
This training strategy, i.e., optimizing each binary convolutional block with block-wise distillation loss derived from FCNN, leads to a more effective optimization to BCNN.
arXiv Detail & Related papers (2020-07-10T07:55:39Z) - Approximation and Non-parametric Estimation of ResNet-type Convolutional
Neural Networks [52.972605601174955]
We show a ResNet-type CNN can attain the minimax optimal error rates in important function classes.
We derive approximation and estimation error rates of the aformentioned type of CNNs for the Barron and H"older classes.
arXiv Detail & Related papers (2019-03-24T19:42:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.