Multi-pooling 3D Convolutional Neural Network for fMRI Classification of
Visual Brain States
- URL: http://arxiv.org/abs/2303.14391v1
- Date: Sat, 25 Mar 2023 07:54:51 GMT
- Title: Multi-pooling 3D Convolutional Neural Network for fMRI Classification of
Visual Brain States
- Authors: Zhen Zhang, Masaki Takeda and Makoto Iwata
- Abstract summary: This paper proposed a multi-pooling 3D convolutional neural network (MP3DCNN) to improve fMRI classification accuracy.
MP3DCNN is mainly composed of a three-layer 3DCNN, where the first and second layers of 3D convolutions each have a branch of pooling connection.
- Score: 3.19429184376611
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Neural decoding of visual object classification via functional magnetic
resonance imaging (fMRI) data is challenging and is vital to understand
underlying brain mechanisms. This paper proposed a multi-pooling 3D
convolutional neural network (MP3DCNN) to improve fMRI classification accuracy.
MP3DCNN is mainly composed of a three-layer 3DCNN, where the first and second
layers of 3D convolutions each have a branch of pooling connection. The results
showed that this model can improve the classification accuracy for categorical
(face vs. object), face sub-categorical (male face vs. female face), and object
sub-categorical (natural object vs. artificial object) classifications from
1.684% to 14.918% over the previous study in decoding brain mechanisms.
Related papers
- Self-Supervised Pretext Tasks for Alzheimer's Disease Classification using 3D Convolutional Neural Networks on Large-Scale Synthetic Neuroimaging Dataset [11.173478552040441]
Alzheimer's Disease (AD) induces both localised and widespread neural degenerative changes throughout the brain.
In this work, we evaluated several unsupervised methods to train a feature extractor for downstream AD vs. CN classification.
arXiv Detail & Related papers (2024-06-20T11:26:32Z) - Brain3D: Generating 3D Objects from fMRI [76.41771117405973]
We design a novel 3D object representation learning method, Brain3D, that takes as input the fMRI data of a subject.
We show that our model captures the distinct functionalities of each region of human vision system.
Preliminary evaluations indicate that Brain3D can successfully identify the disordered brain regions in simulated scenarios.
arXiv Detail & Related papers (2024-05-24T06:06:11Z) - Decomposing 3D Neuroimaging into 2+1D Processing for Schizophrenia
Recognition [25.80846093248797]
We propose to process the 3D data by a 2+1D framework so that we can exploit the powerful deep 2D Convolutional Neural Network (CNN) networks pre-trained on the huge ImageNet dataset for 3D neuroimaging recognition.
Specifically, 3D volumes of Magnetic Resonance Imaging (MRI) metrics are decomposed to 2D slices according to neighboring voxel positions.
Global pooling is applied to remove redundant information as the activation patterns are sparsely distributed over feature maps.
Channel-wise and slice-wise convolutions are proposed to aggregate the contextual information in the third dimension unprocessed by the 2D CNN model.
arXiv Detail & Related papers (2022-11-21T15:22:59Z) - Mental arithmetic task classification with convolutional neural network
based on spectral-temporal features from EEG [0.47248250311484113]
Deep neural networks (DNN) show significant advantages in computer vision applications.
We present here a shallow neural network that uses mainly two convolutional neural network layers, with relatively few parameters and fast to learn spectral-temporal features from EEG.
Experimental results showed that the shallow CNN model outperformed all the other models and achieved the highest classification accuracy of 90.68%.
arXiv Detail & Related papers (2022-09-26T02:15:22Z) - View-Disentangled Transformer for Brain Lesion Detection [50.4918615815066]
We propose a novel view-disentangled transformer to enhance the extraction of MRI features for more accurate tumour detection.
First, the proposed transformer harvests long-range correlation among different positions in a 3D brain scan.
Second, the transformer models a stack of slice features as multiple 2D views and enhance these features view-by-view.
Third, we deploy the proposed transformer module in a transformer backbone, which can effectively detect the 2D regions surrounding brain lesions.
arXiv Detail & Related papers (2022-09-20T11:58:23Z) - Multi-Classification of Brain Tumor Images Using Transfer Learning Based
Deep Neural Network [0.5893124686141781]
This paper focuses on elevating the classification accuracy of brain tumor images with transfer learning based deep neural network.
The proposed model acquires an effective performance with an overall accuracy of 96.25% which is much improved than some existing multi-classification methods.
arXiv Detail & Related papers (2022-06-17T04:30:40Z) - Overcoming the Domain Gap in Neural Action Representations [60.47807856873544]
3D pose data can now be reliably extracted from multi-view video sequences without manual intervention.
We propose to use it to guide the encoding of neural action representations together with a set of neural and behavioral augmentations.
To reduce the domain gap, during training, we swap neural and behavioral data across animals that seem to be performing similar actions.
arXiv Detail & Related papers (2021-12-02T12:45:46Z) - 3D Convolutional Neural Networks for Stalled Brain Capillary Detection [72.21315180830733]
Brain vasculature dysfunctions such as stalled blood flow in cerebral capillaries are associated with cognitive decline and pathogenesis in Alzheimer's disease.
Here, we describe a deep learning-based approach for automatic detection of stalled capillaries in brain images based on 3D convolutional neural networks.
In this setting, our approach outperformed other methods and demonstrated state-of-the-art results, achieving 0.85 Matthews correlation coefficient, 85% sensitivity, and 99.3% specificity.
arXiv Detail & Related papers (2021-04-04T20:30:14Z) - Emotional EEG Classification using Connectivity Features and
Convolutional Neural Networks [81.74442855155843]
We introduce a new classification system that utilizes brain connectivity with a CNN and validate its effectiveness via the emotional video classification.
The level of concentration of the brain connectivity related to the emotional property of the target video is correlated with classification performance.
arXiv Detail & Related papers (2021-01-18T13:28:08Z) - Interpretation of 3D CNNs for Brain MRI Data Classification [56.895060189929055]
We extend the previous findings in gender differences from diffusion-tensor imaging on T1 brain MRI scans.
We provide the voxel-wise 3D CNN interpretation comparing the results of three interpretation methods.
arXiv Detail & Related papers (2020-06-20T17:56:46Z) - Brain MRI-based 3D Convolutional Neural Networks for Classification of
Schizophrenia and Controls [25.80846093248797]
Convolutional Neural Network (CNN) has been successfully applied on classification of both natural images and medical images.
We built 3D CNN models and compared their performance with a handcrafted feature-based machine learning approach.
CNN models achieved higher cross-validation accuracy than handcrafted feature-based machine learning.
arXiv Detail & Related papers (2020-03-14T10:05:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.