A Tensor SVD-based Classification Algorithm Applied to fMRI Data
- URL: http://arxiv.org/abs/2111.00587v1
- Date: Sun, 31 Oct 2021 20:39:23 GMT
- Title: A Tensor SVD-based Classification Algorithm Applied to fMRI Data
- Authors: Katherine Keegan, Tanvi Vishwanath, Yihua Xu
- Abstract summary: We use a projection-based classification algorithm using the t-SVDM, a tensor analog of the matrix SVD.
Our numerical experiments demonstrate that there exists a superior tensor-based approach to fMRI classification than the best possible equivalent matrix-based approach.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: To analyze the abundance of multidimensional data, tensor-based frameworks
have been developed. Traditionally, the matrix singular value decomposition
(SVD) is used to extract the most dominant features from a matrix containing
the vectorized data. While the SVD is highly useful for data that can be
appropriately represented as a matrix, this step of vectorization causes us to
lose the high-dimensional relationships intrinsic to the data. To facilitate
efficient multidimensional feature extraction, we utilize a projection-based
classification algorithm using the t-SVDM, a tensor analog of the matrix SVD.
Our work extends the t-SVDM framework and the classification algorithm, both
initially proposed for tensors of order 3, to any number of dimensions. We then
apply this algorithm to a classification task using the StarPlus fMRI dataset.
Our numerical experiments demonstrate that there exists a superior tensor-based
approach to fMRI classification than the best possible equivalent matrix-based
approach. Our results illustrate the advantages of our chosen tensor framework,
provide insight into beneficial choices of parameters, and could be further
developed for classification of more complex imaging data. We provide our
Python implementation at https://github.com/elizabethnewman/tensor-fmri.
Related papers
- ShapeSplat: A Large-scale Dataset of Gaussian Splats and Their Self-Supervised Pretraining [104.34751911174196]
We build a large-scale dataset of 3DGS using ShapeNet and ModelNet datasets.
Our dataset ShapeSplat consists of 65K objects from 87 unique categories.
We introduce textbftextitGaussian-MAE, which highlights the unique benefits of representation learning from Gaussian parameters.
arXiv Detail & Related papers (2024-08-20T14:49:14Z) - Optimal Matrix-Mimetic Tensor Algebras via Variable Projection [0.0]
Matrix mimeticity arises from interpreting tensors as operators that can be multiplied, factorized, and analyzed analogous to matrices.
We learn optimal linear mappings and corresponding tensor representations without relying on prior knowledge of the data.
We provide original theory of uniqueness of the transformation and convergence analysis of our variable-projection-based algorithm.
arXiv Detail & Related papers (2024-06-11T04:52:23Z) - Support matrix machine: A review [0.0]
Support matrix machine (SMM) represents one of the emerging methodologies tailored for handling matrix input data.
This article provides the first in-depth analysis of the development of the SMM model.
We discuss numerous SMM variants, such as robust, sparse, class imbalance, and multi-class classification models.
arXiv Detail & Related papers (2023-10-30T16:46:23Z) - Large-scale gradient-based training of Mixtures of Factor Analyzers [67.21722742907981]
This article contributes both a theoretical analysis as well as a new method for efficient high-dimensional training by gradient descent.
We prove that MFA training and inference/sampling can be performed based on precision matrices, which does not require matrix inversions after training is completed.
Besides the theoretical analysis and matrices, we apply MFA to typical image datasets such as SVHN and MNIST, and demonstrate the ability to perform sample generation and outlier detection.
arXiv Detail & Related papers (2023-08-26T06:12:33Z) - A new filter for dimensionality reduction and classification of
hyperspectral images using GLCM features and mutual information [0.0]
We introduce a new methodology for dimensionality reduction and classification of hyperspectral images.
We take into account both spectral and spatial information based on mutual information.
Experiments are performed on three well-known hyperspectral benchmark datasets.
arXiv Detail & Related papers (2022-11-01T13:19:08Z) - Why Approximate Matrix Square Root Outperforms Accurate SVD in Global
Covariance Pooling? [59.820507600960745]
We propose a new GCP meta-layer that uses SVD in the forward pass, and Pad'e Approximants in the backward propagation to compute the gradients.
The proposed meta-layer has been integrated into different CNN models and achieves state-of-the-art performances on both large-scale and fine-grained datasets.
arXiv Detail & Related papers (2021-05-06T08:03:45Z) - Rank-R FNN: A Tensor-Based Learning Model for High-Order Data
Classification [69.26747803963907]
Rank-R Feedforward Neural Network (FNN) is a tensor-based nonlinear learning model that imposes Canonical/Polyadic decomposition on its parameters.
First, it handles inputs as multilinear arrays, bypassing the need for vectorization, and can thus fully exploit the structural information along every data dimension.
We establish the universal approximation and learnability properties of Rank-R FNN, and we validate its performance on real-world hyperspectral datasets.
arXiv Detail & Related papers (2021-04-11T16:37:32Z) - Sparse PCA via $l_{2,p}$-Norm Regularization for Unsupervised Feature
Selection [138.97647716793333]
We propose a simple and efficient unsupervised feature selection method, by combining reconstruction error with $l_2,p$-norm regularization.
We present an efficient optimization algorithm to solve the proposed unsupervised model, and analyse the convergence and computational complexity of the algorithm theoretically.
arXiv Detail & Related papers (2020-12-29T04:08:38Z) - Features based Mammogram Image Classification using Weighted Feature
Support Vector Machine [0.0]
This paper considers automated classification of breast tissue type as benign or malignant using Weighted Feature Support Vector Machine (WFSVM)
This analysis shows that the texture features have resulted in better accuracy than the other features with WFSVM and SVM.
arXiv Detail & Related papers (2020-09-19T21:28:31Z) - On Coresets for Support Vector Machines [61.928187390362176]
A coreset is a small, representative subset of the original data points.
We show that our algorithm can be used to extend the applicability of any off-the-shelf SVM solver to streaming, distributed, and dynamic data settings.
arXiv Detail & Related papers (2020-02-15T23:25:12Z) - Efficient Structure-preserving Support Tensor Train Machine [0.0]
Train Multi-way Multi-level Kernel (TT-MMK)
We develop the Train Multi-way Multi-level Kernel (TT-MMK), which combines the simplicity of the Polyadic decomposition, the classification power of the Dual Structure-preserving Support Machine, and the reliability of the Train Vector approximation.
We show by experiments that the TT-MMK method is usually more reliable, less sensitive to tuning parameters, and gives higher prediction accuracy in the SVM classification when benchmarked against other state-of-the-art techniques.
arXiv Detail & Related papers (2020-02-12T16:35:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.