Low Rank Support Quaternion Matrix Machine
- URL: http://arxiv.org/abs/2512.08327v1
- Date: Tue, 09 Dec 2025 07:42:33 GMT
- Title: Low Rank Support Quaternion Matrix Machine
- Authors: Wang Chen, Ziyan Luo, Shuangyue Wang,
- Abstract summary: We propose a novel classification method for color image classification, named as the Low-rank Support Quaternion Matrix Machine (LSQMM)<n>For the purpose of promoting low-rank structures resulting from strongly correlated color channels, a quaternion nuclear norm regularization term is added to the hinge loss in our LSQMM model.<n> Experimental results on multiple color image classification datasets demonstrate that our proposed classification approach exhibits advantages in classification accuracy, robustness and computational efficiency.
- Score: 10.339358618129303
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Input features are conventionally represented as vectors, matrices, or third order tensors in the real field, for color image classification. Inspired by the success of quaternion data modeling for color images in image recovery and denoising tasks, we propose a novel classification method for color image classification, named as the Low-rank Support Quaternion Matrix Machine (LSQMM), in which the RGB channels are treated as pure quaternions to effectively preserve the intrinsic coupling relationships among channels via the quaternion algebra. For the purpose of promoting low-rank structures resulting from strongly correlated color channels, a quaternion nuclear norm regularization term, serving as a natural extension of the conventional matrix nuclear norm to the quaternion domain, is added to the hinge loss in our LSQMM model. An Alternating Direction Method of Multipliers (ADMM)-based iterative algorithm is designed to effectively resolve the proposed quaternion optimization model. Experimental results on multiple color image classification datasets demonstrate that our proposed classification approach exhibits advantages in classification accuracy, robustness and computational efficiency, compared to several state-of-the-art methods using support vector machines, support matrix machines, and support tensor machines.
Related papers
- Quaternion Approximation Networks for Enhanced Image Classification and Oriented Object Detection [2.847742374860449]
Quaternion Approximate Networks (QUAN) is a novel deep learning framework that leverages quaternion algebra for rotation equivariant image classification and object detection.<n>Quaternion Approximate Networks (QUAN) is evaluated on image classification (CIFAR-10/100, ImageNet), object detection (COCO, DOTA), and robotic perception tasks.<n>These results highlight its potential for deployment in resource-constrained robotic systems requiring rotation-aware perception and application in other domains.
arXiv Detail & Related papers (2025-09-05T21:41:40Z) - Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy [57.54306942529943]
We propose an Approximately Orthogonal Fine-Tuning (AOFT) strategy for representing the low-rank weight matrices.<n>Our method achieves competitive performance across a range of downstream image classification tasks.
arXiv Detail & Related papers (2025-07-17T16:09:05Z) - On Learning Gaussian Multi-index Models with Gradient Flow [57.170617397894404]
We study gradient flow on the multi-index regression problem for high-dimensional Gaussian data.
We consider a two-timescale algorithm, whereby the low-dimensional link function is learnt with a non-parametric model infinitely faster than the subspace parametrizing the low-rank projection.
arXiv Detail & Related papers (2023-10-30T17:55:28Z) - $L_{2,1}$-Norm Regularized Quaternion Matrix Completion Using Sparse
Representation and Quaternion QR Decomposition [7.344370881751104]
We propose a method based on quaternion Qatar Riyal decomposition (QQR) and quaternion $L_2,1$-norm called QLNM-QQR.
This new approach reduces computational complexity by avoiding the need to calculate the QSVD of large quaternion matrices.
We also present two improvements to the QLNM-QQR method: an enhanced version called IRQLNM-QQR that uses iteratively reweighted quaternion $L_2,1$-norm minimization and a method called QLNM-QQR-SR that
arXiv Detail & Related papers (2023-09-07T15:08:12Z) - Quaternion tensor left ring decomposition and application for color
image inpainting [14.601163837840675]
We propose the quaternion tensor left ring (QTLR) decomposition, which inherits the powerful and generalized representation abilities of the TR decomposition.
The paper further proposes a low-rank quaternion tensor completion (LRQTC) model and its algorithm for color image inpainting based on the defined QTLR decomposition.
arXiv Detail & Related papers (2023-07-20T06:37:47Z) - Deep Diversity-Enhanced Feature Representation of Hyperspectral Images [87.47202258194719]
We rectify 3D convolution by modifying its topology to enhance the rank upper-bound.
We also propose a novel diversity-aware regularization (DA-Reg) term that acts on the feature maps to maximize independence among elements.
To demonstrate the superiority of the proposed Re$3$-ConvSet and DA-Reg, we apply them to various HS image processing and analysis tasks.
arXiv Detail & Related papers (2023-01-15T16:19:18Z) - Quasi Non-Negative Quaternion Matrix Factorization with Application to
Color Face Recognition [0.0]
A novel quasi-negative quaternion matrix factorization (QNQMF) is presented for color image processing.
The accuracy of the rate of face recognition on the quaternion model is better than on the red, green and blue channels of color image.
arXiv Detail & Related papers (2022-11-30T04:51:09Z) - Semi-Supervised Subspace Clustering via Tensor Low-Rank Representation [64.49871502193477]
We propose a novel semi-supervised subspace clustering method, which is able to simultaneously augment the initial supervisory information and construct a discriminative affinity matrix.
Comprehensive experimental results on six commonly-used benchmark datasets demonstrate the superiority of our method over state-of-the-art methods.
arXiv Detail & Related papers (2022-05-21T01:47:17Z) - Quaternion Optimized Model with Sparse Regularization for Color Image
Recovery [10.137095668835439]
This paper is inspired by an appreciation of the fact that different signal types, including audio formats and images, possess structures that are inherently sparse in respect of their respective bases.
Since color images can be processed as a whole in the quaternion domain, we depicted the sparsity of the color image in the quaternion discrete cosine transform (QDCT) domain.
To achieve a more superior low-rank approximation, the quatenrion-based truncated nuclear norm (QTNN) is employed in the proposed model.
arXiv Detail & Related papers (2022-04-19T03:07:12Z) - Invariant Deep Compressible Covariance Pooling for Aerial Scene
Categorization [80.55951673479237]
We propose a novel invariant deep compressible covariance pooling (IDCCP) to solve nuisance variations in aerial scene categorization.
We conduct extensive experiments on the publicly released aerial scene image data sets and demonstrate the superiority of this method compared with state-of-the-art methods.
arXiv Detail & Related papers (2020-11-11T11:13:07Z) - Multi-View Spectral Clustering Tailored Tensor Low-Rank Representation [105.33409035876691]
This paper explores the problem of multi-view spectral clustering (MVSC) based on tensor low-rank modeling.
We design a novel structured tensor low-rank norm tailored to MVSC.
We show that the proposed method outperforms state-of-the-art methods to a significant extent.
arXiv Detail & Related papers (2020-04-30T11:52:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.