A New Approach to Multilinear Dynamical Systems and Control
- URL: http://arxiv.org/abs/2108.13583v1
- Date: Tue, 31 Aug 2021 02:08:28 GMT
- Title: A New Approach to Multilinear Dynamical Systems and Control
- Authors: Randy C. Hoover, Kyle Caudle, and Karen Braman
- Abstract summary: The paper presents a new approach to multilinear dynamical systems analysis and control.
The approach is based upon recent developments in tensor decompositions and a newly defined algebra of circulants.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The current paper presents a new approach to multilinear dynamical systems
analysis and control. The approach is based upon recent developments in tensor
decompositions and a newly defined algebra of circulants. In particular, it is
shown that under the right tensor multiplication operator, a third order tensor
can be written as a product of third order tensors that is analogous to a
traditional matrix eigenvalue decomposition where the "eigenvectors" become
eigenmatrices and the "eigenvalues" become eigen-tuples. This new development
allows for a proper tensor eigenvalue decomposition to be defined and has
natural extension to linear systems theory through a
\textit{tensor-exponential}. Through this framework we extend many of
traditional techniques used in linear system theory to their multilinear
counterpart.
Related papers
- Entrywise error bounds for low-rank approximations of kernel matrices [55.524284152242096]
We derive entrywise error bounds for low-rank approximations of kernel matrices obtained using the truncated eigen-decomposition.
A key technical innovation is a delocalisation result for the eigenvectors of the kernel matrix corresponding to small eigenvalues.
We validate our theory with an empirical study of a collection of synthetic and real-world datasets.
arXiv Detail & Related papers (2024-05-23T12:26:25Z) - Third quantization of open quantum systems: new dissipative symmetries
and connections to phase-space and Keldysh field theory formulations [77.34726150561087]
We reformulate the technique of third quantization in a way that explicitly connects all three methods.
We first show that our formulation reveals a fundamental dissipative symmetry present in all quadratic bosonic or fermionic Lindbladians.
For bosons, we then show that the Wigner function and the characteristic function can be thought of as ''wavefunctions'' of the density matrix.
arXiv Detail & Related papers (2023-02-27T18:56:40Z) - Partial Degeneration of Tensors [1.0369231476008116]
We study partial degeneration, where one of the local linear maps is constant whereas the others vary along a curve.
The existence of partial degenerations gives strong upper bounds on the aided rank of a tensor, which allows one to turn degenerations into restrictions.
arXiv Detail & Related papers (2022-12-28T20:49:16Z) - Cubic-Regularized Newton for Spectral Constrained Matrix Optimization
and its Application to Fairness [9.649070872824957]
Matrix functions are utilized to rewrite smooth spectral constrained matrix optimization problems.
A new convergence analysis is provided for cubic-regularized Newton for matrix vector spaces.
arXiv Detail & Related papers (2022-09-02T18:11:05Z) - Group-invariant tensor train networks for supervised learning [0.0]
We introduce a new numerical algorithm to construct a basis of tensors that are invariant under the action of normal matrix representations.
The group-invariant tensors are then combined into a group-invariant tensor train network, which can be used as a supervised machine learning model.
arXiv Detail & Related papers (2022-06-30T06:33:08Z) - Semi-Supervised Subspace Clustering via Tensor Low-Rank Representation [64.49871502193477]
We propose a novel semi-supervised subspace clustering method, which is able to simultaneously augment the initial supervisory information and construct a discriminative affinity matrix.
Comprehensive experimental results on six commonly-used benchmark datasets demonstrate the superiority of our method over state-of-the-art methods.
arXiv Detail & Related papers (2022-05-21T01:47:17Z) - High-Order Multilinear Discriminant Analysis via Order-$\textit{n}$
Tensor Eigendecomposition [0.0]
This paper presents a new approach to tensor-based multilinear discriminant analysis referred to as High-Order Multilinear Discriminant Analysis (HOMLDA)
Our proposed approach provides improved classification performance with respect to the current Tucker decomposition-based supervised learning methods.
arXiv Detail & Related papers (2022-05-18T19:49:54Z) - Hessian Eigenspectra of More Realistic Nonlinear Models [73.31363313577941]
We make a emphprecise characterization of the Hessian eigenspectra for a broad family of nonlinear models.
Our analysis takes a step forward to identify the origin of many striking features observed in more complex machine learning models.
arXiv Detail & Related papers (2021-03-02T06:59:52Z) - A Differential Geometry Perspective on Orthogonal Recurrent Models [56.09491978954866]
We employ tools and insights from differential geometry to offer a novel perspective on orthogonal RNNs.
We show that orthogonal RNNs may be viewed as optimizing in the space of divergence-free vector fields.
Motivated by this observation, we study a new recurrent model, which spans the entire space of vector fields.
arXiv Detail & Related papers (2021-02-18T19:39:22Z) - Dominant Z-Eigenpairs of Tensor Kronecker Products are Decoupled and
Applications to Higher-Order Graph Matching [0.0]
We present a theorem that decouples the dominant eigenvectors of tensor Kronecker products.
We investigate low rank structure in the network alignment algorithm TAME.
arXiv Detail & Related papers (2020-11-17T18:55:48Z) - Eigendecomposition-Free Training of Deep Networks for Linear
Least-Square Problems [107.3868459697569]
We introduce an eigendecomposition-free approach to training a deep network.
We show that our approach is much more robust than explicit differentiation of the eigendecomposition.
Our method has better convergence properties and yields state-of-the-art results.
arXiv Detail & Related papers (2020-04-15T04:29:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.