Signal-Plus-Noise Decomposition of Nonlinear Spiked Random Matrix Models

• URL: http://arxiv.org/abs/2405.18274v1
• Date: Tue, 28 May 2024 15:24:35 GMT
• Title: Signal-Plus-Noise Decomposition of Nonlinear Spiked Random Matrix Models
• Authors: Behrad Moniri, Hamed Hassani,
• Abstract summary: We study a nonlinear spiked random matrix model where a nonlinear function is applied element-wise to a noise matrix perturbed by a rank-one signal. We establish a signal-plus-noise decomposition for this model and identify precise phase transitions in the structure of the signal components at critical thresholds of signal strength.
• Score: 28.005935031887038
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we study a nonlinear spiked random matrix model where a nonlinear function is applied element-wise to a noise matrix perturbed by a rank-one signal. We establish a signal-plus-noise decomposition for this model and identify precise phase transitions in the structure of the signal components at critical thresholds of signal strength. To demonstrate the applicability of this decomposition, we then utilize it to study new phenomena in the problems of signed signal recovery in nonlinear models and community detection in transformed stochastic block models. Finally, we validate our results through a series of numerical simulations.

Related papers

• Gradient Descent Provably Solves Nonlinear Tomographic Reconstruction [60.95625458395291]
  In computed tomography (CT) the forward model consists of a linear transform followed by an exponential nonlinearity based on the attenuation of light according to the Beer-Lambert Law. We show that this approach reduces metal artifacts compared to a commercial reconstruction of a human skull with metal crowns.
  arXiv  Detail & Related papers  (2023-10-06T00:47:57Z)
• Non Commutative Convolutional Signal Models in Neural Networks: Stability to Small Deformations [111.27636893711055]
  We study the filtering and stability properties of non commutative convolutional filters. Our results have direct implications for group neural networks, multigraph neural networks and quaternion neural networks.
  arXiv  Detail & Related papers  (2023-10-05T20:27:22Z)
• A Graph Reconstruction by Dynamic Signal Coefficient for Fault Classification [20.273719790567743]
  This paper presents a dynamic feature reconstruction signal graph method, which plays the key role of the proposed end-to-end fault diagnosis model. Experimental results on a public data platform of a bearing and our laboratory platform of robot grinding show that this method is better than the existing methods under different noise intensities.
  arXiv  Detail & Related papers  (2023-05-30T12:24:41Z)
• Neural Abstractions [72.42530499990028]
  We present a novel method for the safety verification of nonlinear dynamical models that uses neural networks to represent abstractions of their dynamics. We demonstrate that our approach performs comparably to the mature tool Flow* on existing benchmark nonlinear models.
  arXiv  Detail & Related papers  (2023-01-27T12:38:09Z)
• Detection problems in the spiked matrix models [15.125686694430573]
  We first show that the principal component analysis can be improved by entrywise pre-transforming the data matrix if the noise is non-Gaussian. We also introduce an algorithm that estimates the rank of the signal when it is not known a priori.
  arXiv  Detail & Related papers  (2023-01-12T23:46:41Z)
• Convolutional Filtering and Neural Networks with Non Commutative Algebras [153.20329791008095]
  We study the generalization of non commutative convolutional neural networks. We show that non commutative convolutional architectures can be stable to deformations on the space of operators.
  arXiv  Detail & Related papers  (2021-08-23T04:22:58Z)
• Detection of Signal in the Spiked Rectangular Models [8.185918509343818]
  We show that the principal component analysis can be improved by pre-transforming the matrix entries if the noise is non-Gaussian. We also propose a hypothesis test to detect the presence of signal with low computational complexity.
  arXiv  Detail & Related papers  (2021-04-28T01:15:45Z)
• Hessian Eigenspectra of More Realistic Nonlinear Models [73.31363313577941]
  We make a emphprecise characterization of the Hessian eigenspectra for a broad family of nonlinear models. Our analysis takes a step forward to identify the origin of many striking features observed in more complex machine learning models.
  arXiv  Detail & Related papers  (2021-03-02T06:59:52Z)
• Online system identification in a Duffing oscillator by free energy minimisation [7.1577508803778045]
  Online system identification is used to estimate parameters of a dynamical system. The proposed inference procedure performs as well as offline prediction error minimisation in a state-of-the-art nonlinear model.
  arXiv  Detail & Related papers  (2020-09-02T06:51:56Z)
• Offline detection of change-points in the mean for stationary graph signals [55.98760097296213]
  We propose an offline method that relies on the concept of graph signal stationarity. Our detector comes with a proof of a non-asymptotic inequality oracle.
  arXiv  Detail & Related papers  (2020-06-18T15:51:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.