Weak Detection in the Spiked Wigner Model with General Rank

• URL: http://arxiv.org/abs/2001.05676v3
• Date: Thu, 4 Mar 2021 05:33:32 GMT
• Title: Weak Detection in the Spiked Wigner Model with General Rank
• Authors: Ji Hyung Jung, Hye Won Chung, and Ji Oon Lee
• Abstract summary: We study the statistical decision process of detecting the signal from a signal+noise' type matrix model with an additive Wigner noise. We propose a hypothesis test based on the linear spectral statistics of the data matrix, which does not depend on the distribution of the signal or the noise.
• Score: 13.45821655503426
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We study the statistical decision process of detecting the signal from a `signal+noise' type matrix model with an additive Wigner noise. We propose a hypothesis test based on the linear spectral statistics of the data matrix, which does not depend on the distribution of the signal or the noise. The test is optimal under the Gaussian noise if the signal-to-noise ratio is small, as it minimizes the sum of the Type-I and Type-II errors. Under the non-Gaussian noise, the test can be improved with an entrywise transformation to the data matrix. We also introduce an algorithm that estimates the rank of the signal when it is not known a priori.

Related papers

• Accelerated zero-order SGD under high-order smoothness and overparameterized regime [79.85163929026146]
  We present a novel gradient-free algorithm to solve convex optimization problems. Such problems are encountered in medicine, physics, and machine learning. We provide convergence guarantees for the proposed algorithm under both types of noise.
  arXiv  Detail & Related papers  (2024-11-21T10:26:17Z)
• Unsupervised Denoising for Signal-Dependent and Row-Correlated Imaging Noise [54.0185721303932]
  We present the first fully unsupervised deep learning-based denoiser capable of handling imaging noise that is row-correlated. Our approach uses a Variational Autoencoder with a specially designed autoregressive decoder. Our method does not require a pre-trained noise model and can be trained from scratch using unpaired noisy data.
  arXiv  Detail & Related papers  (2023-10-11T20:48:20Z)
• Optimal Algorithms for the Inhomogeneous Spiked Wigner Model [89.1371983413931]
  We derive an approximate message-passing algorithm (AMP) for the inhomogeneous problem. We identify in particular the existence of a statistical-to-computational gap where known algorithms require a signal-to-noise ratio bigger than the information-theoretic threshold to perform better than random.
  arXiv  Detail & Related papers  (2023-02-13T19:57:17Z)
• Mismatched estimation of non-symmetric rank-one matrices corrupted by structured noise [21.447998004700384]
  We study the performance of a Bayesian statistician who estimates a rank-one signal corrupted by non-symmetric rotationally invariant noise with a generic distribution of singular values. We derive the exact analytic expression for the error of the mismatched Bayes estimator and also provide the analysis of an approximate message passing (AMP) algorithm.
  arXiv  Detail & Related papers  (2023-02-07T07:56:19Z)
• Optimizing the Noise in Self-Supervised Learning: from Importance Sampling to Noise-Contrastive Estimation [80.07065346699005]
  It is widely assumed that the optimal noise distribution should be made equal to the data distribution, as in Generative Adversarial Networks (GANs) We turn to Noise-Contrastive Estimation which grounds this self-supervised task as an estimation problem of an energy-based model of the data. We soberly conclude that the optimal noise may be hard to sample from, and the gain in efficiency can be modest compared to choosing the noise distribution equal to the data's.
  arXiv  Detail & Related papers  (2023-01-23T19:57:58Z)
• Detection problems in the spiked matrix models [15.125686694430573]
  We first show that the principal component analysis can be improved by entrywise pre-transforming the data matrix if the noise is non-Gaussian. We also introduce an algorithm that estimates the rank of the signal when it is not known a priori.
  arXiv  Detail & Related papers  (2023-01-12T23:46:41Z)
• Asymptotic Normality of Log Likelihood Ratio and Fundamental Limit of the Weak Detection for Spiked Wigner Matrices [13.653940190782142]
  We consider the problem of detecting the presence of a signal in a rank-one spiked Wigner model. We prove that the log likelihood ratio of the spiked model against the null model converges to a Gaussian when the signal-to-noise ratio is below a certain threshold.
  arXiv  Detail & Related papers  (2022-03-02T02:14:54Z)
• Fully Adaptive Bayesian Algorithm for Data Analysis, FABADA [0.0]
  This paper describes a novel non-parametric noise reduction technique from the point of view of Bayesian inference. It iteratively evaluates possible smoothed versions of the data, the smooth models, obtaining an estimation of the underlying signal. Iterations stop based on the evidence and the $chi2$ statistic of the last smooth model, and we compute the expected value of the signal.
  arXiv  Detail & Related papers  (2022-01-13T18:54:31Z)
• Detection of Signal in the Spiked Rectangular Models [8.185918509343818]
  We show that the principal component analysis can be improved by pre-transforming the matrix entries if the noise is non-Gaussian. We also propose a hypothesis test to detect the presence of signal with low computational complexity.
  arXiv  Detail & Related papers  (2021-04-28T01:15:45Z)
• Learning based signal detection for MIMO systems with unknown noise statistics [84.02122699723536]
  This paper aims to devise a generalized maximum likelihood (ML) estimator to robustly detect signals with unknown noise statistics. In practice, there is little or even no statistical knowledge on the system noise, which in many cases is non-Gaussian, impulsive and not analyzable. Our framework is driven by an unsupervised learning approach, where only the noise samples are required.
  arXiv  Detail & Related papers  (2021-01-21T04:48:15Z)
• Learning Noise-Aware Encoder-Decoder from Noisy Labels by Alternating Back-Propagation for Saliency Detection [54.98042023365694]
  We propose a noise-aware encoder-decoder framework to disentangle a clean saliency predictor from noisy training examples. The proposed model consists of two sub-models parameterized by neural networks.
  arXiv  Detail & Related papers  (2020-07-23T18:47:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.