Harnessing the Power of Noise: A Survey of Techniques and Applications

• URL: http://arxiv.org/abs/2410.06348v1
• Date: Tue, 8 Oct 2024 20:37:13 GMT
• Title: Harnessing the Power of Noise: A Survey of Techniques and Applications
• Authors: Reyhaneh Abdolazimi, Shengmin Jin, Pramod K. Varshney, Reza Zafarani,
• Abstract summary: Noise, traditionally considered a nuisance in computational systems, is reconsidered for its unexpected and counter-intuitive benefits. We highlight how noise-enhanced training strategies can lead to models that better generalize from noisy data. This work calls for a shift in how we perceive noise, proposing that it can be a spark for innovation and advancement in the information era.
• Score: 20.696912127185147
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Noise, traditionally considered a nuisance in computational systems, is reconsidered for its unexpected and counter-intuitive benefits across a wide spectrum of domains, including nonlinear information processing, signal processing, image processing, machine learning, network science, and natural language processing. Through a comprehensive review of both historical and contemporary research, this survey presents a dual perspective on noise, acknowledging its potential to both disrupt and enhance performance. Particularly, we highlight how noise-enhanced training strategies can lead to models that better generalize from noisy data, positioning noise not just as a challenge to overcome but as a strategic tool for improvement. This work calls for a shift in how we perceive noise, proposing that it can be a spark for innovation and advancement in the information era.

Related papers

• Enhancing PAC Learning of Half spaces Through Robust Optimization Techniques [0.0]
  PAC learning half spaces under constant malicious noise, where a fraction of the training data is adversarially corrupted. My study presents a novel, efficient algorithm that extends the existing theoretical frameworks to account for noise resilience in half space learning. We provide a comprehensive analysis of the algorithm's performance, demonstrating its superior robustness to malicious noise when compared to existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-10-21T23:08:17Z)
• Towards Robust Transcription: Exploring Noise Injection Strategies for Training Data Augmentation [55.752737615873464]
  This study investigates the impact of white noise at various Signal-to-Noise Ratio (SNR) levels on state-of-the-art APT models. We hope this research provides valuable insights as preliminary work toward developing transcription models that maintain consistent performance across a range of acoustic conditions.
  arXiv  Detail & Related papers  (2024-10-18T02:31:36Z)
• Learning with Noisy Foundation Models [95.50968225050012]
  This paper is the first work to comprehensively understand and analyze the nature of noise in pre-training datasets. We propose a tuning method (NMTune) to affine the feature space to mitigate the malignant effect of noise and improve generalization.
  arXiv  Detail & Related papers  (2024-03-11T16:22:41Z)
• Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks [91.15120211190519]
  This paper aims to understand the nature of noise in pre-training datasets and to mitigate its impact on downstream tasks. We propose a light-weight black-box tuning method (NMTune) to affine the feature space to mitigate the malignant effect of noise.
  arXiv  Detail & Related papers  (2023-09-29T06:18:15Z)
• NoisyNN: Exploring the Influence of Information Entropy Change in Learning Systems [25.05692528736342]
  We show that specific noise can boost the performance of various deep architectures under certain conditions. We categorize the noise into two types, positive noise (PN) and harmful noise (HN), based on whether the noise can help reduce the complexity of the task.
  arXiv  Detail & Related papers  (2023-09-19T14:04:04Z)
• Walking Noise: On Layer-Specific Robustness of Neural Architectures against Noisy Computations and Associated Characteristic Learning Dynamics [1.5184189132709105]
  We discuss the implications of additive, multiplicative and mixed noise for different classification tasks and model architectures. We propose a methodology called Walking Noise which injects layer-specific noise to measure the robustness. We conclude with a discussion of the use of this methodology in practice, among others, discussing its use for tailored multi-execution in noisy environments.
  arXiv  Detail & Related papers  (2022-12-20T17:09:08Z)
• Geometric and Learning-based Mesh Denoising: A Comprehensive Survey [17.652531757914]
  Mesh denoising is a fundamental problem in digital geometry processing. We provide a review of the advances in mesh denoising, containing both traditional geometric approaches and recent learning-based methods.
  arXiv  Detail & Related papers  (2022-09-02T06:54:32Z)
• Robust Time Series Denoising with Learnable Wavelet Packet Transform [1.370633147306388]
  In many applications, signal denoising is often the first pre-processing step before any subsequent analysis or learning task. We propose to apply a deep learning denoising model inspired by a signal processing, a learnable version of wavelet packet transform. We demonstrate how the proposed algorithm relates to the universality of signal processing methods and the learning capabilities of deep learning approaches.
  arXiv  Detail & Related papers  (2022-06-13T13:05:58Z)
• Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis [148.16279746287452]
  We propose a swin-conv block to incorporate the local modeling ability of residual convolutional layer and non-local modeling ability of swin transformer block. For the training data synthesis, we design a practical noise degradation model which takes into consideration different kinds of noise. Experiments on AGWN removal and real image denoising demonstrate that the new network architecture design achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-03-24T18:11:31Z)
• Physics-based Noise Modeling for Extreme Low-light Photography [63.65570751728917]
  We study the noise statistics in the imaging pipeline of CMOS photosensors. We formulate a comprehensive noise model that can accurately characterize the real noise structures. Our noise model can be used to synthesize realistic training data for learning-based low-light denoising algorithms.
  arXiv  Detail & Related papers  (2021-08-04T16:36:29Z)
• Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generation [52.75909685172843]
  Real-world image noise removal is a long-standing yet very challenging task in computer vision. We propose a novel unified framework to deal with the noise removal and noise generation tasks. Our method learns the joint distribution of the clean-noisy image pairs.
  arXiv  Detail & Related papers  (2020-07-12T09:16:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.