Spatial Partial Functionalization of Neural Networks based on Noise Fields

• URL: http://arxiv.org/abs/2606.24588v1
• Date: Tue, 23 Jun 2026 13:50:50 GMT
• Title: Spatial Partial Functionalization of Neural Networks based on Noise Fields
• Abstract summary: Noise in neural computation is typically regarded as a disturbance, but its spatial distribution may also actively regulate which parts of a network participate in computation.<n>This paper investigates the spatial partial functionalization of Noise-modulated Neural Networks using noise fields.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Noise in neural computation is typically regarded as a disturbance, but its spatial distribution may also actively regulate which parts of a network participate in computation. This paper investigates the spatial partial functionalization of Noise-modulated Neural Networks using noise fields. We first present an activation function suitable for this goal, the crossing activation function, using the sample-level, statistical-level, and analytical-level implementations, and examine parameter reuse across these implementations. We then introduce a virtual noise field, an auxiliary continuous space for generating spatially structured network noise fields that activate partially overlapping subnetworks. Using one-dimensional function approximation tasks, we evaluate how multiple functions can be stored in a single network when each function is assigned to a different noise-field location. The results show that memory capacity improves when the spatial arrangement of noise fields reflects the proximity relationships among the functions to be learned, whereas mismatches in noise field structure can reduce effective capacity. These findings suggest that structured noise can serve not only as a perturbation but also as a topology-defining factor for functional subnetwork selection.

Related papers

• Internal noise in deep neural networks: interplay of depth, neuron number, and noise injection step [0.0]
  This paper examines the influence of internal Gaussian noise on the performance of deep feedforward neural networks.<n>Two scenarios are analyzed: noise introduced before and after the activation function, for both additive and multiplicative noise influence.
  arXiv  Detail & Related papers  (2026-04-09T11:36:14Z)
• Paradoxical noise preference in RNNs [0.0]
  In recurrent neural networks (RNNs) used to model biological neural networks, noise is typically introduced during training to emulate biological variability and regularize learning.<n>We find that continuous-time recurrent neural networks (CTRNNs) often perform best at a nonzero noise level, specifically, the same level used during training.<n>This noise preference typically arises when noise is injected inside the neural activation function; networks trained with noise injected outside the activation function perform best with zero noise.
  arXiv  Detail & Related papers  (2026-01-08T03:11:51Z)
• Enhance Vision-Language Alignment with Noise [59.2608298578913]
  We investigate whether the frozen model can be fine-tuned by customized noise.<n>We propose Positive-incentive Noise (PiNI) which can fine-tune CLIP via injecting noise into both visual and text encoders.
  arXiv  Detail & Related papers  (2024-12-14T12:58:15Z)
• Spherical Analysis of Learning Nonlinear Functionals [10.785977740158193]
  In this paper, we consider functionals defined on sets of functions on spheres. The approximation ability of deep ReLU neural networks is investigated using an encoder-decoder framework.
  arXiv  Detail & Related papers  (2024-10-01T20:10:00Z)
• Room Transfer Function Reconstruction Using Complex-valued Neural Networks and Irregularly Distributed Microphones [15.396703290586418]
  We employ complex-valued neural networks to estimate room transfer functions in the frequency range of the first room resonances. This is the first time that complex-valued neural networks are used to estimate room transfer functions.
  arXiv  Detail & Related papers  (2024-02-01T21:16:40Z)
• Provable Data Subset Selection For Efficient Neural Network Training [73.34254513162898]
  We introduce the first algorithm to construct coresets for emphRBFNNs, i.e., small weighted subsets that approximate the loss of the input data on any radial basis function network. We then perform empirical evaluations on function approximation and dataset subset selection on popular network architectures and data sets.
  arXiv  Detail & Related papers  (2023-03-09T10:08:34Z)
• Dencentralized learning in the presence of low-rank noise [57.18977364494388]
  Observations collected by agents in a network may be unreliable due to observation noise or interference. This paper proposes a distributed algorithm that allows each node to improve the reliability of its own observation.
  arXiv  Detail & Related papers  (2022-03-18T09:13:57Z)
• Robust Processing-In-Memory Neural Networks via Noise-Aware Normalization [26.270754571140735]
  PIM accelerators often suffer from intrinsic noise in the physical components. We propose a noise-agnostic method to achieve robust neural network performance against any noise setting.
  arXiv  Detail & Related papers  (2020-07-07T06:51:28Z)
• Simultaneous Denoising and Dereverberation Using Deep Embedding Features [64.58693911070228]
  We propose a joint training method for simultaneous speech denoising and dereverberation using deep embedding features. At the denoising stage, the DC network is leveraged to extract noise-free deep embedding features. At the dereverberation stage, instead of using the unsupervised K-means clustering algorithm, another neural network is utilized to estimate the anechoic speech.
  arXiv  Detail & Related papers  (2020-04-06T06:34:01Z)
• Spatially Adaptive Inference with Stochastic Feature Sampling and Interpolation [72.40827239394565]
  We propose to compute features only at sparsely sampled locations. We then densely reconstruct the feature map with an efficient procedure. The presented network is experimentally shown to save substantial computation while maintaining accuracy over a variety of computer vision tasks.
  arXiv  Detail & Related papers  (2020-03-19T15:36:31Z)
• Non-Local Part-Aware Point Cloud Denoising [55.50360085086123]
  This paper presents a novel non-local part-aware deep neural network to denoise point clouds. We design the non-local learning unit (NLU) customized with a graph attention module to adaptively capture non-local semantically-related features. To enhance the denoising performance, we cascade a series of NLUs to progressively distill the noise features from the noisy inputs.
  arXiv  Detail & Related papers  (2020-03-14T13:51:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.