Scale-covariant spiking wavelets

• URL: http://arxiv.org/abs/2602.02020v2
• Date: Wed, 04 Feb 2026 20:40:04 GMT
• Title: Scale-covariant spiking wavelets
• Abstract summary: We establish a theoretical connection between wavelet transforms and spiking neural networks through scale-space theory.<n>We rely on the scale-covariant guarantees in the integrate-and-fire neurons to implement discrete mother wavelets that approximate continuous wavelets.
• Score: 27.326806758811045
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: We establish a theoretical connection between wavelet transforms and spiking neural networks through scale-space theory. We rely on the scale-covariant guarantees in the leaky integrate-and-fire neurons to implement discrete mother wavelets that approximate continuous wavelets. A reconstruction experiment demonstrates the feasibility of the approach and warrants further analysis to mitigate current approximation errors. Our work suggests a novel spiking signal representation that could enable more energy-efficient signal processing algorithms.

Related papers

• On the Mechanism and Dynamics of Modular Addition: Fourier Features, Lottery Ticket, and Grokking [49.1352577985191]
  We present a comprehensive analysis of how two-layer neural networks learn features to solve the modular addition task.<n>Our work provides a full mechanistic interpretation of the learned model and a theoretical explanation of its training dynamics.
  arXiv  Detail & Related papers  (2026-02-18T20:25:13Z)
• VIKING: Deep variational inference with stochastic projections [48.946143517489496]
  Variational mean field approximations tend to struggle with contemporary overparametrized deep neural networks.<n>We propose a simple variational family that considers two independent linear subspaces of the parameter space.<n>This allows us to build a fully-correlated approximate posterior reflecting the overparametrization.
  arXiv  Detail & Related papers  (2025-10-27T15:38:35Z)
• Provable wavelet-based neural approximation [0.0]
  We develop a wavelet-based theoretical framework for analyzing the universal approximation capabilities of neural networks.<n>We derive sufficient conditions on activation functions to ensure that the associated neural network approximates any functions in the given space, along with an error estimate.
  arXiv  Detail & Related papers  (2025-04-23T13:02:37Z)
• Ambient Noise Full Waveform Inversion with Neural Operators [11.44207799108199]
  Recent studies have shown that a new class of machine learning models, called neural operators, can solve the elastodynamic wave equation orders of magnitude faster than conventional methods.<n>In this study, we demonstrate the first application of neural operators for full waveform inversion on a real seismic dataset.
  arXiv  Detail & Related papers  (2025-03-19T09:10:43Z)
• Rational Gaussian wavelets and corresponding model driven neural networks [1.379948897986203]
  We consider the continuous wavelet transform using Gaussian wavelets multiplied by an appropriate rational term.<n>The zeros and poles of this rational modifier act as free parameters and their choice highly influences the shape of the mother wavelet.<n>We show that the proposed rational Gaussian wavelets are admissible and provide numerical approximations of the wavelet coefficients.
  arXiv  Detail & Related papers  (2025-02-03T11:53:11Z)
• Verification of Geometric Robustness of Neural Networks via Piecewise Linear Approximation and Lipschitz Optimisation [57.10353686244835]
  We address the problem of verifying neural networks against geometric transformations of the input image, including rotation, scaling, shearing, and translation. The proposed method computes provably sound piecewise linear constraints for the pixel values by using sampling and linear approximations in combination with branch-and-bound Lipschitz. We show that our proposed implementation resolves up to 32% more verification cases than present approaches.
  arXiv  Detail & Related papers  (2024-08-23T15:02:09Z)
• WiNet: Wavelet-based Incremental Learning for Efficient Medical Image Registration [68.25711405944239]
  Deep image registration has demonstrated exceptional accuracy and fast inference. Recent advances have adopted either multiple cascades or pyramid architectures to estimate dense deformation fields in a coarse-to-fine manner. We introduce a model-driven WiNet that incrementally estimates scale-wise wavelet coefficients for the displacement/velocity field across various scales.
  arXiv  Detail & Related papers  (2024-07-18T11:51:01Z)
• A Sampling Theory Perspective on Activations for Implicit Neural Representations [73.6637608397055]
  Implicit Neural Representations (INRs) have gained popularity for encoding signals as compact, differentiable entities. We conduct a comprehensive analysis of these activations from a sampling theory perspective. Our investigation reveals that sinc activations, previously unused in conjunction with INRs, are theoretically optimal for signal encoding.
  arXiv  Detail & Related papers  (2024-02-08T05:52:45Z)
• Enhancing Dispersive Readout of Superconducting Qubits Through Dynamic Control of the Dispersive Shift: Experiment and Theory [47.00474212574662]
  A superconducting qubit is coupled to a large-bandwidth readout resonator. We show a beyond-state-of-the-art two-state-readout error of only 0.25,%$ in 100 ns integration time. The presented results are expected to further boost the performance of new and existing algorithms and protocols.
  arXiv  Detail & Related papers  (2023-07-15T10:30:10Z)
• Bayesian inference and neural estimation of acoustic wave propagation [10.980762871305279]
  We introduce a novel framework which combines physics and machine learning methods to analyse acoustic signals. Three methods are developed for this task: a Bayesian inference approach for inferring the spectral acoustics characteristics, a neural-physical model which equips a neural network with forward and backward physical losses, and the non-linear least squares approach which serves as benchmark. The simplicity and efficiency of this framework is empirically validated on simulated data.
  arXiv  Detail & Related papers  (2023-05-28T15:14:46Z)
• Machine learning for phase-resolved reconstruction of nonlinear ocean wave surface elevations from sparse remote sensing data [37.69303106863453]
  We propose a novel approach for phase-resolved wave surface reconstruction using neural networks. Our approach utilizes synthetic yet highly realistic training data on uniform one-dimensional grids.
  arXiv  Detail & Related papers  (2023-05-18T12:30:26Z)
• Message-Passing Neural Quantum States for the Homogeneous Electron Gas [41.94295877935867]
  We introduce a message-passing-neural-network-based wave function Ansatz to simulate extended, strongly interacting fermions in continuous space. We demonstrate its accuracy by simulating the ground state of the homogeneous electron gas in three spatial dimensions.
  arXiv  Detail & Related papers  (2023-05-12T04:12:04Z)
• Variational waveguide QED simulators [58.720142291102135]
  Waveguide QED simulators are made by quantum emitters interacting with one-dimensional photonic band-gap materials. Here, we demonstrate how these interactions can be a resource to develop more efficient variational quantum algorithms.
  arXiv  Detail & Related papers  (2023-02-03T18:55:08Z)
• Deep Residual Error and Bag-of-Tricks Learning for Gravitational Wave Surrogate Modeling [32.15071712355222]
  We show how to reduce the maximum mismatch for waveforms in a validation set by 13.4 times. The most significant improvement comes from the addition of a second network that models the residual error.
  arXiv  Detail & Related papers  (2022-03-16T07:12:42Z)
• Machine Learning S-Wave Scattering Phase Shifts Bypassing the Radial Schr\"odinger Equation [77.34726150561087]
  We present a proof of concept machine learning model resting on a convolutional neural network capable to yield accurate scattering s-wave phase shifts. We discuss how the Hamiltonian can serve as a guiding principle in the construction of a physically-motivated descriptor.
  arXiv  Detail & Related papers  (2021-06-25T17:25:38Z)
• Tunable Anderson Localization of Dark States [146.2730735143614]
  We experimentally study Anderson localization in a superconducting waveguide quantum electrodynamics system. We observe an exponential suppression of the transmission coefficient in the vicinity of its subradiant dark modes. The experiment opens the door to the study of various localization phenomena on a new platform.
  arXiv  Detail & Related papers  (2021-05-25T07:52:52Z)
• Prediction of Ultrasonic Guided Wave Propagation in Solid-fluid and their Interface under Uncertainty using Machine Learning [0.0]
  We advance existing research by accounting for uncertainty in the material and geometric properties of a structure. We develop an efficient algorithm that addresses the inherent complexity of solving the multiphysics problem under uncertainty. The proposed approach provides an accurate prediction for the WpFSI problem in the presence of uncertainty.
  arXiv  Detail & Related papers  (2021-03-30T01:05:14Z)
• Lightning-Fast Gravitational Wave Parameter Inference through Neural Amortization [6.810835072367285]
  Latest advances in neural simulation-based inference can speed up the inference time by up to three orders of magnitude. We find that our model correctly estimates credible intervals for the parameters of simulated gravitational waves.
  arXiv  Detail & Related papers  (2020-10-24T16:48:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.