Recurrent Sinusoidal INRs for Efficient High-Fidelity Representation
- URL: http://arxiv.org/abs/2607.21485v1
- Date: Thu, 23 Jul 2026 16:26:51 GMT
- Title: Recurrent Sinusoidal INRs for Efficient High-Fidelity Representation
- Abstract summary: We study sinusoidal recurrence as an iterative mechanism for harmonic spectral enrichment in implicit neural representations.<n>We empirically validate the resulting spectral behavior against feed-forward INRs, non-sinusoidal recurrent variants, and equilibrium-style sinusoidal models.
- Score: 19.765812812167407
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We study sinusoidal recurrence as an iterative mechanism for harmonic spectral enrichment in implicit neural representations (INRs). Our analysis reveals that sinusoidal activations induce a harmonic line spectrum, providing a spectral account of how recurrent unrolling enriches the effective spectral support. We realize this principle with a shared sinusoidal block that iteratively refines the latent representation. We empirically validate the resulting spectral behavior against feed-forward INRs, non-sinusoidal recurrent variants, and equilibrium-style sinusoidal models. Complementing this analysis, we evaluate the proposed architecture across image and 3D representation tasks. On RGB image benchmarks, our method achieves higher fidelity than feed-forward baselines with fewer parameters and fewer optimization steps, and it further transfers favorably to super-resolution, NeRF, and SDF tasks.
Related papers
- Spectral Gating via Damped Oscillations for Adaptive Implicit Neural Representations [24.706105488382818]
Implicit Neural Representations (INRs) have been proven successful in encoding continuous signals through coordinate-based networks.<n>They face a spectral dilemma: periodic activations capture fine details but act as all-pass filters that memorise noise, while spatially compact activations regularise effectively but suffer from low-frequency bias.<n>We propose to model each neuron's activation as the steady-state response of a sinusoidally-forced damped harmonic oscillator.
arXiv Detail & Related papers (2026-06-22T11:59:47Z) - Coloring the Noise: Adversarial Sobolev Alignment for Faithful Image Super Resolution [43.65326076389854]
Generative priors in Image Super-Resolution often compromise faithful restoration.<n>We propose ASASR, a framework that recasts the generative flow into a Sobolev-induced geometry.<n>We show that ASASR outperforms leading generative baselines in preserving spectral consistency and structural fidelity.
arXiv Detail & Related papers (2026-05-22T06:06:51Z) - Residual Gaussian Splatting for Ultra Sparse-View CBCT Reconstruction [14.00351191217297]
This work integrates wavelet multi-resolution analysis with 3DGS to enhance sparse reconstruction.<n>We introduce a spectrally-decoupled Gaussian representation that stratifies the volumetric field into a geometric base component and a residual detail component.<n>Experiments on clinical datasets demonstrate that RGS enables the reconstructed images to capture highly refined geometric textures.
arXiv Detail & Related papers (2026-04-30T07:59:18Z) - Implicit Neural Representations: A Signal Processing Perspective [54.57279006229212]
Implicit neural representations (INRs) mark a fundamental shift in signal modeling, moving from discrete sampled data to continuous functional representations.<n>This article examines the evolution of INRs from a signal processing perspective, emphasizing spectral behavior, sampling theory, and multiscale representation.<n>We highlight the utility of INRs across a broad range of applications, including inverse problems in medical and radar imaging, compression, and 3D scene representation.
arXiv Detail & Related papers (2026-04-16T14:12:06Z) - RKHS Representation of Algebraic Convolutional Filters with Integral Operators [111.57971404925486]
In this paper, we develop a theory showing that the range of integral operators naturally induces RKHS convolutional signal models.<n>We show that filtering with integral operators corresponds to iterated box products, giving rise to a unital kernel algebra.<n>Our results establish precise connections between eigendecompositions and RKHS representations in graphon signal processing, extend naturally to directed graphons, and enable novel spatial-spectral localization results.
arXiv Detail & Related papers (2026-02-22T08:28:34Z) - FUTON: Fourier Tensor Network for Implicit Neural Representations [56.48739018255443]
Implicit neural representations (INRs) have emerged as powerful tools for encoding signals, yet dominant-based designs often suffer from slow convergence, overfitting to noise, and poor extrapolation.<n>We introduce FUTON, which models signals as generalized Fourier series whose coefficients are parameterized by a low-rank tensor decomposition.
arXiv Detail & Related papers (2026-02-13T19:31:44Z) - Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction [13.79887292039637]
Coded Aperture Snapshot Spectral Imaging (CASSI) reconstruction aims to recover the 3D spatial-spectral signal from 2D measurement.<n>Existing methods for reconstructing HSI typically involve learning mappings from a 2D compressed image to a predetermined set of discrete spectral bands.<n>We propose an innovative method called Spectral-wise Implicit Neural Representation (SINR) as a pioneering step toward addressing this limitation.
arXiv Detail & Related papers (2023-12-02T08:06:07Z) - Deep Equilibrium Diffusion Restoration with Parallel Sampling [120.15039525209106]
Diffusion model-based image restoration (IR) aims to use diffusion models to recover high-quality (HQ) images from degraded images, achieving promising performance.
Most existing methods need long serial sampling chains to restore HQ images step-by-step, resulting in expensive sampling time and high computation costs.
In this work, we aim to rethink the diffusion model-based IR models through a different perspective, i.e., a deep equilibrium (DEQ) fixed point system, called DeqIR.
arXiv Detail & Related papers (2023-11-20T08:27:56Z) - ESSAformer: Efficient Transformer for Hyperspectral Image
Super-resolution [76.7408734079706]
Single hyperspectral image super-resolution (single-HSI-SR) aims to restore a high-resolution hyperspectral image from a low-resolution observation.
We propose ESSAformer, an ESSA attention-embedded Transformer network for single-HSI-SR with an iterative refining structure.
arXiv Detail & Related papers (2023-07-26T07:45:14Z) - Synthetic Wave-Geometric Impulse Responses for Improved Speech
Dereverberation [69.1351513309953]
We show that accurately simulating the low-frequency components of Room Impulse Responses (RIRs) is important to achieving good dereverberation.
We demonstrate that speech dereverberation models trained on hybrid synthetic RIRs outperform models trained on RIRs generated by prior geometric ray tracing methods.
arXiv Detail & Related papers (2022-12-10T20:15:23Z) - Implicit Neural Representation Learning for Hyperspectral Image
Super-Resolution [0.0]
Implicit Neural Representations (INRs) are making strides as a novel and effective representation.
We propose a novel HSI reconstruction model based on INR which represents HSI by a continuous function mapping a spatial coordinate to its corresponding spectral radiance values.
arXiv Detail & Related papers (2021-12-20T14:07:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.