SP$^3$: Spherical Priors for Plug-and-Play Restoration
- URL: http://arxiv.org/abs/2606.16396v1
- Date: Mon, 15 Jun 2026 08:31:52 GMT
- Title: SP$^3$: Spherical Priors for Plug-and-Play Restoration
- Abstract summary: SP$3$ is a novel Plug-and-Play algorithm that accelerates a posteriori image restoration.<n>We show that SP$3$ achieves perceptual quality comparable to state-of-the-art zero-shot diffusion and flow methods.
- Score: 2.939891130492345
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we introduce SP$^3$, a novel Plug-and-Play algorithm that accelerates maximum a posteriori image restoration by replacing denoisers with Spherical Encoders (SE) as generative priors. SP$^3$ approximates the intractable proximal prior step by utilizing the SE tightly structured latent space as a robust projection onto the natural image manifold. Alternating this projection with a closed-form data-consistency step, via Half-Quadratic Splitting, achieves stable convergence without requiring gradient computation during inference. This unique formulation unlocks "anytime" restoration capabilities, producing sharp, plausible images from the first iteration. Evaluations across a variety of image restoration tasks demonstrate that SP$^3$ achieves perceptual quality comparable to state-of-the-art zero-shot diffusion and flow methods while being $3$-$630\times$ faster.
Related papers
- EvTrajGS: Accurate and Efficient 3D Gaussian Splatting from Unposed Event Streams [108.45551580182384]
EvTrajGS is an accurate and efficient 3D Gaussian Splatting framework for unposed event streams.<n>Our method enables reliable joint pose-scene optimization from coarse pose priors, eliminating the need for computationally expensive SLAM-style pipelines.
arXiv Detail & Related papers (2026-08-09T09:00:30Z) - Restoration-Aligned Generative Flow Models for Blind Motion Deblurring [57.425021485907756]
We present DeFlow, a framework that resolves misalignment by reformulating the flow trajectory itself.<n>Under this formulation, the standard flow matching loss naturally takes the form of a residual loss.<n>Experiments on GoPro, HIDE, RealBlur, and RWBI demonstrate that DeFlow achieves strong restoration fidelity and perceptual realism.
arXiv Detail & Related papers (2026-05-09T10:05:51Z) - Image Restoration via Primal Dual Hybrid Gradient and Flow Generative Model [6.402777145722335]
Regularized robustness has been a classical approach to solving imaging inverse problems, where the regularization term enforces desirable properties of the unknown image.<n>Recently, the integration of flow matching generative image restoration has garnered significant attention, owing to their powerful prior modeling capabilities.<n>In this work, we incorporate such generative priors into a Plug-and-Play framework based on splitting a model, where the operator associated with the regularizer is replaced by a time-dependent deblurr derived from the model.
arXiv Detail & Related papers (2025-11-10T06:26:36Z) - InstantSplat: Sparse-view Gaussian Splatting in Seconds [91.77050739918037]
We introduce InstantSplat, a novel approach for addressing sparse-view 3D scene reconstruction at lightning-fast speed.<n>InstantSplat employs a self-supervised framework that optimize 3D scene representation and camera poses.<n>It achieves an acceleration of over 30x in reconstruction and improves visual quality (SSIM) from 0.3755 to 0.7624 compared to traditional SfM with 3D-GS.
arXiv Detail & Related papers (2024-03-29T17:29:58Z) - Implicit Image-to-Image Schrodinger Bridge for Image Restoration [13.138398298354113]
We introduce the Implicit Image-to-Image Schr"odinger Bridge (I$3$SB) to further accelerate the generative process of I$2$SB.<n>I$3$SB restructures the generative process into a non-Markovian framework by incorporating the initial corrupted image at each generative step.<n>Compared to I$2$SB, I$3$SB achieves the same perceptual quality with fewer generative steps, while maintaining or improving fidelity to the ground truth.
arXiv Detail & Related papers (2024-03-10T03:22:57Z) - Improving Diffusion-Based Image Synthesis with Context Prediction [49.186366441954846]
Existing diffusion models mainly try to reconstruct input image from a corrupted one with a pixel-wise or feature-wise constraint along spatial axes.
We propose ConPreDiff to improve diffusion-based image synthesis with context prediction.
Our ConPreDiff consistently outperforms previous methods and achieves a new SOTA text-to-image generation results on MS-COCO, with a zero-shot FID score of 6.21.
arXiv Detail & Related papers (2024-01-04T01:10:56Z) - Latent Diffusion Prior Enhanced Deep Unfolding for Snapshot Spectral Compressive Imaging [17.511583657111792]
Snapshot spectral imaging reconstruction aims to reconstruct three-dimensional spatial-spectral images from a single-shot two-dimensional compressed measurement.
We introduce a generative model, namely the latent diffusion model (LDM), to generate degradation-free prior to deep unfolding method.
arXiv Detail & Related papers (2023-11-24T04:55:20Z) - $PC^2$: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D
Reconstruction [97.06927852165464]
Reconstructing the 3D shape of an object from a single RGB image is a long-standing and highly challenging problem in computer vision.
We propose a novel method for single-image 3D reconstruction which generates a sparse point cloud via a conditional denoising diffusion process.
arXiv Detail & Related papers (2023-02-21T13:37:07Z) - Posterior Coreset Construction with Kernelized Stein Discrepancy for
Model-Based Reinforcement Learning [78.30395044401321]
We develop a novel model-based approach to reinforcement learning (MBRL)
It relaxes the assumptions on the target transition model to belong to a generic family of mixture models.
It can achieve up-to 50 percent reduction in wall clock time in some continuous control environments.
arXiv Detail & Related papers (2022-06-02T17:27:49Z) - The Power of Triply Complementary Priors for Image Compressive Sensing [89.14144796591685]
We propose a joint low-rank deep (LRD) image model, which contains a pair of complementaryly trip priors.
We then propose a novel hybrid plug-and-play framework based on the LRD model for image CS.
To make the optimization tractable, a simple yet effective algorithm is proposed to solve the proposed H-based image CS problem.
arXiv Detail & Related papers (2020-05-16T08:17:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.