Across-scale Process Similarity based Interpolation for Image
Super-Resolution
- URL: http://arxiv.org/abs/2003.09182v1
- Date: Fri, 20 Mar 2020 10:39:46 GMT
- Title: Across-scale Process Similarity based Interpolation for Image
Super-Resolution
- Authors: Sobhan Kanti Dhara and Debashis Sen
- Abstract summary: We propose a technique that performs through an infusion of high frequency signal components computed by exploiting process similarity'
In our approach, the decompositions generating image details and approximations are obtained through the discrete wavelet (DWT) and stationary wavelet (SWT) transforms.
It is found that our approach is the fastest in terms of CPU time and produces comparable results.
- Score: 9.289846887298852
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: A pivotal step in image super-resolution techniques is interpolation, which
aims at generating high resolution images without introducing artifacts such as
blurring and ringing. In this paper, we propose a technique that performs
interpolation through an infusion of high frequency signal components computed
by exploiting `process similarity'. By `process similarity', we refer to the
resemblance between a decomposition of the image at a resolution to the
decomposition of the image at another resolution. In our approach, the
decompositions generating image details and approximations are obtained through
the discrete wavelet (DWT) and stationary wavelet (SWT) transforms. The
complementary nature of DWT and SWT is leveraged to get the structural relation
between the input image and its low resolution approximation. The structural
relation is represented by optimal model parameters obtained through particle
swarm optimization (PSO). Owing to process similarity, these parameters are
used to generate the high resolution output image from the input image. The
proposed approach is compared with six existing techniques qualitatively and in
terms of PSNR, SSIM, and FSIM measures, along with computation time (CPU time).
It is found that our approach is the fastest in terms of CPU time and produces
comparable results.
Related papers
- Efficient Conditional Diffusion Model with Probability Flow Sampling for Image Super-resolution [35.55094110634178]
We propose an efficient conditional diffusion model with probability flow sampling for image super-resolution.
Our method achieves higher super-resolution quality than existing diffusion-based image super-resolution methods.
arXiv Detail & Related papers (2024-04-16T16:08:59Z) - Accelerating Diffusion Sampling with Optimized Time Steps [69.21208434350567]
Diffusion probabilistic models (DPMs) have shown remarkable performance in high-resolution image synthesis.
Their sampling efficiency is still to be desired due to the typically large number of sampling steps.
Recent advancements in high-order numerical ODE solvers for DPMs have enabled the generation of high-quality images with much fewer sampling steps.
arXiv Detail & Related papers (2024-02-27T10:13:30Z) - Image Inpainting via Tractable Steering of Diffusion Models [54.13818673257381]
This paper proposes to exploit the ability of Tractable Probabilistic Models (TPMs) to exactly and efficiently compute the constrained posterior.
Specifically, this paper adopts a class of expressive TPMs termed Probabilistic Circuits (PCs)
We show that our approach can consistently improve the overall quality and semantic coherence of inpainted images with only 10% additional computational overhead.
arXiv Detail & Related papers (2023-11-28T21:14:02Z) - An Optimization-based Deep Equilibrium Model for Hyperspectral Image
Deconvolution with Convergence Guarantees [71.57324258813675]
We propose a novel methodology for addressing the hyperspectral image deconvolution problem.
A new optimization problem is formulated, leveraging a learnable regularizer in the form of a neural network.
The derived iterative solver is then expressed as a fixed-point calculation problem within the Deep Equilibrium framework.
arXiv Detail & Related papers (2023-06-10T08:25:16Z) - Learned Image Compression with Generalized Octave Convolution and
Cross-Resolution Parameter Estimation [5.238765582868391]
We propose a learned multi-resolution image compression framework, which exploits octave convolutions to factorize the latent representations into the high-resolution (HR) and low-resolution (LR) parts.
Experimental results show that our method separately reduces the decoding time by approximately 73.35 % and 93.44 % compared with that of state-of-the-art learned image compression methods.
arXiv Detail & Related papers (2022-09-07T08:21:52Z) - Look Back and Forth: Video Super-Resolution with Explicit Temporal
Difference Modeling [105.69197687940505]
We propose to explore the role of explicit temporal difference modeling in both LR and HR space.
To further enhance the super-resolution result, not only spatial residual features are extracted, but the difference between consecutive frames in high-frequency domain is also computed.
arXiv Detail & Related papers (2022-04-14T17:07:33Z) - Uncovering the Over-smoothing Challenge in Image Super-Resolution: Entropy-based Quantification and Contrastive Optimization [67.99082021804145]
We propose an explicit solution to the COO problem, called Detail Enhanced Contrastive Loss (DECLoss)
DECLoss utilizes the clustering property of contrastive learning to directly reduce the variance of the potential high-resolution distribution.
We evaluate DECLoss on multiple super-resolution benchmarks and demonstrate that it improves the perceptual quality of PSNR-oriented models.
arXiv Detail & Related papers (2022-01-04T08:30:09Z) - Fast computation of mutual information in the frequency domain with
applications to global multimodal image alignment [3.584984184069584]
Information-theoretic concept of mutual information (MI) is widely used as a similarity measure to guide multimodal alignment processes.
We propose an efficient algorithm for computed MI for all discrete spatial displacements.
We evaluate the efficacy of the proposed method on three benchmark datasets.
arXiv Detail & Related papers (2021-06-28T13:27:05Z) - Generating Images with Sparse Representations [21.27273495926409]
High dimensionality of images presents architecture and sampling-efficiency challenges for likelihood-based generative models.
We present an alternative approach, inspired by common image compression methods like JPEG, and convert images to quantized discrete cosine transform (DCT) blocks.
We propose a Transformer-based autoregressive architecture, which is trained to sequentially predict the conditional distribution of the next element in such sequences.
arXiv Detail & Related papers (2021-03-05T17:56:03Z) - A Novel adaptive optimization of Dual-Tree Complex Wavelet Transform for
Medical Image Fusion [0.0]
multimodal image fusion algorithm based on dual-tree complex wavelet transform (DT-CWT) and adaptive particle swarm optimization (APSO) is proposed.
Experiment results show that the proposed method is remarkably better than the method based on particle swarm optimization.
arXiv Detail & Related papers (2020-07-22T15:34:01Z) - The Power of Triply Complementary Priors for Image Compressive Sensing [89.14144796591685]
We propose a joint low-rank deep (LRD) image model, which contains a pair of complementaryly trip priors.
We then propose a novel hybrid plug-and-play framework based on the LRD model for image CS.
To make the optimization tractable, a simple yet effective algorithm is proposed to solve the proposed H-based image CS problem.
arXiv Detail & Related papers (2020-05-16T08:17:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.