Single Image Super-Resolution via a Dual Interactive Implicit Neural Network

• URL: http://arxiv.org/abs/2210.12593v1
• Date: Sun, 23 Oct 2022 02:05:19 GMT
• Title: Single Image Super-Resolution via a Dual Interactive Implicit Neural Network
• Authors: Quan H. Nguyen, William J. Beksi
• Abstract summary: We introduce a novel implicit neural network for the task of single image super-resolution at arbitrary scale factors. We demonstrate the efficacy and flexibility of our approach against the state of the art on publicly available benchmark datasets.
• Score: 5.331665215168209
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we introduce a novel implicit neural network for the task of single image super-resolution at arbitrary scale factors. To do this, we represent an image as a decoding function that maps locations in the image along with their associated features to their reciprocal pixel attributes. Since the pixel locations are continuous in this representation, our method can refer to any location in an image of varying resolution. To retrieve an image of a particular resolution, we apply a decoding function to a grid of locations each of which refers to the center of a pixel in the output image. In contrast to other techniques, our dual interactive neural network decouples content and positional features. As a result, we obtain a fully implicit representation of the image that solves the super-resolution problem at (real-valued) elective scales using a single model. We demonstrate the efficacy and flexibility of our approach against the state of the art on publicly available benchmark datasets.

Related papers

• Pixel-Inconsistency Modeling for Image Manipulation Localization [59.968362815126326]
  Digital image forensics plays a crucial role in image authentication and manipulation localization. This paper presents a generalized and robust manipulation localization model through the analysis of pixel inconsistency artifacts. Experiments show that our method successfully extracts inherent pixel-inconsistency forgery fingerprints.
  arXiv  Detail & Related papers  (2023-09-30T02:54:51Z)
• Adaptive Local Implicit Image Function for Arbitrary-scale Super-resolution [61.95533972380704]
  Local implicit image function (LIIF) denotes images as a continuous function where pixel values are expansion by using the corresponding coordinates as inputs. LIIF can be adopted for arbitrary-scale image super-resolution tasks, resulting in a single effective and efficient model for various up-scaling factors. We propose a novel adaptive local image function (A-LIIF) to alleviate this problem.
  arXiv  Detail & Related papers  (2022-08-07T11:23:23Z)
• Learning Enriched Features for Fast Image Restoration and Enhancement [166.17296369600774]
  This paper presents a holistic goal of maintaining spatially-precise high-resolution representations through the entire network. We learn an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details. Our approach achieves state-of-the-art results for a variety of image processing tasks, including defocus deblurring, image denoising, super-resolution, and image enhancement.
  arXiv  Detail & Related papers  (2022-04-19T17:59:45Z)
• Enhancing Multi-Scale Implicit Learning in Image Super-Resolution with Integrated Positional Encoding [4.781615891172263]
  We consider each pixel as the aggregation of signals from a local area in an image super-resolution context. We propose integrated positional encoding (IPE), extending traditional positional encoding by aggregating frequency information over the pixel area. We show the effectiveness of IPE-LIIF by quantitative and qualitative evaluations, and further demonstrate the generalization ability of IPE to larger image scales.
  arXiv  Detail & Related papers  (2021-12-10T06:09:55Z)
• Joint Implicit Image Function for Guided Depth Super-Resolution [11.325235139023931]
  Guided depth super-resolution is a practical task where a low-resolution and noisy input depth map is restored to a high-resolution version. We take the form of a general image but use a novel Joint Implicit Image Function representation to learn both the weights and values. We demonstrate the effectiveness of our JIIF representation on guided depth super-resolution task, significantly outperforming state-of-the-art methods on three public benchmarks.
  arXiv  Detail & Related papers  (2021-07-19T09:42:18Z)
• Image Inpainting Using Wasserstein Generative Adversarial Imputation Network [0.0]
  This paper introduces an image inpainting model based on Wasserstein Generative Adversarial Imputation Network. A universal imputation model is able to handle various scenarios of missingness with sufficient quality.
  arXiv  Detail & Related papers  (2021-06-23T05:55:07Z)
• InfinityGAN: Towards Infinite-Resolution Image Synthesis [92.40782797030977]
  We present InfinityGAN, a method to generate arbitrary-resolution images. We show how it trains and infers patch-by-patch seamlessly with low computational resources.
  arXiv  Detail & Related papers  (2021-04-08T17:59:30Z)
• Gigapixel Histopathological Image Analysis using Attention-based Neural Networks [7.1715252990097325]
  We propose a CNN structure consisting of a compressing path and a learning path. Our method integrates both global and local information, is flexible with regard to the size of the input images and only requires weak image-level labels.
  arXiv  Detail & Related papers  (2021-01-25T10:18:52Z)
• Spatially-Adaptive Pixelwise Networks for Fast Image Translation [57.359250882770525]
  We introduce a new generator architecture, aimed at fast and efficient high-resolution image-to-image translation. We use pixel-wise networks; that is, each pixel is processed independently of others. Our model is up to 18x faster than state-of-the-art baselines.
  arXiv  Detail & Related papers  (2020-12-05T10:02:03Z)
• Learning Enriched Features for Real Image Restoration and Enhancement [166.17296369600774]
  convolutional neural networks (CNNs) have achieved dramatic improvements over conventional approaches for image restoration task. We present a novel architecture with the collective goals of maintaining spatially-precise high-resolution representations through the entire network. Our approach learns an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details.
  arXiv  Detail & Related papers  (2020-03-15T11:04:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.