Rank-One Network: An Effective Framework for Image Restoration

• URL: http://arxiv.org/abs/2011.12610v1
• Date: Wed, 25 Nov 2020 09:39:24 GMT
• Title: Rank-One Network: An Effective Framework for Image Restoration
• Authors: Shangqi Gao and Xiahai Zhuang
• Abstract summary: We propose a new framework comprised of two modules, i.e., the RO decomposition and RO reconstruction. The RO decomposition is developed to decompose a corrupted image into the RO components and residual. The RO reconstruction is aimed to reconstruct the important information, respectively from the RO components and residual, as well as to restore the image from this reconstructed information.
• Score: 18.55701190218365
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The principal rank-one (RO) components of an image represent the self-similarity of the image, which is an important property for image restoration. However, the RO components of a corrupted image could be decimated by the procedure of image denoising. We suggest that the RO property should be utilized and the decimation should be avoided in image restoration. To achieve this, we propose a new framework comprised of two modules, i.e., the RO decomposition and RO reconstruction. The RO decomposition is developed to decompose a corrupted image into the RO components and residual. This is achieved by successively applying RO projections to the image or its residuals to extract the RO components. The RO projections, based on neural networks, extract the closest RO component of an image. The RO reconstruction is aimed to reconstruct the important information, respectively from the RO components and residual, as well as to restore the image from this reconstructed information. Experimental results on four tasks, i.e., noise-free image super-resolution (SR), realistic image SR, gray-scale image denoising, and color image denoising, show that the method is effective and efficient for image restoration, and it delivers superior performance for realistic image SR and color image denoising.

Related papers

• Customizable ROI-Based Deep Image Compression [69.93869435045916]
  Region of Interest (ROI)-based image compression prioritizes bit allocation by prioritizing ROI for higher-quality reconstruction.<n>Existing ROI-based image compression schemes predefine the ROI, making it unchangeable.<n>This work proposes a paradigm for customizable ROI-based deep image compression.
  arXiv  Detail & Related papers  (2025-07-01T02:03:09Z)
• Reconstructive Visual Instruction Tuning [64.91373889600136]
  reconstructive visual instruction tuning (ROSS) is a family of Large Multimodal Models (LMMs) that exploit vision-centric supervision signals. It reconstructs latent representations of input images, avoiding directly regressing exact raw RGB values. Empirically, ROSS consistently brings significant improvements across different visual encoders and language models.
  arXiv  Detail & Related papers  (2024-10-12T15:54:29Z)
• Image Reconstruction using Enhanced Vision Transformer [0.08594140167290097]
  We propose a novel image reconstruction framework which can be used for tasks such as image denoising, deblurring or inpainting. The model proposed in this project is based on Vision Transformer (ViT) that takes 2D images as input and outputs embeddings. We incorporate four additional optimization techniques in the framework to improve the model reconstruction capability.
  arXiv  Detail & Related papers  (2023-07-11T02:14:18Z)
• A Feature Reuse Framework with Texture-adaptive Aggregation for Reference-based Super-Resolution [29.57364804554312]
  Reference-based super-resolution (RefSR) has gained considerable success in the field of super-resolution. We propose a feature reuse framework that guides the step-by-step texture reconstruction process. We introduce a single image feature embedding module and a texture-adaptive aggregation module.
  arXiv  Detail & Related papers  (2023-06-02T12:49:22Z)
• Bridging Component Learning with Degradation Modelling for Blind Image Super-Resolution [69.11604249813304]
  We propose a components decomposition and co-optimization network (CDCN) for blind SR. CDCN decomposes the input LR image into structure and detail components in feature space. We present a degradation-driven learning strategy to jointly supervise the HR image detail and structure restoration process.
  arXiv  Detail & Related papers  (2022-12-03T14:53:56Z)
• Reference-based Image Super-Resolution with Deformable Attention Transformer [62.71769634254654]
  RefSR aims to exploit auxiliary reference (Ref) images to super-resolve low-resolution (LR) images. This paper proposes a deformable attention Transformer, namely DATSR, with multiple scales. Experiments demonstrate that our DATSR achieves state-of-the-art performance on benchmark datasets.
  arXiv  Detail & Related papers  (2022-07-25T07:07:00Z)
• Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution [64.15915577164894]
  A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing. HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
  arXiv  Detail & Related papers  (2022-06-07T14:55:32Z)
• Dual Perceptual Loss for Single Image Super-Resolution Using ESRGAN [13.335546116599494]
  This paper proposes a method called Dual Perceptual Loss (DP Loss) to replace the original perceptual loss to solve the problem of single image super-resolution reconstruction. Due to the complementary property between the VGG features and the ResNet features, the proposed DP Loss considers the advantages of learning two features simultaneously. The qualitative and quantitative analysis on benchmark datasets demonstrates the superiority of our proposed method over state-of-the-art super-resolution methods.
  arXiv  Detail & Related papers  (2022-01-17T12:42:56Z)
• Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescaling [139.25215100378284]
  We propose a hierarchical conditional flow (HCFlow) as a unified framework for image SR and image rescaling. HCFlow learns a mapping between HR and LR image pairs by modelling the distribution of the LR image and the rest high-frequency component simultaneously. To further enhance the performance, other losses such as perceptual loss and GAN loss are combined with the commonly used negative log-likelihood loss in training.
  arXiv  Detail & Related papers  (2021-08-11T16:11:01Z)
• Structure-Preserving Super Resolution with Gradient Guidance [87.79271975960764]
  Structures matter in single image super resolution (SISR) Recent studies benefiting from generative adversarial network (GAN) have promoted the development of SISR. However, there are always undesired structural distortions in the recovered images.
  arXiv  Detail & Related papers  (2020-03-29T17:26:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.