A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Maps

• URL: http://arxiv.org/abs/2206.04289v1
• Date: Thu, 9 Jun 2022 05:43:37 GMT
• Title: A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Maps
• Authors: Zicheng Zhang, Wei Sun, Xiongkuo Min, Wenhan Zhu, Tao Wang, Wei Lu, Guangtao Zhai
• Abstract summary: We propose a no-reference deep-learning image quality assessment method based on frequency maps. We first obtain the high-frequency map (HM) and low-frequency map (LM) of SRI by using Sobel operator and piecewise smooth image approximation. Our method outperforms all compared IQA models on the selected three super-resolution quality assessment (SRQA) databases.
• Score: 39.58198651685851
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: To support the application scenarios where high-resolution (HR) images are urgently needed, various single image super-resolution (SISR) algorithms are developed. However, SISR is an ill-posed inverse problem, which may bring artifacts like texture shift, blur, etc. to the reconstructed images, thus it is necessary to evaluate the quality of super-resolution images (SRIs). Note that most existing image quality assessment (IQA) methods were developed for synthetically distorted images, which may not work for SRIs since their distortions are more diverse and complicated. Therefore, in this paper, we propose a no-reference deep-learning image quality assessment method based on frequency maps because the artifacts caused by SISR algorithms are quite sensitive to frequency information. Specifically, we first obtain the high-frequency map (HM) and low-frequency map (LM) of SRI by using Sobel operator and piecewise smooth image approximation. Then, a two-stream network is employed to extract the quality-aware features of both frequency maps. Finally, the features are regressed into a single quality value using fully connected layers. The experimental results show that our method outperforms all compared IQA models on the selected three super-resolution quality assessment (SRQA) databases.

Related papers

• QMRNet: Quality Metric Regression for EO Image Quality Assessment and Super-Resolution [2.425299069769717]
  We benchmark state-of-the-art Super-Resolution (SR) algorithms for distinct Earth Observation (EO) datasets. We also propose a novel Quality Metric Regression Network (QMRNet) that is able to predict quality (as a No-Reference metric) by training on any property of the image. Overall benchmark shows promising results for LIIF, CAR and MSRN and also the potential use of QMRNet as Loss for optimizing SR predictions.
  arXiv  Detail & Related papers  (2022-10-12T22:51:13Z)
• High Dynamic Range Image Quality Assessment Based on Frequency Disparity [78.36555631446448]
  An image quality assessment (IQA) algorithm based on frequency disparity for high dynamic range ( HDR) images is proposed. The proposed LGFM can provide a higher consistency with the subjective perception compared with the state-of-the-art HDR IQA methods.
  arXiv  Detail & Related papers  (2022-09-06T08:22:13Z)
• Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution [64.15915577164894]
  A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing. HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
  arXiv  Detail & Related papers  (2022-06-07T14:55:32Z)
• SPQE: Structure-and-Perception-Based Quality Evaluation for Image Super-Resolution [24.584839578742237]
  Super-Resolution technique has greatly improved the visual quality of images by enhancing their resolutions. It also calls for an efficient SR Image Quality Assessment (SR-IQA) to evaluate those algorithms or their generated images. In emerging deep-learning-based SR, a generated high-quality, visually pleasing image may have different structures from its corresponding low-quality image.
  arXiv  Detail & Related papers  (2022-05-07T07:52:55Z)
• Image Quality Assessment using Contrastive Learning [50.265638572116984]
  We train a deep Convolutional Neural Network (CNN) using a contrastive pairwise objective to solve the auxiliary problem. We show through extensive experiments that CONTRIQUE achieves competitive performance when compared to state-of-the-art NR image quality models. Our results suggest that powerful quality representations with perceptual relevance can be obtained without requiring large labeled subjective image quality datasets.
  arXiv  Detail & Related papers  (2021-10-25T21:01:00Z)
• Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment [157.1292674649519]
  We propose a practical solution named degraded-reference IQA (DR-IQA) DR-IQA exploits the inputs of IR models, degraded images, as references. Our results can even be close to the performance of full-reference settings.
  arXiv  Detail & Related papers  (2021-08-18T02:35:08Z)
• Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescaling [139.25215100378284]
  We propose a hierarchical conditional flow (HCFlow) as a unified framework for image SR and image rescaling. HCFlow learns a mapping between HR and LR image pairs by modelling the distribution of the LR image and the rest high-frequency component simultaneously. To further enhance the performance, other losses such as perceptual loss and GAN loss are combined with the commonly used negative log-likelihood loss in training.
  arXiv  Detail & Related papers  (2021-08-11T16:11:01Z)
• Learning-Based Quality Assessment for Image Super-Resolution [25.76907513611358]
  We build a large-scale SR image database using a novel semi-automatic labeling approach. The resulting SR Image quality database contains 8,400 images of 100 natural scenes. We train an end-to-end Deep Image SR Quality (DISQ) model by employing two-stream Deep Neural Networks (DNNs) for feature extraction, followed by a feature fusion network for quality prediction.
  arXiv  Detail & Related papers  (2020-12-16T04:06:27Z)
• Blind Quality Assessment for Image Superresolution Using Deep Two-Stream Convolutional Networks [41.558981828761574]
  We propose a no-reference/blind deep neural network-based SR image quality assessor (DeepSRQ) To learn more discriminative feature representations of various distorted SR images, the proposed DeepSRQ is a two-stream convolutional network. Experimental results on three publicly available SR image quality databases demonstrate the effectiveness and generalization ability of our proposed DeepSRQ.
  arXiv  Detail & Related papers  (2020-04-13T19:14:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.