Half of an image is enough for quality assessment

• URL: http://arxiv.org/abs/2301.12891v1
• Date: Mon, 30 Jan 2023 13:52:22 GMT
• Title: Half of an image is enough for quality assessment
• Authors: Junyong You, Yuan Lin, Jari Korhonen
• Abstract summary: We develop a positional masked transformer for image quality assessment (IQA) We observe that half of an image might contribute trivially to image quality, whereas the other half is crucial. Such observation is generalized to that half of the image regions can dominate image quality in several CNN-based IQA models.
• Score: 17.681369126678465
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep networks show promising performance in image quality assessment (IQA), whereas few studies have investigated how a deep model works. In this work, a positional masked transformer for IQA is first developed, based on which we observe that half of an image might contribute trivially to image quality, whereas the other half is crucial. Such observation is generalized to that half of the image regions can dominate image quality in several CNN-based IQA models. Motivated by this observation, three semantic measures (saliency, frequency, objectness) are then derived, showing high accordance with importance degree of image regions in IQA.

Related papers

• Exploring Rich Subjective Quality Information for Image Quality Assessment in the Wild [66.40314964321557]
  We propose a novel IQA method named RichIQA to explore the rich subjective rating information beyond MOS to predict image quality in the wild. RichIQA is characterized by two key novel designs: (1) a three-stage image quality prediction network which exploits the powerful feature representation capability of the Convolutional vision Transformer (CvT) and mimics the short-term and long-term memory mechanisms of human brain. RichIQA outperforms state-of-the-art competitors on multiple large-scale in the wild IQA databases with rich subjective rating labels.
  arXiv  Detail & Related papers  (2024-09-09T12:00:17Z)
• Q-Ground: Image Quality Grounding with Large Multi-modality Models [61.72022069880346]
  We introduce Q-Ground, the first framework aimed at tackling fine-scale visual quality grounding. Q-Ground combines large multi-modality models with detailed visual quality analysis. Central to our contribution is the introduction of the QGround-100K dataset.
  arXiv  Detail & Related papers  (2024-07-24T06:42:46Z)
• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• Dual-Branch Network for Portrait Image Quality Assessment [76.27716058987251]
  We introduce a dual-branch network for portrait image quality assessment (PIQA) We utilize two backbone networks (textiti.e., Swin Transformer-B) to extract the quality-aware features from the entire portrait image and the facial image cropped from it. We leverage LIQE, an image scene classification and quality assessment model, to capture the quality-aware and scene-specific features as the auxiliary features.
  arXiv  Detail & Related papers  (2024-05-14T12:43:43Z)
• Cross-IQA: Unsupervised Learning for Image Quality Assessment [3.2287957986061038]
  We propose a no-reference image quality assessment (NR-IQA) method termed Cross-IQA based on vision transformer(ViT) model. The proposed Cross-IQA method can learn image quality features from unlabeled image data. Experimental results show that Cross-IQA can achieve state-of-the-art performance in assessing the low-frequency degradation information.
  arXiv  Detail & Related papers  (2024-05-07T13:35:51Z)
• Reference-Free Image Quality Metric for Degradation and Reconstruction Artifacts [2.5282283486446753]
  We develop a reference-free quality evaluation network, dubbed "Quality Factor (QF) Predictor" Our QF Predictor is a lightweight, fully convolutional network comprising seven layers. It receives JPEG compressed image patch with a random QF as input, is trained to accurately predict the corresponding QF.
  arXiv  Detail & Related papers  (2024-05-01T22:28:18Z)
• Large Multi-modality Model Assisted AI-Generated Image Quality Assessment [53.182136445844904]
  We introduce a large Multi-modality model Assisted AI-Generated Image Quality Assessment (MA-AGIQA) model. It uses semantically informed guidance to sense semantic information and extract semantic vectors through carefully designed text prompts. It achieves state-of-the-art performance, and demonstrates its superior generalization capabilities on assessing the quality of AI-generated images.
  arXiv  Detail & Related papers  (2024-04-27T02:40:36Z)
• End-to-end deep multi-score model for No-reference stereoscopic image quality assessment [6.254148286968409]
  We use a deep multi-score Convolutional Neural Network (CNN) to estimate stereoscopic image quality without reference. Our model has been trained to perform four tasks: First, predict the left view's quality. Second, predict the quality of the left view. Third and fourth, predict the quality of the stereo view and global quality, respectively, with the global score serving as the ultimate quality.
  arXiv  Detail & Related papers  (2022-11-02T16:45:35Z)
• Deep Superpixel-based Network for Blind Image Quality Assessment [4.079861933099766]
  The goal in a blind image quality assessment (BIQA) model is to simulate the process of evaluating images by human eyes. We propose a deep adaptive superpixel-based network, namely DSN-IQA, to assess the quality of image based on multi-scale and superpixel segmentation.
  arXiv  Detail & Related papers  (2021-10-13T08:26:58Z)
• MUSIQ: Multi-scale Image Quality Transformer [22.908901641767688]
  Current state-of-the-art IQA methods are based on convolutional neural networks (CNNs) We design a multi-scale image quality Transformer (MUSIQ) to process native resolution images with varying sizes and aspect ratios. With a multi-scale image representation, our proposed method can capture image quality at different granularities.
  arXiv  Detail & Related papers  (2021-08-12T23:36:22Z)
• MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessment [73.55944459902041]
  This paper presents a no-reference IQA metric based on deep meta-learning. We first collect a number of NR-IQA tasks for different distortions. Then meta-learning is adopted to learn the prior knowledge shared by diversified distortions. Extensive experiments demonstrate that the proposed metric outperforms the state-of-the-arts by a large margin.
  arXiv  Detail & Related papers  (2020-04-11T23:36:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.