UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessment

• URL: http://arxiv.org/abs/2406.17472v2
• Date: Wed, 4 Sep 2024 09:34:13 GMT
• Title: UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessment
• Authors: Vlad Hosu, Lorenzo Agnolucci, Oliver Wiedemann, Daisuke Iso, Dietmar Saupe,
• Abstract summary: We introduce a novel Image Quality Assessment dataset comprising 6073 UHD-1 (4K) images, annotated at a fixed width of 3840 pixels. Ours focuses on highly aesthetic photos of high technical quality, filling a gap in the literature. The dataset is annotated with perceptual quality ratings obtained through a crowdsourcing study.
• Score: 4.563959812257119
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce a novel Image Quality Assessment (IQA) dataset comprising 6073 UHD-1 (4K) images, annotated at a fixed width of 3840 pixels. Contrary to existing No-Reference (NR) IQA datasets, ours focuses on highly aesthetic photos of high technical quality, filling a gap in the literature. The images, carefully curated to exclude synthetic content, are sufficiently diverse to train general NR-IQA models. Importantly, the dataset is annotated with perceptual quality ratings obtained through a crowdsourcing study. Ten expert raters, comprising photographers and graphics artists, assessed each image at least twice in multiple sessions spanning several days, resulting in 20 highly reliable ratings per image. Annotators were rigorously selected based on several metrics, including self-consistency, to ensure their reliability. The dataset includes rich metadata with user and machine-generated tags from over 5,000 categories and popularity indicators such as favorites, likes, downloads, and views. With its unique characteristics, such as its focus on high-quality images, reliable crowdsourced annotations, and high annotation resolution, our dataset opens up new opportunities for advancing perceptual image quality assessment research and developing practical NR-IQA models that apply to modern photos. Our dataset is available at https://database.mmsp-kn.de/uhd-iqa-benchmark-database.html

Related papers

• AIM 2024 Challenge on UHD Blind Photo Quality Assessment [49.54883484094671]
  The AIM 2024 UHD-IQA Challenge aims to advance the No-Reference Image Quality Assessment (NR-IQA) task for modern, high-resolution photos. The challenge is based on the recently released UHD-IQA Benchmark Database, which comprises 6,073 UHD-1 (4K) images annotated with perceptual quality ratings from expert raters.
  arXiv  Detail & Related papers  (2024-09-24T17:44:24Z)
• Descriptive Image Quality Assessment in the Wild [25.503311093471076]
  VLM-based Image Quality Assessment (IQA) seeks to describe image quality linguistically to align with human expression. We introduce Depicted image Quality Assessment in the Wild (DepictQA-Wild) Our method includes a multi-functional IQA task paradigm that encompasses both assessment and comparison tasks, brief and detailed responses, full-reference and non-reference scenarios.
  arXiv  Detail & Related papers  (2024-05-29T07:49:15Z)
• Dual-Branch Network for Portrait Image Quality Assessment [76.27716058987251]
  We introduce a dual-branch network for portrait image quality assessment (PIQA) We utilize two backbone networks (textiti.e., Swin Transformer-B) to extract the quality-aware features from the entire portrait image and the facial image cropped from it. We leverage LIQE, an image scene classification and quality assessment model, to capture the quality-aware and scene-specific features as the auxiliary features.
  arXiv  Detail & Related papers  (2024-05-14T12:43:43Z)
• An Image Quality Assessment Dataset for Portraits [0.9786690381850354]
  This paper introduces PIQ23, a portrait-specific IQA dataset of 5116 images of 50 scenarios acquired by 100 smartphones. The dataset includes individuals of various genders and ethnicities who have given explicit and informed consent for their photographs to be used in public research. An in-depth statistical analysis of these annotations allows us to evaluate their consistency over PIQ23.
  arXiv  Detail & Related papers  (2023-04-12T11:30:06Z)
• Blind Multimodal Quality Assessment: A Brief Survey and A Case Study of Low-light Images [73.27643795557778]
  Blind image quality assessment (BIQA) aims at automatically and accurately forecasting objective scores for visual signals. Recent developments in this field are dominated by unimodal solutions inconsistent with human subjective rating patterns. We present a unique blind multimodal quality assessment (BMQA) of low-light images from subjective evaluation to objective score.
  arXiv  Detail & Related papers  (2023-03-18T09:04:55Z)
• Quality Evaluation of Arbitrary Style Transfer: Subjective Study and Objective Metric [28.898576735547262]
  We propose a new sparse representation-based image quality evaluation metric (SRQE) to measure the quality of arbitrary style transfer (AST) images. Experimental results on the AST-IQAD have demonstrated the superiority of the proposed method.
  arXiv  Detail & Related papers  (2022-08-01T05:50:58Z)
• Conformer and Blind Noisy Students for Improved Image Quality Assessment [80.57006406834466]
  Learning-based approaches for perceptual image quality assessment (IQA) usually require both the distorted and reference image for measuring the perceptual quality accurately. In this work, we explore the performance of transformer-based full-reference IQA models. We also propose a method for IQA based on semi-supervised knowledge distillation from full-reference teacher models into blind student models.
  arXiv  Detail & Related papers  (2022-04-27T10:21:08Z)
• Confusing Image Quality Assessment: Towards Better Augmented Reality Experience [96.29124666702566]
  We consider AR technology as the superimposition of virtual scenes and real scenes, and introduce visual confusion as its basic theory. A ConFusing Image Quality Assessment (CFIQA) database is established, which includes 600 reference images and 300 distorted images generated by mixing reference images in pairs. An objective metric termed CFIQA is also proposed to better evaluate the confusing image quality.
  arXiv  Detail & Related papers  (2022-04-11T07:03:06Z)
• BIQ2021: A Large-Scale Blind Image Quality Assessment Database [1.3670071336891754]
  The Blind Image Quality Assessment Database, BIQ2021, is presented in this article. The dataset consists of three sets of images: those taken without the intention of using them for image quality assessment, those taken with intentionally introduced natural distortions, and those taken from an open-source image-sharing platform. The database contains information about subjective scoring, human subject statistics, and the standard deviation of each image.
  arXiv  Detail & Related papers  (2022-02-08T14:07:38Z)
• Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment [157.1292674649519]
  We propose a practical solution named degraded-reference IQA (DR-IQA) DR-IQA exploits the inputs of IR models, degraded images, as references. Our results can even be close to the performance of full-reference settings.
  arXiv  Detail & Related papers  (2021-08-18T02:35:08Z)
• DeepFL-IQA: Weak Supervision for Deep IQA Feature Learning [8.035521056416242]
  We propose a new IQA dataset and a weakly supervised feature learning approach to train features more suitable for IQA of artificially distorted images. The dataset, KADIS-700k, is far more extensive than similar works, consisting of 140,000 pristine images, 25 distortions types, totaling 700k distorted versions. Our method, termed DeepFL-IQA, performs better than other feature-based no-reference IQA methods and also better than all tested full-reference IQA methods on KADID-10k.
  arXiv  Detail & Related papers  (2020-01-20T15:13:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.