Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment

• URL: http://arxiv.org/abs/2209.05321v4
• Date: Mon, 22 Apr 2024 01:39:07 GMT
• Title: Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment
• Authors: Baoliang Chen, Hanwei Zhu, Lingyu Zhu, Shiqi Wang, Sam Kwong,
• Abstract summary: We make the first attempt to learn the statistics of SCIs, based upon which the quality of SCIs can be effectively determined. We empirically show that the statistics deviation could be effectively leveraged in quality assessment.
• Score: 60.88265569998563
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The statistical regularities of natural images, referred to as natural scene statistics, play an important role in no-reference image quality assessment. However, it has been widely acknowledged that screen content images (SCIs), which are typically computer generated, do not hold such statistics. Here we make the first attempt to learn the statistics of SCIs, based upon which the quality of SCIs can be effectively determined. The underlying mechanism of the proposed approach is based upon the mild assumption that the SCIs, which are not physically acquired, still obey certain statistics that could be understood in a learning fashion. We empirically show that the statistics deviation could be effectively leveraged in quality assessment, and the proposed method is superior when evaluated in different settings. Extensive experimental results demonstrate the Deep Feature Statistics based SCI Quality Assessment (DFSS-IQA) model delivers promising performance compared with existing NR-IQA models and shows a high generalization capability in the cross-dataset settings. The implementation of our method is publicly available at https://github.com/Baoliang93/DFSS-IQA.

Related papers

• A Novel Characterization of the Population Area Under the Risk Coverage Curve (AURC) and Rates of Finite Sample Estimators [15.294324192338484]
  Area Under the Risk-Coverage Curve (AURC) has emerged as the foremost evaluation metric for assessing the performance of SC systems. We derive empirical AURC plug-in estimators for finite sample scenarios. We empirically validate the effectiveness of our estimators through experiments across multiple datasets.
  arXiv  Detail & Related papers  (2024-10-20T11:14:51Z)
• X-Fake: Juggling Utility Evaluation and Explanation of Simulated SAR Images [49.546627070454456]
  The distribution inconsistency between real and simulated data is the main obstacle that influences the utility of simulated SAR images. We propose a novel trustworthy utility evaluation framework with a counterfactual explanation for simulated SAR images for the first time, denoted as X-Fake. The proposed framework is validated on four simulated SAR image datasets obtained from electromagnetic models and generative artificial intelligence approaches.
  arXiv  Detail & Related papers  (2024-07-28T09:27:53Z)
• Opinion-Unaware Blind Image Quality Assessment using Multi-Scale Deep Feature Statistics [54.08757792080732]
  We propose integrating deep features from pre-trained visual models with a statistical analysis model to achieve opinion-unaware BIQA (OU-BIQA) Our proposed model exhibits superior consistency with human visual perception compared to state-of-the-art BIQA models.
  arXiv  Detail & Related papers  (2024-05-29T06:09:34Z)
• When No-Reference Image Quality Models Meet MAP Estimation in Diffusion Latents [92.45867913876691]
  No-reference image quality assessment (NR-IQA) models can effectively quantify perceived image quality. We show that NR-IQA models can be plugged into the maximum a posteriori (MAP) estimation framework for image enhancement.
  arXiv  Detail & Related papers  (2024-03-11T03:35:41Z)
• Has the Deep Neural Network learned the Stochastic Process? A Wildfire Perspective [17.897121328003617]
  This paper presents the first systematic study of evalution of Deep Neural Network (DNN) We show that traditional evaluation methods assess a DNN's ability to replicate the observed ground truth (GT) We propose a new system property: Statistic-GT, representing the GT of the process, and an evaluation metric that exclusively assesses fidelity to Statistic-GT.
  arXiv  Detail & Related papers  (2024-02-23T07:54:20Z)
• On quantifying and improving realism of images generated with diffusion [50.37578424163951]
  We propose a metric, called Image Realism Score (IRS), computed from five statistical measures of a given image. IRS is easily usable as a measure to classify a given image as real or fake. We experimentally establish the model- and data-agnostic nature of the proposed IRS by successfully detecting fake images generated by Stable Diffusion Model (SDM), Dalle2, Midjourney and BigGAN. Our efforts have also led to Gen-100 dataset, which provides 1,000 samples for 100 classes generated by four high-quality models.
  arXiv  Detail & Related papers  (2023-09-26T08:32:55Z)
• Detecting Out-of-distribution Examples via Class-conditional Impressions Reappearing [30.938412222724608]
  Out-of-distribution (OOD) detection aims at enhancing standard deep neural networks to distinguish anomalous inputs from original training data. Due to privacy and security, auxiliary data tends to be impractical in a real-world scenario. We propose a data-free method without training on natural data, called Class-Conditional Impressions Reappearing (C2IR)
  arXiv  Detail & Related papers  (2023-03-17T02:55:08Z)
• DeepDC: Deep Distance Correlation as a Perceptual Image Quality Evaluator [53.57431705309919]
  ImageNet pre-trained deep neural networks (DNNs) show notable transferability for building effective image quality assessment (IQA) models. We develop a novel full-reference IQA (FR-IQA) model based exclusively on pre-trained DNN features. We conduct comprehensive experiments to demonstrate the superiority of the proposed quality model on five standard IQA datasets.
  arXiv  Detail & Related papers  (2022-11-09T14:57:27Z)
• Differential privacy and robust statistics in high dimensions [49.50869296871643]
  High-dimensional Propose-Test-Release (HPTR) builds upon three crucial components: the exponential mechanism, robust statistics, and the Propose-Test-Release mechanism. We show that HPTR nearly achieves the optimal sample complexity under several scenarios studied in the literature.
  arXiv  Detail & Related papers  (2021-11-12T06:36:40Z)
• No-Reference Image Quality Assessment by Hallucinating Pristine Features [24.35220427707458]
  We propose a no-reference (NR) image quality assessment (IQA) method via feature level pseudo-reference (PR) hallucination. The effectiveness of our proposed method is demonstrated on four popular IQA databases.
  arXiv  Detail & Related papers  (2021-08-09T16:48:34Z)
• Image Super-Resolution Quality Assessment: Structural Fidelity Versus Statistical Naturalness [36.022063424485324]
  Single image super-resolution (SISR) algorithms reconstruct high-resolution (HR) images with their low-resolution (LR) counterparts. We assess the quality of SISR generated images in a two-dimensional (2D) space of structural fidelity versus statistical naturalness. We find that a simple linear combination of a straightforward local structural fidelity and a global statistical naturalness measures produce surprisingly accurate predictions of SISR image quality.
  arXiv  Detail & Related papers  (2021-05-15T04:31:48Z)
• No-reference Screen Content Image Quality Assessment with Unsupervised Domain Adaptation [37.1611601418026]
  We develop the first unsupervised domain adaptation based no reference quality assessment method for SCIs. Inspired by the transferability of pair-wise relationship, the proposed quality measure operates based on the philosophy of improving the transferability and discriminability simultaneously. Our method can achieve higher performance on different source-target settings based on a light-weight convolution neural network.
  arXiv  Detail & Related papers  (2020-08-19T17:31:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.