Comparison of Image Quality Models for Optimization of Image Processing
Systems
- URL: http://arxiv.org/abs/2005.01338v3
- Date: Tue, 8 Dec 2020 12:59:48 GMT
- Title: Comparison of Image Quality Models for Optimization of Image Processing
Systems
- Authors: Keyan Ding, Kede Ma, Shiqi Wang, Eero P. Simoncelli
- Abstract summary: We use eleven full-reference IQA models to train deep neural networks for four low-level vision tasks.
Subjective testing on the optimized images allows us to rank the competing models in terms of their perceptual performance.
- Score: 41.57409136781606
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The performance of objective image quality assessment (IQA) models has been
evaluated primarily by comparing model predictions to human quality judgments.
Perceptual datasets gathered for this purpose have provided useful benchmarks
for improving IQA methods, but their heavy use creates a risk of overfitting.
Here, we perform a large-scale comparison of IQA models in terms of their use
as objectives for the optimization of image processing algorithms.
Specifically, we use eleven full-reference IQA models to train deep neural
networks for four low-level vision tasks: denoising, deblurring,
super-resolution, and compression. Subjective testing on the optimized images
allows us to rank the competing models in terms of their perceptual
performance, elucidate their relative advantages and disadvantages in these
tasks, and propose a set of desirable properties for incorporation into future
IQA models.
Related papers
- DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wild [54.139923409101044]
We propose a novel IQA method called diffusion priors-based IQA (DP-IQA)
We use pre-trained stable diffusion as the backbone, extract multi-level features from the denoising U-Net, and decode them to estimate the image quality score.
We distill the knowledge in the above model into a CNN-based student model, significantly reducing the parameter to enhance applicability.
arXiv Detail & Related papers (2024-05-30T12:32:35Z) - Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Compare [99.57567498494448]
We introduce Compare2Score, an all-around LMM-based no-reference IQA model.
During training, we generate scaled-up comparative instructions by comparing images from the same IQA dataset.
Experiments on nine IQA datasets validate that the Compare2Score effectively bridges text-defined comparative levels during training.
arXiv Detail & Related papers (2024-05-29T17:26:09Z) - Descriptive Image Quality Assessment in the Wild [25.503311093471076]
VLM-based Image Quality Assessment (IQA) seeks to describe image quality linguistically to align with human expression.
We introduce Depicted image Quality Assessment in the Wild (DepictQA-Wild)
Our method includes a multi-functional IQA task paradigm that encompasses both assessment and comparison tasks, brief and detailed responses, full-reference and non-reference scenarios.
arXiv Detail & Related papers (2024-05-29T07:49:15Z) - Opinion-Unaware Blind Image Quality Assessment using Multi-Scale Deep Feature Statistics [54.08757792080732]
We propose integrating deep features from pre-trained visual models with a statistical analysis model to achieve opinion-unaware BIQA (OU-BIQA)
Our proposed model exhibits superior consistency with human visual perception compared to state-of-the-art BIQA models.
arXiv Detail & Related papers (2024-05-29T06:09:34Z) - Comparison of No-Reference Image Quality Models via MAP Estimation in
Diffusion Latents [99.19391983670569]
We show that NR-IQA models can be plugged into the maximum a posteriori (MAP) estimation framework for image enhancement.
Different NR-IQA models are likely to induce different enhanced images, which are ultimately subject to psychophysical testing.
This leads to a new computational method for comparing NR-IQA models within the analysis-by-synthesis framework.
arXiv Detail & Related papers (2024-03-11T03:35:41Z) - Optimization-Based Improvement of Face Image Quality Assessment
Techniques [5.831942593046074]
Face image quality assessment (FIQA) techniques try to infer sample-quality information from the input face images that can aid with the recognition process.
We present in this paper a supervised quality-label optimization approach, aimed at improving the performance of existing FIQA techniques.
We evaluate the proposed approach in comprehensive experiments with six state-of-the-art FIQA approaches.
arXiv Detail & Related papers (2023-05-24T08:06:12Z) - Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and
Wild [98.48284827503409]
We develop a textitunified BIQA model and an approach of training it for both synthetic and realistic distortions.
We employ the fidelity loss to optimize a deep neural network for BIQA over a large number of such image pairs.
Experiments on six IQA databases show the promise of the learned method in blindly assessing image quality in the laboratory and wild.
arXiv Detail & Related papers (2020-05-28T13:35:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.