Blind Image Quality Assessment Using Multi-Stream Architecture with Spatial and Channel Attention
- URL: http://arxiv.org/abs/2307.09857v3
- Date: Mon, 07 Oct 2024 18:56:53 GMT
- Title: Blind Image Quality Assessment Using Multi-Stream Architecture with Spatial and Channel Attention
- Authors: Muhammad Azeem Aslam, Xu Wei, Hassan Khalid, Nisar Ahmed, Zhu Shuangtong, Xin Liu, Yimei Xu,
- Abstract summary: BIQA (Blind Image Quality Assessment) is an important field of study that evaluates images automatically.
Most algorithms generate quality without emphasizing the important region of interest.
A multi-stream spatial and channel attention-based algorithm is being proposed to solve this problem.
- Score: 4.983104446206061
- License:
- Abstract: BIQA (Blind Image Quality Assessment) is an important field of study that evaluates images automatically. Although significant progress has been made, blind image quality assessment remains a difficult task since images vary in content and distortions. Most algorithms generate quality without emphasizing the important region of interest. In order to solve this, a multi-stream spatial and channel attention-based algorithm is being proposed. This algorithm generates more accurate predictions with a high correlation to human perceptual assessment by combining hybrid features from two different backbones, followed by spatial and channel attention to provide high weights to the region of interest. Four legacy image quality assessment datasets are used to validate the effectiveness of our proposed approach. Authentic and synthetic distortion image databases are used to demonstrate the effectiveness of the proposed method, and we show that it has excellent generalization properties with a particular focus on the perceptual foreground information.
Related papers
- Q-Ground: Image Quality Grounding with Large Multi-modality Models [61.72022069880346]
We introduce Q-Ground, the first framework aimed at tackling fine-scale visual quality grounding.
Q-Ground combines large multi-modality models with detailed visual quality analysis.
Central to our contribution is the introduction of the QGround-100K dataset.
arXiv Detail & Related papers (2024-07-24T06:42:46Z) - An Image Quality Evaluation and Masking Algorithm Based On Pre-trained Deep Neural Networks [3.3573574079709223]
We present a deep learning based image quality evaluation algorithm that uses an autoencoder to learn features of high quality astronomical images.
The trained autoencoder enables automatic evaluation of image quality and masking of noise affected areas.
Our algorithm can be employed to automatically evaluate image quality obtained by different sky surveying projects.
arXiv Detail & Related papers (2024-05-06T12:20:16Z) - Adaptive Feature Selection for No-Reference Image Quality Assessment by Mitigating Semantic Noise Sensitivity [55.399230250413986]
We propose a Quality-Aware Feature Matching IQA Metric (QFM-IQM) to remove harmful semantic noise features from the upstream task.
Our approach achieves superior performance to the state-of-the-art NR-IQA methods on eight standard IQA datasets.
arXiv Detail & Related papers (2023-12-11T06:50:27Z) - Helping Visually Impaired People Take Better Quality Pictures [52.03016269364854]
We develop tools to help visually impaired users minimize occurrences of common technical distortions.
We also create a prototype feedback system that helps to guide users to mitigate quality issues.
arXiv Detail & Related papers (2023-05-14T04:37:53Z) - Gap-closing Matters: Perceptual Quality Evaluation and Optimization of Low-Light Image Enhancement [55.8106019031768]
There is a growing consensus in the research community that the optimization of low-light image enhancement approaches should be guided by the visual quality perceived by end users.
We propose a gap-closing framework for assessing subjective and objective quality systematically.
We validate the effectiveness of our proposed framework through both the accuracy of quality prediction and the perceptual quality of image enhancement.
arXiv Detail & Related papers (2023-02-22T15:57:03Z) - Image Quality Assessment using Contrastive Learning [50.265638572116984]
We train a deep Convolutional Neural Network (CNN) using a contrastive pairwise objective to solve the auxiliary problem.
We show through extensive experiments that CONTRIQUE achieves competitive performance when compared to state-of-the-art NR image quality models.
Our results suggest that powerful quality representations with perceptual relevance can be obtained without requiring large labeled subjective image quality datasets.
arXiv Detail & Related papers (2021-10-25T21:01:00Z) - No-Reference Image Quality Assessment by Hallucinating Pristine Features [24.35220427707458]
We propose a no-reference (NR) image quality assessment (IQA) method via feature level pseudo-reference (PR) hallucination.
The effectiveness of our proposed method is demonstrated on four popular IQA databases.
arXiv Detail & Related papers (2021-08-09T16:48:34Z) - Residual Networks based Distortion Classification and Ranking for
Laparoscopic Image Quality Assessment [12.374294852377382]
Laparoscopic images and videos are often affected by different types of distortion like noise, smoke, blur and nonuniform illumination.
We propose in this paper to formulate the image quality assessment task as a multi-label classification problem taking into account both the type as well as the severity level (or rank) of distortions.
The obtained results on a laparoscopic image dataset show the efficiency of the proposed approach.
arXiv Detail & Related papers (2021-06-12T14:26:11Z) - Towards Unsupervised Deep Image Enhancement with Generative Adversarial
Network [92.01145655155374]
We present an unsupervised image enhancement generative network (UEGAN)
It learns the corresponding image-to-image mapping from a set of images with desired characteristics in an unsupervised manner.
Results show that the proposed model effectively improves the aesthetic quality of images.
arXiv Detail & Related papers (2020-12-30T03:22:46Z) - Deep Multi-Scale Features Learning for Distorted Image Quality
Assessment [20.7146855562825]
Existing deep neural networks (DNNs) have shown significant effectiveness for tackling the IQA problem.
We propose to use pyramid features learning to build a DNN with hierarchical multi-scale features for distorted image quality prediction.
Our proposed network is optimized in a deep end-to-end supervision manner.
arXiv Detail & Related papers (2020-12-01T23:39:01Z) - Recognition Oriented Iris Image Quality Assessment in the Feature Space [40.615018679370685]
A large portion of iris images captured in real world scenarios are poor quality due to uncontrolled environment and non-cooperative subject.
Traditional factors based methods discard most images, which will cause system timeout and disrupt user experience.
We propose a recognition-oriented quality metric and assessment method for iris image to deal with the problem.
arXiv Detail & Related papers (2020-09-01T08:58:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.