Subjective and Objective Quality Assessment of Non-Uniformly Distorted Omnidirectional Images

• URL: http://arxiv.org/abs/2501.11511v1
• Date: Mon, 20 Jan 2025 14:39:50 GMT
• Title: Subjective and Objective Quality Assessment of Non-Uniformly Distorted Omnidirectional Images
• Authors: Jiebin Yan, Jiale Rao, Xuelin Liu, Yuming Fang, Yifan Zuo, Weide Liu,
• Abstract summary: We propose a perception-guided OIQA model for non-uniform distortion by adaptively simulating users' viewing behavior.<n> Experimental results demonstrate that the proposed model outperforms state-of-the-art methods.
• Score: 33.10692798685548
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Omnidirectional image quality assessment (OIQA) has been one of the hot topics in IQA with the continuous development of VR techniques, and achieved much success in the past few years. However, most studies devote themselves to the uniform distortion issue, i.e., all regions of an omnidirectional image are perturbed by the ``same amount'' of noise, while ignoring the non-uniform distortion issue, i.e., partial regions undergo ``different amount'' of perturbation with the other regions in the same omnidirectional image. Additionally, nearly all OIQA models are verified on the platforms containing a limited number of samples, which largely increases the over-fitting risk and therefore impedes the development of OIQA. To alleviate these issues, we elaborately explore this topic from both subjective and objective perspectives. Specifically, we construct a large OIQA database containing 10,320 non-uniformly distorted omnidirectional images, each of which is generated by considering quality impairments on one or two camera len(s). Then we meticulously conduct psychophysical experiments and delve into the influence of both holistic and individual factors (i.e., distortion range and viewing condition) on omnidirectional image quality. Furthermore, we propose a perception-guided OIQA model for non-uniform distortion by adaptively simulating users' viewing behavior. Experimental results demonstrate that the proposed model outperforms state-of-the-art methods. The source code is available at https://github.com/RJL2000/OIQAND.

Related papers

• Viewport-Unaware Blind Omnidirectional Image Quality Assessment: A Flexible and Effective Paradigm [29.433569465806176]
  We present a flexible and effective paradigm, which is viewport-unaware and can be easily adapted to 2D plane image quality assessment (2D-IQA) The proposed model achieves competitive performance with low complexity against other state-of-the-art models, and we also verify its adaptive capacity to 2D-IQA.
  arXiv  Detail & Related papers  (2025-03-08T08:50:10Z)
• Max360IQ: Blind Omnidirectional Image Quality Assessment with Multi-axis Attention [30.688264840230755]
  We propose a novel and effective blind omnidirectional image quality assessment model with multi-axis attention (Max360IQ) Max360IQ can proficiently measure not only the quality of uniformly distorted omnidirectional images but also the quality of non-uniformly distorted omnidirectional images.
  arXiv  Detail & Related papers  (2025-02-26T11:01:03Z)
• Omnidirectional Image Quality Captioning: A Large-scale Database and A New Model [35.232181599179306]
  We conduct the largest study so far on omnidirectional image quality assessment (OIQA) using a large-scale database called OIQ-10K. A comprehensive psychophysical study is elaborated to collect human opinions for each omnidirectional image. We propose a novel adaptive feature-tailoring OIQA model named IQCaption360, which is capable of generating a quality caption for an omnidirectional image.
  arXiv  Detail & Related papers  (2025-02-21T07:54:00Z)
• Perceptual Depth Quality Assessment of Stereoscopic Omnidirectional Images [10.382801621282228]
  We develop an objective quality assessment model named depth quality index (DQI) for efficient no-reference (NR) depth quality assessment of stereoscopic omnidirectional images. Motivated by the perceptual characteristics of the human visual system (HVS), the proposed DQI is built upon multi-color-channel, adaptive viewport selection, and interocular discrepancy features.
  arXiv  Detail & Related papers  (2024-08-19T16:28:05Z)
• DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wild [54.139923409101044]
  Blind image quality assessment (IQA) in the wild presents significant challenges. Given the difficulty in collecting large-scale training data, leveraging limited data to develop a model with strong generalization remains an open problem. Motivated by the robust image perception capabilities of pre-trained text-to-image (T2I) diffusion models, we propose a novel IQA method, diffusion priors-based IQA.
  arXiv  Detail & Related papers  (2024-05-30T12:32:35Z)
• AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Images [70.42666704072964]
  We establish a large-scale AI generated omnidirectional image IQA database named AIGCOIQA2024. A subjective IQA experiment is conducted to assess human visual preferences from three perspectives. We conduct a benchmark experiment to evaluate the performance of state-of-the-art IQA models on our database.
  arXiv  Detail & Related papers  (2024-04-01T10:08:23Z)
• Adaptive Feature Selection for No-Reference Image Quality Assessment by Mitigating Semantic Noise Sensitivity [55.399230250413986]
  We propose a Quality-Aware Feature Matching IQA Metric (QFM-IQM) to remove harmful semantic noise features from the upstream task. Our approach achieves superior performance to the state-of-the-art NR-IQA methods on eight standard IQA datasets.
  arXiv  Detail & Related papers  (2023-12-11T06:50:27Z)
• Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessment [50.82681686110528]
  Blind Omnidirectional Image Quality Assessment (BOIQA) aims to objectively assess the human perceptual quality of omnidirectional images (ODIs) The quality assessment of ODIs is severely hampered by the fact that the existing BOIQA pipeline lacks the modeling of the observer's browsing process. We propose a novel multi-sequence network for BOIQA called Assessor360, which is derived from the realistic multi-assessor ODI quality assessment procedure.
  arXiv  Detail & Related papers  (2023-05-18T13:55:28Z)
• Blind Omnidirectional Image Quality Assessment: Integrating Local Statistics and Global Semantics [14.586878663223832]
  We propose a blind/no-reference OIQA method named S$2$ that bridges the gap between low-level statistics and high-level semantics of omnidirectional images. A quality regression along with a weighting process is then followed that maps the extracted quality-aware features to a perceptual quality prediction.
  arXiv  Detail & Related papers  (2023-02-24T01:47:13Z)
• KonX: Cross-Resolution Image Quality Assessment [6.658103076536836]
  We present the first study of its kind that disentangles and examines the two issues separately via KonX. We show that objective IQA methods have a scale bias, which reduces their predictive performance. We propose a multi-scale and multi-column architecture that improves performance over previous state-of-the-art IQA models.
  arXiv  Detail & Related papers  (2022-12-12T10:23:48Z)
• Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-Loop [113.75573175709573]
  We make one of the first attempts to examine the perceptual robustness of NR-IQA models. We test one knowledge-driven and three data-driven NR-IQA methods under four full-reference IQA models. We find that all four NR-IQA models are vulnerable to the proposed perceptual attack.
  arXiv  Detail & Related papers  (2022-10-03T13:47:16Z)
• Perceptual Quality Assessment of Omnidirectional Images [81.76416696753947]
  We first establish an omnidirectional IQA (OIQA) database, which includes 16 source images and 320 distorted images degraded by 4 commonly encountered distortion types. Then a subjective quality evaluation study is conducted on the OIQA database in the VR environment. The original and distorted omnidirectional images, subjective quality ratings, and the head and eye movement data together constitute the OIQA database.
  arXiv  Detail & Related papers  (2022-07-06T13:40:38Z)
• Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild [98.48284827503409]
  We develop a textitunified BIQA model and an approach of training it for both synthetic and realistic distortions. We employ the fidelity loss to optimize a deep neural network for BIQA over a large number of such image pairs. Experiments on six IQA databases show the promise of the learned method in blindly assessing image quality in the laboratory and wild.
  arXiv  Detail & Related papers  (2020-05-28T13:35:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.