Blind Stereoscopic Omnidirectional Image Quality Assessment Using Predictive Coding Hierarchy

• URL: http://arxiv.org/abs/2608.28798v1
• Date: Fri, 28 Aug 2026 19:06:04 GMT
• Title: Blind Stereoscopic Omnidirectional Image Quality Assessment Using Predictive Coding Hierarchy
• Abstract summary: We propose a Predictive Coding Hierarchy-inspired metric (PCH) for blind/no-reference stereoscopic omnidirectional image quality assessment.<n>Motivated by the viewing process of SOIs, the proposed PCH includes a local cyclopean perception module, a global predictive perception module, and a visual quality regressor.<n>Extensive experiments demonstrate that the proposed PCH achieves competitive and consistently improved performance compared with state-of-the-art quality assessment methods.
• Score: 28.575866509102124
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Stereoscopic omnidirectional images (SOIs) have provided users with newly immersive quality of experience in virtual reality environments. However, developing efficient and accurate perceptual quality assessment metrics for SOIs remains challenging due to many factors such as freely changeable field of views and binocular vision. In this paper, based on the characteristics of the human visual system (HVS), we propose a Predictive Coding Hierarchy-inspired metric (PCH) for blind/no-reference stereoscopic omnidirectional image quality assessment. Motivated by the viewing process of SOIs, the proposed PCH includes a local cyclopean perception module, a global predictive perception module, and a visual quality regressor. First, observers browse different spherical sceneries from viewports, and aggregate the local visual information to infer the perceptual quality of SOIs. Therefore, we extract various viewports, followed by cyclopean conversion and saliency detection to approach the perception and attention of the human brain. After the local aggregation, viewers then infer the global scene in their minds. Based on the binocular mechanism, we fuse left and right views to perform predictive coding hierarchy modelling. Finally, the visual quality regressor is exploited to obtain the ultimate quality score related to both local and global perceptual cues. Extensive experiments demonstrate that the proposed PCH achieves competitive and consistently improved performance compared with state-of-the-art quality assessment methods.

Related papers

• ARIQA-3DS: A Stereoscopic Image Quality Assessment Dataset for Realistic Augmented Reality [4.439002023615223]
  We present ARIQA-3DS, the first large stereoscopic AR Image Quality Assessment dataset.<n>The dataset fuses high-resolution stereoscopic omni captures of real-world scenes with diverse augmented foregrounds under controlled transparency and degradation conditions.<n>Our analysis reveals that perceived quality is primarily driven by foreground degradation and modulated by transparency levels, while oculomotor and perceptual symptoms show a progressive but manageable increase during viewing.
  arXiv  Detail & Related papers  (2026-04-03T15:35:27Z)
• Surveillance Facial Image Quality Assessment: A Multi-dimensional Dataset and Lightweight Model [59.39390911456143]
  We propose the first comprehensive study on surveillance facial image quality assessment (SFIQA)<n>SFIQA-Bench consists of 5,004 surveillance facial images captured by three widely deployed surveillance cameras in real-world scenarios.<n>A subjective experiment is conducted to collect six dimensional quality ratings, including noise, sharpness, colorfulness, contrast, fidelity and overall quality.
  arXiv  Detail & Related papers  (2026-02-07T06:51:03Z)
• Perception-oriented Bidirectional Attention Network for Image Super-resolution Quality Assessment [61.27648290203618]
  We propose the Perception-oriented Bidirectional Attention Network (PBAN) for image SR FR-IQA.<n>PBAN is composed of three modules: an image encoder module, a perception-oriented bidirectional attention (PBA) module, and a quality prediction module.<n>Our proposed PBAN outperforms state-of-the-art quality assessment methods.
  arXiv  Detail & Related papers  (2025-09-08T08:39:45Z)
• PIGUIQA: A Physical Imaging Guided Perceptual Framework for Underwater Image Quality Assessment [59.9103803198087]
  We propose a Physical Imaging Guided perceptual framework for Underwater Image Quality Assessment (UIQA)<n>By leveraging underwater radiative transfer theory, we integrate physics-based imaging estimations to establish quantitative metrics for these distortions.<n>The proposed model accurately predicts image quality scores and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-12-20T03:31:45Z)
• When Does Perceptual Alignment Benefit Vision Representations? [76.32336818860965]
  We investigate how aligning vision model representations to human perceptual judgments impacts their usability. We find that aligning models to perceptual judgments yields representations that improve upon the original backbones across many downstream tasks. Our results suggest that injecting an inductive bias about human perceptual knowledge into vision models can contribute to better representations.
  arXiv  Detail & Related papers  (2024-10-14T17:59:58Z)
• Perceptual Depth Quality Assessment of Stereoscopic Omnidirectional Images [10.382801621282228]
  We develop an objective quality assessment model named depth quality index (DQI) for efficient no-reference (NR) depth quality assessment of stereoscopic omnidirectional images. Motivated by the perceptual characteristics of the human visual system (HVS), the proposed DQI is built upon multi-color-channel, adaptive viewport selection, and interocular discrepancy features.
  arXiv  Detail & Related papers  (2024-08-19T16:28:05Z)
• Towards Top-Down Stereo Image Quality Assessment via Stereo Attention [3.113304966059062]
  Stereo image quality assessment (SIQA) plays a crucial role in evaluating and improving the visual experience of 3D content. This paper presents a novel Stereo AttenTion Network (SATNet) which employs a top-down perspective to guide the quality assessment process. Experimental results highlight the superiority of our top-down method in advancing the state-of-the-art in the SIQA field.
  arXiv  Detail & Related papers  (2023-08-08T09:37:18Z)
• Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessment [50.82681686110528]
  Blind Omnidirectional Image Quality Assessment (BOIQA) aims to objectively assess the human perceptual quality of omnidirectional images (ODIs) The quality assessment of ODIs is severely hampered by the fact that the existing BOIQA pipeline lacks the modeling of the observer's browsing process. We propose a novel multi-sequence network for BOIQA called Assessor360, which is derived from the realistic multi-assessor ODI quality assessment procedure.
  arXiv  Detail & Related papers  (2023-05-18T13:55:28Z)
• End-to-end deep multi-score model for No-reference stereoscopic image quality assessment [6.254148286968409]
  We use a deep multi-score Convolutional Neural Network (CNN) to estimate stereoscopic image quality without reference. Our model has been trained to perform four tasks: First, predict the left view's quality. Second, predict the quality of the left view. Third and fourth, predict the quality of the stereo view and global quality, respectively, with the global score serving as the ultimate quality.
  arXiv  Detail & Related papers  (2022-11-02T16:45:35Z)
• Self-Supervised Visibility Learning for Novel View Synthesis [79.53158728483375]
  Conventional rendering methods estimate scene geometry and synthesize novel views in two separate steps. We propose an end-to-end NVS framework to eliminate the error propagation issue. Our network is trained in an end-to-end self-supervised fashion, thus significantly alleviating error accumulation in view synthesis.
  arXiv  Detail & Related papers  (2021-03-29T08:11:25Z)
• No-Reference Quality Assessment for 360-degree Images by Analysis of Multi-frequency Information and Local-global Naturalness [26.614657212889398]
  360-degree/omnidirectional images (OIs) have achieved remarkable attentions due to the increasing applications of virtual reality (VR) We propose a novel and effective no-reference omnidirectional image quality assessment (NR OIQA) algorithm by Multi-Frequency Information and Local-Global Naturalness (MFILGN) Experimental results on two publicly available OIQA databases demonstrate that our proposed MFILGN outperforms state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-02-22T22:52:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.