PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis

• URL: http://arxiv.org/abs/2604.04576v2
• Date: Tue, 07 Apr 2026 02:30:59 GMT
• Title: PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis
• Abstract summary: We propose a framework that evaluates diffusion-generated views using reference images from different poses.<n>PR-IQA achieves full-reference-level accuracy without ground-truth supervision.<n>Our quality-aware 3DGS approach more effectively filters inconsistencies, producing superior 3D reconstructions and NVS results.
• Score: 9.367653098793296
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Diffusion models are promising for sparse-view novel view synthesis (NVS), as they can generate pseudo-ground-truth views to aid 3D reconstruction pipelines like 3D Gaussian Splatting (3DGS). However, these synthesized images often contain photometric and geometric inconsistencies, and their direct use for supervision can impair reconstruction. To address this, we propose Partial-Reference Image Quality Assessment (PR-IQA), a framework that evaluates diffusion-generated views using reference images from different poses, eliminating the need for ground truth. PR-IQA first computes a geometrically consistent partial quality map in overlapping regions. It then performs quality completion to inpaint this partial map into a dense, full-image map. This completion is achieved via a cross-attention mechanism that incorporates reference-view context, ensuring cross-view consistency and enabling thorough quality assessment. When integrated into a diffusion-augmented 3DGS pipeline, PR-IQA restricts supervision to high-confidence regions identified by its quality maps. Experiments demonstrate that PR-IQA outperforms existing IQA methods, achieving full-reference-level accuracy without ground-truth supervision. Thus, our quality-aware 3DGS approach more effectively filters inconsistencies, producing superior 3D reconstructions and NVS results. The project page is available at https://kakaomacao.github.io/pr-iqa-project-page/.

Related papers

• From Explicit References to Scene Manifolds: Distributional Fidelity and Realism for Radiance Field Quality Assessment [6.557590493848202]
  SCODA is a lightweight scene-conditioned objective perceptual quality assessment method.<n>It shifts QA from explicit image-to-image comparison to scene-manifold modeling.<n> Experiments show strong agreement with human judgments and robust generalization across GS- and NeRF-generated views and trajectories.
  arXiv  Detail & Related papers  (2026-09-07T11:09:30Z)
• GenRec: Knowing Where to Reconstruct and Where to Generate [106.48347271421765]
  GenRec is a flow matching model that builds the reconstruction--generation split directly into its architecture, supervision, and gradient flow.<n>It attains the best reconstruction fidelity in observed regions while also surpassing purely generative baselines on perceptual quality in unobserved ones.
  arXiv  Detail & Related papers  (2026-08-18T14:31:19Z)
• SplatGuide: Geometric Priors from 3D Gaussians for Pose-Free Novel View Synthesis [42.23526579547921]
  SplatGuide reuses a single 3DGS scene across three complementary roles.<n>Per-Gaussian source-view indices are rendered into a target-view voting map.<n>Reconstruction tokens supply feature-level guidance via cross-attention.
  arXiv  Detail & Related papers  (2026-08-17T17:45:57Z)
• ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning [59.558706734431276]
  Current evaluations of spatial intelligence can be systematically invalid under modern vision-language model (VLM) settings.<n>We introduce ReVSI, a benchmark and protocol that ensures each QA pair is answerable and correct under the model's actual inputs.
  arXiv  Detail & Related papers  (2026-04-27T10:45:51Z)
• PoInit-of-View: Poisoning Initialization of Views Transfers Across Multiple 3D Reconstruction Systems [55.84012796735184]
  Poisoning input views of 3D reconstruction systems has been recently studied.<n>We propose PoInit-of-View, which optimize adversarial perturbations to intentionally introduce cross-view inconsistencies.<n> Experimental results demonstrate the effectiveness of our PoInit-of-View on diverse 3D reconstruction systems and datasets.
  arXiv  Detail & Related papers  (2026-04-17T00:48:12Z)
• Joint Geometry-Appearance Human Reconstruction in a Unified Latent Space via Bridge Diffusion [57.09673862519791]
  This paper introduces textbfJGA-LBD, a novel framework that unifies the modeling of geometry and appearance into a joint latent representation.<n> Experiments demonstrate that JGA-LBD outperforms current state-of-the-art approaches in terms of both geometry fidelity and appearance quality.
  arXiv  Detail & Related papers  (2026-01-01T12:48:56Z)
• Non-Aligned Reference Image Quality Assessment for Novel View Synthesis [8.68364429451164]
  We introduce a Non-Temporal Reference (NAR-IQA) framework tailored for Novel View Synthesis (NVS) images.<n>Our model is built on a contrastive learning framework that incorporates LoRA-enhanced DINOv2 embeddings.<n>We conduct a novel user study to gather data on human preferences when viewing non-aligned references in NVS.
  arXiv  Detail & Related papers  (2025-11-11T12:08:12Z)
• PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting [54.7468067660037]
  PF3plat sets a new state-of-the-art across all benchmarks, supported by comprehensive ablation studies validating our design choices.<n>Our framework capitalizes on fast speed, scalability, and high-quality 3D reconstruction and view synthesis capabilities of 3DGS.
  arXiv  Detail & Related papers  (2024-10-29T15:28:15Z)
• High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimization [51.878078860524795]
  We present a high-fidelity 3D generative adversarial network (GAN) inversion framework that can synthesize photo-realistic novel views. Our approach enables high-fidelity 3D rendering from a single image, which is promising for various applications of AI-generated 3D content.
  arXiv  Detail & Related papers  (2022-11-28T18:59:52Z)
• NeurAR: Neural Uncertainty for Autonomous 3D Reconstruction [64.36535692191343]
  Implicit neural representations have shown compelling results in offline 3D reconstruction and also recently demonstrated the potential for online SLAM systems. This paper addresses two key challenges: 1) seeking a criterion to measure the quality of the candidate viewpoints for the view planning based on the new representations, and 2) learning the criterion from data that can generalize to different scenes instead of hand-crafting one. Our method demonstrates significant improvements on various metrics for the rendered image quality and the geometry quality of the reconstructed 3D models when compared with variants using TSDF or reconstruction without view planning.
  arXiv  Detail & Related papers  (2022-07-22T10:05:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.