A Reference-Free Framework for Evaluating Single-Frame ISP Pipelines

• URL: http://arxiv.org/abs/2607.23321v1
• Date: Sat, 25 Jul 2026 18:28:35 GMT
• Title: A Reference-Free Framework for Evaluating Single-Frame ISP Pipelines
• Abstract summary: Blind image quality assessment (IQA) techniques can grade visual quality without a reference.<n>We propose a reference-free learning framework that estimates full-reference image quality metrics from a processed sRGB image.
• Score: 20.879463787517704
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Evaluating camera image signal processing (ISP) pipelines requires measuring low-level artifacts introduced by operations such as denoising, demosaicing, tone mapping, and compression. Blind image quality assessment (IQA) techniques can grade visual quality without a reference, but they typically focus on semantic and high-level visual cues or human perceptual scores rather than the low-level image-processing artifacts introduced by camera pipelines. In contrast, full-reference metrics such as PSNR and SSIM measure pixel-level differences and structural similarity, while LPIPS measures perceptual similarity in deep feature space. However, these metrics require perfectly aligned image pairs, which are difficult to collect in practical settings. We propose a reference-free learning framework that estimates full-reference image quality metrics from a processed sRGB image and its ISO metadata. Our method predicts a proxy sRGB reference, which is then compared with the processed image to compute PSNR, SSIM, and LPIPS in their standard full-reference form. Our experiments show that the proxy-reference model can be learned from synthetic data and applied to real camera data. We further show that lightweight LoRA fine-tuning enables efficient adaptation when ISP components or pipeline configurations are changed. The proposed method outperforms direct metric regression in estimating metric values and achieves higher agreement with full-reference rankings than conventional blind IQA methods. These results demonstrate the feasibility of reference-free estimation of full-reference metrics for practical camera-pipeline evaluation.

Related papers

• Never Seen Before: Benchmarking Genuine Zero-Shot Composed Image Retrieval with Consistent Video-Sourced Datasets [61.420656457977195]
  Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve a target image based on a query composed of a reference image and a relative caption without training samples.<n>Existing ZS-CIR datasets often suffer from complete irrelevance between reference and target images due to noisy image sources.<n>We introduce ZeroSight, a novel benchmark for ZS-CIR.
  arXiv  Detail & Related papers  (2026-06-05T08:23:25Z)
• Automating Parameter Selection in Deep Image Prior for Fluorescence Microscopy Image Denoising via Similarity-Based Parameter Transfer [1.342048192901064]
  Unsupervised deep image prior (DIP) addresses shortcomings of training data requirements and limited generalization associated with supervised deep learning.<n>We show that a parameter transfer from a calibration dataset to a test image leads to similar and better performance than a transfer based on quantitative image similarity measures.
  arXiv  Detail & Related papers  (2026-01-17T13:47:41Z)
• CrossScore: Towards Multi-View Image Evaluation and Scoring [24.853612457257697]
  Cross-reference image quality assessment method fills the gap in the image assessment landscape. Our method enables accurate image quality assessment without requiring ground truth references.
  arXiv  Detail & Related papers  (2024-04-22T17:59:36Z)
• Estimating Physical Information Consistency of Channel Data Augmentation for Remote Sensing Images [3.063197102484114]
  We propose an approach to estimate whether a channel augmentation technique affects the physical information of RS images. We compare the scores associated with original and augmented pixel signatures to evaluate the physical consistency.
  arXiv  Detail & Related papers  (2024-03-21T16:48:45Z)
• MB-RACS: Measurement-Bounds-based Rate-Adaptive Image Compressed Sensing Network [65.1004435124796]
  We propose a Measurement-Bounds-based Rate-Adaptive Image Compressed Sensing Network (MB-RACS) framework. Our experiments demonstrate that the proposed MB-RACS method surpasses current leading methods.
  arXiv  Detail & Related papers  (2024-01-19T04:40:20Z)
• Beyond Learned Metadata-based Raw Image Reconstruction [86.1667769209103]
  Raw images have distinct advantages over sRGB images, e.g., linearity and fine-grained quantization levels. They are not widely adopted by general users due to their substantial storage requirements. We propose a novel framework that learns a compact representation in the latent space, serving as metadata.
  arXiv  Detail & Related papers  (2023-06-21T06:59:07Z)
• PIQI: Perceptual Image Quality Index based on Ensemble of Gaussian Process Regression [2.9412539021452715]
  Perceptual Image Quality Index (PIQI) is proposed to assess the quality of digital images. The performance of the PIQI is checked on six benchmark databases and compared with twelve state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-05-16T06:44:17Z)
• Learning Transformer Features for Image Quality Assessment [53.51379676690971]
  We propose a unified IQA framework that utilizes CNN backbone and transformer encoder to extract features. The proposed framework is compatible with both FR and NR modes and allows for a joint training scheme.
  arXiv  Detail & Related papers  (2021-12-01T13:23:00Z)
• Palette: Image-to-Image Diffusion Models [50.268441533631176]
  We introduce Palette, a simple and general framework for image-to-image translation using conditional diffusion models. On four challenging image-to-image translation tasks, Palette outperforms strong GAN and regression baselines. We report several sample quality scores including FID, Inception Score, Classification Accuracy of a pre-trained ResNet-50, and Perceptual Distance against reference images.
  arXiv  Detail & Related papers  (2021-11-10T17:49:29Z)
• Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescaling [139.25215100378284]
  We propose a hierarchical conditional flow (HCFlow) as a unified framework for image SR and image rescaling. HCFlow learns a mapping between HR and LR image pairs by modelling the distribution of the LR image and the rest high-frequency component simultaneously. To further enhance the performance, other losses such as perceptual loss and GAN loss are combined with the commonly used negative log-likelihood loss in training.
  arXiv  Detail & Related papers  (2021-08-11T16:11:01Z)
• Subjective Annotation for a Frame Interpolation Benchmark using Artefact Amplification [6.544757635738911]
  For image quality assessment, the actual quality experienced by the user cannot be fully deduced from simple measures. We conducted a subjective quality assessment crowdscouring study for the interpolated frames provided by one of the optical flow benchmarks. As a first step, we proposed such a new full-reference method, called WAE-IQA.
  arXiv  Detail & Related papers  (2020-01-10T18:20:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.