Distortion-Aware Fusion of Statistical and Vision-Language Features for Blind Image Quality Assessment

• URL: http://arxiv.org/abs/2606.02002v1
• Date: Mon, 01 Jun 2026 09:57:52 GMT
• Title: Distortion-Aware Fusion of Statistical and Vision-Language Features for Blind Image Quality Assessment
• Abstract summary: We propose a distortion-aware fusion framework that integrates a 138-dimensional NSS descriptor with two complementary VLM embeddings.<n>A per-distortion analysis on KADID-10k reveals that NSS features contribute most on noise and color-shift distortions.
• Score: 3.4153424359998508
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Blind image quality assessment (BIQA) aims to predict perceived image quality without access to a reference image. Classical natural scene statistics (NSS) descriptors and modern vision-language model (VLM) embeddings address this problem from fundamentally different perspectives, yet whether combining them yields complementary benefits and how to weight their contributions per input image remains unexplored. We propose a distortion-aware fusion framework that integrates a 138-dimensional NSS descriptor with two complementary VLM embeddings, SigLIP and CLIP-H, through a multiplicative gating mechanism that learns per-input stream weights conditioned on image content. Unlike static concatenation fusion, the proposed gating network suppresses or amplifies each stream's contribution based on the input, producing weights that correlate positively (Spearman rank correlation rho=0.33) with the per-distortion NSS contribution measured by independent ablation on KADID-10k. The framework requires no end-to-end fine-tuning of the VLM backbones and is trained with a hybrid loss combining mean squared error, Pearson linear correlation, and pairwise ranking objectives. We evaluate on three standard benchmarks: KonIQ-10k (SROCC=0.9142, PLCC=0.9279), KADID-10k (SROCC=0.9715, PLCC=0.9733, surpassing recent state-of-the-art methods), and LIVE Challenge in-the-Wild (SROCC=0.8527, PLCC=0.8802 with cross-dataset pretraining and fine-tuning). A per-distortion analysis on KADID-10k reveals that NSS features contribute most on noise and color-shift distortions where pixel statistics are directly affected, and least on perceptual distortions such as color saturation changes. The learned gate values validate these findings, confirming that the model autonomously discovers distortion-stream affinity patterns consistent with the manual per-distortion study.

Related papers

• Multi-Contrast MRI Motion Correction via Parameter-Informed Disentanglement and Adaptive Experts [56.74856091904914]
  We propose a unified framework combining parameter-informed contrast disentanglement with severity-aware adaptive correction.<n>ScanCLIP derives contrast embeddings from acquisition parameters to disentangle contrast style from anatomical content, yielding contrast-free features.<n>A Vision Transformer then estimates motion severity and routes features through a Mixture-of-Experts network, enabling targeted artifact correction.
  arXiv  Detail & Related papers  (2026-05-29T02:48:23Z)
• SHAMISA: SHAped Modeling of Implicit Structural Associations for Self-supervised No-Reference Image Quality Assessment [6.175621390241037]
  No-Reference Image Quality Assessment (NR-IQA) aims to estimate perceptual quality without access to a reference image of pristine quality.<n>We propose SHAMISA, a non-contrastive self-supervised framework that learns from unlabeled distorted images by leveraging explicitly structured supervision.
  arXiv  Detail & Related papers  (2026-03-14T00:37:26Z)
• A Contrastive Pre-trained Foundation Model for Deciphering Imaging Noisomics across Modalities [21.574587733837973]
  "Noisomics" is a framework shifting the focus from suppression to systematic noise decoding.<n>CoP employs contrastive learning to disentangle semantic signals from perturbations.<n>CoP breaks traditional deep learning scaling laws, achieving superior performance with only 100 training samples.
  arXiv  Detail & Related papers  (2026-01-21T02:52:34Z)
• Continual Action Quality Assessment via Adaptive Manifold-Aligned Graph Regularization [53.82400605816587]
  Action Quality Assessment (AQA) quantifies human actions in videos, supporting applications in sports scoring, rehabilitation, and skill evaluation.<n>A major challenge lies in the non-stationary nature of quality distributions in real-world scenarios.<n>We introduce Continual AQA (CAQA), which equips with Continual Learning capabilities to handle evolving distributions.
  arXiv  Detail & Related papers  (2025-10-08T10:09:47Z)
• No-Reference Image Contrast Assessment with Customized EfficientNet-B0 [3.4527546378946]
  No reference image quality assessment NR IQA models struggled to accurately evaluate contrast distortions under diverse real world conditions.<n>In this study, we proposed a deep learning based framework for blind contrast quality assessment.<n>Models are modified with a contrast-aware regression head and trained end to end using targeted data augmentations.
  arXiv  Detail & Related papers  (2025-09-26T06:54:37Z)
• A Lightweight Ensemble-Based Face Image Quality Assessment Method with Correlation-Aware Loss [14.915614314380578]
  Face image quality assessment (FIQA) plays a critical role in face recognition and verification systems.<n>We propose a lightweight and efficient method for FIQA, designed for the perceptual evaluation of face images in the wild.
  arXiv  Detail & Related papers  (2025-09-12T10:13:38Z)
• Solving Inverse Problems with FLAIR [68.87167940623318]
  We present FLAIR, a training-free variational framework that leverages flow-based generative models as prior for inverse problems.<n>Results on standard imaging benchmarks demonstrate that FLAIR consistently outperforms existing diffusion- and flow-based methods in terms of reconstruction quality and sample diversity.
  arXiv  Detail & Related papers  (2025-06-03T09:29:47Z)
• ExIQA: Explainable Image Quality Assessment Using Distortion Attributes [0.3683202928838613]
  We propose an explainable approach for distortion identification based on attribute learning. We generate a dataset consisting of 100,000 images for efficient training. Our approach achieves state-of-the-art (SOTA) performance across multiple datasets in both PLCC and SRCC metrics.
  arXiv  Detail & Related papers  (2024-09-10T20:28:14Z)
• You Only Train Once: A Unified Framework for Both Full-Reference and No-Reference Image Quality Assessment [45.62136459502005]
  We propose a network to perform full reference (FR) and no reference (NR) IQA. We first employ an encoder to extract multi-level features from input images. A Hierarchical Attention (HA) module is proposed as a universal adapter for both FR and NR inputs. A Semantic Distortion Aware (SDA) module is proposed to examine feature correlations between shallow and deep layers of the encoder.
  arXiv  Detail & Related papers  (2023-10-14T11:03:04Z)
• (Certified!!) Adversarial Robustness for Free! [116.6052628829344]
  We certify 71% accuracy on ImageNet under adversarial perturbations constrained to be within a 2-norm of 0.5. We obtain these results using only pretrained diffusion models and image classifiers, without requiring any fine tuning or retraining of model parameters.
  arXiv  Detail & Related papers  (2022-06-21T17:27:27Z)
• Treatment Learning Causal Transformer for Noisy Image Classification [62.639851972495094]
  In this work, we incorporate this binary information of "existence of noise" as treatment into image classification tasks to improve prediction accuracy. Motivated from causal variational inference, we propose a transformer-based architecture, that uses a latent generative model to estimate robust feature representations for noise image classification. We also create new noisy image datasets incorporating a wide range of noise factors for performance benchmarking.
  arXiv  Detail & Related papers  (2022-03-29T13:07:53Z)
• Image Quality Assessment using Contrastive Learning [50.265638572116984]
  We train a deep Convolutional Neural Network (CNN) using a contrastive pairwise objective to solve the auxiliary problem. We show through extensive experiments that CONTRIQUE achieves competitive performance when compared to state-of-the-art NR image quality models. Our results suggest that powerful quality representations with perceptual relevance can be obtained without requiring large labeled subjective image quality datasets.
  arXiv  Detail & Related papers  (2021-10-25T21:01:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.