Low-Quality Face Recognition using Center Aligned Representations and Local Margin Constraints

• URL: http://arxiv.org/abs/2609.01014v1
• Date: Tue, 01 Sep 2026 10:04:12 GMT
• Title: Low-Quality Face Recognition using Center Aligned Representations and Local Margin Constraints
• Abstract summary: Low-quality face recognition (LQFR) remains challenging due to the difficulty of matching degraded query (probe) images against low-quality (LQ) enrollment imagery.<n>We propose a unified framework that combines three main components: (1) Local Probability Margin (LPM), which estimates per-sample difficulty directly from the model's discriminative landscape; (2) Nested Attention Module (NAM), a new low-rank adapter module that embeds a self-attention mechanism within selected transformer layers; and (3) Quality Gating Protocol (QGP), where an off-the-shelf image quality estimator modulates the adapter contribution
• Score: 1.0885910878567457
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Low-quality face recognition (LQFR) remains challenging due to the difficulty of matching degraded query (probe) images against low-quality (LQ) enrollment (gallery) imagery and the scarcity of training data for large-scale models. While recent face recognition (FR) models perform well on high-quality (HQ) imagery, their accuracy drops significantly on LQ images with extremely low signal-to-noise ratio (SNR). Moreover, fine-tuning HQ-pretrained models on LQ data often improves LQ recognition at the expense of HQ generalization. This trade-off becomes more pronounced in modern evaluation settings spanning multiple datasets with varying image quality levels. To address these limitations, we propose a unified framework that combines three main components: (1) Local Probability Margin (LPM), which estimates per-sample difficulty directly from the model's discriminative landscape; (2) Nested Attention Module (NAM), a new low-rank adapter module that embeds a self-attention mechanism within selected transformer layers; and (3) Quality Gating Protocol (QGP), where an off-the-shelf image quality estimator modulates the adapter contribution at test time, enabling a single model to handle the full quality spectrum without sacrificing HQ performance. Experiments on surveillance (TinyFace, SurvFace) and standard (IJB-B, IJB-C) face recognition benchmarks demonstrate consistent gains in both identification and verification. Code and models will be released at github.com/candllq/nam.

Related papers

• Learning Where to Look and How to Judge: Resolution-agnostic Image Quality Assessment with Quality-aware Saliency [1.6806593639401994]
  No-reference image quality assessment (NR IQA) has recently benefited from deep and multimodal models.<n>We present textbfReLIQS, a model for textbfResolution-agnostic textbfLearning for textbfImage textbfQuality with textbfSaliency.<n>ReLIQS is a CLIP-based multiscale patch-driven architecture that learns both emphwhere to look and emphhow to judge quality
  arXiv  Detail & Related papers  (2026-08-03T05:54:06Z)
• Causal Disentanglement for Full-Reference Image Quality Assessment [21.96346718260435]
  We propose a novel FR-IQA paradigm based on causal inference and decoupled representation learning.<n>Our approach formulates degradation estimation as a causal disentanglement process guided by intervention on latent representations.<n>Our method achieves highly competitive performance on standard IQA benchmarks across fully supervised, few-label, and label-free settings.
  arXiv  Detail & Related papers  (2026-04-23T13:18:13Z)
• Beyond Ground-Truth: Leveraging Image Quality Priors for Real-World Image Restoration [21.358966811756645]
  Real-world image restoration aims to restore high-quality (HQ) images from degraded low-quality (LQ) inputs captured under uncontrolled conditions.<n>Existing methods typically depend on ground-truth (GT) supervision, assuming that GT provides perfect reference quality.<n>We propose an Image Quality Prior (IQP)-extracted from pre-trained No-Reference Image Quality Assessment (NR-IQA) models-to guide the restoration process toward perceptually optimal outputs explicitly.
  arXiv  Detail & Related papers  (2026-03-31T14:13:10Z)
• Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probing [10.754977682331855]
  "Thinking with Images" paradigms induce spurious "cropping-implies-degradation" biases and misinterprets natural depth-of-field as artifacts.<n>We propose Q-Probe, the first agentic IQA framework designed to scale IQA to high resolution via context-aware probing.<n>Q-Probe achieves state-of-the-art performance in high-resolution settings while maintaining superior efficacy across resolution scales.
  arXiv  Detail & Related papers  (2026-01-21T08:02:32Z)
• Enhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generation [102.10193318526137]
  Large Multimodal Models (LMMs) have recently shown remarkable promise in low-level visual perception tasks.<n>We introduce IQARAG, a training-free framework that enhances LMMs' Image Quality Assessment (IQA) ability.<n>IQARAG leverages Retrieval-Augmented Generation (RAG) to retrieve some semantically similar but quality-variant reference images with corresponding Mean Opinion Scores (MOSs) for input image.
  arXiv  Detail & Related papers  (2026-01-13T08:00:02Z)
• Evaluating and Preserving High-level Fidelity in Super-Resolution [50.65679806442527]
  Super-Resolution (SR) models are achieving impressive effects in reconstructing details and delivering pleasant visually outputs.<n>However, the overpowering generative ability can sometimes hallucinate and thus change the image content.<n>This type of high-level change can be easily identified by humans yet not well-studied in existing low-level image quality metrics.
  arXiv  Detail & Related papers  (2025-12-07T22:53:34Z)
• TRIQA: Image Quality Assessment by Contrastive Pretraining on Ordered Distortion Triplets [31.2422359004089]
  No-Reference (NR) IQA remains particularly challenging due to the absence of a reference image.<n>We propose a novel approach that constructs a custom dataset using a limited number of reference content images.<n>We train a quality-aware model using contrastive triplet-based learning, enabling efficient training with fewer samples.
  arXiv  Detail & Related papers  (2025-07-16T23:43:12Z)
• IQPFR: An Image Quality Prior for Blind Face Restoration and Beyond [56.99331967165238]
  Blind Face Restoration (BFR) addresses the challenge of reconstructing degraded low-quality (LQ) facial images into high-quality (HQ) outputs.<n>We propose a novel framework that incorporates an Image Quality Prior (IQP) derived from No-Reference Image Quality Assessment (NR-IQA) models.<n>Our method outperforms state-of-the-art techniques across multiple benchmarks.
  arXiv  Detail & Related papers  (2025-03-12T11:39:51Z)
• IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Models [0.5356944479760104]
  We propose methods to integrate image quality assessment (IQA) models into diffusion-based generators.<n>We show that diffusion models can learn complex qualitative relationships from both IQA models' outputs and internal activations.<n>We introduce IQA-Adapter, a novel framework that conditions generation on target quality levels by learning the implicit relationship between images and quality scores.
  arXiv  Detail & Related papers  (2024-12-02T18:40:19Z)
• Q-Ground: Image Quality Grounding with Large Multi-modality Models [61.72022069880346]
  We introduce Q-Ground, the first framework aimed at tackling fine-scale visual quality grounding. Q-Ground combines large multi-modality models with detailed visual quality analysis. Central to our contribution is the introduction of the QGround-100K dataset.
  arXiv  Detail & Related papers  (2024-07-24T06:42:46Z)
• DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wild [73.6767681305851]
  Blind image quality assessment (IQA) in the wild presents significant challenges.<n>Given the difficulty in collecting large-scale training data, leveraging limited data to develop a model with strong generalization remains an open problem.<n>Motivated by the robust image perception capabilities of pre-trained text-to-image (T2I) diffusion models, we propose a novel IQA method, diffusion priors-based IQA.
  arXiv  Detail & Related papers  (2024-05-30T12:32:35Z)
• When No-Reference Image Quality Models Meet MAP Estimation in Diffusion Latents [92.45867913876691]
  No-reference image quality assessment (NR-IQA) models can effectively quantify perceived image quality.<n>We show that NR-IQA models can be plugged into the maximum a posteriori (MAP) estimation framework for image enhancement.
  arXiv  Detail & Related papers  (2024-03-11T03:35:41Z)
• Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild [98.48284827503409]
  We develop a textitunified BIQA model and an approach of training it for both synthetic and realistic distortions. We employ the fidelity loss to optimize a deep neural network for BIQA over a large number of such image pairs. Experiments on six IQA databases show the promise of the learned method in blindly assessing image quality in the laboratory and wild.
  arXiv  Detail & Related papers  (2020-05-28T13:35:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.