Robust Face Super-Resolution and Recognition Through Multi-Feature Aggregation in Diffusion Models

• URL: http://arxiv.org/abs/2607.05702v1
• Date: Mon, 06 Jul 2026 23:49:55 GMT
• Title: Robust Face Super-Resolution and Recognition Through Multi-Feature Aggregation in Diffusion Models
• Abstract summary: We introduce FASR++, a diffusion-model-based super-resolution algorithm.<n>It generates high-quality images that can considerably improve performance in face recognition tasks.<n>We validate our approach on two standard face recognition datasets.
• Score: 2.1688624609312077
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Images acquired in surveillance environments often suffer from conditions such as low resolution, variations in pose, irregular illumination, and occlusions. Due to the low quality of these images, face recognition algorithms often struggle. This major limitation can be addressed by employing super-resolution techniques that enhance the details of the image. However, due to the high degree of difficulty of the problem, most super-resolution algorithms tend to cause distortions in the image and in the individual's identity. Thus, additional information must be incorporated into the processing to improve recognition robustness. In this regard, surveillance cameras can capture multiple images, even at low quality, and the data extracted from these images, such as consecutive video frames, can significantly enhance both super-resolution and facial recognition. In this work, we introduce FASR++, a diffusion-model-based super-resolution algorithm. It leverages a reference low-resolution image and features extracted from multiple auxiliary low-quality images to generate a super-resolved output, minimizing distortions in the individual's identity. Our approach recovers facial features without explicitly providing soft attributes or computing a function gradient to guide the reconstruction process. FASR++ generates high-quality images that can considerably improve performance in face recognition tasks when used as a pre-processing step. We validate our approach on two standard face recognition datasets and attain state-of-the-art results for verification, face recognition, and image quality metrics such as PSNR, SSIM, and LPIPS.

Related papers

• SMFD-UNet: Semantic Face Mask Is The Only Thing You Need To Deblur Faces [0.0]
  We present SMFD-UNet (Semantic Mask Fusion Deblurring UNet), a new lightweight framework using semantic face masks to drive the deblurring process.<n>We show that SMFD-UNet shows better performance than state-of-the-art models, attaining higher Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) while preserving satisfactory naturalness measures.
  arXiv  Detail & Related papers  (2026-04-08T18:16:39Z)
• PETALface: Parameter Efficient Transfer Learning for Low-resolution Face Recognition [54.642714288448744]
  PETALface is the first work leveraging the powers of PEFT for low resolution face recognition.<n>We introduce two low-rank adaptation modules to the backbone, with weights adjusted based on the input image quality to account for the difference in quality for the gallery and probe images.<n>Experiments demonstrate that the proposed method outperforms full fine-tuning on low-resolution datasets while preserving performance on high-resolution and mixed-quality datasets.
  arXiv  Detail & Related papers  (2024-12-10T18:59:45Z)
• Multi-Feature Aggregation in Diffusion Models for Enhanced Face Super-Resolution [6.055006354743854]
  We develop an algorithm that utilize a low-resolution image combined with features extracted from multiple low-quality images to generate a super-resolved image. Unlike other algorithms, our approach recovers facial features without explicitly providing attribute information. This is the first time multi-features combined with low-resolution images are used as conditioners to generate more reliable super-resolution images.
  arXiv  Detail & Related papers  (2024-08-27T20:08:33Z)
• Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution [64.15915577164894]
  A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing. HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
  arXiv  Detail & Related papers  (2022-06-07T14:55:32Z)
• LR-to-HR Face Hallucination with an Adversarial Progressive Attribute-Induced Network [67.64536397027229]
  Face super-resolution is a challenging and highly ill-posed problem. We propose an end-to-end progressive learning framework incorporating facial attributes. We show that the proposed approach can yield satisfactory face hallucination images outperforming other state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-09-29T19:50:45Z)
• Network Architecture Search for Face Enhancement [82.25775020564654]
  We present a multi-task face restoration network, called Network Architecture Search for Face Enhancement (NASFE) NASFE can enhance poor quality face images containing a single degradation (i.e. noise or blur) or multiple degradations (noise+blur+low-light)
  arXiv  Detail & Related papers  (2021-05-13T19:46:05Z)
• Joint Face Image Restoration and Frontalization for Recognition [79.78729632975744]
  In real-world scenarios, many factors may harm face recognition performance, e.g., large pose, bad illumination,low resolution, blur and noise. Previous efforts usually first restore the low-quality faces to high-quality ones and then perform face recognition. We propose an Multi-Degradation Face Restoration model to restore frontalized high-quality faces from the given low-quality ones.
  arXiv  Detail & Related papers  (2021-05-12T03:52:41Z)
• JDSR-GAN: Constructing A Joint and Collaborative Learning Network for Masked Face Super-Resolution [28.022800882214803]
  Face images obtained in most video surveillance scenarios are low resolution with mask simultaneously. Most of the previous face super-resolution solutions can not handle both tasks in one model. We construct a joint and collaborative learning network, called JDSR-GAN, for the masked face super-resolution task.
  arXiv  Detail & Related papers  (2021-03-25T08:50:40Z)
• Analysis and evaluation of Deep Learning based Super-Resolution algorithms to improve performance in Low-Resolution Face Recognition [0.0]
  Super-resolution algorithms may be able to recover the discriminant properties of the subjects involved. This project aimed at evaluating and adapting different deep neural network architectures for the task of face super-resolution. Experiments showed that general super-resolution architectures might enhance face verification performance of deep neural networks trained on high-resolution faces.
  arXiv  Detail & Related papers  (2021-01-19T02:41:57Z)
• Multi Scale Identity-Preserving Image-to-Image Translation Network for Low-Resolution Face Recognition [7.6702700993064115]
  We propose an identity-preserving end-to-end image-to-image translation deep neural network. It is capable of super-resolving very low-resolution faces to their high-resolution counterparts while preserving identity-related information.
  arXiv  Detail & Related papers  (2020-10-23T09:21:06Z)
• Invertible Image Rescaling [118.2653765756915]
  We develop an Invertible Rescaling Net (IRN) to produce visually-pleasing low-resolution images. We capture the distribution of the lost information using a latent variable following a specified distribution in the downscaling process.
  arXiv  Detail & Related papers  (2020-05-12T09:55:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.