Latent Diffusion Based Face Enhancement under Degraded Conditions for Forensic Face Recognition

• URL: http://arxiv.org/abs/2508.00941v1
• Date: Thu, 31 Jul 2025 14:28:12 GMT
• Title: Latent Diffusion Based Face Enhancement under Degraded Conditions for Forensic Face Recognition
• Abstract summary: Face recognition systems experience severe performance degradation when processing low-quality forensic evidence imagery.<n>This paper presents an evaluation of latent diffusion-based enhancement for improving face recognition under relevant degradations.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Face recognition systems experience severe performance degradation when processing low-quality forensic evidence imagery. This paper presents an evaluation of latent diffusion-based enhancement for improving face recognition under forensically relevant degradations. Using a dataset of 3,000 individuals from LFW with 24,000 recognition attempts, we implement the Flux.1 Kontext Dev pipeline with Facezoom LoRA adaptation to test against seven degradation categories, including compression artefacts, blur effects, and noise contamination. Our approach demonstrates substantial improvements, increasing overall recognition accuracy from 29.1% to 84.5% (55.4 percentage point improvement, 95% CI: [54.1, 56.7]). Statistical analysis reveals significant performance gains across all degradation types, with effect sizes exceeding conventional thresholds for practical significance. These findings establish the potential of sophisticated diffusion based enhancement in forensic face recognition applications.

Related papers

• Implicit Neural Representation-Based Continuous Single Image Super Resolution: An Empirical Study [50.15623093332659]
  Implicit neural representation (INR) has become the standard approach for arbitrary-scale image super-resolution (ASSR)<n>We compare existing techniques across diverse settings and present aggregated performance results on multiple image quality metrics.<n>We examine a new loss function that penalizes intensity variations while preserving edges, textures, and finer details during training.
  arXiv  Detail & Related papers  (2026-01-25T07:09:20Z)
• ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection [0.0]
  ForensicFormer is a hierarchical framework that unifies low-level artifact detection, mid-level boundary analysis, and high-level semantic reasoning.<n>Our method maintains 86.8% average accuracy across seven diverse test sets, spanning traditional manipulations, GAN-generated images, and diffusion model outputs.
  arXiv  Detail & Related papers  (2026-01-12T04:29:36Z)
• Fixed-Threshold Evaluation of a Hybrid CNN-ViT for AI-Generated Image Detection Across Photos and Art [0.0]
  We introduce fixed-threshold evaluation that holds decision thresholds, selected once on clean validation data, fixed across all post-processing transformations.<n>Our hybrid approach achieves balanced crossdomain performance: 91.4% accuracy on tinygenimage photos, 89.7% accuracy on AiData art/graphics, and 98.3% (competitive) on CIFAKE.
  arXiv  Detail & Related papers  (2025-12-25T05:19:09Z)
• Efficient Perceptual Image Super Resolution: AIM 2025 Study and Benchmark [53.56717645904575]
  We aim to replicate or improve the perceptual results of Real-ESRGAN while meeting strict efficiency constraints.<n>The proposed solutions were evaluated on a novel dataset consisting of 500 test images of 4K resolution, each degraded using multiple degradation types.<n>The top-performing approach manages to outperform Real-ESRGAN across all benchmark datasets.
  arXiv  Detail & Related papers  (2025-10-14T17:45:22Z)
• Realism to Deception: Investigating Deepfake Detectors Against Face Enhancement [1.8886473137668816]
  Face enhancement techniques can inadvertently distort biometric features, leading to significant decrease in the accuracy of deepfake detectors.<n>We systematically evaluate whether commonly used face enhancement methods can serve as anti-forensic tools.<n>Our results demonstrate that face enhancement methods can effectively function as anti-forensic tools.
  arXiv  Detail & Related papers  (2025-09-08T19:49:52Z)
• DiffusionFF: Face Forgery Detection via Diffusion-based Artifact Localization [21.139016641596676]
  DiffusionFF is a novel framework that enhances face forgery detection through diffusion-based artifact localization.<n>Our method utilizes a denoising diffusion model to generate high-quality Structural Dissimilarity (DSSIM) maps, which effectively capture subtle traces of manipulation.
  arXiv  Detail & Related papers  (2025-08-03T18:06:04Z)
• One-Step Diffusion-based Real-World Image Super-Resolution with Visual Perception Distillation [53.24542646616045]
  We propose VPD-SR, a novel visual perception diffusion distillation framework specifically designed for image super-resolution (SR) generation.<n>VPD-SR consists of two components: Explicit Semantic-aware Supervision (ESS) and High-frequency Perception (HFP) loss.<n>The proposed VPD-SR achieves superior performance compared to both previous state-of-the-art methods and the teacher model with just one-step sampling.
  arXiv  Detail & Related papers  (2025-06-03T08:28:13Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models.<n>In this paper, we investigate how detection performance varies across model backbones, types, and datasets.<n>We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• MRIFE: A Mask-Recovering and Interactive-Feature-Enhancing Semantic Segmentation Network For Relic Landslide Detection [7.6822321138894765]
  Relic landslide, formed over a long period, possess the potential for reactivation, making them a hazardous geological phenomenon. High-resolution remote sensing images for relic landslides face many challenges, including the object visual blur problem. A semantic segmentation model, termed mask-recovering and interactive-feature-enhancing (MRIFE), is proposed for more efficient feature extraction and separation. The proposed MRIFE is evaluated on a real relic landslide dataset, and experimental results show that it greatly improves the performance of relic landslide detection.
  arXiv  Detail & Related papers  (2024-11-26T07:15:50Z)
• Diffusion Facial Forgery Detection [56.69763252655695]
  This paper introduces DiFF, a comprehensive dataset dedicated to face-focused diffusion-generated images. We conduct extensive experiments on the DiFF dataset via a human test and several representative forgery detection methods. The results demonstrate that the binary detection accuracy of both human observers and automated detectors often falls below 30%.
  arXiv  Detail & Related papers  (2024-01-29T03:20:19Z)
• DifAugGAN: A Practical Diffusion-style Data Augmentation for GAN-based Single Image Super-resolution [88.13972071356422]
  We propose a diffusion-style data augmentation scheme for GAN-based image super-resolution (SR) methods, known as DifAugGAN. It involves adapting the diffusion process in generative diffusion models for improving the calibration of the discriminator during training. Our DifAugGAN can be a Plug-and-Play strategy for current GAN-based SISR methods to improve the calibration of the discriminator and thus improve SR performance.
  arXiv  Detail & Related papers  (2023-11-30T12:37:53Z)
• Boosting Cross-Quality Face Verification using Blind Face Restoration [0.13654846342364302]
  It is crucial for the task of face verification to enhance the perceptual quality of the low quality images. In this paper, we investigate the impact of applying three state-of-the-art blind face restoration techniques on the performance of face verification system.
  arXiv  Detail & Related papers  (2023-08-15T18:05:19Z)
• Impact of Face Image Quality Estimation on Presentation Attack Detection [10.832111751830272]
  We study the effect of quality assessment methods on filtering bona fide and attack samples. We show that a reduction of 20% of the training dataset by removing lower quality samples allowed us to improve the BPCER by 3% in a cross-dataset test.
  arXiv  Detail & Related papers  (2022-09-30T14:23:47Z)
• Octuplet Loss: Make Face Recognition Robust to Image Resolution [5.257115841810258]
  We propose a novel combination of the popular triplet loss to improve robustness against image resolution. We leverage the relationship between high-resolution images and their synthetically down-sampled variants jointly with their identity labels. Fine-tuning several state-of-the-art approaches with our method proves that we can significantly boost performance for cross-resolution (high-to-low resolution) face verification.
  arXiv  Detail & Related papers  (2022-07-14T08:22:58Z)
• On the Effect of Selfie Beautification Filters on Face Detection and Recognition [53.561797148529664]
  Social media image filters modify the image contrast or illumination or occlude parts of the face with for example artificial glasses or animal noses. We develop a method to reconstruct the applied manipulation with a modified version of the U-NET segmentation network. From a recognition perspective, we employ distance measures and trained machine learning algorithms applied to features extracted using a ResNet-34 network trained to recognize faces.
  arXiv  Detail & Related papers  (2021-10-17T22:10:56Z)
• Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain [88.7339322596758]
  We present a novel Spatial-Phase Shallow Learning (SPSL) method, which combines spatial image and phase spectrum to capture the up-sampling artifacts of face forgery. SPSL can achieve the state-of-the-art performance on cross-datasets evaluation as well as multi-class classification and obtain comparable results on single dataset evaluation.
  arXiv  Detail & Related papers  (2021-03-02T16:45:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.