CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection

• URL: http://arxiv.org/abs/2606.20302v1
• Date: Thu, 18 Jun 2026 14:37:02 GMT
• Title: CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection
• Abstract summary: CUPID is a POI video deepfake detector that combines UV texture maps, a facial appearance representation derived from 3D face reconstructions, with the representation learning capabilities of the Masked Autoencoder (MAE)<n>Our method does not require any deepfake videos in its training phase. Moreover, it does not even require to include a specific POI in the training set.<n>In the testing phase, the embeddings extracted from a query video depicting the POI can be matched against pristine reference videos to assess the video authenticity.
• Score: 20.011973962811528
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deepfakes targeting a high-profile individual, known as Person-of-Interest (POI), are a threat to modern democracies and societies. Current POI deepfake detection methods still struggle to combine robustness to post-processing, efficiency and interpretability, focal aspects of modern deepfake detectors. In this paper we propose CUPID, a POI video deepfake detector that combines UV texture maps, a facial appearance representation derived from 3D face reconstructions, with the representation learning capabilities of the Masked Autoencoder (MAE). Our method does not require any deepfake videos in its training phase. Moreover, it does not even require to include a specific POI in the training set: the combination of UV texture maps extracted from real video frames and the MAE context-guided reconstruction yields a latent space that captures rich and discriminative facial features also for identities unseen during training. In the testing phase, the embeddings extracted from a query video depicting the POI can be matched against pristine reference videos to assess the video authenticity. Furthermore, operating in the UV space naturally provides an additional layer of interpretability. Specifically, we can extract decoded residual maps that highlight which facial regions of a test video deviate most from the identity representation of the corresponding POI. Experiments on four deepfake datasets show that CUPID outperforms current state of the art on most datasets and achieves the best overall robustness against strong downscaling and compression, providing also substantially faster inference. Our experimental code will be released at https://github.com/polimi-ispl/CUPID.

Related papers

• Learning Unified Video and Image Representation for Video Face Forgery Detection [49.19035628283472]
  Existing methods for video face forgery detection assume that all frames in a forged video are manipulated.<n>We propose a novel framework, UVIF, that utilizes additional annotated images to provide fine-grained supervision for detecting partial forgeries in videos.<n>UVIF employs a unified encoder and a multi-task learning paradigm to jointly model facial videos and images for boosted video face forgery detection.
  arXiv  Detail & Related papers  (2026-08-13T10:25:59Z)
• EDVD-LLaMA: Explainable Deepfake Video Detection via Multimodal Large Language Model Reasoning [58.42596067220998]
  deepfake video technology has not only facilitated artistic creation but also made it easier to spread misinformation.<n>Traditional deepfake video detection methods face issues such as a lack of transparency in their principles and insufficient capabilities to cope with forgery techniques.<n>This paper proposes the explainable deepfake video detection (EDVD) task and designs the EDVD-LLaMA multimodal reasoning framework.
  arXiv  Detail & Related papers  (2025-10-18T10:34:05Z)
• Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMs [92.02382309654263]
  We introduce DeeptraceReward, a benchmark that annotates human-perceived fake traces for video generation reward.<n>The dataset comprises 4.3K detailed annotations across 3.3 high-quality generated videos.<n>We consolidate these annotations into 9 major categories of deepfake traces that lead humans to identify a video as AI-generated.
  arXiv  Detail & Related papers  (2025-09-26T17:59:54Z)
• A Lightweight and Interpretable Deepfakes Detection Framework [8.23719496171112]
  The creation and dissemination of so-called deepfakes poses a serious threat to social life, civil rest, and law.<n>Most of the existing detectors focus on detecting either face-swap, lip-sync, or puppet master deepfakes.<n>This paper presents a unified framework that exploits the power of proposed feature fusion of hybrid facial landmarks.
  arXiv  Detail & Related papers  (2025-01-21T07:03:11Z)
• Vulnerability-Aware Spatio-Temporal Learning for Generalizable Deepfake Video Detection [14.586314545834934]
  We propose a fine-grained deepfake video detection approach called FakeSTormer.<n>Specifically, we introduce a multi-task learning framework that incorporates two auxiliary branches for explicitly attending artifact-prone spatial and temporal regions.<n>We also propose a video-level synthesis strategy that generates pseudo-fake videos with subtle-temporal artifacts.
  arXiv  Detail & Related papers  (2025-01-02T10:21:34Z)
• Deepfake detection in videos with multiple faces using geometric-fakeness features [79.16635054977068]
  Deepfakes of victims or public figures can be used by fraudsters for blackmailing, extorsion and financial fraud. In our research we propose to use geometric-fakeness features (GFF) that characterize a dynamic degree of a face presence in a video. We employ our approach to analyze videos with multiple faces that are simultaneously present in a video.
  arXiv  Detail & Related papers  (2024-10-10T13:10:34Z)
• Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for Enhanced Video Forgery Detection [19.432851794777754]
  We present a novel approach for the detection of deepfake videos using a pair of vision transformers pre-trained by a self-supervised masked autoencoding setup. Our method consists of two distinct components, one of which focuses on learning spatial information from individual RGB frames of the video, while the other learns temporal consistency information from optical flow fields generated from consecutive frames.
  arXiv  Detail & Related papers  (2023-06-12T05:49:23Z)
• Deep Convolutional Pooling Transformer for Deepfake Detection [54.10864860009834]
  We propose a deep convolutional Transformer to incorporate decisive image features both locally and globally. Specifically, we apply convolutional pooling and re-attention to enrich the extracted features and enhance efficacy. The proposed solution consistently outperforms several state-of-the-art baselines on both within- and cross-dataset experiments.
  arXiv  Detail & Related papers  (2022-09-12T15:05:41Z)
• Video Transformer for Deepfake Detection with Incremental Learning [11.586926513803077]
  Face forgery by deepfake is widely spread over the internet and this raises severe societal concerns. We propose a novel video transformer with incremental learning for detecting deepfake videos.
  arXiv  Detail & Related papers  (2021-08-11T16:22:56Z)
• Two-branch Recurrent Network for Isolating Deepfakes in Videos [17.59209853264258]
  We present a method for deepfake detection based on a two-branch network structure. One branch propagates the original information, while the other branch suppresses the face content. Our two novel components show promising results on the FaceForensics++, Celeb-DF, and Facebook's DFDC preview benchmarks.
  arXiv  Detail & Related papers  (2020-08-08T01:38:56Z)
• Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing [61.82466976737915]
  Depth supervised learning has been proven as one of the most effective methods for face anti-spoofing. We propose a new approach to detect presentation attacks from multiple frames based on two insights. The proposed approach achieves state-of-the-art results on five benchmark datasets.
  arXiv  Detail & Related papers  (2020-03-18T06:11:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.