SPOT-Face: Forensic Face Identification using Attention Guided Optimal Transport

• URL: http://arxiv.org/abs/2601.09229v1
• Date: Wed, 14 Jan 2026 07:02:21 GMT
• Title: SPOT-Face: Forensic Face Identification using Attention Guided Optimal Transport
• Authors: Ravi Shankar Prasad, Dinesh Singh,
• Abstract summary: SPOT-Face is a superpixel graph-based framework designed for cross-domain forensic face identification.<n>Our framework demonstrates to be highly effective for matching skulls and sketches to faces in forensic investigations.
• Score: 2.9936254916060503
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Person identification in forensic investigations becomes very challenging when common identification means for DNA (i.e., hair strands, soft tissue) are not available. Current methods utilize deep learning methods for face recognition. However, these methods lack effective mechanisms to model cross-domain structural correspondence between two different forensic modalities. In this paper, we introduce a SPOT-Face, a superpixel graph-based framework designed for cross-domain forensic face identification of victims using their skeleton and sketch images. Our unified framework involves constructing a superpixel-based graph from an image and then using different graph neural networks(GNNs) backbones to extract the embeddings of these graphs, while cross-domain correspondence is established through attention-guided optimal transport mechanism. We have evaluated our proposed framework on two publicly available dataset: IIT\_Mandi\_S2F (S2F) and CUFS. Extensive experiments were conducted to evaluate our proposed framework. The experimental results show significant improvement in identification metrics ( i.e., Recall, mAP) over existing graph-based baselines. Furthermore, our framework demonstrates to be highly effective for matching skulls and sketches to faces in forensic investigations.

Related papers

• Cranio-ID: Graph-Based Craniofacial Identification via Automatic Landmark Annotation in 2D Multi-View X-rays [2.4382430407654767]
  Traditional methods for locating craniometric landmarks are time-consuming and require specialized knowledge and expertise.<n>We propose a novel framework Cranio-ID: First, an automatic annotation of landmarks on 2D skulls with their respective optical images.<n>Second, cross-modal matching by formulating these landmarks into graph representations and then finding semantic correspondence between graphs of these two modalities.
  arXiv  Detail & Related papers  (2025-11-18T12:15:22Z)
• Fast Graph Neural Network for Image Classification [0.0]
  This study introduces a novel approach that integrates Graph Convolutional Networks (GCNs) with Voronoi diagrams to enhance image classification.<n>The proposed model achieves significant improvements in both preprocessing efficiency and classification accuracy across various benchmark datasets.
  arXiv  Detail & Related papers  (2025-08-20T17:57:59Z)
• Cross-Domain Identity Representation for Skull to Face Matching with Benchmark DataSet [6.1655282360871375]
  We present a framework for the identification of a person given the X-ray image of a skull using convolutional Siamese networks for cross-domain identity representation.<n>Siamese networks are twin networks that share the same architecture and can be trained to discover a feature space where nearby observations that are similar are grouped and dissimilar observations are moved apart.
  arXiv  Detail & Related papers  (2025-07-11T05:49:12Z)
• A Graph-Based Framework for Interpretable Whole Slide Image Analysis [86.37618055724441]
  We develop a framework that transforms whole-slide images into biologically-informed graph representations.<n>Our approach builds graph nodes from tissue regions that respect natural structures, not arbitrary grids.<n>We demonstrate strong performance on challenging cancer staging and survival prediction tasks.
  arXiv  Detail & Related papers  (2025-03-14T20:15:04Z)
• UniForensics: Face Forgery Detection via General Facial Representation [60.5421627990707]
  High-level semantic features are less susceptible to perturbations and not limited to forgery-specific artifacts, thus having stronger generalization. We introduce UniForensics, a novel deepfake detection framework that leverages a transformer-based video network, with a meta-functional face classification for enriched facial representation.
  arXiv  Detail & Related papers  (2024-07-26T20:51:54Z)
• COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
  Face forgery recognition methods can only process one face at a time. Most face forgery recognition methods can only process one face at a time. We propose COMICS, an end-to-end framework for multi-face forgery detection.
  arXiv  Detail & Related papers  (2023-08-03T03:37:13Z)
• Adaptive Face Recognition Using Adversarial Information Network [57.29464116557734]
  Face recognition models often degenerate when training data are different from testing data. We propose a novel adversarial information network (AIN) to address it.
  arXiv  Detail & Related papers  (2023-05-23T02:14:11Z)
• MD-CSDNetwork: Multi-Domain Cross Stitched Network for Deepfake Detection [80.83725644958633]
  Current deepfake generation methods leave discriminative artifacts in the frequency spectrum of fake images and videos. We present a novel approach, termed as MD-CSDNetwork, for combining the features in the spatial and frequency domains to mine a shared discriminative representation.
  arXiv  Detail & Related papers  (2021-09-15T14:11:53Z)
• VisGraphNet: a complex network interpretation of convolutional neural features [6.50413414010073]
  We propose and investigate the use of visibility graphs to model the feature map of a neural network. The work is motivated by an alternative viewpoint provided by these graphs over the original data.
  arXiv  Detail & Related papers  (2021-08-27T20:21:04Z)
• Structured Landmark Detection via Topology-Adapting Deep Graph Learning [75.20602712947016]
  We present a new topology-adapting deep graph learning approach for accurate anatomical facial and medical landmark detection. The proposed method constructs graph signals leveraging both local image features and global shape features. Experiments are conducted on three public facial image datasets (WFLW, 300W, and COFW-68) as well as three real-world X-ray medical datasets (Cephalometric (public), Hand and Pelvis)
  arXiv  Detail & Related papers  (2020-04-17T11:55:03Z)
• Joint Deep Learning of Facial Expression Synthesis and Recognition [97.19528464266824]
  We propose a novel joint deep learning of facial expression synthesis and recognition method for effective FER. The proposed method involves a two-stage learning procedure. Firstly, a facial expression synthesis generative adversarial network (FESGAN) is pre-trained to generate facial images with different facial expressions. In order to alleviate the problem of data bias between the real images and the synthetic images, we propose an intra-class loss with a novel real data-guided back-propagation (RDBP) algorithm.
  arXiv  Detail & Related papers  (2020-02-06T10:56:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.