From A Glance to "Gotcha": Interactive Facial Image Retrieval with Progressive Relevance Feedback

• URL: http://arxiv.org/abs/2007.15683v1
• Date: Thu, 30 Jul 2020 18:46:25 GMT
• Title: From A Glance to "Gotcha": Interactive Facial Image Retrieval with Progressive Relevance Feedback
• Authors: Xinru Yang, Haozhi Qi, Mingyang Li, Alexander Hauptmann
• Abstract summary: We propose an end-to-end framework to retrieve facial images with relevance feedback progressively provided by the witness. With no need of any extra annotations, our model can be applied at the cost of a little response effort.
• Score: 72.29919762941029
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Facial image retrieval plays a significant role in forensic investigations where an untrained witness tries to identify a suspect from a massive pool of images. However, due to the difficulties in describing human facial appearances verbally and directly, people naturally tend to depict by referring to well-known existing images and comparing specific areas of faces with them and it is also challenging to provide complete comparison at each time. Therefore, we propose an end-to-end framework to retrieve facial images with relevance feedback progressively provided by the witness, enabling an exploitation of history information during multiple rounds and an interactive and iterative approach to retrieving the mental image. With no need of any extra annotations, our model can be applied at the cost of a little response effort. We experiment on \texttt{CelebA} and evaluate the performance by ranking percentile and achieve 99\% under the best setting. Since this topic remains little explored to the best of our knowledge, we hope our work can serve as a stepping stone for further research.

Related papers

• A Comprehensive Review of Few-shot Action Recognition [64.47305887411275]
  Few-shot action recognition aims to address the high cost and impracticality of manually labeling complex and variable video data. It requires accurately classifying human actions in videos using only a few labeled examples per class.
  arXiv  Detail & Related papers  (2024-07-20T03:53:32Z)
• Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Method [77.65459419417533]
  We put face forgery in a semantic context and define that computational methods that alter semantic face attributes are sources of face forgery. We construct a large face forgery image dataset, where each image is associated with a set of labels organized in a hierarchical graph. We propose a semantics-oriented face forgery detection method that captures label relations and prioritizes the primary task.
  arXiv  Detail & Related papers  (2024-05-14T10:24:19Z)
• FACE-AUDITOR: Data Auditing in Facial Recognition Systems [24.082527732931677]
  Few-shot-based facial recognition systems have gained increasing attention due to their scalability and ability to work with a few face images. To prevent the face images from being misused, one straightforward approach is to modify the raw face images before sharing them. We propose a complete toolkit FACE-AUDITOR that can query the few-shot-based facial recognition model and determine whether any of a user's face images is used in training the model.
  arXiv  Detail & Related papers  (2023-04-05T23:03:54Z)
• A survey on facial image deblurring [3.6775758132528877]
  When the facial image is blurred, it has a great impact on high-level vision tasks such as face recognition. This paper surveys and summarizes recently published methods for facial image deblurring, most of which are based on deep learning. We show the performance of classical methods on datasets and metrics and give a brief discussion on the differences of model-based and learning-based methods.
  arXiv  Detail & Related papers  (2023-02-10T02:24:56Z)
• Specialized Re-Ranking: A Novel Retrieval-Verification Framework for Cloth Changing Person Re-Identification [36.4001616893874]
  Re-ID can work under more complicated scenarios with higher security than normal Re-ID and biometric techniques. We propose a novel retrieval-verification framework to handle similar images.
  arXiv  Detail & Related papers  (2022-10-07T14:47:28Z)
• FaIRCoP: Facial Image Retrieval using Contrastive Personalization [43.293482565385055]
  Retrieving facial images from attributes plays a vital role in various systems such as face recognition and suspect identification. Existing methods do so by comparing specific characteristics from the user's mental image against the suggested images. We propose a method that uses the user's feedback to label images as either similar or dissimilar to the target image.
  arXiv  Detail & Related papers  (2022-05-28T09:52:09Z)
• Where Does the Performance Improvement Come From? - A Reproducibility Concern about Image-Text Retrieval [85.03655458677295]
  Image-text retrieval has gradually become a major research direction in the field of information retrieval. We first examine the related concerns and why the focus is on image-text retrieval tasks. We analyze various aspects of the reproduction of pretrained and nonpretrained retrieval models.
  arXiv  Detail & Related papers  (2022-03-08T05:01:43Z)
• SynFace: Face Recognition with Synthetic Data [83.15838126703719]
  We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap. We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
  arXiv  Detail & Related papers  (2021-08-18T03:41:54Z)
• Enhancing Social Relation Inference with Concise Interaction Graph and Discriminative Scene Representation [56.25878966006678]
  We propose an approach of textbfPRactical textbfInference in textbfSocial rtextbfElation (PRISE) It concisely learns interactive features of persons and discriminative features of holistic scenes. PRISE achieves 6.8$%$ improvement for domain classification in PIPA dataset.
  arXiv  Detail & Related papers  (2021-07-30T04:20:13Z)
• Part2Whole: Iteratively Enrich Detail for Cross-Modal Retrieval with Partial Query [25.398090300086302]
  We propose an interactive retrieval framework called Part2Whole to tackle this problem. An Interactive Retrieval Agent is trained to build an optimal policy to refine the initial query. We present a weakly-supervised reinforcement learning method that needs no human-annotated data other than the text-image dataset.
  arXiv  Detail & Related papers  (2021-03-02T11:27:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.