Deep Fusion Siamese Network for Automatic Kinship Verification

• URL: http://arxiv.org/abs/2006.00143v2
• Date: Sun, 7 Jun 2020 12:19:00 GMT
• Title: Deep Fusion Siamese Network for Automatic Kinship Verification
• Authors: Jun Yu, Mengyan Li, Xinlong Hao and Guochen Xie
• Abstract summary: We propose a deep siamese network to quantify the relative similarity between two individuals. Two deep siamese networks are integrated into a deep triplet network for tri-subject (i.e., father, mother and child) kinship verification.
• Score: 20.360475286657877
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automatic kinship verification aims to determine whether some individuals belong to the same family. It is of great research significance to help missing persons reunite with their families. In this work, the challenging problem is progressively addressed in two respects. First, we propose a deep siamese network to quantify the relative similarity between two individuals. When given two input face images, the deep siamese network extracts the features from them and fuses these features by combining and concatenating. Then, the fused features are fed into a fully-connected network to obtain the similarity score between two faces, which is used to verify the kinship. To improve the performance, a jury system is also employed for multi-model fusion. Second, two deep siamese networks are integrated into a deep triplet network for tri-subject (i.e., father, mother and child) kinship verification, which is intended to decide whether a child is related to a pair of parents or not. Specifically, the obtained similarity scores of father-child and mother-child are weighted to generate the parent-child similarity score for kinship verification. Recognizing Families In the Wild (RFIW) is a challenging kinship recognition task with multiple tracks, which is based on Families in the Wild (FIW), a large-scale and comprehensive image database for automatic kinship recognition. The Kinship Verification (track I) and Tri-Subject Verification (track II) are supported during the ongoing RFIW2020 Challenge. Our team (ustc-nelslip) ranked 1st in track II, and 3rd in track I. The code is available at https://github.com/gniknoil/FG2020-kinship.

Related papers

• A Powerful Face Preprocessing For Robust Kinship Verification based Tensor Analyses [0.6829272097221595]
  We introduce a system to check relatedness that starts with a pair of face images of a child and a parent, after which it is revealed whether two people are related or not. Our findings show that, in comparison to other strategies currently in use, our system is robust.
  arXiv  Detail & Related papers  (2023-12-18T15:33:26Z)
• Beyond Sharing Weights in Decoupling Feature Learning Network for UAV RGB-Infrared Vehicle Re-Identification [7.907187589000295]
  Cross-modality vehicle Re-ID based on unmanned aerial vehicle (UAV) is gaining more attention in video surveillance and public security. We pioneer a cross-modality vehicle Re-ID benchmark named UAV Cross-Modality Vehicle Re-ID (UCM-VeID), containing 753 identities with 16015 RGB and 13913 infrared images. To meet cross-modality discrepancy and orientation discrepancy challenges, we present a hybrid weights decoupling network (HWDNet) to learn the shared discriminative orientation-invariant features.
  arXiv  Detail & Related papers  (2023-10-12T04:12:43Z)
• Object Segmentation by Mining Cross-Modal Semantics [68.88086621181628]
  We propose a novel approach by mining the Cross-Modal Semantics to guide the fusion and decoding of multimodal features. Specifically, we propose a novel network, termed XMSNet, consisting of (1) all-round attentive fusion (AF), (2) coarse-to-fine decoder (CFD), and (3) cross-layer self-supervision.
  arXiv  Detail & Related papers  (2023-05-17T14:30:11Z)
• Kinship Verification Based on Cross-Generation Feature Interaction Learning [53.62256887837659]
  Kinship verification from facial images has been recognized as an emerging yet challenging technique in computer vision applications. We propose a novel cross-generation feature interaction learning (CFIL) framework for robust kinship verification.
  arXiv  Detail & Related papers  (2021-09-07T01:50:50Z)
• Exploring Visual Context for Weakly Supervised Person Search [155.46727990750227]
  Person search has recently emerged as a challenging task that jointly addresses pedestrian detection and person re-identification. Existing approaches follow a fully supervised setting where both bounding box and identity annotations are available. This paper inventively considers weakly supervised person search with only bounding box annotations.
  arXiv  Detail & Related papers  (2021-06-19T14:47:13Z)
• DeepI2P: Image-to-Point Cloud Registration via Deep Classification [71.3121124994105]
  DeepI2P is a novel approach for cross-modality registration between an image and a point cloud. Our method estimates the relative rigid transformation between the coordinate frames of the camera and Lidar. We circumvent the difficulty by converting the registration problem into a classification and inverse camera projection optimization problem.
  arXiv  Detail & Related papers  (2021-04-08T04:27:32Z)
• Decoupled and Memory-Reinforced Networks: Towards Effective Feature Learning for One-Step Person Search [65.51181219410763]
  One-step methods have been developed to handle pedestrian detection and identification sub-tasks using a single network. There are two major challenges in the current one-step approaches. We propose a decoupled and memory-reinforced network (DMRNet) to overcome these problems.
  arXiv  Detail & Related papers  (2021-02-22T06:19:45Z)
• A Multi-Task Comparator Framework for Kinship Verification [5.908471365011942]
  kinship verification often relies on cosine distances between face identification features. Gender bias inherent in these features makes it hard to reliably predict whether two opposite-gender pairs are related. We show that our framework is robust against this gender bias and achieves comparable results on two tracks of the RFIW Challenge 2020.
  arXiv  Detail & Related papers  (2020-06-02T14:00:09Z)
• Retrieval of Family Members Using Siamese Neural Network [20.360475286657877]
  Retrieval of family members in the wild aims at finding family members of the given subject in the dataset. We propose our solution with deep Siamese neural network. Our solution can be divided into two parts: similarity and ranking.
  arXiv  Detail & Related papers  (2020-05-30T04:32:16Z)
• Recognizing Families through Images with Pretrained Encoder [0.1909808926064466]
  Kinship verification and kinship retrieval are emerging tasks in computer vision. We employ 3 methods, FaceNet, Siamese VGG-Face, and a combination of FaceNet and VGG-Face models as feature extractors.
  arXiv  Detail & Related papers  (2020-05-24T17:59:19Z)
• Cascaded Human-Object Interaction Recognition [175.60439054047043]
  We introduce a cascade architecture for a multi-stage, coarse-to-fine HOI understanding. At each stage, an instance localization network progressively refines HOI proposals and feeds them into an interaction recognition network. With our carefully-designed human-centric relation features, these two modules work collaboratively towards effective interaction understanding.
  arXiv  Detail & Related papers  (2020-03-09T17:05:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.