A Multi-Task Comparator Framework for Kinship Verification
- URL: http://arxiv.org/abs/2006.01615v1
- Date: Tue, 2 Jun 2020 14:00:09 GMT
- Title: A Multi-Task Comparator Framework for Kinship Verification
- Authors: Stefan H\"ormann, Martin Knoche, Gerhard Rigoll
- Abstract summary: kinship verification often relies on cosine distances between face identification features.
Gender bias inherent in these features makes it hard to reliably predict whether two opposite-gender pairs are related.
We show that our framework is robust against this gender bias and achieves comparable results on two tracks of the RFIW Challenge 2020.
- Score: 5.908471365011942
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Approaches for kinship verification often rely on cosine distances between
face identification features. However, due to gender bias inherent in these
features, it is hard to reliably predict whether two opposite-gender pairs are
related. Instead of fine tuning the feature extractor network on kinship
verification, we propose a comparator network to cope with this bias. After
concatenating both features, cascaded local expert networks extract the
information most relevant for their corresponding kinship relation. We
demonstrate that our framework is robust against this gender bias and achieves
comparable results on two tracks of the RFIW Challenge 2020. Moreover, we show
how our framework can be further extended to handle partially known or unknown
kinship relations.
Related papers
- GSSF: Generalized Structural Sparse Function for Deep Cross-modal Metric Learning [51.677086019209554]
We propose a Generalized Structural Sparse to capture powerful relationships across modalities for pair-wise similarity learning.
The distance metric delicately encapsulates two formats of diagonal and block-diagonal terms.
Experiments on cross-modal and two extra uni-modal retrieval tasks have validated its superiority and flexibility.
arXiv Detail & Related papers (2024-10-20T03:45:50Z) - Multi-attention Associate Prediction Network for Visual Tracking [3.9628431811908533]
classification-regression prediction networks have realized impressive success in several modern deep trackers.
There is an inherent difference between classification and regression tasks, so they have diverse even opposite demands for feature matching.
We propose a multi-attention associate prediction network (MAPNet) to tackle the above problems.
arXiv Detail & Related papers (2024-03-25T03:18:58Z) - Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondence [51.54175067684008]
This paper introduces a Transformer-based integrative feature and cost aggregation network designed for dense matching tasks.
We first show that feature aggregation and cost aggregation exhibit distinct characteristics and reveal the potential for substantial benefits stemming from the judicious use of both aggregation processes.
Our framework is evaluated on standard benchmarks for semantic matching, and also applied to geometric matching, where we show that our approach achieves significant improvements compared to existing methods.
arXiv Detail & Related papers (2024-03-17T07:02:55Z) - Local Consensus Enhanced Siamese Network with Reciprocal Loss for
Two-view Correspondence Learning [35.5851523517487]
Two-view correspondence learning usually establish an end-to-end network to jointly predict correspondence reliability and relative pose.
We propose a Local Feature Consensus (LFC) plugin block to augment the features of existing models.
We extend existing models to a Siamese network with a reciprocal loss that exploits the supervision of mutual projection.
arXiv Detail & Related papers (2023-08-06T22:20:09Z) - Birds of a Feather Trust Together: Knowing When to Trust a Classifier
via Adaptive Neighborhood Aggregation [30.34223543030105]
We show how NeighborAgg can leverage the two essential information via an adaptive neighborhood aggregation.
We also extend our approach to the closely related task of mislabel detection and provide a theoretical coverage guarantee to bound the false negative.
arXiv Detail & Related papers (2022-11-29T18:43:15Z) - Fairness and robustness in anti-causal prediction [73.693135253335]
Robustness to distribution shift and fairness have independently emerged as two important desiderata required of machine learning models.
While these two desiderata seem related, the connection between them is often unclear in practice.
By taking this perspective, we draw explicit connections between a common fairness criterion - separation - and a common notion of robustness.
arXiv Detail & Related papers (2022-09-20T02:41:17Z) - Are Two Heads the Same as One? Identifying Disparate Treatment in Fair
Neural Networks [38.14455334700671]
We show that deep neural networks that satisfy demographic parity do so through a form of race or gender awareness.
We propose a simple two-stage solution for enforcing fairness.
arXiv Detail & Related papers (2022-04-09T10:07:02Z) - Learning to Decouple Relations: Few-Shot Relation Classification with
Entity-Guided Attention and Confusion-Aware Training [49.9995628166064]
We propose CTEG, a model equipped with two mechanisms to learn to decouple easily-confused relations.
On the one hand, an EGA mechanism is introduced to guide the attention to filter out information causing confusion.
On the other hand, a Confusion-Aware Training (CAT) method is proposed to explicitly learn to distinguish relations.
arXiv Detail & Related papers (2020-10-21T11:07:53Z) - Robust Person Re-Identification through Contextual Mutual Boosting [77.1976737965566]
We propose the Contextual Mutual Boosting Network (CMBN) to localize pedestrians.
It localizes pedestrians and recalibrates features by effectively exploiting contextual information and statistical inference.
Experiments on the benchmarks demonstrate the superiority of the architecture compared the state-of-the-art.
arXiv Detail & Related papers (2020-09-16T06:33:35Z) - Deep Fusion Siamese Network for Automatic Kinship Verification [20.360475286657877]
We propose a deep siamese network to quantify the relative similarity between two individuals.
Two deep siamese networks are integrated into a deep triplet network for tri-subject (i.e., father, mother and child) kinship verification.
arXiv Detail & Related papers (2020-05-30T01:43:59Z) - Cascaded Human-Object Interaction Recognition [175.60439054047043]
We introduce a cascade architecture for a multi-stage, coarse-to-fine HOI understanding.
At each stage, an instance localization network progressively refines HOI proposals and feeds them into an interaction recognition network.
With our carefully-designed human-centric relation features, these two modules work collaboratively towards effective interaction understanding.
arXiv Detail & Related papers (2020-03-09T17:05:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.