Learning Preference-Based Similarities from Face Images using Siamese Multi-Task CNNs

• URL: http://arxiv.org/abs/2001.09371v1
• Date: Sat, 25 Jan 2020 23:08:12 GMT
• Title: Learning Preference-Based Similarities from Face Images using Siamese Multi-Task CNNs
• Authors: Nils Gessert and Alexander Schlaefer
• Abstract summary: Key challenge for online dating platforms is to determine suitable matches for their users. Deep learning approaches have shown that a variety of properties can be predicted from human faces to some degree. We investigate the feasibility of bridging image-based matching and matching with personal interests, preferences, and attitude.
• Score: 78.24964622317633
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Online dating has become a common occurrence over the last few decades. A key challenge for online dating platforms is to determine suitable matches for their users. A lot of dating services rely on self-reported user traits and preferences for matching. At the same time, some services largely rely on user images and thus initial visual preference. Especially for the latter approach, previous research has attempted to capture users' visual preferences for automatic match recommendation. These approaches are mostly based on the assumption that physical attraction is the key factor for relationship formation and personal preferences, interests, and attitude are largely neglected. Deep learning approaches have shown that a variety of properties can be predicted from human faces to some degree, including age, health and even personality traits. Therefore, we investigate the feasibility of bridging image-based matching and matching with personal interests, preferences, and attitude. We approach the problem in a supervised manner by predicting similarity scores between two users based on images of their faces only. The ground-truth for the similarity matching scores is determined by a test that aims to capture users' preferences, interests, and attitude that are relevant for forming romantic relationships. The images are processed by a Siamese Multi-Task deep learning architecture. We find a statistically significant correlation between predicted and target similarity scores. Thus, our results indicate that learning similarities in terms of interests, preferences, and attitude from face images appears to be feasible to some degree.

Related papers

• Modeling User Preferences via Brain-Computer Interfacing [54.3727087164445]
  We use Brain-Computer Interfacing technology to infer users' preferences, their attentional correlates towards visual content, and their associations with affective experience. We link these to relevant applications, such as information retrieval, personalized steering of generative models, and crowdsourcing population estimates of affective experiences.
  arXiv  Detail & Related papers  (2024-05-15T20:41:46Z)
• End-to-End Context-Aided Unicity Matching for Person Re-identification [100.02321122258638]
  We propose an end-to-end person unicity matching architecture for learning and refining the person matching relations. We use the samples' global context relationship to refine the soft matching results and reach the matching unicity through bipartite graph matching. Given full consideration to real-world person re-identification applications, we achieve the unicity matching in both one-shot and multi-shot settings.
  arXiv  Detail & Related papers  (2022-10-20T07:33:57Z)
• Learning an Adaptation Function to Assess Image Visual Similarities [0.0]
  We focus here on the specific task of learning visual image similarities when analogy matters. We propose to compare different supervised, semi-supervised and self-supervised networks, pre-trained on distinct scales and contents datasets. Our experiments conducted on the Totally Looks Like image dataset highlight the interest of our method, by increasing the retrieval scores of the best model @1 by 2.25x.
  arXiv  Detail & Related papers  (2022-06-03T07:15:00Z)
• PoWareMatch: a Quality-aware Deep Learning Approach to Improve Human Schema Matching [20.110234122423172]
  We examine a novel angle on the behavior of humans as matchers, studying match creation as a process. We design PoWareMatch that makes use of a deep learning mechanism to calibrate and filter human matching decisions. PoWareMatch predicts well the benefit of extending the match with an additional correspondence and generates high quality matches.
  arXiv  Detail & Related papers  (2021-09-15T14:24:56Z)
• Enhancing Social Relation Inference with Concise Interaction Graph and Discriminative Scene Representation [56.25878966006678]
  We propose an approach of textbfPRactical textbfInference in textbfSocial rtextbfElation (PRISE) It concisely learns interactive features of persons and discriminative features of holistic scenes. PRISE achieves 6.8$%$ improvement for domain classification in PIPA dataset.
  arXiv  Detail & Related papers  (2021-07-30T04:20:13Z)
• Automatic Main Character Recognition for Photographic Studies [78.88882860340797]
  Main characters in images are the most important humans that catch the viewer's attention upon first look. Identifying the main character in images plays an important role in traditional photographic studies and media analysis. We propose a method for identifying the main characters using machine learning based human pose estimation.
  arXiv  Detail & Related papers  (2021-06-16T18:14:45Z)
• Rank-smoothed Pairwise Learning In Perceptual Quality Assessment [26.599014990168836]
  We show that regularizing pairwise empirical probabilities with aggregated rankwise probabilities leads to a more reliable training loss. We show that training a deep image quality assessment model with our rank-smoothed loss consistently improves the accuracy of predicting human preferences.
  arXiv  Detail & Related papers  (2020-11-21T23:33:14Z)
• Learning Attentive Pairwise Interaction for Fine-Grained Classification [53.66543841939087]
  We propose a simple but effective Attentive Pairwise Interaction Network (API-Net) for fine-grained classification. API-Net first learns a mutual feature vector to capture semantic differences in the input pair. It then compares this mutual vector with individual vectors to generate gates for each input image. We conduct extensive experiments on five popular benchmarks in fine-grained classification.
  arXiv  Detail & Related papers  (2020-02-24T12:17:56Z)
• PrivacyNet: Semi-Adversarial Networks for Multi-attribute Face Privacy [15.301150389512744]
  We develop a technique for soft biometric privacy to face images via an image methodology. The image perturbation is undertaken using a GAN-based Semi-Adversarial Network (SAN) PrivacyNet allows a person to choose attributes that have to be obfuscated in the input face images.
  arXiv  Detail & Related papers  (2020-01-02T18:53:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.