A Linked Aggregate Code for Processing Faces (Revised Version)

• URL: http://arxiv.org/abs/2009.08281v1
• Date: Thu, 17 Sep 2020 13:29:25 GMT
• Title: A Linked Aggregate Code for Processing Faces (Revised Version)
• Abstract summary: A model of face representation is compared to experimental data on the perception of facial similarity. The results suggest that the LAC based similarity measure may offer a fertile starting point for further modelling studies of face representation in higher visual areas.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A model of face representation, inspired by the biology of the visual system, is compared to experimental data on the perception of facial similarity. The face representation model uses aggregate primary visual cortex (V1) cell responses topographically linked to a grid covering the face, allowing comparison of shape and texture at corresponding points in two facial images. When a set of relatively similar faces was used as stimuli, this Linked Aggregate Code (LAC) predicted human performance in similarity judgment experiments. When faces of perceivable categories were used, dimensions such as apparent sex and race emerged from the LAC model without training. The dimensional structure of the LAC similarity measure for the mixed category task displayed some psychologically plausible features but also highlighted differences between the model and the human similarity judgements. The human judgements exhibited a racial perceptual bias that was not shared by the LAC model. The results suggest that the LAC based similarity measure may offer a fertile starting point for further modelling studies of face representation in higher visual areas, including studies of the development of biases in face perception.

Related papers

• AlignFace: Human-Aligned Face Similarity Metric with Interpretable Concept Relations [13.228617286387887]
  We introduce the FACETS dataset and propose AlignFace, an interpretable, human-aligned, face similarity metric.<n>Experiments found AlignFace significantly improves alignment with human subpopulation perceptions compared to baseline metrics.
  arXiv  Detail & Related papers  (2026-08-14T09:36:28Z)
• Human face perception reflects inverse-generative and naturalistic discriminative objectives [2.4126189670630733]
  Deep neural networks offer mechanistic hypotheses for human face perception.<n>We compared six neural network models sharing an architecture but trained on distinct tasks.<n>We tested model predictions against face-dissimilarity judgments from 864 human participants.
  arXiv  Detail & Related papers  (2026-05-12T18:06:57Z)
• Relational Visual Similarity [75.39827145344957]
  relational similarity is arguable by cognitive scientist to be what distinguishes humans from other species.<n>All widely used visual similarity metrics today focus solely on perceptual attribute similarity.<n>Our study shows that while relational similarity has a lot of real-world applications, existing image similarity models fail to capture it.
  arXiv  Detail & Related papers  (2025-12-08T18:59:56Z)
• COLIBRI Fuzzy Model: Color Linguistic-Based Representation and Interpretation [0.0]
  This paper introduces the Human Perception-Based Fuzzy Color Model, COLIBRI, to bridge the gap between computational color representations and human visual perception.<n>The proposed model uses fuzzy sets and logic to create a framework for color categorization.<n>Our findings are significant for fields such as design, artificial intelligence, marketing, and human-computer interaction.
  arXiv  Detail & Related papers  (2025-07-15T17:01:45Z)
• Evaluating Multiview Object Consistency in Humans and Image Models [68.36073530804296]
  We leverage an experimental design from the cognitive sciences which requires zero-shot visual inferences about object shape. We collect 35K trials of behavioral data from over 500 participants. We then evaluate the performance of common vision models.
  arXiv  Detail & Related papers  (2024-09-09T17:59:13Z)
• Unveiling the Human-like Similarities of Automatic Facial Expression Recognition: An Empirical Exploration through Explainable AI [0.562479170374811]
  This study aims to explore the similarity between deep neural networks and human perception by comparing twelve different networks. We employ an innovative global explainable AI method to generate heatmaps, revealing crucial facial regions for the twelve networks trained on six facial expressions. Findings suggest limited alignment between human and AI facial expression recognition, with network architectures influencing the similarity.
  arXiv  Detail & Related papers  (2024-01-22T10:52:02Z)
• Distinguishing representational geometries with controversial stimuli: Bayesian experimental design and its application to face dissimilarity judgments [0.5735035463793008]
  We show that a neural network trained to invert a 3D-face-model graphics is more human-aligned than the same architecture trained on identification, classification, or autoencoding. Our results indicate that a neural network trained to invert a 3D-face-model graphics is more human-aligned than the same architecture trained on identification, classification, or autoencoding.
  arXiv  Detail & Related papers  (2022-11-28T04:17:35Z)
• Modeling Category-Selective Cortical Regions with Topographic Variational Autoencoders [72.15087604017441]
  Category-selectivity describes the observation that certain spatially localized areas of the cerebral cortex tend to respond robustly and selectively to stimuli from specific limited categories. We leverage the newly introduced Topographic Variational Autoencoder to model of the emergence of such localized category-selectivity in an unsupervised manner. We show preliminary results suggesting that our model yields a nested spatial hierarchy of increasingly abstract categories, analogous to observations from the human ventral temporal cortex.
  arXiv  Detail & Related papers  (2021-10-25T11:37:41Z)
• Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Models [86.79402670904338]
  We evaluate the performance of four state-of-the-art deep face recognition models in the presence of image distortions. We have observed that image distortions have a relationship with the performance gap of the model across different subgroups.
  arXiv  Detail & Related papers  (2021-08-14T16:49:05Z)
• Transforming Neural Network Visual Representations to Predict Human Judgments of Similarity [12.5719993304358]
  We investigate how to bring machine visual representations into better alignment with human representations. We find that with appropriate linear transformations of deep embeddings, we can improve prediction of human binary choice.
  arXiv  Detail & Related papers  (2020-10-13T16:09:47Z)
• Action similarity judgment based on kinematic primitives [48.99831733355487]
  We investigate to which extent a computational model based on kinematics can determine action similarity. The chosen model has its roots in developmental robotics and performs action classification based on learned kinematic primitives. The results show that both the model and human performance are highly accurate in an action similarity task based on kinematic-level features.
  arXiv  Detail & Related papers  (2020-08-30T13:58:47Z)
• Few-shot Visual Reasoning with Meta-analogical Contrastive Learning [141.2562447971]
  We propose to solve a few-shot (or low-shot) visual reasoning problem, by resorting to analogical reasoning. We extract structural relationships between elements in both domains, and enforce them to be as similar as possible with analogical learning. We validate our method on RAVEN dataset, on which it outperforms state-of-the-art method, with larger gains when the training data is scarce.
  arXiv  Detail & Related papers  (2020-07-23T14:00:34Z)
• InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs [73.27299786083424]
  We propose a framework called InterFaceGAN to interpret the disentangled face representation learned by state-of-the-art GAN models. We first find that GANs learn various semantics in some linear subspaces of the latent space. We then conduct a detailed study on the correlation between different semantics and manage to better disentangle them via subspace projection.
  arXiv  Detail & Related papers  (2020-05-18T18:01:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.