On the Influence of Gender and Race in Romantic Relationship Prediction from Large Language Models

• URL: http://arxiv.org/abs/2410.03996v1
• Date: Sat, 5 Oct 2024 01:41:55 GMT
• Title: On the Influence of Gender and Race in Romantic Relationship Prediction from Large Language Models
• Authors: Abhilasha Sancheti, Haozhe An, Rachel Rudinger,
• Abstract summary: We study the presence of heteronormative biases and prejudice against interracial romantic relationships in large language models. We show that models are less likely to predict romantic relationships for (a) same-gender character pairs than different-gender pairs; and (b) intra/inter-racial character pairs involving Asian names as compared to Black, Hispanic, or White names.
• Score: 21.178861746240507
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We study the presence of heteronormative biases and prejudice against interracial romantic relationships in large language models by performing controlled name-replacement experiments for the task of relationship prediction. We show that models are less likely to predict romantic relationships for (a) same-gender character pairs than different-gender pairs; and (b) intra/inter-racial character pairs involving Asian names as compared to Black, Hispanic, or White names. We examine the contextualized embeddings of first names and find that gender for Asian names is less discernible than non-Asian names. We discuss the social implications of our findings, underlining the need to prioritize the development of inclusive and equitable technology.

Related papers

• Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts [15.676219253088211]
  We study gender equity within large language models (LLMs) through a decision-making lens. We explore nine relationship configurations through name pairs across three name lists (men, women, neutral)
  arXiv  Detail & Related papers  (2024-10-14T20:50:11Z)
• Uncovering Name-Based Biases in Large Language Models Through Simulated Trust Game [0.0]
  Gender and race inferred from an individual's name are a notable source of stereotypes and biases that subtly influence social interactions. We show that our approach can detect name-based biases in both base and instruction-tuned models.
  arXiv  Detail & Related papers  (2024-04-23T02:21:17Z)
• What's in a Name? Auditing Large Language Models for Race and Gender Bias [49.28899492966893]
  We employ an audit design to investigate biases in state-of-the-art large language models, including GPT-4. We find that the advice systematically disadvantages names that are commonly associated with racial minorities and women.
  arXiv  Detail & Related papers  (2024-02-21T18:25:25Z)
• The Causal Influence of Grammatical Gender on Distributional Semantics [87.8027818528463]
  How much meaning influences gender assignment across languages is an active area of research in linguistics and cognitive science. We offer a novel, causal graphical model that jointly represents the interactions between a noun's grammatical gender, its meaning, and adjective choice. When we control for the meaning of the noun, the relationship between grammatical gender and adjective choice is near zero and insignificant.
  arXiv  Detail & Related papers  (2023-11-30T13:58:13Z)
• Gendec: A Machine Learning-based Framework for Gender Detection from Japanese Names [0.0]
  This work presents a novel dataset for Japanese name gender detection comprising 64,139 full names in romaji, hiragana, and kanji forms, along with their biological genders. We propose Gendec, a framework for gender detection from Japanese names that leverages diverse approaches, including traditional machine learning techniques or cutting-edge transfer learning models.
  arXiv  Detail & Related papers  (2023-11-18T07:46:59Z)
• Will the Prince Get True Love's Kiss? On the Model Sensitivity to Gender Perturbation over Fairytale Texts [87.62403265382734]
  Recent studies show that traditional fairytales are rife with harmful gender biases. This work aims to assess learned biases of language models by evaluating their robustness against gender perturbations.
  arXiv  Detail & Related papers  (2023-10-16T22:25:09Z)
• Comparing Biases and the Impact of Multilingual Training across Multiple Languages [70.84047257764405]
  We present a bias analysis across Italian, Chinese, English, Hebrew, and Spanish on the downstream sentiment analysis task. We adapt existing sentiment bias templates in English to Italian, Chinese, Hebrew, and Spanish for four attributes: race, religion, nationality, and gender. Our results reveal similarities in bias expression such as favoritism of groups that are dominant in each language's culture.
  arXiv  Detail & Related papers  (2023-05-18T18:15:07Z)
• For the Underrepresented in Gender Bias Research: Chinese Name Gender Prediction with Heterogeneous Graph Attention Network [1.13608321568471]
  We design a Chinese Heterogeneous Graph Attention (CHGAT) model to capture the heterogeneity in component relationships and incorporate the pronunciations of characters. Our model largely surpasses current tools and also outperforms the state-of-the-art algorithm. We open-source a more balanced multi-character dataset from an official source together with our code, hoping to help future research promoting gender equality.
  arXiv  Detail & Related papers  (2023-02-01T13:08:50Z)
• Hi, my name is Martha: Using names to measure and mitigate bias in generative dialogue models [14.624075519580405]
  Being trained on real human conversations containing unbalanced gender and race/ethnicity references can lead to models that display learned biases. We show that several methods of tuning these dialogue models, specifically name scrambling, controlled generation, and unlikelihood training, are effective in reducing bias in conversation.
  arXiv  Detail & Related papers  (2021-09-07T19:20:24Z)
• Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models [104.41668491794974]
  We quantify the usage of adjectives and verbs generated by language models surrounding the names of politicians as a function of their gender. We find that while some words such as dead, and designated are associated with both male and female politicians, a few specific words such as beautiful and divorced are predominantly associated with female politicians.
  arXiv  Detail & Related papers  (2021-04-15T15:03:26Z)
• How True is GPT-2? An Empirical Analysis of Intersectional Occupational Biases [50.591267188664666]
  Downstream applications are at risk of inheriting biases contained in natural language models. We analyze the occupational biases of a popular generative language model, GPT-2. For a given job, GPT-2 reflects the societal skew of gender and ethnicity in the US, and in some cases, pulls the distribution towards gender parity.
  arXiv  Detail & Related papers  (2021-02-08T11:10:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.