Gender Bias in English-to-Greek Machine Translation

• URL: http://arxiv.org/abs/2506.09558v1
• Date: Wed, 11 Jun 2025 09:44:12 GMT
• Title: Gender Bias in English-to-Greek Machine Translation
• Authors: Eleni Gkovedarou, Joke Daems, Luna De Bruyne,
• Abstract summary: We find persistent gender bias in translations by both Google Translate and DeepL.<n>GPT-4o shows promise, generating appropriate gendered and neutral alternatives for most ambiguous cases.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: As the demand for inclusive language increases, concern has grown over the susceptibility of machine translation (MT) systems to reinforce gender stereotypes. This study investigates gender bias in two commercial MT systems, Google Translate and DeepL, focusing on the understudied English-to-Greek language pair. We address three aspects of gender bias: i) male bias, ii) occupational stereotyping, and iii) errors in anti-stereotypical translations. Additionally, we explore the potential of prompted GPT-4o as a bias mitigation tool that provides both gender-explicit and gender-neutral alternatives when necessary. To achieve this, we introduce GendEL, a manually crafted bilingual dataset of 240 gender-ambiguous and unambiguous sentences that feature stereotypical occupational nouns and adjectives. We find persistent gender bias in translations by both MT systems; while they perform well in cases where gender is explicitly defined, with DeepL outperforming both Google Translate and GPT-4o in feminine gender-unambiguous sentences, they are far from producing gender-inclusive or neutral translations when the gender is unspecified. GPT-4o shows promise, generating appropriate gendered and neutral alternatives for most ambiguous cases, though residual biases remain evident.

Related papers

• Gender-Neutral Machine Translation Strategies in Practice [13.511723323294339]
  Gender-inclusive machine translation (MT) should preserve gender ambiguity in the source to avoid misgendering and representational harms.<n>Here we assess the sensitivity of 21 MT systems to the need for gender neutrality in response to gender ambiguity in three translation directions of varying difficulty.
  arXiv  Detail & Related papers  (2025-06-18T17:57:39Z)
• EuroGEST: Investigating gender stereotypes in multilingual language models [53.88459905621724]
  Large language models increasingly support multiple languages, yet most benchmarks for gender bias remain English-centric.<n>We introduce EuroGEST, a dataset designed to measure gender-stereotypical reasoning in LLMs across English and 29 European languages.
  arXiv  Detail & Related papers  (2025-06-04T11:58:18Z)
• Translate With Care: Addressing Gender Bias, Neutrality, and Reasoning in Large Language Model Translations [6.066322919105025]
  We introduce the Translate-with-Care dataset, comprising 3,950 challenging scenarios across six low- to mid-resource languages.<n>Our analysis reveals a universal struggle in translating genderless content, resulting in gender stereotyping and reasoning errors.<n>Google Translate and GPT-4 showed particularly strong bias, favoring male pronouns 4-6 times more than feminine ones.
  arXiv  Detail & Related papers  (2025-05-31T23:27:07Z)
• Beyond Binary Gender: Evaluating Gender-Inclusive Machine Translation with Ambiguous Attitude Words [85.48043537327258]
  Existing machine translation gender bias evaluations are primarily focused on male and female genders. This study presents a benchmark AmbGIMT (Gender-Inclusive Machine Translation with Ambiguous attitude words) We propose a novel process to evaluate gender bias based on the Emotional Attitude Score (EAS), which is used to quantify ambiguous attitude words.
  arXiv  Detail & Related papers  (2024-07-23T08:13:51Z)
• Probing Explicit and Implicit Gender Bias through LLM Conditional Text Generation [64.79319733514266]
  Large Language Models (LLMs) can generate biased and toxic responses. We propose a conditional text generation mechanism without the need for predefined gender phrases and stereotypes.
  arXiv  Detail & Related papers  (2023-11-01T05:31:46Z)
• VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution [80.57383975987676]
  VisoGender is a novel dataset for benchmarking gender bias in vision-language models. We focus on occupation-related biases within a hegemonic system of binary gender, inspired by Winograd and Winogender schemas. We benchmark several state-of-the-art vision-language models and find that they demonstrate bias in resolving binary gender in complex scenes.
  arXiv  Detail & Related papers  (2023-06-21T17:59:51Z)
• Gender, names and other mysteries: Towards the ambiguous for gender-inclusive translation [7.322734499960981]
  This paper explores the case where the source sentence lacks explicit gender markers, but the target sentence contains them due to richer grammatical gender. We find that many name-gender co-occurrences in MT data are not resolvable with 'unambiguous gender' in the source language. We discuss potential steps toward gender-inclusive translation which accepts the ambiguity in both gender and translation.
  arXiv  Detail & Related papers  (2023-06-07T16:21:59Z)
• Towards Understanding Gender-Seniority Compound Bias in Natural Language Generation [64.65911758042914]
  We investigate how seniority impacts the degree of gender bias exhibited in pretrained neural generation models. Our results show that GPT-2 amplifies bias by considering women as junior and men as senior more often than the ground truth in both domains. These results suggest that NLP applications built using GPT-2 may harm women in professional capacities.
  arXiv  Detail & Related papers  (2022-05-19T20:05:02Z)
• Extending Challenge Sets to Uncover Gender Bias in Machine Translation: Impact of Stereotypical Verbs and Adjectives [0.45687771576879593]
  State-of-the-art machine translation (MT) systems are trained on large corpora of text, mostly generated by humans. Recent research showed that MT systems are biased towards stereotypical translation of occupations. In this paper we present an extension of this challenge set, called WiBeMT, with gender-biased adjectives and adds sentences with gender-biased verbs.
  arXiv  Detail & Related papers  (2021-07-24T11:22:10Z)
• Neural Machine Translation Doesn't Translate Gender Coreference Right Unless You Make It [18.148675498274866]
  We propose schemes for incorporating explicit word-level gender inflection tags into Neural Machine Translation. We find that simple existing approaches can over-generalize a gender-feature to multiple entities in a sentence. We also propose an extension to assess translations of gender-neutral entities from English given a corresponding linguistic convention.
  arXiv  Detail & Related papers  (2020-10-11T20:05:42Z)
• Multi-Dimensional Gender Bias Classification [67.65551687580552]
  Machine learning models can inadvertently learn socially undesirable patterns when training on gender biased text. We propose a general framework that decomposes gender bias in text along several pragmatic and semantic dimensions. Using this fine-grained framework, we automatically annotate eight large scale datasets with gender information.
  arXiv  Detail & Related papers  (2020-05-01T21:23:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.