Gender Bias in Instruction-Guided Speech Synthesis Models

• URL: http://arxiv.org/abs/2502.05649v1
• Date: Sat, 08 Feb 2025 17:38:24 GMT
• Title: Gender Bias in Instruction-Guided Speech Synthesis Models
• Authors: Chun-Yi Kuan, Hung-yi Lee,
• Abstract summary: This study investigates the potential gender bias in how models interpret occupation-related prompts. We explore whether these models exhibit tendencies to amplify gender stereotypes when interpreting such prompts. Our experimental results reveal the model's tendency to exhibit gender bias for certain occupations.
• Score: 55.2480439325792
• License:
• Abstract: Recent advancements in controllable expressive speech synthesis, especially in text-to-speech (TTS) models, have allowed for the generation of speech with specific styles guided by textual descriptions, known as style prompts. While this development enhances the flexibility and naturalness of synthesized speech, there remains a significant gap in understanding how these models handle vague or abstract style prompts. This study investigates the potential gender bias in how models interpret occupation-related prompts, specifically examining their responses to instructions like "Act like a nurse". We explore whether these models exhibit tendencies to amplify gender stereotypes when interpreting such prompts. Our experimental results reveal the model's tendency to exhibit gender bias for certain occupations. Moreover, models of different sizes show varying degrees of this bias across these occupations.

Related papers

• The in-context inductive biases of vision-language models differ across modalities [15.501577963067856]
  We study how generalizations vary by the modality in which stimuli are presented, and the way the stimuli are described in text. We find that the models generally show some bias towards generalizing according to shape over color. These results help to reveal how vision-language models represent different types of inputs in context.
  arXiv  Detail & Related papers  (2025-02-03T17:11:03Z)
• Gender Bias in Text-to-Video Generation Models: A case study of Sora [63.064204206220936]
  This study investigates the presence of gender bias in OpenAI's Sora, a text-to-video generation model. We uncover significant evidence of bias by analyzing the generated videos from a diverse set of gender-neutral and stereotypical prompts.
  arXiv  Detail & Related papers  (2024-12-30T18:08:13Z)
• Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models [50.40276881893513]
  This study introduces Spoken Stereoset, a dataset specifically designed to evaluate social biases in Speech Large Language Models (SLLMs) By examining how different models respond to speech from diverse demographic groups, we aim to identify these biases. The findings indicate that while most models show minimal bias, some still exhibit slightly stereotypical or anti-stereotypical tendencies.
  arXiv  Detail & Related papers  (2024-08-14T16:55:06Z)
• Bias in Text Embedding Models [0.0]
  This paper examines the degree to which a selection of popular text embedding models are biased, particularly along gendered dimensions. The analysis reveals that text embedding models are prone to gendered biases but in varying ways.
  arXiv  Detail & Related papers  (2024-06-17T22:58:36Z)
• UnMASKed: Quantifying Gender Biases in Masked Language Models through Linguistically Informed Job Market Prompts [0.0]
  This research delves into the inherent biases present in masked language models (MLMs) This study evaluated six prominent models: BERT, RoBERTa, DistilBERT, BERT-multilingual, XLM-RoBERTa, and DistilBERT-multilingual. The analysis reveals stereotypical gender alignment of all models, with multilingual variants showing comparatively reduced biases.
  arXiv  Detail & Related papers  (2024-01-28T23:00:40Z)
• Will the Prince Get True Love's Kiss? On the Model Sensitivity to Gender Perturbation over Fairytale Texts [87.62403265382734]
  Recent studies show that traditional fairytales are rife with harmful gender biases. This work aims to assess learned biases of language models by evaluating their robustness against gender perturbations.
  arXiv  Detail & Related papers  (2023-10-16T22:25:09Z)
• Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale [61.555788332182395]
  We investigate the potential for machine learning models to amplify dangerous and complex stereotypes. We find a broad range of ordinary prompts produce stereotypes, including prompts simply mentioning traits, descriptors, occupations, or objects.
  arXiv  Detail & Related papers  (2022-11-07T18:31:07Z)
• Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models [17.90351661475405]
  This work extends text-based bias analysis methods to investigate multimodal language models. We demonstrate that VL-BERT exhibits gender biases, often preferring to reinforce a stereotype over faithfully describing the visual scene.
  arXiv  Detail & Related papers  (2021-04-18T00:02:32Z)
• Multi-Dimensional Gender Bias Classification [67.65551687580552]
  Machine learning models can inadvertently learn socially undesirable patterns when training on gender biased text. We propose a general framework that decomposes gender bias in text along several pragmatic and semantic dimensions. Using this fine-grained framework, we automatically annotate eight large scale datasets with gender information.
  arXiv  Detail & Related papers  (2020-05-01T21:23:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.