BAFIS: Dataset + Framework to assess occupational Bias and Human Preference in modern Text-to-image Models

• URL: http://arxiv.org/abs/2606.20241v1
• Date: Thu, 18 Jun 2026 13:52:37 GMT
• Title: BAFIS: Dataset + Framework to assess occupational Bias and Human Preference in modern Text-to-image Models
• Abstract summary: This work investigates the inherent biases and language-induced biases present in text-to-image models.<n>We present a comprehensive evaluation of five current text-to-image models, focusing on gender and ethnicity bias, image quality, and prompt alignment.<n>Our findings reveal systematic biases in text-to-image models, with established evaluation metrics in partial correlation with subjective user ratings.
• Score: 0.8538830579425146
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generative artificial intelligence has the potential to improve productivity and transform the production of creative content. However, existing research indicates that image generation models are significantly influenced by biases. This work investigates the inherent biases and language-induced biases present in text-to-image models within the context of occupation-related image generation, complementing established metrics with human preference feedback. We present a comprehensive evaluation of five current text-to-image models: Midjourney v6.1, Stable Diffusion 3 Medium, DALL-E 3, Playground v2.5, and FLUX.1-dev , focusing on gender and ethnicity bias, image quality, and prompt alignment. To facilitate this evaluation, we developed the "Battle-Arena for Fair Image Synthesis" (BAFIS), a platform designed to collect human feedback on bias in generated images. Furthermore, we created a dataset comprising 21,140 synthetic images generated using multilingual prompts, which serves as a basis for our analysis. We further place our results within a broader social context by comparing them to official statistics from the German Federal Employment Agency. Our findings reveal systematic biases in text-to-image models, with established evaluation metrics in partial correlation with subjective user ratings. Thus, our research emphasizes the need for including human preferences to develop fairer and more inclusive text-to-image models.

Related papers

• Exploring Bias in over 100 Text-to-Image Generative Models [49.60774626839712]
  We investigate bias trends in text-to-image generative models over time, focusing on the increasing availability of models through open platforms like Hugging Face.<n>We assess bias across three key dimensions: (i) distribution bias, (ii) generative hallucination, and (iii) generative miss-rate.<n>Our findings indicate that artistic and style-transferred models exhibit significant bias, whereas foundation models, benefiting from broader training distributions, are becoming progressively less biased.
  arXiv  Detail & Related papers  (2025-03-11T03:40:44Z)
• KITTEN: A Knowledge-Intensive Evaluation of Image Generation on Visual Entities [93.74881034001312]
  KITTEN is a benchmark for Knowledge-InTensive image generaTion on real-world ENtities.<n>We conduct a systematic study of the latest text-to-image models and retrieval-augmented models.<n>Analysis shows that even advanced text-to-image models fail to generate accurate visual details of entities.
  arXiv  Detail & Related papers  (2024-10-15T17:50:37Z)
• Finding the Subjective Truth: Collecting 2 Million Votes for Comprehensive Gen-AI Model Evaluation [0.0]
  Our study collected over 2 million annotations across 4,512 images, evaluating four prominent models on style preference, coherence, and text-to-image alignment. We show that our approach makes it feasible to comprehensively rank image generation models based on a vast pool of annotators.
  arXiv  Detail & Related papers  (2024-09-18T12:02:20Z)
• Gender Bias Evaluation in Text-to-image Generation: A Survey [25.702257177921048]
  We review recent work on gender bias evaluation in text-to-image generation. We focus on the evaluation of recent popular models such as Stable Diffusion and DALL-E 2.
  arXiv  Detail & Related papers  (2024-08-21T06:01:23Z)
• Analyzing Quality, Bias, and Performance in Text-to-Image Generative Models [0.0]
  Despite advances in generative models, most studies ignore the presence of bias. In this paper, we examine several text-to-image models not only by qualitatively assessing their performance in generating accurate images of human faces, groups, and specified numbers of objects but also by presenting a social bias analysis. As expected, models with larger capacity generate higher-quality images. However, we also document the inherent gender or social biases these models possess, offering a more complete understanding of their impact and limitations.
  arXiv  Detail & Related papers  (2024-06-28T14:10:42Z)
• Multimodal Large Language Model is a Human-Aligned Annotator for Text-to-Image Generation [87.50120181861362]
  VisionPrefer is a high-quality and fine-grained preference dataset that captures multiple preference aspects. We train a reward model VP-Score over VisionPrefer to guide the training of text-to-image generative models and the preference prediction accuracy of VP-Score is comparable to human annotators.
  arXiv  Detail & Related papers  (2024-04-23T14:53:15Z)
• Evaluating Text-to-Image Generative Models: An Empirical Study on Human Image Synthesis [21.619269792415903]
  We present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models. Our framework categorizes evaluations into two distinct groups: first, focusing on image qualities such as aesthetics and realism, and second, examining text conditions through concept coverage and fairness.
  arXiv  Detail & Related papers  (2024-03-08T07:41:47Z)
• Exploring Social Bias in Downstream Applications of Text-to-Image Foundation Models [72.06006736916821]
  We use synthetic images to probe two applications of text-to-image models, image editing and classification, for social bias. Using our methodology, we uncover meaningful and significant inter-sectional social biases in textitStable Diffusion, a state-of-the-art open-source text-to-image model. Our findings caution against the uninformed adoption of text-to-image foundation models for downstream tasks and services.
  arXiv  Detail & Related papers  (2023-12-05T14:36:49Z)
• Aligning Text-to-Image Models using Human Feedback [104.76638092169604]
  Current text-to-image models often generate images that are inadequately aligned with text prompts. We propose a fine-tuning method for aligning such models using human feedback. Our results demonstrate the potential for learning from human feedback to significantly improve text-to-image models.
  arXiv  Detail & Related papers  (2023-02-23T17:34:53Z)
• How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions? [67.97752431429865]
  We study the effect on the diversity of the generated images when adding ethical intervention. Preliminary studies indicate that a large change in the model predictions is triggered by certain phrases such as 'irrespective of gender'
  arXiv  Detail & Related papers  (2022-10-27T07:32:39Z)
• DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models [73.12069620086311]
  We investigate the visual reasoning capabilities and social biases of text-to-image models. First, we measure three visual reasoning skills: object recognition, object counting, and spatial relation understanding. Second, we assess the gender and skin tone biases by measuring the gender/skin tone distribution of generated images.
  arXiv  Detail & Related papers  (2022-02-08T18:36:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.