Assessing the Geographic Diversity of AI's Platial Representations in Image Generation

• URL: http://arxiv.org/abs/2606.05188v1
• Date: Tue, 28 Apr 2026 11:57:42 GMT
• Title: Assessing the Geographic Diversity of AI's Platial Representations in Image Generation
• Abstract summary: We show how to evaluate geographic diversity in image generation through a case study.<n>For instance, older models can exhibit greater geographic diversity despite producing lower-quality images.<n>We observe explicit model homogeneity underlying the lack of geographic diversity.
• Score: 7.106770983243944
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: (Gen)AI diversity is not merely an ethical issue. From the perspective of geographic information science (GIScience), it could be interpreted as a function of uncertainty and as a form of cognitive bias, embedded in AI outputs. Recent work has sought to develop information-theoretic diversity measures and apply them to evaluate AI-chatbot outputs in a geographic context. As the AI ecosystem to which we are exposed on a daily basis becomes rapidly multimodal, we believe it is important to examine geographic diversity across various modalities. Focusing on images, this paper aims to fill this research gap. First, we select the GPT and DALL-E models as state-of-the-art examples and point out how assessing their geographic diversity involves various stages, including prompt revision and image generation. Then, taking inspiration from species diversity measures in ecological research, we incorporate similarity weighting into the measurement of geographic diversity. Next, we demonstrate how to evaluate geographic diversity in image generation through a case study. Our analysis reveals several counterintuitive findings. For instance, older models can exhibit greater geographic diversity despite producing lower-quality images, and prompt revision yields greater geographic diversity than image generation. At the same time, we observe explicit model homogeneity underlying the lack of geographic diversity, as the selected models consistently depict the same prototypical geo-specific feature or similar features. This is concerning, as it risks producing stereotypical representations of places.

Related papers

• Geographic Bias and Diversity in AI Evaluation [13.861735837455626]
  This chapter investigates the geographical nature of bias in (generative) AI.<n>We identify a range of geographic biases that span from representation bias in the training data to regional disparities in the factual recall of language models.<n>We showcase how recent studies address the latter bias by evaluating geographic diversity in the outputs of generative AI.
  arXiv  Detail & Related papers  (2026-04-28T11:32:32Z)
• GeoDiv: Framework For Measuring Geographical Diversity In Text-To-Image Models [42.84755778627983]
  Text-to-image (T2I) models are rapidly gaining popularity, yet their outputs often lack geographical diversity, reinforce stereotypes, and misrepresent regions.<n>We introduce GeoDiv, a framework leveraging large language and vision-language models to assess geographical diversity along two complementary axes.<n>GeoDiv reveals a consistent lack of diversity and identifies fine-grained attributes where models default to biased portrayals.
  arXiv  Detail & Related papers  (2026-02-25T17:08:43Z)
• The Factuality Tax of Diversity-Intervened Text-to-Image Generation: Benchmark and Fact-Augmented Intervention [61.80236015147771]
  We quantify the trade-off between using diversity interventions and preserving demographic factuality in T2I models. Experiments on DoFaiR reveal that diversity-oriented instructions increase the number of different gender and racial groups. We propose Fact-Augmented Intervention (FAI) to reflect on verbalized or retrieved factual information about gender and racial compositions of generation subjects in history.
  arXiv  Detail & Related papers  (2024-06-29T09:09:42Z)
• Improving Geo-diversity of Generated Images with Contextualized Vendi Score Guidance [12.33170407159189]
  State-of-the-art text-to-image generative models struggle to depict everyday objects with the true diversity of the real world. We introduce an inference time intervention, contextualized Vendi Score Guidance (c-VSG), that guides the backwards steps of latent diffusion models to increase the diversity of a sample. We find that c-VSG substantially increases the diversity of generated images, both for the worst performing regions and on average, while simultaneously maintaining or improving image quality and consistency.
  arXiv  Detail & Related papers  (2024-06-06T23:35:51Z)
• Towards Geographic Inclusion in the Evaluation of Text-to-Image Models [25.780536950323683]
  We study how much annotators in Africa, Europe, and Southeast Asia vary in their perception of geographic representation, visual appeal, and consistency in real and generated images. For example, annotators in different locations often disagree on whether exaggerated, stereotypical depictions of a region are considered geographically representative. We recommend steps for improved automatic and human evaluations.
  arXiv  Detail & Related papers  (2024-05-07T16:23:06Z)
• DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversity [24.887571095245313]
  We introduce three indicators to evaluate the realism, diversity and prompt-generation consistency of text-to-image generative systems. We find that models have less realism and diversity of generations when prompting for Africa and West Asia than Europe. Perhaps most interestingly, our indicators suggest that progress in image generation quality has come at the cost of real-world geographic representation.
  arXiv  Detail & Related papers  (2023-08-11T15:43:37Z)
• GeoNet: Benchmarking Unsupervised Adaptation across Geographies [71.23141626803287]
  We study the problem of geographic robustness and make three main contributions. First, we introduce a large-scale dataset GeoNet for geographic adaptation. Second, we hypothesize that the major source of domain shifts arise from significant variations in scene context. Third, we conduct an extensive evaluation of several state-of-the-art unsupervised domain adaptation algorithms and architectures.
  arXiv  Detail & Related papers  (2023-03-27T17:59:34Z)
• Stable Bias: Analyzing Societal Representations in Diffusion Models [72.27121528451528]
  We propose a new method for exploring the social biases in Text-to-Image (TTI) systems. Our approach relies on characterizing the variation in generated images triggered by enumerating gender and ethnicity markers in the prompts. We leverage this method to analyze images generated by 3 popular TTI systems and find that while all of their outputs show correlations with US labor demographics, they also consistently under-represent marginalized identities to different extents.
  arXiv  Detail & Related papers  (2023-03-20T19:32:49Z)
• GIVL: Improving Geographical Inclusivity of Vision-Language Models with Pre-Training Methods [62.076647211744564]
  We propose GIVL, a Geographically Inclusive Vision-and-Language Pre-trained model. There are two attributes of geo-diverse visual concepts which can help to learn geo-diverse knowledge: 1) concepts under similar categories have unique knowledge and visual characteristics, 2) concepts with similar visual features may fall in completely different categories. Compared with similar-size models pre-trained with similar scale of data, GIVL achieves state-of-the-art (SOTA) and more balanced performance on geo-diverse V&L tasks.
  arXiv  Detail & Related papers  (2023-01-05T03:43:45Z)
• Random Network Distillation as a Diversity Metric for Both Image and Text Generation [62.13444904851029]
  We develop a new diversity metric that can be applied to data, both synthetic and natural, of any type. We validate and deploy this metric on both images and text.
  arXiv  Detail & Related papers  (2020-10-13T22:03:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.