Fairness in Image Search: A Study of Occupational Stereotyping in Image Retrieval and its Debiasing

• URL: http://arxiv.org/abs/2305.03881v2
• Date: Tue, 22 Aug 2023 16:09:59 GMT
• Title: Fairness in Image Search: A Study of Occupational Stereotyping in Image Retrieval and its Debiasing
• Authors: Swagatika Dash
• Abstract summary: We present our study on bias and fairness in web search, with a focus on keyword-based image search. We first discuss several kinds of biases that exist in search systems and why it is important to mitigate them. We examine the extent of gender bias in top-tanked image search results obtained for several occupational keywords.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multi-modal search engines have experienced significant growth and widespread use in recent years, making them the second most common internet use. While search engine systems offer a range of services, the image search field has recently become a focal point in the information retrieval community, as the adage goes, "a picture is worth a thousand words". Although popular search engines like Google excel at image search accuracy and agility, there is an ongoing debate over whether their search results can be biased in terms of gender, language, demographics, socio-cultural aspects, and stereotypes. This potential for bias can have a significant impact on individuals' perceptions and influence their perspectives. In this paper, we present our study on bias and fairness in web search, with a focus on keyword-based image search. We first discuss several kinds of biases that exist in search systems and why it is important to mitigate them. We narrow down our study to assessing and mitigating occupational stereotypes in image search, which is a prevalent fairness issue in image retrieval. For the assessment of stereotypes, we take gender as an indicator. We explore various open-source and proprietary APIs for gender identification from images. With these, we examine the extent of gender bias in top-tanked image search results obtained for several occupational keywords. To mitigate the bias, we then propose a fairness-aware re-ranking algorithm that optimizes (a) relevance of the search result with the keyword and (b) fairness w.r.t genders identified. We experiment on 100 top-ranked images obtained for 10 occupational keywords and consider random re-ranking and re-ranking based on relevance as baselines. Our experimental results show that the fairness-aware re-ranking algorithm produces rankings with better fairness scores and competitive relevance scores than the baselines.

Related papers

• Identifying Implicit Social Biases in Vision-Language Models [34.53206726136747]
  We conduct a systematic analysis of the social biases that are present in vision-language models. We find that CLIP frequently displays undesirable associations between harmful words and specific demographic groups. Our findings highlight the importance of evaluating and addressing bias in vision-language models.
  arXiv  Detail & Related papers  (2024-11-01T19:41:28Z)
• Auditing Google's Search Algorithm: Measuring News Diversity Across Brazil, the UK, and the US [0.0]
  This study examines the influence of Google's search algorithm on news diversity by analyzing search results in Brazil, the UK, and the US. It explores how Google's system preferentially favors a limited number of news outlets. Findings indicate a slight leftward bias in search outcomes and a preference for popular, often national outlets.
  arXiv  Detail & Related papers  (2024-10-31T11:49:16Z)
• Classes Are Not Equal: An Empirical Study on Image Recognition Fairness [100.36114135663836]
  We experimentally demonstrate that classes are not equal and the fairness issue is prevalent for image classification models across various datasets. Our findings reveal that models tend to exhibit greater prediction biases for classes that are more challenging to recognize. Data augmentation and representation learning algorithms improve overall performance by promoting fairness to some degree in image classification.
  arXiv  Detail & Related papers  (2024-02-28T07:54:50Z)
• VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution [80.57383975987676]
  VisoGender is a novel dataset for benchmarking gender bias in vision-language models. We focus on occupation-related biases within a hegemonic system of binary gender, inspired by Winograd and Winogender schemas. We benchmark several state-of-the-art vision-language models and find that they demonstrate bias in resolving binary gender in complex scenes.
  arXiv  Detail & Related papers  (2023-06-21T17:59:51Z)
• Mitigating Test-Time Bias for Fair Image Retrieval [18.349154934096784]
  We address the challenge of generating fair and unbiased image retrieval results given neutral textual queries. We introduce a straightforward technique, Post-hoc Bias Mitigation, that post-processes the outputs from the pre-trained vision-language model. Our approach achieves the lowest bias, compared with various existing bias-mitigation methods, in text-based image retrieval result.
  arXiv  Detail & Related papers  (2023-05-23T21:31:16Z)
• Ranking Loss and Sequestering Learning for Reducing Image Search Bias in Histopathology [0.6595290783361959]
  This paper proposes two novel ideas to improve image search performance. First, we use a ranking loss function to guide feature extraction toward the matching-oriented nature of the search. Second, we introduce the concept of sequestering learning to enhance the generalization of feature extraction.
  arXiv  Detail & Related papers  (2023-04-15T03:38:09Z)
• Discovering and Mitigating Visual Biases through Keyword Explanation [66.71792624377069]
  We propose the Bias-to-Text (B2T) framework, which interprets visual biases as keywords. B2T can identify known biases, such as gender bias in CelebA, background bias in Waterbirds, and distribution shifts in ImageNet-R/C. B2T uncovers novel biases in larger datasets, such as Dollar Street and ImageNet.
  arXiv  Detail & Related papers  (2023-01-26T13:58:46Z)
• Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search [8.730027941735804]
  We study a unique gender bias in image search. The search images are often gender-imbalanced for gender-neutral natural language queries. We introduce two novel debiasing approaches.
  arXiv  Detail & Related papers  (2021-09-12T04:47:33Z)
• Automatic Main Character Recognition for Photographic Studies [78.88882860340797]
  Main characters in images are the most important humans that catch the viewer's attention upon first look. Identifying the main character in images plays an important role in traditional photographic studies and media analysis. We propose a method for identifying the main characters using machine learning based human pose estimation.
  arXiv  Detail & Related papers  (2021-06-16T18:14:45Z)
• Gender Stereotype Reinforcement: Measuring the Gender Bias Conveyed by Ranking Algorithms [68.85295025020942]
  We propose the Gender Stereotype Reinforcement (GSR) measure, which quantifies the tendency of a Search Engines to support gender stereotypes. GSR is the first specifically tailored measure for Information Retrieval, capable of quantifying representational harms.
  arXiv  Detail & Related papers  (2020-09-02T20:45:04Z)
• Learning Preference-Based Similarities from Face Images using Siamese Multi-Task CNNs [78.24964622317633]
  Key challenge for online dating platforms is to determine suitable matches for their users. Deep learning approaches have shown that a variety of properties can be predicted from human faces to some degree. We investigate the feasibility of bridging image-based matching and matching with personal interests, preferences, and attitude.
  arXiv  Detail & Related papers  (2020-01-25T23:08:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.