Perception-Aware Bias Detection for Query Suggestions

• URL: http://arxiv.org/abs/2601.03730v1
• Date: Wed, 07 Jan 2026 09:21:59 GMT
• Title: Perception-Aware Bias Detection for Query Suggestions
• Abstract summary: This paper adds on the bias detection pipeline for bias detection in query suggestions of person-related search.<n>The sparseness and lack of contextual metadata of query suggestions make them a difficult subject for bias detection.
• Score: 5.490018587818889
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Bias in web search has been in the spotlight of bias detection research for quite a while. At the same time, little attention has been paid to query suggestions in this regard. Awareness of the problem of biased query suggestions has been raised. Likewise, there is a rising need for automatic bias detection approaches. This paper adds on the bias detection pipeline for bias detection in query suggestions of person-related search developed by Bonart et al. \cite{Bonart_2019a}. The sparseness and lack of contextual metadata of query suggestions make them a difficult subject for bias detection. Furthermore, query suggestions are perceived very briefly and subliminally. To overcome these issues, perception-aware metrics are introduced. Consequently, the enhanced pipeline is able to better detect systematic topical bias in search engine query suggestions for person-related searches. The results of an analysis performed with the developed pipeline confirm this assumption. Due to the perception-aware bias detection metrics, findings produced by the pipeline can be assumed to reflect bias that users would discern.

Related papers

• R$^2$-Searcher: Calibrating Retrieval and Reasoning Boundaries for Agentic Search [59.034878430183305]
  R$2$-Searcher explicitly explores and calibrates the retrieval and reasoning boundaries.<n>We show that R$2$-Searcher significantly outperforms state-of-the-art agentic search methods in answer accuracy and retrieval-reasoning quality.
  arXiv  Detail & Related papers  (2026-06-26T19:44:34Z)
• Auditing Search Query Suggestion Bias Through Recursive Algorithm Interrogation [5.490018587818889]
  This work presents a new, alternative approach to search query bias identification.<n>It includes less high-level suggestions to deepen the data basis of bias analyses.<n>Based on these suggestions, we investigate topical group bias in person-related searches in the political domain.
  arXiv  Detail & Related papers  (2026-01-06T12:13:39Z)
• Rethinking Prompt-based Debiasing in Large Language Models [40.90578215191079]
  Investigating bias in large language models (LLMs) is crucial for developing trustworthy AI.<n>While prompt-based through prompt engineering is common, its effectiveness relies on the assumption that models inherently understand biases.<n>Our study systematically analyzed this assumption using the BBQ and StereoSet benchmarks on both open-source models as well as commercial GPT model.
  arXiv  Detail & Related papers  (2025-03-12T10:06:03Z)
• Investigating Bias in Political Search Query Suggestions by Relative Comparison with LLMs [1.5356574175312299]
  bias in search query suggestions can lead to exposure to biased search results and can impact opinion formation. We use a multi-step approach to identify and quantify bias in English search query suggestions. We apply our approach to the U.S. political news domain and compare bias in Google and Bing.
  arXiv  Detail & Related papers  (2024-10-31T12:40:38Z)
• Measuring and Addressing Indexical Bias in Information Retrieval [69.7897730778898]
  PAIR framework supports automatic bias audits for ranked documents or entire IR systems. After introducing DUO, we run an extensive evaluation of 8 IR systems on a new corpus of 32k synthetic and 4.7k natural documents. A human behavioral study validates our approach, showing that our bias metric can help predict when and how indexical bias will shift a reader's opinion.
  arXiv  Detail & Related papers  (2024-06-06T17:42:37Z)
• Take Care of Your Prompt Bias! Investigating and Mitigating Prompt Bias in Factual Knowledge Extraction [56.17020601803071]
  Recent research shows that pre-trained language models (PLMs) suffer from "prompt bias" in factual knowledge extraction. This paper aims to improve the reliability of existing benchmarks by thoroughly investigating and mitigating prompt bias.
  arXiv  Detail & Related papers  (2024-03-15T02:04:35Z)
• Whole Page Unbiased Learning to Rank [59.52040055543542]
  Unbiased Learning to Rank(ULTR) algorithms are proposed to learn an unbiased ranking model with biased click data. We propose a Bias Agnostic whole-page unbiased Learning to rank algorithm, named BAL, to automatically find the user behavior model. Experimental results on a real-world dataset verify the effectiveness of the BAL.
  arXiv  Detail & Related papers  (2022-10-19T16:53:08Z)
• Selective Query-guided Debiasing for Video Corpus Moment Retrieval [28.739889161193037]
  Video moment retrieval aims to localize target moments in untrimmed videos pertinent to a given textual query.<n>Existing retrieval systems tend to rely on retrieval bias as a shortcut.<n>We propose a Selective Query-guided Debiasing network (SQuiDNet)
  arXiv  Detail & Related papers  (2022-10-17T03:10:21Z)
• Self-supervised debiasing using low rank regularization [59.84695042540525]
  Spurious correlations can cause strong biases in deep neural networks, impairing generalization ability. We propose a self-supervised debiasing framework potentially compatible with unlabeled samples. Remarkably, the proposed debiasing framework significantly improves the generalization performance of self-supervised learning baselines.
  arXiv  Detail & Related papers  (2022-10-11T08:26:19Z)
• Information-Theoretic Bias Reduction via Causal View of Spurious Correlation [71.9123886505321]
  We propose an information-theoretic bias measurement technique through a causal interpretation of spurious correlation. We present a novel debiasing framework against the algorithmic bias, which incorporates a bias regularization loss. The proposed bias measurement and debiasing approaches are validated in diverse realistic scenarios.
  arXiv  Detail & Related papers  (2022-01-10T01:19:31Z)
• On the Social and Technical Challenges of Web Search Autosuggestion Moderation [118.47867428272878]
  Autosuggestions are typically generated by machine learning (ML) systems trained on a corpus of search logs and document representations. While current search engines have become increasingly proficient at suppressing such problematic suggestions, there are still persistent issues that remain. We discuss several dimensions of problematic suggestions, difficult issues along the pipeline, and why our discussion applies to the increasing number of applications beyond web search.
  arXiv  Detail & Related papers  (2020-07-09T19:22:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.