Per-Entity Bias Mapping for AI Visibility: Why Brand Mentions Require Entity-Specific Calibration
- URL: http://arxiv.org/abs/2606.21595v1
- Date: Fri, 19 Jun 2026 16:50:29 GMT
- Title: Per-Entity Bias Mapping for AI Visibility: Why Brand Mentions Require Entity-Specific Calibration
- Abstract summary: This paper argues that aggregate metrics are insufficient because entities exhibit systematically different AI visibility error profiles.<n>Three failure modes are identified: underrepresented entities suffer invisibility due to weak knowledge graph presence; large entities suffer the Brand Hallucination Paradox.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: AI-mediated answer systems increasingly determine how brands and organizations are represented to users. Existing approaches reduce visibility to mention rate or citation frequency. This paper argues that aggregate metrics are insufficient because entities exhibit systematically different AI visibility error profiles. We introduce Per-Entity Bias Mapping (PEBM): a ten-dimensional framework distinguishing raw from verified mentions. Three failure modes are identified: (1) underrepresented entities suffer invisibility due to weak knowledge graph presence; (2) large entities suffer the Brand Hallucination Paradox -- model familiarity creates stronger surfaces for plausible but incorrect completions; (3) CEE entities face a structural infrastructure gap across knowledge graphs, NER, and entity linking. A fourth dimension, Parametric-Retrieval Lag Asymmetry, describes divergence between retrieval-augmented and parametric memory update cycles. A full-scale empirical study (n=100 Hungarian B2B entities, 1,400 probe runs, 2,062 sources) finds Tier 1 brands produce 52.69% fabricated citations versus 37.87% for Tier 3 entities (+14.82 pp; p=1.67e-11), supporting the Brand Hallucination Paradox. Regulatory-framed queries elevate fabrication to 56.77% versus 37.59% baseline (+19.2 pp). We identify rejection-induced confabulation escalation: agentic quality filters function as hallucination accelerators in compliance contexts. We introduce ghost cartography as a unifying mechanism: entities in sparse latent regions produce confident output interpolated from neighboring dense regions, yielding a two-dimensional confabulation space (fabricated presence vs. frozen representation).
Related papers
- NovGauge: A Fine-Grained Benchmark for Diagnosing LLMs' Capability in Paper Novelty Assessment [54.4265627247104]
Large language models (LLMs) are increasingly used in peer review at major AI conferences.<n>Existing benchmarks assess novelty as a single holistic score.<n>We present NovGauge, a human-anchored benchmark for fine-grained novelty assessment diagnosis.
arXiv Detail & Related papers (2026-09-10T08:34:56Z) - MNIST-PRO: MNIST is Back as a Partially Observable World for AI Agents [74.83535434786145]
MNIST-PRO is a benchmark that isolates agentic perception by converting MNIST digit recognition into a sequential, glimpse-based search task with lookback constraints.<n>We evaluate ten multimodal models across four memory representations, including raw visual history, textual states, structured metric grid maps, and a consolidated visual canvas.
arXiv Detail & Related papers (2026-08-31T16:05:39Z) - Representing Entity Importance in AI Knowledge Systems: A Dual-Signal Framework of Audience Evaluation and Structural Authority [0.0]
AI knowledge systems require representations of entity importance for retrieval, recommendation, evidence selection, and knowledge-intensive reasoning.<n>This study introduces an interpretable dual-signal representation in which each entity is characterized by an audience dimension and a structural-authority dimension.<n>Results show that audience evaluation and structural authority are non-redundant signals and should not automatically be collapsed into a single notion of importance.
arXiv Detail & Related papers (2026-07-23T05:06:09Z) - From Geometric Recovery to Causal Validation: A Reproducible Audit of Sparse Autoencoder Features, from Superposition Geometry to Causal Inertness [0.0]
Sparse autoencoders (SAEs) are the standard for decomposing superposed neural representations into interpretable features.<n>We show this conflates two distinct claims: decoder-geometry alignment and encoder-activation behavior.<n>We package the method as sae-causal-audit, a model-agnostic instrument with a deterministic pipeline.
arXiv Detail & Related papers (2026-07-13T21:18:52Z) - MedHal-Loc: Are "Explainable-by-Architecture" Medical Hallucination Detectors Faithful Localizers? A Localization Benchmark [3.738942365298833]
We introduce MedHal-Loc, a benchmark and metric for localization faithfulness.<n>We find that NLI-per-clause, consistency-per-sentence, and the dedicated span detector FAVA all localize well above chance.
arXiv Detail & Related papers (2026-06-19T15:11:37Z) - The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content [11.226669792850645]
We formalise a phenomenon we term the structural attention tax: knowledge graph (KG) triples.<n>KG triples capture 2-3x more attention per token than semantically equivalent natural-language text.<n>We develop a formal framework decomposing attention scores into semantic and structural components.
arXiv Detail & Related papers (2026-04-21T08:47:00Z) - ARGOS: Who, Where, and When in Agentic Multi-Camera Person Search [49.61286310968402]
We introduce ARGOS, the first benchmark and framework that reformulates multi-camera person search as an interactive reasoning problem.<n>An ARGOS agent receives a vague witness statement and must decide what to ask, when to invoke spatial or temporal tools, and how to interpret ambiguous responses.<n>The benchmark comprises 2,691 tasks across 14 real-world scenarios in three progressive tracks: semantic perception (Who), spatial reasoning (Where), and temporal reasoning (When)
arXiv Detail & Related papers (2026-04-14T14:06:19Z) - Inductive Reasoning for Temporal Knowledge Graphs with Emerging Entities [54.48612448535698]
Reasoning on Temporal Knowledge Graphs (TKGs) is essential for predicting future events and time-aware facts.<n>We propose TransFIR, a novel framework that leverages historical interaction sequences from semantically similar known entities to support inductive reasoning.
arXiv Detail & Related papers (2026-04-11T11:23:05Z) - Anatomy of a Lie: A Multi-Stage Diagnostic Framework for Tracing Hallucinations in Vision-Language Models [62.932580559941414]
Vision-Language Models (VLMs) frequently "hallucinate" - generate plausible yet factually incorrect statements.<n>We propose a new paradigm for diagnosing hallucinations, recasting them from static output errors into dynamic pathologies of a model's computational cognition.
arXiv Detail & Related papers (2026-03-16T17:20:38Z) - FACTUM: Mechanistic Detection of Citation Hallucination in Long-Form RAG [29.07623863966094]
Retrieval-Augmented Generation (RAG) models are critically undermined by citation hallucinations.<n>We introduce FACTUM, a framework for testing Citation Trustworthiness via Underlying Mechanisms.<n>Our analysis reveals that correct citations are consistently marked by higher parametric force.<n>By capturing this complex interplay, FACTUM outperforms state-of-the-art baselines by up to 37.5% in AUC.
arXiv Detail & Related papers (2026-01-09T15:41:08Z) - Losing the Plot: How VLM responses degrade on imperfect charts [11.071294641688496]
Vision language models (VLMs) show strong results on chart understanding, yet existing benchmarks assume clean figures and fact based queries.<n>We evaluate ChatGPT 4o, Claude Sonnet 4, and Gemini 2.5 Pro, finding sharp performance drops under corruption or occlusion.<n>A key innovation is prompt reverse inconsistency, where models contradict themselves when asked to confirm versus deny the same statement.
arXiv Detail & Related papers (2025-09-22T21:12:20Z) - Certainly Uncertain: A Benchmark and Metric for Multimodal Epistemic and Aleatoric Awareness [106.52630978891054]
We present a taxonomy of uncertainty specific to vision-language AI systems.
We also introduce a new metric confidence-weighted accuracy, that is well correlated with both accuracy and calibration error.
arXiv Detail & Related papers (2024-07-02T04:23:54Z) - Robust Self-Supervised LiDAR Odometry via Representative Structure
Discovery and 3D Inherent Error Modeling [67.75095378830694]
We develop a two-stage odometry estimation network, where we obtain the ego-motion by estimating a set of sub-region transformations.
In this paper, we aim to alleviate the influence of unreliable structures in training, inference and mapping phases.
Our two-frame odometry outperforms the previous state of the arts by 16%/12% in terms of translational/rotational errors.
arXiv Detail & Related papers (2022-02-27T12:52:27Z) - Generalized Focal Loss: Learning Qualified and Distributed Bounding
Boxes for Dense Object Detection [85.53263670166304]
One-stage detector basically formulates object detection as dense classification and localization.
Recent trend for one-stage detectors is to introduce an individual prediction branch to estimate the quality of localization.
This paper delves into the representations of the above three fundamental elements: quality estimation, classification and localization.
arXiv Detail & Related papers (2020-06-08T07:24:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.