Measuring Google AI Overviews: Activation, Source Quality, Claim Fidelity, and Publisher Impact

• URL: http://arxiv.org/abs/2605.14021v1
• Date: Wed, 13 May 2026 18:34:39 GMT
• Title: Measuring Google AI Overviews: Activation, Source Quality, Claim Fidelity, and Publisher Impact
• Abstract summary: Google AI Overviews (AIOs) are arguably the most widely encountered deployment of generative AI, reaching over 2 billion users who may not realize the answers they see are AI-generated.<n>We present a large-scale longitudinal measurement study, issuing 55,393 trending queries across 19 topical categories over a 40-day window (March 13 - April 21, 2026).<n>We report four main findings. First, overall AIO activation is 13.7%, rising to 64.7% for question-form queries, while politically sensitive topics see markedly lower rates.
• Score: 10.145178533574695
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Google AI Overviews (AIOs) are arguably the most widely encountered deployment of generative AI, reaching over 2 billion users who may not realize the answers they see are AI-generated. Where search engines have traditionally surfaced ranked sources and left users to evaluate them, AIOs synthesize and deliver a single answer - giving Google unprecedented editorial control over what users read and know. We present a large-scale longitudinal measurement study, issuing 55,393 trending queries across 19 topical categories over a 40-day window (March 13 - April 21, 2026). We report four main findings. First, overall AIO activation is 13.7%, rising to 64.7% for question-form queries, while politically sensitive topics see markedly lower rates. Second, AIO-cited domains are more credible than co-displayed first-page results, yet nearly 30% do not appear in those results at all, indicating a source selection mechanism distinct from Google's ranking algorithm. Third, decomposing responses into 98,020 atomic claims, 11.0% are unsupported by the cited pages - with omission the dominant failure mode - and source quality and claim fidelity are largely independent. Fourth, well over half of AIO-cited pages carry display advertising, meaning publishers lose revenue when AIOs suppress the click-through, even as Google's own sponsored ads continue to appear on the same page. Together, these findings document a rapid transformation of the online information ecosystem whose consequences for epistemic security remain poorly understood.

Related papers

• On the limits and opportunities of AI reviewers: Reviewing the reviews of Nature-family papers with 45 expert scientists [113.03797263688519]
  Many scientists view AI reviewers as probabilistic systems without the expertise to evaluate research.<n>Existing evaluations of AI reviewers have focused on whether their verdicts match human verdicts.
  arXiv  Detail & Related papers  (2026-05-20T03:33:55Z)
• The Impact of AI Search on the Online Content Ecosystem: Evidence from Google and Reddit [0.0]
  generative AI search tools that summarize answers directly on the results page may disrupt this relationship by making visits to source platforms optional.<n>We study this question using Google AI Overviews and Reddit, one of the largest online discussion platforms.
  arXiv  Detail & Related papers  (2026-05-14T18:07:42Z)
• How Generative AI Disrupts Search: An Empirical Study of Google Search, Gemini, and AI Overviews [5.313243639890497]
  We compare the search results returned by Google's search engine, the accompanying AI Overview (AIO), and Gemini Flash 2.5 for each query.<n>For 51.5% of representative, real-user queries, AIOs are generated, and are displayed above the organic search results.<n>Traditional Google search is significantly more likely to retrieve information from popular or institutional websites in government or education.<n>Generative search engines are significantly more likely to retrieve Google-owned content.
  arXiv  Detail & Related papers  (2026-04-30T12:32:21Z)
• Answer Bubbles: Information Exposure in AI-Mediated Search [14.377773240202849]
  We examine responses to 11,000 real search queries across four systems -- vanilla GPT, Search GPT, Google AI Overviews, and traditional Google Search.<n>We find that generative search systems exhibit significant textitsource-selection biases in their citations.
  arXiv  Detail & Related papers  (2026-03-17T05:41:39Z)
• The Rise of AI Search: Implications for Information Markets and Human Judgement at Scale [0.7780248301908202]
  From 2024 to 2025, overall exposure to Google AI Overviews expanded from 7 to 229 countries.<n>While only 1% of Covid search queries were answered by AI in 2024, over 66% of Covid queries were answered by AI in 2025.
  arXiv  Detail & Related papers  (2026-02-13T19:35:56Z)
• Impact of AI Search Summaries on Website Traffic: Evidence from Google AI Overviews and Wikipedia [0.0]
  We estimate the causal impact of Google's AI Overview on Wikipedia traffic.<n>Across 161,382 matched article-language pairs, AIO exposure reduces daily traffic to English articles by approximately 15%.<n>These findings provide early causal evidence that generative-answer features in search engines can materially reallocate attention away from informational publishers.
  arXiv  Detail & Related papers  (2026-02-05T01:31:44Z)
• Reduced AI Acceptance After the Generative AI Boom: Evidence From a Two-Wave Survey Study [40.26767449635043]
  We examine shifts in public attitudes toward AI before and after the launch of ChatGPT.<n>The proportion of respondents finding AI "not acceptable at all" increased from 23% to 30%.<n>These shifts have amplified existing social inequalities in terms of widened educational, linguistic, and gender gaps post-boom.
  arXiv  Detail & Related papers  (2025-10-27T17:47:58Z)
• Shoot First, Ask Questions Later? Building Rational Agents that Explore and Act Like People [81.63702981397408]
  Given limited resources, to what extent do agents based on language models (LMs) act rationally?<n>We develop methods to benchmark and enhance agentic information-seeking, drawing on insights from human behavior.<n>For Spotter agents, our approach boosts accuracy by up to 14.7% absolute over LM-only baselines; for Captain agents, it raises expected information gain (EIG) by up to 0.227 bits (94.2% of the achievable noise ceiling)
  arXiv  Detail & Related papers  (2025-10-23T17:57:28Z)
• Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoning [53.45095336430027]
  We develop a unified framework that combines implicit retrieval and structured collaboration.<n>On Humanity's Last Exam (HLE) Bio/Chem Gold, our framework achieves 48.3% accuracy.<n>Results on SuperGPQA and TRQA confirm robustness across domains.
  arXiv  Detail & Related papers  (2025-09-25T14:05:55Z)
• The Leaderboard Illusion [61.27964089648608]
  Arena has emerged as the go-to leaderboard for ranking the most capable AI systems.<n>We identify systematic issues that have resulted in a distorted playing field.
  arXiv  Detail & Related papers  (2025-04-29T15:48:49Z)
• Consent in Crisis: The Rapid Decline of the AI Data Commons [74.68176012363253]
  General-purpose artificial intelligence (AI) systems are built on massive swathes of public web data. We conduct the first, large-scale, longitudinal audit of the consent protocols for the web domains underlying AI training corpora.
  arXiv  Detail & Related papers  (2024-07-20T16:50:18Z)
• Evaluating Verifiability in Generative Search Engines [70.59477647085387]
  Generative search engines directly generate responses to user queries, along with in-line citations. We conduct human evaluation to audit four popular generative search engines. We find that responses from existing generative search engines are fluent and appear informative, but frequently contain unsupported statements and inaccurate citations.
  arXiv  Detail & Related papers  (2023-04-19T17:56:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.