How unique are hallucinated citations offered by generative Artificial Intelligence models?

• URL: http://arxiv.org/abs/2604.16407v1
• Date: Tue, 31 Mar 2026 21:24:34 GMT
• Title: How unique are hallucinated citations offered by generative Artificial Intelligence models?
• Abstract summary: This paper investigates how generative AI produces and propagates hallucinated academic references.<n>It focuses on the recurring non-existent citation 'Education Governance and Datafication' attributed to Ben Williamson and Nelli Piattoeva.<n>It shows that hallucinated citations are not random inventions but patterned recombinations of real authors, journals, dates, and keywords.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This paper investigates how generative AI produces and propagates hallucinated academic references, focusing on the recurring non-existent citation 'Education Governance and Datafication' attributed to Ben Williamson and Nelli Piattoeva. Drawing on 137 accessible source papers identified through Google Scholar and Google searches, the study analyses the structure, recurrence, and onward citation of this phantom reference. It shows that hallucinated citations are not random inventions but patterned recombinations of real authors, journals, dates, and keywords, with duplication occurring in nearly 30% of cases. The paper also reports a structured interrogation of ChatGPT 5-mini about how it generates citations and finds that, absent verification, the model reconstructs plausible references from learned patterns rather than factual recall. Finally, ten AI-generated essays on datafication and school governance were examined: while most references were genuine or partly accurate, 9.2% remained hallucinated, including an exact match to the most common phantom citation. The findings highlight ongoing risks to academic integrity and show that web-enabled AI still does not fully eliminate fabricated references.

Related papers

• Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection [30.352741291341843]
  Existing detectors reduce to binary found/not-found decisions, offering little field-level signal to auditors.<n>We introduce a 12-code taxonomy spanning Real, Potential, and Hallucinated citations.<n>CiteTracer extracts citations from PDF and Bib, fetches evidence through lookup URL, scholar connectors, and web search.<n>It reaches 97.1% accuracy on the synthetic benchmark, with class-level F1 scores of 97.0, 95.8, and 98.5 for Real, Potential, and Hallucinated, respectively, and fabricates hallucinations on the real-world set without abstaining.
  arXiv  Detail & Related papers  (2026-05-09T00:53:24Z)
• CiteAudit: You Cited It, But Did You Read It? A Benchmark for Verifying Scientific References in the LLM Era [51.63024682584688]
  Large language models (LLMs) introduce a new risk: fabricated references that appear plausible but correspond to no real publications.<n>We present the first comprehensive benchmark and detection framework for hallucinated citations in scientific writing.<n>Our framework significantly outperforms prior methods in both accuracy and interpretability.
  arXiv  Detail & Related papers  (2026-02-26T19:17:39Z)
• Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025 [0.0]
  Large language models (LLMs) are increasingly used in academic writing, yet they frequently hallucinate by generating citations to sources that do not exist.<n>This study analyzes 100 AI-generated hallucinated citations that appeared in papers accepted by the 2025 Conference on Neural Information Processing Systems.<n>Despite review by 3-5 expert researchers per paper, these fabricated citations evaded detection, appearing in 53 published papers.
  arXiv  Detail & Related papers  (2026-02-05T17:43:35Z)
• The 17% Gap: Quantifying Epistemic Decay in AI-Assisted Survey Papers [0.0]
  "Hallucinated papers" are a known artifact, but the systematic degradation of valid citation chains remains unquantified.<n>We conducted a forensic audit of 50 recent survey papers in Artificial Intelligence published between September 2024 and January 2026.<n>We detect a persistent 17.0% Phantom Rate -- citations that cannot be resolved to any digital object despite aggressive forensic recovery.
  arXiv  Detail & Related papers  (2026-01-24T12:00:55Z)
• Hallucinate or Memorize? The Two Sides of Probabilistic Learning in Large Language Models [0.0]
  Large language models (LLMs) have been increasingly applied to a wide range of tasks, from natural language understanding to code generation.<n>While they have also been used to assist in citation recommendation, the hallucination of non-existent papers remains a major issue.<n>This study hypothesizes that an LLM's ability to correctly produce records depends on whether the underlying knowledge is generated or memorized.
  arXiv  Detail & Related papers  (2025-11-12T01:29:12Z)
• Hallucinations in Bibliographic Recommendation: Citation Frequency as a Proxy for Training Data Redundancy [0.0]
  Large hallucination models (LLMs) have been increasingly applied to a wide range of tasks.<n>This study hypothesizes that an LLM's ability to correctly produce information depends on whether the underlying knowledge is generated or memorized.
  arXiv  Detail & Related papers  (2025-10-29T10:51:35Z)
• WebWeaver: Structuring Web-Scale Evidence with Dynamic Outlines for Open-Ended Deep Research [73.58638285105971]
  This paper tackles textbfopen-ended deep research (OEDR), a complex challenge where AI agents must synthesize vast web-scale information into insightful reports.<n>We introduce textbfWebWeaver, a novel dual-agent framework that emulates the human research process.<n>Our framework establishes a new state-of-the-art across major OEDR benchmarks, including DeepResearch Bench, DeepConsult, and DeepResearchGym.
  arXiv  Detail & Related papers  (2025-09-16T17:57:21Z)
• Cite Pretrain: Retrieval-Free Knowledge Attribution for Large Language Models [44.31597857713689]
  We introduce Active Indexing for the first stage, which creates generalizable, source-anchored bindings.<n>Experiments with Qwen-2.5-7B&3B show that Active Indexing consistently outperforms a Passive Indexing baseline.<n> internal citations complement external ones by making the model more robust to retrieval noise.
  arXiv  Detail & Related papers  (2025-06-21T04:48:05Z)
• Guarding against artificial intelligence--hallucinated citations: the case for full-text reference deposit [0.0]
  Journals should require authors to submit the full text of each cited source along with their manuscripts.<n>This solution requires limited additional work on the part of authors or editors while effectively immunizing journals against hallucinated references.
  arXiv  Detail & Related papers  (2025-03-25T17:12:38Z)
• Improving Wikipedia Verifiability with AI [116.69749668874493]
  We develop a neural network based system, called Side, to identify Wikipedia citations that are unlikely to support their claims. Our first citation recommendation collects over 60% more preferences than existing Wikipedia citations for the same top 10% most likely unverifiable claims. Our results indicate that an AI-based system could be used, in tandem with humans, to improve the verifiability of Wikipedia.
  arXiv  Detail & Related papers  (2022-07-08T15:23:29Z)
• Deep Graph Learning for Anomalous Citation Detection [55.81334139806342]
  We propose a novel deep graph learning model, namely GLAD (Graph Learning for Anomaly Detection), to identify anomalies in citation networks. Within the GLAD framework, we propose an algorithm called CPU (Citation PUrpose) to discover the purpose of citation based on citation texts.
  arXiv  Detail & Related papers  (2022-02-23T09:05:28Z)
• Towards generating citation sentences for multiple references with intent control [86.53829532976303]
  We build a novel generation model with the Fusion-in-Decoder approach to cope with multiple long inputs. Experiments demonstrate that the proposed approaches provide much more comprehensive features for generating citation sentences.
  arXiv  Detail & Related papers  (2021-12-02T15:32:24Z)
• Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals [69.76097138157816]
  Probabilistic text generators have been used to produce fake scientific papers for more than a decade. Complex AI-powered generation techniques produce texts indistinguishable from that of humans. Some websites offer to rewrite texts for free, generating gobbledegook full of tortured phrases.
  arXiv  Detail & Related papers  (2021-07-12T20:47:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.