Layer-Resolved Optimal Transport for Hallucination Detection in NMT and Abstractive Summarization

• URL: http://arxiv.org/abs/2606.13216v1
• Date: Thu, 11 Jun 2026 11:30:08 GMT
• Title: Layer-Resolved Optimal Transport for Hallucination Detection in NMT and Abstractive Summarization
• Abstract summary: Optimal transport (OT) has been shown to detect hallucinations in neural machine translation (NMT)<n>We extend this analysis to all six decoder layers of the Fairseq DE-EN model.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Optimal transport (OT) has been shown to detect hallucinations in neural machine translation (NMT) by measuring the geometric distance between cross-attention distributions and a reference distribution, without any supervision. We extend this analysis to all six decoder layers of the Fairseq DE-EN model ($N=3{,}414$), showing that Wass-to-Unif and Wass-to-Data are complementary detectors specialised across hallucination types, that detection is concentrated in layers L1--L4 with L5 anti-predictive for subtler types, and that hallucinated translations lack the exploratory attention phase present in correct translations from the first decoding step. We further evaluate whether the geometric signal transfers to abstractive summarization faithfulness detection: our unsupervised OT detector on AggreFact ($N=1{,}116$) achieves $57.2\%$/$57.6\%$ balanced accuracy on CNN/XSum -- above chance but substantially below supervised MiniCheck-Flan-T5-L($69.9\%$/$74.3\%$). This gap is principled: unlike NMT hallucinations, unfaithful summaries can attend correctly to source tokens while misrepresenting their content, a failure mode invisible to concentration-based OT metrics by construction. Structural experiments on T5-base confirm consistent decoder organisation across depth, with Layer~3 showing peak concentration and Layer~12 being most critical for generation quality. Together, the results establish OT on cross-attention as a reliable detector when the failure mode is source disengagement, a principled interpretability tool regardless of task, and fundamentally limited when faithfulness failures occur downstream of attention.

Related papers

• HalluTracer: Hallucination Detection via Depth-Averaging Truth Signals [45.64606191137958]
  We introduce HalluTracer, a framework that aggregates truthfulness evidence across every layer of the forward pass.<n>A geometric analysis reveals that the per-layer signals are weakly correlated, so that simple depth averaging suppresses layer-specific noise.<n>HalluTracer consistently outperforms matched white-box baselines.
  arXiv  Detail & Related papers  (2026-08-17T10:03:29Z)
• Role-Break in Attention Heads: Understanding and Detecting Hallucinations in VLMs [49.743008490747094]
  Vision-Language Models (VLMs) remain prone to hallucinations, producing content that is inconsistent with or unsupported by the input image.<n>Under a unified head-level view, we find that hallucination-induced changes manifest as localized deviations from each head's faithful contextual behavior.<n> Detailed analysis reveals that these deviations are systematically organized across attention heads, contextual sources, and deviation directions, and that the resulting signal is linearly readable once head identity is preserved.
  arXiv  Detail & Related papers  (2026-07-31T13:33:51Z)
• Spectral Dynamics of Semantic Drift in Clinical Multi-Agent Language Model Networks [0.0]
  We show that localized dense cliques confine hallucinated data, preventing global consensus and forcing the system toward a permanent entropy saturation threshold.<n>By introducing dynamic spectral monitoring operating at an $mathcalO(N3)$ time complexity, we present a mathematically rigorous technique to ensure global state diffusion.
  arXiv  Detail & Related papers  (2026-07-23T20:20:45Z)
• Now You (Still) See Me: Detecting Evasive Steganographic Payloads in LLMs [52.149036302760386]
  Large language models can be fine-tuned to encode prompt-borne secrets into fluent, seemingly benign outputs.<n>Recent work proposes detection using linear probes that recover the secret from internal activations.<n>We show that this defense can be systematically evaded, but that detectability can be recovered through a targeted data-level intervention.
  arXiv  Detail & Related papers  (2026-06-08T12:27:11Z)
• Scalable Token-Level Hallucination Detection in Large Language Models [63.3426544914783]
  Internal hallucinations are difficult to detect in reasoning-intensive tasks.<n>We propose TokenHD, a holistic pipeline for training token-level hallucination detectors.
  arXiv  Detail & Related papers  (2026-05-12T16:47:40Z)
• Predictive Maps of Multi-Agent Reasoning: A Successor-Representation Spectrum for LLM Communication Topologies [0.0]
  Existing evaluation answers these questions only post hoc and only for the task measured.<n>We introduce a structural diagnostic for multi-agent LLM communication graphs based on the successor representation $M = (I - P)-1$ of the row-stochastic communication operator.<n>We derive closed-form spectra for the chain, star, and mesh under row-stochastic normalization, and validate the predictions on a 12-step structured state-tracking task.
  arXiv  Detail & Related papers  (2026-05-12T03:11:39Z)
• Self-Attention as Transport: Limits of Symmetric Spectral Diagnostics [0.0]
  We show that uniform causal attention satisfies an $n$-independent floor $ge 1/5$ with worst cut at $tast/n approx 0.32$, while window attention pierces the floor as $O(w/n)$.<n>The resulting two-axis diagnostic yields a falsifiable polarity prediction.
  arXiv  Detail & Related papers  (2026-05-06T13:25:13Z)
• Neural Uncertainty Principle: A Unified View of Adversarial Fragility and LLM Hallucination [60.197429875410286]
  Adversarial vulnerability in vision and hallucination in large language models are conventionally viewed as separate problems.<n>Formalizing a Neural Uncertainty Principle (NUP) under a loss-induced state, we find that in near-bound regimes, further compression must be accompanied by increased sensitivity dispersion.<n>In vision, masking highly coupled components improves robustness without costly adversarial training.<n>In language, the same prefill-stage probe detects hallucination risk before generating any answer tokens.
  arXiv  Detail & Related papers  (2026-03-20T02:07:10Z)
• Information Fidelity in Tool-Using LLM Agents: A Martingale Analysis of the Model Context Protocol [69.11739400975445]
  We introduce the first theoretical framework for analyzing error accumulation in Model Context Protocol (MCP) agents.<n>We show that cumulative distortion exhibits linear growth and high-probability deviations bounded by $O(sqrtT)$.<n>Key findings include: semantic weighting reduces distortion by 80%, and periodic re-grounding approximately every 9 steps suffices for error control.
  arXiv  Detail & Related papers  (2026-02-10T21:08:53Z)
• Optimal Transport for Unsupervised Hallucination Detection in Neural Machine Translation [34.8089664250053]
  Neural machine translation (NMT) has become the de-facto standard in real-world machine translation applications. NMT models can unpredictably produce severely pathological translations, known as hallucinations, that seriously undermine user trust. We propose a fully unsupervised, plug-in detector that can be used with any attention-based NMT model.
  arXiv  Detail & Related papers  (2022-12-19T17:06:58Z)
• Detecting Hallucinated Content in Conditional Neural Sequence Generation [165.68948078624499]
  We propose a task to predict whether each token in the output sequence is hallucinated (not contained in the input) We also introduce a method for learning to detect hallucinations using pretrained language models fine tuned on synthetic data.
  arXiv  Detail & Related papers  (2020-11-05T00:18:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.