Score-Control for Hallucination Reduction in Diffusion Models

• URL: http://arxiv.org/abs/2606.00377v1
• Date: Fri, 29 May 2026 21:35:54 GMT
• Title: Score-Control for Hallucination Reduction in Diffusion Models
• Abstract summary: Diffusion models have emerged as the backbone of modern generative AI, powering advances in vision, language, audio and other modalities.<n>Despite their success, they suffer from hallucinations, implausible samples that lie outside the support of true data distribution.<n>We first empirically confirm previously proposed hypothesis that score smoothness causes hallucinations in Image Generation diffusion models and provide a density-based perspective.<n>Motivated by this, we introduce a Variance-Guided Score Modulation (VSM) strategy that controls the score Jacobian, in turn reducing score smoothness and better approxing the ground truth score that decreases hallucinations.
• Score: 5.244752390553863
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Diffusion models have emerged as the backbone of modern generative AI, powering advances in vision, language, audio and other modalities. Despite their success, they suffer from hallucinations, implausible samples that lie outside the support of true data distribution, which degrade reliability and trust. In this work, we first empirically confirm previously proposed hypothesis that score smoothness causes hallucinations in Image Generation diffusion models and provide a density-based perspective. We further formalize this notion by linking the hallucinations probability mass to lipschitz constant of the learned score function. Motivated by this, we introduce a Variance-Guided Score Modulation (VSM) strategy that controls the score Jacobian, in turn reducing score smoothness and better approximating the ground truth score that decreases hallucinations. Empirical results on synthetic and real-world datasets demonstrate that our approach reduces hallucinations (up to ~25%) while maintaining high fidelity and diversity, providing a principled step toward more reliable diffusion-based image generation. We also propose two benchmark datasets with extreme semantic variation for systematic hallucination evaluation. Code and Datasets are publicly available at https://github.com/bhosalems/VSM.

Related papers

• VCE: A zero-cost hallucination mitigation method of LVLMs via visual contrastive editing [70.82867621856968]
  Large vision-language models (LVLMs) frequently suffer from Object Hallucination (OH)<n>Recent studies suggest that the hallucination problem may stem from language priors.<n>We propose Visual Contrastive Editing (VCE), a novel post-hoc method that identifies and suppresses hallucinatory tendencies.
  arXiv  Detail & Related papers  (2026-04-21T12:40:07Z)
• Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Models [10.020835642521897]
  We present the first controlled comparative study to evaluate hallucination patterns in dLLMs.<n>Our results demonstrate that current dLLMs exhibit a higher propensity for hallucination than AR counterparts controlled for architecture, scale, and pre-training weights.<n>Our findings underscore that although dLLMs have narrowed the performance gap on general tasks, their distinct hallucination mechanisms pose a critical challenge to model reliability.
  arXiv  Detail & Related papers  (2026-04-12T09:59:41Z)
• Laplacian Score Sharpening for Mitigating Hallucination in Diffusion Models [4.878587790802629]
  We propose a post-hoc adjustment to the score function during inference that leverages the Laplacian (or hallucination) of the score to reduce mode sharpness.<n>We show that this correction significantly reduces the rate of hallucinated samples across toy 1D/2D distributions and a high-dimensional image dataset.
  arXiv  Detail & Related papers  (2025-11-10T14:16:31Z)
• Counting Hallucinations in Diffusion Models [34.45858211220468]
  Diffusion probabilistic models (DPMs) have demonstrated remarkable progress in generative tasks, such as image and video synthesis.<n>They often produce hallucinated samples (hallucinations) that conflict with real-world knowledge.<n>Despite their prevalence, the lack of feasible methodologies for systematically quantifying such hallucinations hinders progress.
  arXiv  Detail & Related papers  (2025-10-15T01:48:04Z)
• Mitigating Diffusion Model Hallucinations with Dynamic Guidance [75.90458880492054]
  Diffusion models often produce hallucinatory samples with structural inconsistencies that lie outside of the support of the true data distribution.<n>We introduce Dynamic Guidance, which mitigates hallucinations by selectively sharpening the score function only along the pre-determined directions known to cause artifacts.<n>To our knowledge, this is the first approach that addresses hallucinations at generation time rather than through post-hoc filtering.
  arXiv  Detail & Related papers  (2025-10-06T20:31:13Z)
• Counterfactual Probing for Hallucination Detection and Mitigation in Large Language Models [0.0]
  We propose Counterfactual Probing, a novel approach for detecting and mitigating hallucinations in large language models.<n>Our method dynamically generates counterfactual statements that appear plausible but contain subtle factual errors, then evaluates the model's sensitivity to these perturbations.
  arXiv  Detail & Related papers  (2025-08-03T17:29:48Z)
• Mitigating Object Hallucinations via Sentence-Level Early Intervention [10.642552315531404]
  Multimodal large language models (MLLMs) have revolutionized cross-modal understanding but continue to struggle with hallucinations.<n>We propose SENTINEL, a framework that eliminates dependency on human annotations.<n>Sentence-level Early iNtervention Through IN-domain prEference Learning can reduce hallucinations by over 90% compared to the original model.
  arXiv  Detail & Related papers  (2025-07-16T17:55:43Z)
• Generate, but Verify: Reducing Hallucination in Vision-Language Models with Retrospective Resampling [78.78822033285938]
  Vision-Language Models (VLMs) excel at visual understanding but often suffer from visual hallucinations.<n>In this work, we introduce REVERSE, a unified framework that integrates hallucination-aware training with on-the-fly self-verification.
  arXiv  Detail & Related papers  (2025-04-17T17:59:22Z)
• Understanding Hallucinations in Diffusion Models through Mode Interpolation [89.10226585746848]
  We study a particular failure mode in diffusion models, which we term mode mode. We find that diffusion models smoothly "interpolate" between nearby data modes in the training set, to generate samples that are completely outside the support of the original training distribution. We show how hallucination leads to the generation of combinations of shapes that never existed.
  arXiv  Detail & Related papers  (2024-06-13T17:43:41Z)
• Alleviating Hallucinations of Large Language Models through Induced Hallucinations [67.35512483340837]
  Large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information. We propose a simple textitInduce-then-Contrast Decoding (ICD) strategy to alleviate hallucinations.
  arXiv  Detail & Related papers  (2023-12-25T12:32:49Z)
• HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data [102.56792377624927]
  hallucinations inherent in machine-generated data remain under-explored. We present a novel hallucination detection and elimination framework, HalluciDoctor, based on the cross-checking paradigm. Our method successfully mitigates 44.6% hallucinations relatively and maintains competitive performance compared to LLaVA.
  arXiv  Detail & Related papers  (2023-11-22T04:52:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.