CPR: Mitigating Large Language Model Hallucinations with Curative Prompt Refinement

• URL: http://arxiv.org/abs/2510.12029v1
• Date: Tue, 14 Oct 2025 00:27:46 GMT
• Title: CPR: Mitigating Large Language Model Hallucinations with Curative Prompt Refinement
• Authors: Jung-Woo Shim, Yeong-Joon Ju, Ji-Hoon Park, Seong-Whan Lee,
• Abstract summary: Curative Prompt Refinement (CPR) is a plug-and-play framework for curative prompt refinement.<n>CPR cleans ill-formed prompts and generates additional informative task descriptions.<n>CPR achieves over a 90% win rate over the original prompts without any external knowledge.
• Score: 49.435669307386156
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advancements in large language models (LLMs) highlight their fluency in generating responses to diverse prompts. However, these models sometimes generate plausible yet incorrect ``hallucinated" facts, undermining trust. A frequent but often overlooked cause of such errors is the use of poorly structured or vague prompts by users, leading LLMs to base responses on assumed rather than actual intentions. To mitigate hallucinations induced by these ill-formed prompts, we introduce Curative Prompt Refinement (CPR), a plug-and-play framework for curative prompt refinement that 1) cleans ill-formed prompts, and 2) generates additional informative task descriptions to align the intention of the user and the prompt using a fine-tuned small language model. When applied to language models, we discover that CPR significantly increases the quality of generation while also mitigating hallucination. Empirical studies show that prompts with CPR applied achieves over a 90\% win rate over the original prompts without any external knowledge.

Related papers

• PruneHal: Reducing Hallucinations in Multi-modal Large Language Models through Adaptive KV Cache Pruning [87.35309934860938]
  hallucinations in large language models (MLLMs) are strongly associated with insufficient attention allocated to visual tokens.<n>We propose textbfPruneHal, a training-free, simple yet effective method that leverages adaptive KV cache pruning to enhance the model's focus on critical visual information.
  arXiv  Detail & Related papers  (2025-10-22T02:41:07Z)
• Multi-stage Prompt Refinement for Mitigating Hallucinations in Large Language Models [49.435669307386156]
  Multi-stage Prompt Refinement (MPR) is a framework designed to systematically improve ill-formed prompts across multiple stages.<n>MPR iteratively enhances the clarity of prompts with additional context and employs a self-reflection mechanism with ranking to prioritize the most relevant input.<n>Results on hallucination benchmarks show that MPR achieve over an 85% win rate compared to their original forms.
  arXiv  Detail & Related papers  (2025-10-14T00:31:36Z)
• Exploring and Mitigating Fawning Hallucinations in Large Language Models [52.444712272909435]
  We analyze fawning hallucinations in various natural language processing tasks.<n>We tailor the so-termed contrastive decoding method for fawning-hallucination mitigation.
  arXiv  Detail & Related papers  (2025-08-31T14:29:54Z)
• DecoPrompt : Decoding Prompts Reduces Hallucinations when Large Language Models Meet False Premises [28.72485319617863]
  We propose a new prompting algorithm, named DecoPrompt, to mitigate hallucination.<n> DecoPrompt leverages LLMs to "decode" the false-premise prompts without really eliciting hallucination output from LLMs.<n>We perform experiments on two datasets, demonstrating that DecoPrompt can reduce hallucinations effectively on outputs from different LLMs.
  arXiv  Detail & Related papers  (2024-11-12T00:48:01Z)
• Mitigating Large Language Model Hallucination with Faithful Finetuning [46.33663932554782]
  Large language models (LLMs) have demonstrated remarkable performance on various natural language processing tasks. They are prone to generating fluent yet untruthful responses, known as "hallucinations"
  arXiv  Detail & Related papers  (2024-06-17T07:16:07Z)
• Multi-Modal Hallucination Control by Visual Information Grounding [121.6983694815504]
  We show that Generative Vision-Language Models (VLMs) are prone to generate plausible-sounding textual answers that are not always grounded in the input image. We introduce Multi-Modal Mutual-Information Decoding (M3ID), a new sampling method for prompt amplification. M3ID amplifies the influence of the reference image over the language prior, hence favoring the generation of tokens with higher mutual information with the visual prompt.
  arXiv  Detail & Related papers  (2024-03-20T22:05:18Z)
• Alleviating Hallucinations of Large Language Models through Induced Hallucinations [67.35512483340837]
  Large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information. We propose a simple textitInduce-then-Contrast Decoding (ICD) strategy to alleviate hallucinations.
  arXiv  Detail & Related papers  (2023-12-25T12:32:49Z)
• Effective Prompt Extraction from Language Models [70.00099540536382]
  We present a framework for measuring the effectiveness of prompt extraction attacks. In experiments with 3 different sources of prompts and 11 underlying large language models, we find that simple text-based attacks can in fact reveal prompts with high probability. Our framework determines with high precision whether an extracted prompt is the actual secret prompt, rather than a model hallucination.
  arXiv  Detail & Related papers  (2023-07-13T16:15:08Z)
• Trapping LLM Hallucinations Using Tagged Context Prompts [11.655802601887197]
  We propose a novel method to recognize and flag instances when large language models perform outside their domain knowledge. We find that the use of context combined with embedded tags can successfully combat hallucinations within generative language models.
  arXiv  Detail & Related papers  (2023-06-09T17:48:54Z)
• Position-based Prompting for Health Outcome Generation [0.0]
  We explore an idea of using a position-attention mechanism to capture positional information of each word in a prompt relative to the mask to be filled. Our approach consistently outperforms a baseline in which the default mask language model (MLM) representation is used to predict masked tokens.
  arXiv  Detail & Related papers  (2022-03-30T16:44:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.