Cross-Prompt Generalization in Detecting AI-Generated Fake News Using Interpretable Linguistic Features

• URL: http://arxiv.org/abs/2606.04199v1
• Date: Tue, 02 Jun 2026 20:33:56 GMT
• Title: Cross-Prompt Generalization in Detecting AI-Generated Fake News Using Interpretable Linguistic Features
• Abstract summary: We investigate cross-prompt generalization in fake news detection using three datasets of AI-generated articles produced under distinct prompts.<n>We extract interpretable linguistic features capturing lexical diversity, readability, and emotion-based characteristics.<n>Analysis of feature distributions shows that AI-generated text exhibits increased lexical diversity, reduced readability, and substantially lower emotional intensity compared to the overall dataset.
• Score: 0.13999481573773068
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The increasing use of large language models has raised concerns about the spread of AI-generated fake news, particularly under varying prompting strategies. Most existing detection models are trained and evaluated under a single generation setting, leaving their ability to generalize across unseen prompts unclear. In this study, we investigate cross-prompt generalization in fake news detection using three datasets of AI-generated articles produced under distinct prompts, combined with real news articles. We extract interpretable linguistic features capturing lexical diversity, readability, and emotion-based characteristics and evaluate a random forest classifier under a cross-prompt framework, where models trained on one prompt are tested on another. Across all six train-test combinations, performance remains consistently high, with AUC values ranging from 0.988 to 1.000. Analysis of feature distributions shows that AI-generated text exhibits increased lexical diversity, reduced readability, and substantially lower emotional intensity compared to the overall dataset, with variations across prompts. Despite these distributional shifts, the classifier maintains strong performance, indicating that these features capture stable properties of AI-generated text that generalize across prompting strategies. These findings suggest that feature-based approaches can provide robust detection of AI-generated fake news under prompt variability.

Related papers

• Team RAS in 11th ABAW Competition: Multimodal Ambivalence Recognition Approach [52.92973028971813]
  We present a single text-centered multimodal approach for video-level ambivalence and hesitancy recognition.<n>The proposed approach combines linguistic, acoustic, facial, and scene features using text-centered multimodal fusion model.<n>Experiments on the Behavioural Ambivalence/Hesitancy (BAH) corpus confirm that text is the strongest unimodal modality.
  arXiv  Detail & Related papers  (2026-07-16T08:04:23Z)
• Findings of the Counter Turing Test: AI-Generated Text Detection [23.358538027776877]
  This paper provides a comprehensive analysis of state-of-the-art AI-generated text detection techniques.<n>It evaluates their effectiveness through the Counter Turing Test (CT2) shared tasks.<n>The top-performing teams leveraged fine-tuned transformer models, ensemble learning, and hybrid detection approaches.
  arXiv  Detail & Related papers  (2026-05-20T06:01:17Z)
• Human vs. Machine Deception: Distinguishing AI-Generated and Human-Written Fake News Using Ensemble Learning [0.13999481573773068]
  This study examines linguistic, structural, and emotional differences between human-written and AI-generated fake news.<n>A document-level feature representation is constructed using sentence structure, lexical diversity, punctuation patterns, readability indices, and emotion-based features.<n>The results show strong and consistent classification performance, with readability-based features emerging as the most informative predictors.
  arXiv  Detail & Related papers  (2026-04-10T23:51:28Z)
• Why AI-Generated Text Detection Fails: Evidence from Explainable AI Beyond Benchmark Accuracy [0.9169660430821364]
  We propose a framework that integrates linguistic feature engineering, machine learning, and explainable AI techniques.<n>Using SHAP-based explanations, we show that the most influential features differ markedly between datasets.<n>We believe that this knowledge helps build AI detectors that are robust across different settings.
  arXiv  Detail & Related papers  (2026-03-24T12:46:15Z)
• When AI Settles Down: Late-Stage Stability as a Signature of AI-Generated Text Detection [15.739137990102991]
  We analyze over 120k text samples and reveal Late-Stage Volatility Decay: AI-generated text exhibits rapidly stabilizing log probability fluctuations as generation progresses.<n>We propose two simple features: Derivative Dispersion and Local Volatility, which computed exclusively from late-stage statistics.
  arXiv  Detail & Related papers  (2026-01-08T11:11:00Z)
• Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detection [71.59834293521074]
  We develop a framework to distinguish between human-authored and machine-generated text.<n>Our method achieves 98.3% AUROC and AUPR with only 8.9% FPR95 on DeepFake dataset.<n>Code, pretrained weights, and demo will be released.
  arXiv  Detail & Related papers  (2025-10-07T08:14:45Z)
• Diversity Boosts AI-Generated Text Detection [51.56484100374058]
  DivEye is a novel framework that captures how unpredictability fluctuates across a text using surprisal-based features.<n>Our method outperforms existing zero-shot detectors by up to 33.2% and achieves competitive performance with fine-tuned baselines.
  arXiv  Detail & Related papers  (2025-09-23T10:21:22Z)
• Group-Adaptive Threshold Optimization for Robust AI-Generated Text Detection [58.419940585826744]
  We introduce FairOPT, an algorithm for group-specific threshold optimization for probabilistic AI-text detectors.<n>We partitioned data into subgroups based on attributes (e.g., text length and writing style) and implemented FairOPT to learn decision thresholds for each group to reduce discrepancy.<n>Our framework paves the way for more robust classification in AI-generated content detection via post-processing.
  arXiv  Detail & Related papers  (2025-02-06T21:58:48Z)
• Detecting Machine-Generated Long-Form Content with Latent-Space Variables [54.07946647012579]
  Existing zero-shot detectors primarily focus on token-level distributions, which are vulnerable to real-world domain shifts. We propose a more robust method that incorporates abstract elements, such as event transitions, as key deciding factors to detect machine versus human texts.
  arXiv  Detail & Related papers  (2024-10-04T18:42:09Z)
• MAGE: Machine-generated Text Detection in the Wild [82.70561073277801]
  Large language models (LLMs) have achieved human-level text generation, emphasizing the need for effective AI-generated text detection. We build a comprehensive testbed by gathering texts from diverse human writings and texts generated by different LLMs. Despite challenges, the top-performing detector can identify 86.54% out-of-domain texts generated by a new LLM, indicating the feasibility for application scenarios.
  arXiv  Detail & Related papers  (2023-05-22T17:13:29Z)
• Artificial Text Detection via Examining the Topology of Attention Maps [58.46367297712477]
  We propose three novel types of interpretable topological features for this task based on Topological Data Analysis (TDA) We empirically show that the features derived from the BERT model outperform count- and neural-based baselines up to 10% on three common datasets. The probing analysis of the features reveals their sensitivity to the surface and syntactic properties.
  arXiv  Detail & Related papers  (2021-09-10T12:13:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.