The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agents

• URL: http://arxiv.org/abs/2410.19064v2
• Date: Wed, 28 May 2025 08:26:32 GMT
• Title: The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agents
• Authors: Yuhan Liu, Zirui Song, Juntian Zhang, Xiaoqing Zhang, Xiuying Chen, Rui Yan,
• Abstract summary: Previous research has often assumed fake news inherently exists rather than exploring its gradual formation.<n>We propose FUSE, a novel Large Language Model (LLM)-based simulation approach explicitly focusing on fake news evolution from real news.<n>Results show that FUSE effectively captures fake news evolution patterns and accurately reproduces known fake news, aligning closely with human evaluations.
• Score: 33.92860158860716
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: With the growing spread of misinformation online, understanding how true news evolves into fake news has become crucial for early detection and prevention. However, previous research has often assumed fake news inherently exists rather than exploring its gradual formation. To address this gap, we propose FUSE (Fake news evolUtion Simulation framEwork), a novel Large Language Model (LLM)-based simulation approach explicitly focusing on fake news evolution from real news. Our framework model a social network with four distinct types of LLM agents commonly observed in daily interactions: spreaders who propagate information, commentators who provide interpretations, verifiers who fact-check, and bystanders who observe passively to simulate realistic daily interactions that progressively distort true news. To quantify these gradual distortions, we develop FUSE-EVAL, a comprehensive evaluation framework measuring truth deviation along multiple linguistic and semantic dimensions. Results show that FUSE effectively captures fake news evolution patterns and accurately reproduces known fake news, aligning closely with human evaluations. Experiments demonstrate that FUSE accurately reproduces known fake news evolution scenarios, aligns closely with human judgment, and highlights the importance of timely intervention at early stages. Our framework is extensible, enabling future research on broader scenarios of fake news.

Related papers

• Fake News Detection and Manipulation Reasoning via Large Vision-Language Models [38.457805116130004]
  This paper introduces a benchmark for fake news detection and manipulation reasoning, referred to as Human-centric and Fact-related Fake News (HFFN) The benchmark highlights the centrality of human and the high factual relevance, with detailed manual annotations. A Multi-modal news Detection and Reasoning langUage Model (M-DRUM) is presented not only to judge on the authenticity of multi-modal news, but also raise analytical reasoning about potential manipulations.
  arXiv  Detail & Related papers  (2024-07-02T08:16:43Z)
• Exploring the Deceptive Power of LLM-Generated Fake News: A Study of Real-World Detection Challenges [21.425647152424585]
  We propose a strong fake news attack method called conditional Variational-autoencoder-Like Prompt (VLPrompt) Unlike current methods, VLPrompt eliminates the need for additional data collection while maintaining contextual coherence. Our experiments, including various detection methods and novel human study metrics, were conducted to assess their performance on our dataset.
  arXiv  Detail & Related papers  (2024-03-27T04:39:18Z)
• From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake News [38.990330255607276]
  We introduce a Fake news propagation simulation framework based on large language models (LLMs) Our simulation results uncover patterns in fake news propagation related to topic relevance, and individual traits, aligning with real-world observations.
  arXiv  Detail & Related papers  (2024-03-14T15:40:13Z)
• Adapting Fake News Detection to the Era of Large Language Models [48.5847914481222]
  We study the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news. Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa.
  arXiv  Detail & Related papers  (2023-11-02T08:39:45Z)
• Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection [50.07850264495737]
  "Prompt-and-Align" (P&A) is a novel prompt-based paradigm for few-shot fake news detection. We show that P&A sets new states-of-the-art for few-shot fake news detection performance by significant margins.
  arXiv  Detail & Related papers  (2023-09-28T13:19:43Z)
• Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
  Multiverse is a new feature based on multilingual evidence that can be used for fake news detection. The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
  arXiv  Detail & Related papers  (2022-11-25T18:24:17Z)
• A Multi-Policy Framework for Deep Learning-Based Fake News Detection [0.31498833540989407]
  This work introduces Multi-Policy Statement Checker (MPSC), a framework that automates fake news detection. MPSC uses deep learning techniques to analyze a statement itself and its related news articles, predicting whether it is seemingly credible or suspicious.
  arXiv  Detail & Related papers  (2022-06-01T21:25:21Z)
• SOK: Fake News Outbreak 2021: Can We Stop the Viral Spread? [5.64512235559998]
  Social Networks' omnipresence and ease of use has revolutionized the generation and distribution of information in today's world. Unlike traditional media channels, social networks facilitate faster and wider spread of disinformation and misinformation. Viral spread of false information has serious implications on the behaviors, attitudes and beliefs of the public.
  arXiv  Detail & Related papers  (2021-05-22T09:26:13Z)
• Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Media [1.7616042687330642]
  We propose a model for detecting fake news using stance as one of the features along with the content of the article. Our work interprets the content with automatic feature extraction and the relevance of the text pieces. The experiment conducted on the real-world dataset indicates that our model outperforms the previous work and enables fake news detection with an accuracy of 95.32%.
  arXiv  Detail & Related papers  (2021-05-21T10:46:43Z)
• How does Truth Evolve into Fake News? An Empirical Study of Fake News Evolution [55.27685924751459]
  We present the Fake News Evolution dataset: a new dataset tracking the fake news evolution process. Our dataset is composed of 950 paired data, each of which consists of articles representing the truth, the fake news, and the evolved fake news. We observe the features during the evolution and they are the disinformation techniques, text similarity, top 10 keywords, classification accuracy, parts of speech, and sentiment properties.
  arXiv  Detail & Related papers  (2021-03-10T09:01:34Z)
• Causal Understanding of Fake News Dissemination on Social Media [50.4854427067898]
  We argue that it is critical to understand what user attributes potentially cause users to share fake news. In fake news dissemination, confounders can be characterized by fake news sharing behavior that inherently relates to user attributes and online activities. We propose a principled approach to alleviating selection bias in fake news dissemination.
  arXiv  Detail & Related papers  (2020-10-20T19:37:04Z)
• Modeling the spread of fake news on Twitter [2.7910505923792637]
  We propose a point process model of the spread of fake news on Twitter. We show that the proposed model is superior to the current state-of-the-art methods in accurately predicting the evolution of the spread of a fake news item. The proposed model contributes to understanding the dynamics of the spread of fake news on social media.
  arXiv  Detail & Related papers  (2020-07-28T08:28:16Z)
• Machine Learning Explanations to Prevent Overtrust in Fake News Detection [64.46876057393703]
  This research investigates the effects of an Explainable AI assistant embedded in news review platforms for combating the propagation of fake news. We design a news reviewing and sharing interface, create a dataset of news stories, and train four interpretable fake news detection algorithms. For a deeper understanding of Explainable AI systems, we discuss interactions between user engagement, mental model, trust, and performance measures in the process of explaining.
  arXiv  Detail & Related papers  (2020-07-24T05:42:29Z)
• Leveraging Multi-Source Weak Social Supervision for Early Detection of Fake News [67.53424807783414]
  Social media has greatly enabled people to participate in online activities at an unprecedented rate. This unrestricted access also exacerbates the spread of misinformation and fake news online which might cause confusion and chaos unless being detected early for its mitigation. We jointly leverage the limited amount of clean data along with weak signals from social engagements to train deep neural networks in a meta-learning framework to estimate the quality of different weak instances. Experiments on realworld datasets demonstrate that the proposed framework outperforms state-of-the-art baselines for early detection of fake news without using any user engagements at prediction time.
  arXiv  Detail & Related papers  (2020-04-03T18:26:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.