From a Tiny Slip to a Giant Leap: An LLM-Based Simulation for Fake News Evolution

• URL: http://arxiv.org/abs/2410.19064v1
• Date: Thu, 24 Oct 2024 18:17:16 GMT
• Title: From a Tiny Slip to a Giant Leap: An LLM-Based Simulation for Fake News Evolution
• Authors: Yuhan Liu, Zirui Song, Xiaoqing Zhang, Xiuying Chen, Rui Yan,
• Abstract summary: We propose a Fake News evolUtion Simulation framEwork based on large language models (LLMs) We define four types of agents commonly observed in daily interactions: spreaders, who propagate information; commentators, who provide opinions and interpretations; verifiers, who check the accuracy of information and bystanders, who passively observe without engaging. Given the lack of prior work in this area, we developed a FUSE-EVAL evaluation framework to measure the deviation from true news during the fake news evolution process.
• Score: 35.82418316346851
• License:
• Abstract: With the growing spread of misinformation online, research has increasingly focused on detecting and tracking fake news. However, an overlooked issue is that fake news does not naturally exist in social networks -- it often originates from distorted facts or deliberate fabrication by malicious actors. Understanding how true news gradually evolves into fake news is critical for early detection and prevention, reducing its spread and impact. Hence, in this paper, we take the first step toward simulating and revealing this evolution, proposing a Fake News evolUtion Simulation framEwork (FUSE) based on large language models (LLMs). Specifically, we employ LLM as agents to represent individuals in a simulated social network. We define four types of agents commonly observed in daily interactions: spreaders, who propagate information; commentators, who provide opinions and interpretations; verifiers, who check the accuracy of information; and bystanders, who passively observe without engaging. For simulated environments, we model various social network structures, such as high-clustering networks and scale-free networks, to mirror real-world network dynamics. Each day, the agents engage in belief exchanges, reflect on their thought processes, and reintroduce the news accordingly. Given the lack of prior work in this area, we developed a FUSE-EVAL evaluation framework to measure the deviation from true news during the fake news evolution process. The results show that FUSE successfully captures the underlying patterns of how true news transforms into fake news and accurately reproduces previously discovered instances of fake news, aligning closely with human evaluations. Moreover, our work provides insights into the fact that combating fake news should not be delayed until it has fully evolved; instead, prevention in advance is key to achieving better outcomes.

Related papers

• From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake News [38.990330255607276]
  We introduce a Fake news propagation simulation framework based on large language models (LLMs) Our simulation results uncover patterns in fake news propagation related to topic relevance, and individual traits, aligning with real-world observations.
  arXiv  Detail & Related papers  (2024-03-14T15:40:13Z)
• Adapting Fake News Detection to the Era of Large Language Models [48.5847914481222]
  We study the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news. Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa.
  arXiv  Detail & Related papers  (2023-11-02T08:39:45Z)
• Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection [50.07850264495737]
  "Prompt-and-Align" (P&A) is a novel prompt-based paradigm for few-shot fake news detection. We show that P&A sets new states-of-the-art for few-shot fake news detection performance by significant margins.
  arXiv  Detail & Related papers  (2023-09-28T13:19:43Z)
• SOK: Fake News Outbreak 2021: Can We Stop the Viral Spread? [5.64512235559998]
  Social Networks' omnipresence and ease of use has revolutionized the generation and distribution of information in today's world. Unlike traditional media channels, social networks facilitate faster and wider spread of disinformation and misinformation. Viral spread of false information has serious implications on the behaviors, attitudes and beliefs of the public.
  arXiv  Detail & Related papers  (2021-05-22T09:26:13Z)
• Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Media [1.7616042687330642]
  We propose a model for detecting fake news using stance as one of the features along with the content of the article. Our work interprets the content with automatic feature extraction and the relevance of the text pieces. The experiment conducted on the real-world dataset indicates that our model outperforms the previous work and enables fake news detection with an accuracy of 95.32%.
  arXiv  Detail & Related papers  (2021-05-21T10:46:43Z)
• How does Truth Evolve into Fake News? An Empirical Study of Fake News Evolution [55.27685924751459]
  We present the Fake News Evolution dataset: a new dataset tracking the fake news evolution process. Our dataset is composed of 950 paired data, each of which consists of articles representing the truth, the fake news, and the evolved fake news. We observe the features during the evolution and they are the disinformation techniques, text similarity, top 10 keywords, classification accuracy, parts of speech, and sentiment properties.
  arXiv  Detail & Related papers  (2021-03-10T09:01:34Z)
• Causal Understanding of Fake News Dissemination on Social Media [50.4854427067898]
  We argue that it is critical to understand what user attributes potentially cause users to share fake news. In fake news dissemination, confounders can be characterized by fake news sharing behavior that inherently relates to user attributes and online activities. We propose a principled approach to alleviating selection bias in fake news dissemination.
  arXiv  Detail & Related papers  (2020-10-20T19:37:04Z)
• Modeling the spread of fake news on Twitter [2.7910505923792637]
  We propose a point process model of the spread of fake news on Twitter. We show that the proposed model is superior to the current state-of-the-art methods in accurately predicting the evolution of the spread of a fake news item. The proposed model contributes to understanding the dynamics of the spread of fake news on social media.
  arXiv  Detail & Related papers  (2020-07-28T08:28:16Z)
• Leveraging Multi-Source Weak Social Supervision for Early Detection of Fake News [67.53424807783414]
  Social media has greatly enabled people to participate in online activities at an unprecedented rate. This unrestricted access also exacerbates the spread of misinformation and fake news online which might cause confusion and chaos unless being detected early for its mitigation. We jointly leverage the limited amount of clean data along with weak signals from social engagements to train deep neural networks in a meta-learning framework to estimate the quality of different weak instances. Experiments on realworld datasets demonstrate that the proposed framework outperforms state-of-the-art baselines for early detection of fake news without using any user engagements at prediction time.
  arXiv  Detail & Related papers  (2020-04-03T18:26:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.