Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithms

• URL: http://arxiv.org/abs/2310.05984v1
• Date: Thu, 5 Oct 2023 18:26:06 GMT
• Title: Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithms
• Authors: Petter T\"ornberg, Diliara Valeeva, Justus Uitermark, Christopher Bail
• Abstract summary: Social media is often criticized for amplifying toxic discourse and discouraging constructive conversations. This paper asks whether simulating social media can help researchers study how different news feed algorithms shape the quality of online conversations.
• Score: 8.602553195689513
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Social media is often criticized for amplifying toxic discourse and discouraging constructive conversations. But designing social media platforms to promote better conversations is inherently challenging. This paper asks whether simulating social media through a combination of Large Language Models (LLM) and Agent-Based Modeling can help researchers study how different news feed algorithms shape the quality of online conversations. We create realistic personas using data from the American National Election Study to populate simulated social media platforms. Next, we prompt the agents to read and share news articles - and like or comment upon each other's messages - within three platforms that use different news feed algorithms. In the first platform, users see the most liked and commented posts from users whom they follow. In the second, they see posts from all users - even those outside their own network. The third platform employs a novel "bridging" algorithm that highlights posts that are liked by people with opposing political views. We find this bridging algorithm promotes more constructive, non-toxic, conversation across political divides than the other two models. Though further research is needed to evaluate these findings, we argue that LLMs hold considerable potential to improve simulation research on social media and many other complex social settings.

Related papers

• Echo Chambers in the Age of Algorithms: An Audit of Twitter's Friend Recommender System [2.8186456204337746]
  We conduct an algorithmic audit of Twitter's Who-To-Follow friend recommendation system. We create automated Twitter accounts that initially follow left and right affiliated U.S. politicians during the 2022 U.S. midterm elections. We find that while following the recommendation algorithm leads accounts into dense and reciprocal neighborhoods that structurally resemble echo chambers, the recommender also results in less political homogeneity of a user's network.
  arXiv  Detail & Related papers  (2024-04-09T16:12:22Z)
• Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference [48.99117537559644]
  We introduce Arena, an open platform for evaluating Large Language Models (LLMs) based on human preferences. Our methodology employs a pairwise comparison approach and leverages input from a diverse user base through crowdsourcing. This paper describes the platform, analyzes the data we have collected so far, and explains the tried-and-true statistical methods we are using.
  arXiv  Detail & Related papers  (2024-03-07T01:22:38Z)
• InfoPattern: Unveiling Information Propagation Patterns in Social Media [59.67008841974645]
  InfoPattern centers on the interplay between language and human ideology. The demo is capable of: (1) red teaming to simulate adversary responses from opposite ideology communities; (2) stance detection to identify the underlying political sentiments in each message; (3) information propagation graph discovery to reveal the evolution of claims across various communities over time.
  arXiv  Detail & Related papers  (2023-11-27T09:12:35Z)
• Exploring Embeddings for Measuring Text Relatedness: Unveiling Sentiments and Relationships in Online Comments [1.7230140898679147]
  This paper investigates sentiment and semantic relationships among comments across various social media platforms. It uses word embeddings to analyze components in sentences and documents. Our analysis will enable a deeper understanding of the interconnectedness of online comments and will investigate the notion of the internet functioning as a large interconnected brain.
  arXiv  Detail & Related papers  (2023-09-15T04:57:23Z)
• News consumption and social media regulations policy [70.31753171707005]
  We analyze two social media that enforced opposite moderation methods, Twitter and Gab, to assess the interplay between news consumption and content regulation. Our results show that the presence of moderation pursued by Twitter produces a significant reduction of questionable content. The lack of clear regulation on Gab results in the tendency of the user to engage with both types of content, showing a slight preference for the questionable ones which may account for a dissing/endorsement behavior.
  arXiv  Detail & Related papers  (2021-06-07T19:26:32Z)
• Can You be More Social? Injecting Politeness and Positivity into Task-Oriented Conversational Agents [60.27066549589362]
  Social language used by human agents is associated with greater users' responsiveness and task completion. The model uses a sequence-to-sequence deep learning architecture, extended with a social language understanding element. Evaluation in terms of content preservation and social language level using both human judgment and automatic linguistic measures shows that the model can generate responses that enable agents to address users' issues in a more socially appropriate way.
  arXiv  Detail & Related papers  (2020-12-29T08:22:48Z)
• Analysing Social Media Network Data with R: Semi-Automated Screening of Users, Comments and Communication Patterns [0.0]
  Communication on social media platforms is increasingly widespread across societies. Fake news, hate speech and radicalizing elements are part of this modern form of communication. A basic understanding of these mechanisms and communication patterns could help to counteract negative forms of communication.
  arXiv  Detail & Related papers  (2020-11-26T14:52:01Z)
• Political audience diversity and news reliability in algorithmic ranking [54.23273310155137]
  We propose using the political diversity of a website's audience as a quality signal. Using news source reliability ratings from domain experts and web browsing data from a diverse sample of 6,890 U.S. citizens, we first show that websites with more extreme and less politically diverse audiences have lower journalistic standards.
  arXiv  Detail & Related papers  (2020-07-16T02:13:55Z)
• Echo Chambers on Social Media: A comparative analysis [64.2256216637683]
  We introduce an operational definition of echo chambers and perform a massive comparative analysis on 1B pieces of contents produced by 1M users on four social media platforms. We infer the leaning of users about controversial topics and reconstruct their interaction networks by analyzing different features. We find support for the hypothesis that platforms implementing news feed algorithms like Facebook may elicit the emergence of echo-chambers.
  arXiv  Detail & Related papers  (2020-04-20T20:00:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.