Measuring Social Media Polarization Using Large Language Models and Heuristic Rules

• URL: http://arxiv.org/abs/2601.00927v1
• Date: Fri, 02 Jan 2026 01:11:58 GMT
• Title: Measuring Social Media Polarization Using Large Language Models and Heuristic Rules
• Authors: Jawad Chowdhury, Rezaur Rashid, Gabriel Terejanu,
• Abstract summary: This study systematically analyze and quantify affective polarization in discussions on divisive topics such as climate change and gun control.<n>By combining AI-driven content annotation with domain-informed scoring, our framework offers a scalable and interpretable approach to measuring affective polarization.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding affective polarization in online discourse is crucial for evaluating the societal impact of social media interactions. This study presents a novel framework that leverages large language models (LLMs) and domain-informed heuristics to systematically analyze and quantify affective polarization in discussions on divisive topics such as climate change and gun control. Unlike most prior approaches that relied on sentiment analysis or predefined classifiers, our method integrates LLMs to extract stance, affective tone, and agreement patterns from large-scale social media discussions. We then apply a rule-based scoring system capable of quantifying affective polarization even in small conversations consisting of single interactions, based on stance alignment, emotional content, and interaction dynamics. Our analysis reveals distinct polarization patterns that are event dependent: (i) anticipation-driven polarization, where extreme polarization escalates before well-publicized events, and (ii) reactive polarization, where intense affective polarization spikes immediately after sudden, high-impact events. By combining AI-driven content annotation with domain-informed scoring, our framework offers a scalable and interpretable approach to measuring affective polarization. The source code is publicly available at: https://github.com/hasanjawad001/llm-social-media-polarization.

Related papers

• A Natural Language Agentic Approach to Study Affective Polarization [2.6363860776602333]
  Affective polarization has been central to political and social studies, with growing focus on social media.<n>We present a multi-agent model providing a comprehensive approach to studying affective polarization in social media.<n>We develop a platform leveraging large language models (LLMs) to construct virtual communities where agents engage in discussions.
  arXiv  Detail & Related papers  (2026-03-03T08:02:58Z)
• Unveiling Affective Polarization Trends in Parliamentary Proceedings [6.373171949526166]
  Using measures of Valence, Arousal and Dominance, we detect signals of emotional discourse.<n>We find that the emotional style of members of government differs from that of opposition members.
  arXiv  Detail & Related papers  (2025-12-04T20:13:43Z)
• Latent Topic Synthesis: Leveraging LLMs for Electoral Ad Analysis [51.95395936342771]
  We introduce an end-to-end framework for automatically generating an interpretable topic taxonomy from an unlabeled corpus.<n>We apply this framework to a large corpus of Meta political ads from the month ahead of the 2024 U.S. Presidential election.<n>Our approach uncovers latent discourse structures, synthesizes semantically rich topic labels, and annotates topics with moral framing dimensions.
  arXiv  Detail & Related papers  (2025-10-16T20:30:20Z)
• BIPOLAR: Polarization-based granular framework for LLM bias evaluation [0.0]
  This study proposes a reusable, granular, and topic-agnostic framework to evaluate polarisation-related biases in large language models.<n>Our approach combines polarisation-sensitive sentiment metrics with a synthetically generated balanced dataset of conflict-related statements.<n>As a case study, we created a synthetic dataset that focusses on the Russia-Ukraine war, and we evaluated the bias in several LLMs.
  arXiv  Detail & Related papers  (2025-08-14T20:44:19Z)
• Aligning Spoken Dialogue Models from User Interactions [55.192134724622235]
  We propose a novel preference alignment framework to improve spoken dialogue models on realtime conversations from user interactions.<n>We create a dataset of more than 150,000 preference pairs from raw multi-turn speech conversations annotated with AI feedback.<n>Our findings shed light on the importance of a well-calibrated balance among various dynamics, crucial for natural real-time speech dialogue systems.
  arXiv  Detail & Related papers  (2025-06-26T16:45:20Z)
• Quantifying Polarization: A Comparative Study of Measures and Methods [2.0249250133493195]
  Political polarization, a key driver of social fragmentation, has drawn increasing attention for its role in shaping online and offline discourse.<n>This study evaluates five widely used polarization measures, testing their strengths and weaknesses with synthetic datasets.<n>We present a novel adaptation of Kleinberg's burst detection algorithm to improve mode detection in polarized distributions.
  arXiv  Detail & Related papers  (2025-01-13T16:43:23Z)
• Emergence of human-like polarization among large language model agents [79.96817421756668]
  We simulate a networked system involving thousands of large language model agents, discovering their social interactions, result in human-like polarization.<n>Similarities between humans and LLM agents raise concerns about their capacity to amplify societal polarization, but also hold the potential to serve as a valuable testbed for identifying plausible strategies to mitigate polarization and its consequences.
  arXiv  Detail & Related papers  (2025-01-09T11:45:05Z)
• In-Group Love, Out-Group Hate: A Framework to Measure Affective Polarization via Contentious Online Discussions [2.8963943201523796]
  We introduce a discrete choice model that captures decision-making within affectively polarized social networks.<n>We propose a statistical inference method estimate key parameters -- in-group love and out-group hate -- from social media data.
  arXiv  Detail & Related papers  (2024-12-18T23:58:13Z)
• Polarity Calibration for Opinion Summarization [46.83053173308394]
  Polarity calibration aims to align the polarity of output summary with that of input text. We evaluate our model on two types of opinions summarization tasks: summarizing product reviews and political opinions articles.
  arXiv  Detail & Related papers  (2024-04-02T07:43:12Z)
• Mitigating Framing Bias with Polarity Minimization Loss [56.24404488440295]
  Framing bias plays a significant role in exacerbating political polarization by distorting the perception of actual events. We propose a new loss function that encourages the model to minimize the polarity difference between the polarized input articles to reduce framing bias.
  arXiv  Detail & Related papers  (2023-11-03T09:50:23Z)
• Dynamic Causal Disentanglement Model for Dialogue Emotion Detection [77.96255121683011]
  We propose a Dynamic Causal Disentanglement Model based on hidden variable separation. This model effectively decomposes the content of dialogues and investigates the temporal accumulation of emotions. Specifically, we propose a dynamic temporal disentanglement model to infer the propagation of utterances and hidden variables.
  arXiv  Detail & Related papers  (2023-09-13T12:58:09Z)
• Designing Recommender Systems to Depolarize [0.32634122554913997]
  Polarization is implicated in the erosion of democracy and the progression to violence. While algorithm-driven social media does not seem to be a primary driver of polarization at the country level, it could be a useful intervention point in polarized societies. This paper examines algorithmic depolarization interventions with the goal of conflict transformation.
  arXiv  Detail & Related papers  (2021-07-11T03:23:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.