ControBench: An Interaction-Aware Benchmark for Controversial Discourse Analysis on Social Networks

• URL: http://arxiv.org/abs/2605.00513v1
• Date: Fri, 01 May 2026 08:39:26 GMT
• Title: ControBench: An Interaction-Aware Benchmark for Controversial Discourse Analysis on Social Networks
• Abstract summary: ControBench is a benchmark for controversial discourse analysis.<n>It is built from Reddit discussions on Trump, abortion, and religion.<n>We evaluate graph neural networks, pretrained language models, and large language models on ControBench.
• Score: 17.87131765035957
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding how people argue across ideological divides online is important for studying political polarization, misinformation, and content moderation. Existing datasets capture only part of this problem: some preserve text but ignore interaction structure, some model structure without rich semantics, and others represent conversations without stable user-level ideological identity. We introduce ControBench, a benchmark for controversial discourse analysis that combines heterogeneous social interaction graphs with rich textual semantics. Built from Reddit discussions on three topics, Trump, abortion, and religion, ControBench contains 7,370 users, 1,783 posts, and 26,525 interactions. The graph contains user and post nodes connected by semantically enriched edges; in particular, user-comment-user edges encode both a reply and the parent comment that it responds to, preserving local argumentative context. User labels are derived from self-declared Reddit flairs, providing a scalable proxy for ideological identity without manual annotation. The resulting datasets exhibit low or negative adjusted homophily (Trump: -0.77, Abortion: 0.06, Religion: 0.04), reflecting the cross-cutting structure of real-world debate. We evaluate graph neural networks, pretrained language models, and large language models on ControBench and observe distinct performance patterns across topics and model families, especially when ideological boundaries are ambiguous. These results position ControBench as a challenging and realistic benchmark for controversial discourse analysis.

Related papers

• DeTox-Fed: Detecting Toxic Conversations in the Fediverse with Federated Graph Neural Networks [0.18665975431697424]
  DeTox-Fed is a graph-learning framework for detecting toxic conversations in decentralized social networks.<n>It combines conversational structure, user-interaction patterns, conversation-level statistics, and aggregate sentiment signals.<n>We show that it achieves stable toxic conversation detection under limited local labels, partial client participation, and varying moderation thresholds.
  arXiv  Detail & Related papers  (2026-05-20T11:41:27Z)
• Latent Topic Synthesis: Leveraging LLMs for Electoral Ad Analysis [51.95395936342771]
  We introduce an end-to-end framework for automatically generating an interpretable topic taxonomy from an unlabeled corpus.<n>We apply this framework to a large corpus of Meta political ads from the month ahead of the 2024 U.S. Presidential election.<n>Our approach uncovers latent discourse structures, synthesizes semantically rich topic labels, and annotates topics with moral framing dimensions.
  arXiv  Detail & Related papers  (2025-10-16T20:30:20Z)
• Identifying & Interactively Refining Ambiguous User Goals for Data Visualization Code Generation [48.63200319578052]
  We develop a taxonomy of types of ambiguity that arise in this task and propose metrics to quantify them.<n>Our work also explores how multi-turn dialogue can reduce ambiguity, therefore, improve code accuracy by better matching user goals.
  arXiv  Detail & Related papers  (2025-10-10T13:44:40Z)
• GASCOM: Graph-based Attentive Semantic Context Modeling for Online Conversation Understanding [4.9711707739781215]
  We propose a Graph-based Attentive Semantic COntext Modeling (GASCOM) framework for online conversation understanding. Specifically, we design two novel algorithms that utilise both the graph structure of the online conversation as well as the semantic information from individual posts. Our proposed framework significantly outperforms state-of-the-art methods on both tasks.
  arXiv  Detail & Related papers  (2023-10-21T14:45:26Z)
• When Crowd Meets Persona: Creating a Large-Scale Open-Domain Persona Dialogue Corpus [13.051107304650627]
  Building a natural language dataset requires caution since word semantics is vulnerable to subtle text change or the definition of the annotated concept. In this study, we tackle these issues when creating a large-scale open-domain persona dialogue corpus.
  arXiv  Detail & Related papers  (2023-04-01T16:10:36Z)
• CoSyn: Detecting Implicit Hate Speech in Online Conversations Using a Context Synergized Hyperbolic Network [52.85130555886915]
  CoSyn is a context-synergized neural network that explicitly incorporates user- and conversational context for detecting implicit hate speech in online conversations. We show that CoSyn outperforms all our baselines in detecting implicit hate speech with absolute improvements in the range of 1.24% - 57.8%.
  arXiv  Detail & Related papers  (2023-03-02T17:30:43Z)
• A Graph-Based Context-Aware Model to Understand Online Conversations [3.8345539498627437]
  In online conversations, comments and replies may be based on external context beyond the immediately relevant information. We propose GraphNLI, a novel graph-based deep learning architecture that uses graph walks to incorporate the wider context of a conversation. We evaluate GraphNLI on two such tasks - polarity prediction and misogynistic hate speech detection.
  arXiv  Detail & Related papers  (2022-11-16T20:51:45Z)
• GraphNLI: A Graph-based Natural Language Inference Model for Polarity Prediction in Online Debates [3.8345539498627437]
  We propose GraphNLI, a novel graph-based deep learning architecture that uses graph walk techniques to capture the wider context of a discussion thread. We then use these embeddings to predict the polarity relation between a reply and the post it is replying to. Our model outperforms relevant baselines, including S-BERT, with an overall accuracy of 83%.
  arXiv  Detail & Related papers  (2022-02-16T16:26:21Z)
• ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Mining [61.82562838486632]
  We crowdsource four new datasets on diverse online conversation forms of news comments, discussion forums, community question answering forums, and email threads. We benchmark state-of-the-art models on our datasets and analyze characteristics associated with the data.
  arXiv  Detail & Related papers  (2021-06-01T22:17:13Z)
• Weakly-Supervised Aspect-Based Sentiment Analysis via Joint Aspect-Sentiment Topic Embedding [71.2260967797055]
  We propose a weakly-supervised approach for aspect-based sentiment analysis. We learn sentiment, aspect> joint topic embeddings in the word embedding space. We then use neural models to generalize the word-level discriminative information.
  arXiv  Detail & Related papers  (2020-10-13T21:33:24Z)
• A Deep Neural Framework for Contextual Affect Detection [51.378225388679425]
  A short and simple text carrying no emotion can represent some strong emotions when reading along with its context. We propose a Contextual Affect Detection framework which learns the inter-dependence of words in a sentence.
  arXiv  Detail & Related papers  (2020-01-28T05:03:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.