Contextualized Counterspeech Can Be More Persuasive Than Generic Counterspeech

• URL: http://arxiv.org/abs/2607.26236v1
• Date: Tue, 28 Jul 2026 20:16:06 GMT
• Title: Contextualized Counterspeech Can Be More Persuasive Than Generic Counterspeech
• Abstract summary: We propose and evaluate strategies for generating contextualized counterspeech adapted to the moderation setting and personalized to the moderated user.<n>We implement algorithmic measures of counterspeech quality based on ROUGE, BLEU, and BERTScore.<n>Our findings show that personalization can be effective, but not uniformly so.
• Score: 9.595956819209263
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: AI-generated counterspeech offers a scalable and effective strategy to mitigate online toxicity by promoting more constructive dialogue. Yet, existing approaches adopt a generic, one-size-fits-all paradigm, overlooking the conversational context and characteristics of the targeted users. Here, we propose and evaluate multiple strategies for generating contextualized counterspeech that is adapted to the moderation setting and personalized to the moderated user. In detail, we explore a range of configurations that integrate different forms of contextual information and fine-tuning techniques. We conduct a comprehensive evaluation combining quantitative indicators with a pre-registered, mixed-design crowdsourcing experiment. To ensure robustness, we implement algorithmic measures of counterspeech quality based on ROUGE, BLEU, and BERTScore, observing overall consistent results across metrics. Furthermore, we analyze which characteristics of both the generated counterspeech and the moderated toxic message most strongly influence perceived persuasiveness, yielding insights into how contextualized interventions can be made more effective. Our findings show that personalization can be effective, but not uniformly so. Lightweight strategies combining conversational context and user history improve perceived adequacy and persuasiveness, whereas several other contextualization strategies degrade human-perceived counterspeech quality. Taken together, these results provide actionable directions for developing more personalized, effective, and responsible counterspeech systems, ultimately advancing human-AI collaboration in online content moderation.

Related papers

• Character Beyond Speech: Leveraging Role-Playing Evaluation in Audio Large Language Models via Reinforcement Learning [57.22705949022221]
  RoleJudge is an evaluation framework that leverages audio large language models to assess the alignment between speech and character.<n>We introduce RoleChat, the first voice role-playing evaluation dataset enriched with chain-of-thought reasoning annotations.
  arXiv  Detail & Related papers  (2026-04-15T12:39:03Z)
• Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning [66.52010873968383]
  We introduce a conversational agent that interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through reinforcement learning (RL) training.<n>The experimental results across four widely used conversational benchmarks demonstrate the effectiveness of our methods.
  arXiv  Detail & Related papers  (2026-01-19T14:55:54Z)
• Aligning Spoken Dialogue Models from User Interactions [55.192134724622235]
  We propose a novel preference alignment framework to improve spoken dialogue models on realtime conversations from user interactions.<n>We create a dataset of more than 150,000 preference pairs from raw multi-turn speech conversations annotated with AI feedback.<n>Our findings shed light on the importance of a well-calibrated balance among various dynamics, crucial for natural real-time speech dialogue systems.
  arXiv  Detail & Related papers  (2025-06-26T16:45:20Z)
• Causal Discovery and Counterfactual Reasoning to Optimize Persuasive Dialogue Policies [14.324214906731923]
  We use causal discovery and counterfactual reasoning to optimize system persuasion capability and outcomes.<n>Our experiments with the PersuasionForGood dataset show measurable improvements in persuasion outcomes.
  arXiv  Detail & Related papers  (2025-03-19T06:06:10Z)
• Contextualized Counterspeech: Strategies for Adaptation, Personalization, and Evaluation [2.1944577276732726]
  We propose and evaluate strategies for generating tailored counterspeech that is adapted to the moderation context and personalized for the moderated user.<n>Results show that contextualized counterspeech can significantly outperform state-of-the-art generic counterspeech in adequacy and persuasiveness.<n>The effectiveness of contextualized AI-generated counterspeech and the divergence between human and algorithmic evaluations underscore the importance of increased human-AI collaboration in content moderation.
  arXiv  Detail & Related papers  (2024-12-10T09:29:52Z)
• Assessing the Human Likeness of AI-Generated Counterspeech [10.434435022492723]
  This paper investigates the human likeness of AI-generated counterspeech.<n>We implement and evaluate several LLM-based generation strategies.<n>We reveal differences in linguistic characteristics, politeness, and specificity.
  arXiv  Detail & Related papers  (2024-10-14T18:48:47Z)
• Counterfactual Reasoning Using Predicted Latent Personality Dimensions for Optimizing Persuasion Outcome [13.731895847081953]
  We present a novel approach that tracks a user's latent personality dimensions (LPDs) during ongoing persuasion conversation. We generate tailored counterfactual utterances based on these LPDs to optimize the overall persuasion outcome.
  arXiv  Detail & Related papers  (2024-04-21T23:03:47Z)
• On the Behavior of Intrusive and Non-intrusive Speech Enhancement Metrics in Predictive and Generative Settings [14.734454356396157]
  We evaluate the performance of the same speech enhancement backbone trained under predictive and generative paradigms. We show that intrusive and non-intrusive measures correlate differently for each paradigm.
  arXiv  Detail & Related papers  (2023-06-05T16:30:17Z)
• Controllable Mixed-Initiative Dialogue Generation through Prompting [50.03458333265885]
  Mixed-initiative dialogue tasks involve repeated exchanges of information and conversational control. Agents gain control by generating responses that follow particular dialogue intents or strategies, prescribed by a policy planner. Standard approach has been fine-tuning pre-trained language models to perform generation conditioned on these intents. We instead prompt large language models as a drop-in replacement to fine-tuning on conditional generation.
  arXiv  Detail & Related papers  (2023-05-06T23:11:25Z)
• Towards Robust Speech-to-Text Adversarial Attack [78.5097679815944]
  This paper introduces a novel adversarial algorithm for attacking the state-of-the-art speech-to-text systems, namely DeepSpeech, Kaldi, and Lingvo. Our approach is based on developing an extension for the conventional distortion condition of the adversarial optimization formulation. Minimizing over this metric, which measures the discrepancies between original and adversarial samples' distributions, contributes to crafting signals very close to the subspace of legitimate speech recordings.
  arXiv  Detail & Related papers  (2021-03-15T01:51:41Z)
• You Impress Me: Dialogue Generation via Mutual Persona Perception [62.89449096369027]
  The research in cognitive science suggests that understanding is an essential signal for a high-quality chit-chat conversation. Motivated by this, we propose P2 Bot, a transmitter-receiver based framework with the aim of explicitly modeling understanding.
  arXiv  Detail & Related papers  (2020-04-11T12:51:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.