Toxicity in Twitch Chats: An LLM-Based Analysis Across Gaming Communities

• URL: http://arxiv.org/abs/2605.24000v1
• Date: Mon, 18 May 2026 15:29:21 GMT
• Title: Toxicity in Twitch Chats: An LLM-Based Analysis Across Gaming Communities
• Abstract summary: We analyze 20 million chat messages from 4,452 streams, spanning seven game genres on Twitch.<n>We categorize messages according to Twitch's toxicity taxonomy with a pre-trained Large Language Model using zero-shot classification.<n>Our analysis reveals that 2.4% of all messages are classified as toxic, with notable differences across genres.
• Score: 37.781069460376315
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Toxicity in online gaming communities remains a persistent challenge, manifesting across genres, platforms, and player interactions. While much research is focused on in-game toxicity, less is known about how toxic behavior varies between gaming communities on streaming platforms. To address this shortcoming, we analyze approximately 20 million chat messages from 4,452 streams, spanning seven game genres on Twitch. We categorize messages according to Twitch's toxicity taxonomy with a pre-trained Large Language Model using zero-shot classification. The taxonomy comprises four categories and eight subclasses, including harassment, discrimination, sexual content, and profanity. Our approach achieves an F1 score of 94.5% on the TextDetox dataset and demonstrates human-model agreement comparable to inter-human agreement. Our analysis reveals that 2.4% of all messages are classified as toxic, with notable differences across genres: streams of MOBA games exhibit the highest relative rate of toxicity (3.2%), and sports games show the lowest rate (2%). Furthermore, results indicate that individual games differ significantly in their toxicity distributions, even within genres, suggesting the existence of game-specific community norms and mechanics that shape toxic behavior beyond genre-level effects. These findings offer empirical insights into genre- and game-specific toxicity patterns on Twitch and can inform more targeted moderation strategies for gaming communities.

Related papers

• "Shut Up and Let Me Enjoy My Otome": Understanding and Measuring the Toxicity in Otome Game Communities [20.305306682682087]
  We present the first large-scale measurement of toxicity in otome game communities across social platforms.<n>We introduce OtomeSCAN, a framework for collecting, evaluating, and analyzing 620,045 posts from Weibo and Reddit spanning 18 months.<n>Our analysis reveals significant platform-based differences in toxicity: 22.20% of otome-related posts on Weibo are toxic, compared to 3.71% on Reddit.
  arXiv  Detail & Related papers  (2026-09-07T21:44:53Z)
• ToxiTwitch: Toward Emote-Aware Hybrid Moderation for Live Streaming Platforms [4.632366780742502]
  We present an exploratory comparison of toxicity detection approaches tailored to Twitch.<n>Our analysis reveals that incorporating emotes improves the detection of toxic behavior.<n>ToxiTwitch is a hybrid model that combines LLM-generated embeddings of text and emotes with traditional machine learning classifiers.
  arXiv  Detail & Related papers  (2026-01-22T03:12:17Z)
• Self-Anchored Attention Model for Sample-Efficient Classification of Prosocial Text Chat [44.52122332148653]
  This research is novel in applying NLP techniques to discover and classify prosocial behaviors in player in-game chat communication.<n>It can help shift the focus of moderation from solely penalizing toxicity to actively encouraging positive interactions on online platforms.
  arXiv  Detail & Related papers  (2025-06-10T21:40:54Z)
• Uncovering the Viral Nature of Toxicity in Competitive Online Video Games [0.4681661603096334]
  We analyze proprietary data from the free-to-play first-person action game Call of Duty: Warzone.<n>All of a player's teammates engaging in toxic speech increases their probability of engaging in similar behavior by 26.1 to 30.3 times the average player's likelihood of engaging in toxic speech.
  arXiv  Detail & Related papers  (2024-10-01T18:07:06Z)
• Unveiling the Implicit Toxicity in Large Language Models [77.90933074675543]
  The open-endedness of large language models (LLMs) combined with their impressive capabilities may lead to new safety issues when being exploited for malicious use. We show that LLMs can generate diverse implicit toxic outputs that are exceptionally difficult to detect via simply zero-shot prompting. We propose a reinforcement learning (RL) based attacking method to further induce the implicit toxicity in LLMs.
  arXiv  Detail & Related papers  (2023-11-29T06:42:36Z)
• Towards Detecting Contextual Real-Time Toxicity for In-Game Chat [5.371337604556311]
  ToxBuster is a scalable model that reliably detects toxic content in real-time for a line of chat by including chat history and metadata. ToxBuster consistently outperforms conventional toxicity models across popular multiplayer games, including Rainbow Six Siege, For Honor, and DOTA 2.
  arXiv  Detail & Related papers  (2023-10-20T00:29:57Z)
• Analyzing Norm Violations in Live-Stream Chat [49.120561596550395]
  We study the first NLP study dedicated to detecting norm violations in conversations on live-streaming platforms. We define norm violation categories in live-stream chats and annotate 4,583 moderated comments from Twitch. Our results show that appropriate contextual information can boost moderation performance by 35%.
  arXiv  Detail & Related papers  (2023-05-18T05:58:27Z)
• In-game Toxic Language Detection: Shared Task and Attention Residuals [10.670973882076797]
  In-game toxic language becomes the hot potato in the gaming industry and community.<n>It is still challenging to detect toxicity due to the nature of in-game chat, which has extremely short length.<n>In this paper, we describe how the in-game toxic language shared task has been established using the real-world in-game chat data.
  arXiv  Detail & Related papers  (2022-11-11T04:33:45Z)
• Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection [75.54119209776894]
  We investigate the effect of annotator identities (who) and beliefs (why) on toxic language annotations. We consider posts with three characteristics: anti-Black language, African American English dialect, and vulgarity. Our results show strong associations between annotator identity and beliefs and their ratings of toxicity.
  arXiv  Detail & Related papers  (2021-11-15T18:58:20Z)
• Mitigating Biases in Toxic Language Detection through Invariant Rationalization [70.36701068616367]
  biases toward some attributes, including gender, race, and dialect, exist in most training datasets for toxicity detection. We propose to use invariant rationalization (InvRat), a game-theoretic framework consisting of a rationale generator and a predictor, to rule out the spurious correlation of certain syntactic patterns. Our method yields lower false positive rate in both lexical and dialectal attributes than previous debiasing methods.
  arXiv  Detail & Related papers  (2021-06-14T08:49:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.