DeTox-Fed: Detecting Toxic Conversations in the Fediverse with Federated Graph Neural Networks
- URL: http://arxiv.org/abs/2605.21054v1
- Date: Wed, 20 May 2026 11:41:27 GMT
- Title: DeTox-Fed: Detecting Toxic Conversations in the Fediverse with Federated Graph Neural Networks
- Abstract summary: DeTox-Fed is a graph-learning framework for detecting toxic conversations in decentralized social networks.<n>It combines conversational structure, user-interaction patterns, conversation-level statistics, and aggregate sentiment signals.<n>We show that it achieves stable toxic conversation detection under limited local labels, partial client participation, and varying moderation thresholds.
- Score: 0.18665975431697424
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The rise of decentralized social networks (DSNs), and in particular the rapid uptake of the Fediverse (e.g., Pleroma, Mastodon, Lemygrad), introduces new challenges in content moderation. Independent instances host their own data, follow different moderation policies, and often observe only partial views of conversations. We present DeTox-Fed, a federated graph-learning framework for detecting toxic conversations in DSNs without requiring instances to share raw conversations or moderation labels. Each instance constructs a local conversation graph, where nodes represent conversation trees and edges capture shared user participation across conversations. A Graph Neural Network (GNN) is then trained in a federated learning setup, allowing instances to collaboratively learn a toxicity classifier while preserving data locality. Unlike text-only moderation approaches, DeTox-Fed combines conversational structure, user-interaction patterns, conversation-level statistics, and aggregate sentiment signals. We evaluate the framework on a large Pleroma conversation dataset and show that it achieves stable toxic conversation detection under limited local labels, partial client participation, and varying moderation thresholds. Our results indicate that federated graph-based moderation is a promising direction for semi-automated moderation in decentralized social networks.
Related papers
- TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue [79.83228182492354]
Speakers in natural conversation take turns speaking and listening, deciding in real time when to take, hold, or yield the floor.<n>We present TurnBench, a benchmark that pairs a 30-hour, hand-labeled corpus of dyadic human conversation with a standardized evaluation protocol for end-of-turn and interruption detection.<n>We find end-of-turn recall stable across types, while interruption false positives are strongly type-dependent and concentrated in backchannel-dense interaction styles.
arXiv Detail & Related papers (2026-08-25T23:14:36Z) - ControBench: An Interaction-Aware Benchmark for Controversial Discourse Analysis on Social Networks [17.87131765035957]
ControBench is a benchmark for controversial discourse analysis.<n>It is built from Reddit discussions on Trump, abortion, and religion.<n>We evaluate graph neural networks, pretrained language models, and large language models on ControBench.
arXiv Detail & Related papers (2026-05-01T08:39:26Z) - Temporal Graph Network: Hallucination Detection in Multi-Turn Conversation [0.9064542163606172]
Hallucinations can be produced by conversational AI systems.<n>We present a novel graph-based method for detecting dialogue-level hallucinations.<n>Our framework models each dialogue as a node, encoding it using a sentence transformer.
arXiv Detail & Related papers (2026-01-06T14:34:45Z) - Integrating Large Language Models with Graph-based Reasoning for Conversational Question Answering [58.17090503446995]
We focus on a conversational question answering task which combines the challenges of understanding questions in context and reasoning over evidence gathered from heterogeneous sources like text, knowledge graphs, tables, and infoboxes.
Our method utilizes a graph structured representation to aggregate information about a question and its context.
arXiv Detail & Related papers (2024-06-14T13:28:03Z) - Decentralised Moderation for Interoperable Social Networks: A Conversation-based Approach for Pleroma and the Fediverse [10.791075186479622]
We propose a decentralised conversation-aware content moderation approach suitable for the fediverse.
Our approach employs a graph deep learning model (GraphNLI) trained locally on each server.
Our model effectively detects toxicity on larger instances, exclusively trained using their local post information.
arXiv Detail & Related papers (2024-04-03T20:29:40Z) - Conversational Semantic Parsing using Dynamic Context Graphs [68.72121830563906]
We consider the task of conversational semantic parsing over general purpose knowledge graphs (KGs) with millions of entities, and thousands of relation-types.
We focus on models which are capable of interactively mapping user utterances into executable logical forms.
arXiv Detail & Related papers (2023-05-04T16:04:41Z) - A Graph-Based Context-Aware Model to Understand Online Conversations [3.8345539498627437]
In online conversations, comments and replies may be based on external context beyond the immediately relevant information.
We propose GraphNLI, a novel graph-based deep learning architecture that uses graph walks to incorporate the wider context of a conversation.
We evaluate GraphNLI on two such tasks - polarity prediction and misogynistic hate speech detection.
arXiv Detail & Related papers (2022-11-16T20:51:45Z) - Knowledge-Grounded Conversational Data Augmentation with Generative
Conversational Networks [76.11480953550013]
We take a step towards automatically generating conversational data using Generative Conversational Networks.
We evaluate our approach on conversations with and without knowledge on the Topical Chat dataset.
arXiv Detail & Related papers (2022-07-22T22:37:14Z) - GCNet: Graph Completion Network for Incomplete Multimodal Learning in
Conversation [43.79770897364927]
We propose a novel framework for incomplete multimodal learning in conversations, called "Graph Complete Network (GCNet)"
Our GCNet contains two well-designed graph neural network-based modules, "Speaker GNN" and "Temporal GNN", to capture temporal and speaker information in conversations.
To make full use of complete and incomplete data in feature learning, we jointly optimize classification and reconstruction in an end-to-end manner.
arXiv Detail & Related papers (2022-03-04T08:13:18Z) - Disentangling Online Chats with DAG-Structured LSTMs [55.33014148383343]
DAG-LSTMs are a generalization of Tree-LSTMs that can handle directed acyclic dependencies.
We show that the novel model we propose achieves state of the art status on the task of recovering reply-to relations.
arXiv Detail & Related papers (2021-06-16T18:00:00Z) - Dual ResGCN for Balanced Scene GraphGeneration [106.7828712878278]
We propose a novel model, dubbed textitdual ResGCN, which consists of an object residual graph convolutional network and a relation residual graph convolutional network.
The two networks are complementary to each other. The former captures object-level context information, textiti.e., the connections among objects.
The latter is carefully designed to explicitly capture relation-level context information textiti.e., the connections among relations.
arXiv Detail & Related papers (2020-11-09T07:44:17Z) - Iterative Context-Aware Graph Inference for Visual Dialog [126.016187323249]
We propose a novel Context-Aware Graph (CAG) neural network.
Each node in the graph corresponds to a joint semantic feature, including both object-based (visual) and history-related (textual) context representations.
arXiv Detail & Related papers (2020-04-05T13:09:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.