Creating Group Rules with AI: Human-AI Collaboration in WhatsApp Moderation

• URL: http://arxiv.org/abs/2605.12613v1
• Date: Tue, 12 May 2026 18:02:49 GMT
• Title: Creating Group Rules with AI: Human-AI Collaboration in WhatsApp Moderation
• Abstract summary: We show how WhatsApp group admins collaborate with AI tools to create, enforce, and maintain group rules.<n>Our findings show that admins appreciated the AI's ability to surface overlooked rules and reduce their moderation burden.<n>We conclude with design implications for building moderation tools that center human judgment, relational nuance, contextual adaptability, and collective governance.
• Score: 14.812507021519776
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: WhatsApp is one of the most widely used messaging platforms globally, with billions of users sharing information in private groups. Yet, it offers little infrastructure to support moderation and group governance. In the absence of platform-level oversight, group admins bear the responsibility of governing group behavior. In this paper, we explore how WhatsApp group admins collaborate with AI tools to create, enforce, and maintain group rules. Drawing on a two-phase speculative design study with 20 admins in India, we examine how participants interacted with an AI assistant (Meta AI) to co-create rules and responded to a series of probes illustrating AI-assisted moderation features. Our findings show that while admins appreciated the AI's ability to surface overlooked rules and reduce their moderation burden, they were highly sensitive to issues of relational trust, data privacy, tone, and social context. We identify how group type and admin style shaped their willingness to delegate authority, and surface the limitations of current chatbot interfaces in supporting collaborative rule-making. We conclude with design implications for building moderation tools that center human judgment, relational nuance, contextual adaptability, and collective governance.

Related papers

• Using AI Agents to Automate Black-Box Audits of Personalization Algorithms at Scale [76.72846830885882]
  Personalization algorithms determine what content users encounter on online platforms.<n> auditing these systems is difficult because independent auditors have only black-box access to the algorithms.<n>We introduce a framework for black-box audits of personalization algorithms using generative AI agents as behavioral engines for synthetic accounts.
  arXiv  Detail & Related papers  (2026-06-29T18:25:09Z)
• Leading Across the Spectrum of Human-AI Relationships: A Conceptual Framework for Increasingly Heterogeneous Teams [51.56484100374058]
  A decision may look human-led after AI has set the frame, or appear automated while human judgment still carries decisive force.<n>This paper offers a leadership-facing spectrum to see those relationships within a bounded mandate.<n>The aim is practical: to help strategic leaders recognize the configuration at work, notice when it shifts, and judge whether it fits the decision before them.
  arXiv  Detail & Related papers  (2026-04-30T04:05:37Z)
• Collaborative Document Editing with Multiple Users and AI Agents [19.340967112148665]
  We propose integrating AI agents directly into collaborative writing environments.<n>Our prototype makes AI use transparent and customisable through two new shared objects: agent profiles and tasks.
  arXiv  Detail & Related papers  (2025-09-15T12:11:59Z)
• When Autonomy Goes Rogue: Preparing for Risks of Multi-Agent Collusion in Social Systems [78.04679174291329]
  We introduce a proof-of-concept to simulate the risks of malicious multi-agent systems (MAS)<n>We apply this framework to two high-risk fields: misinformation spread and e-commerce fraud.<n>Our findings show that decentralized systems are more effective at carrying out malicious actions than centralized ones.
  arXiv  Detail & Related papers  (2025-07-19T15:17:30Z)
• AI's Social Forcefield: Reshaping Distributed Cognition in Human-AI Teams [6.386909552513031]
  We show that AI actively reshapes the social and cognitive fabric of collaboration.<n>We show that AI participation reorganizes the distributed cognitive architecture of teams.<n>We argue for rethinking AI in teams as a socially influential actor.
  arXiv  Detail & Related papers  (2024-07-03T13:46:00Z)
• Conversational Agents to Facilitate Deliberation on Harmful Content in WhatsApp Groups [13.830408652480418]
  WhatsApp groups have become a hotbed for the propagation of harmful content. Given the platform's end-to-end encryption, moderation responsibilities lie on group admins and members. We investigate the role of a conversational agent in facilitating deliberation on harmful content in WhatsApp groups.
  arXiv  Detail & Related papers  (2024-05-30T17:07:07Z)
• Policy Learning with a Language Bottleneck [65.99843627646018]
  We introduce Policy Learning with a Language Bottleneck (PLLB), a framework enabling AI agents to generate linguistic rules.<n>PLLBB alternates between a *rule generation* step guided by language models, and an *update* step where agents learn new policies guided by rules.<n>We show thatPLLB agents are able to learn more interpretable and generalizable behaviors, but can also share the learned rules with human users.
  arXiv  Detail & Related papers  (2024-05-07T08:40:21Z)
• Trust and ethical considerations in a multi-modal, explainable AI-driven chatbot tutoring system: The case of collaboratively solving Rubik's Cube [13.560874044962429]
  Prominent ethical issues in high school AI education include data privacy, information leakage, abusive language, and fairness. This paper describes technological components that were built to address ethical and trustworthy concerns in a multi-modal collaborative platform. In data privacy, we want to ensure that the informed consent of children, parents, and teachers, is at the center of any data that is managed.
  arXiv  Detail & Related papers  (2024-01-30T16:33:21Z)
• Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning [50.47568731994238]
  Key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL) This paper presents a general framework model for integrating and learning structured reasoning into AI agents' policies.
  arXiv  Detail & Related papers  (2023-12-22T17:57:57Z)
• "There Has To Be a Lot That We're Missing": Moderating AI-Generated Content on Reddit [5.202496456440801]
  We focus on online community moderators' experiences with AI-generated content (AIGC)<n>Our study finds that rules about AIGC are motivated by concerns about content quality, social dynamics, and governance challenges.<n>We find that, despite the absence of robust tools for detecting AIGC, moderators were able to somewhat limit the disruption it caused.
  arXiv  Detail & Related papers  (2023-11-21T16:15:21Z)
• On Avoiding Power-Seeking by Artificial Intelligence [93.9264437334683]
  We do not know how to align a very intelligent AI agent's behavior with human interests. I investigate whether we can build smart AI agents which have limited impact on the world, and which do not autonomously seek power.
  arXiv  Detail & Related papers  (2022-06-23T16:56:21Z)
• A User-Centred Framework for Explainable Artificial Intelligence in Human-Robot Interaction [70.11080854486953]
  We propose a user-centred framework for XAI that focuses on its social-interactive aspect. The framework aims to provide a structure for interactive XAI solutions thought for non-expert users.
  arXiv  Detail & Related papers  (2021-09-27T09:56:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.