"I Thought You Were The Uncensored Place": Norms, Rules, and Moderation in AI-Generated Sexual Content Communities

• URL: http://arxiv.org/abs/2608.13659v1
• Date: Thu, 13 Aug 2026 18:02:10 GMT
• Title: "I Thought You Were The Uncensored Place": Norms, Rules, and Moderation in AI-Generated Sexual Content Communities
• Abstract summary: We interviewed 24 members and moderators of large AIG-SC online communities with stated rules against creating and sharing abusive content.<n>Our findings reveal a complex picture: while many creators and communities have personal boundaries against abuse, advice and resources for creating any form of AI-generated sexual content are accessible to users regardless of their intentions.
• Score: 15.938938006206058
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: As AI-generated sexual content (AIG-SC) is increasingly produced, online communities have emerged to support creators' needs. To understand whether and how community governance attempts work to prevent abuse while supporting free expression, we interviewed 24 members and moderators of large AIG-SC online communities (10,000+ members) with stated rules against creating and sharing abusive content (e.g., AI-generated CSAM). Through in-depth interviews, we offer insight into: (1) how and why these communities form; (2) implicit community norms; (3) explicitly stated rules---and their operationalization via content moderation; and (4) tensions between community values and moderation that leave space for abusive behavior. Our findings reveal a complex picture: while many creators and communities have personal boundaries against abuse, advice and resources for creating any form of AI-generated sexual content are accessible to users regardless of their intentions. Further complicating community moderation are norms that center anti-censorship and non-judgment, which leave moderators to justify their actions using the limits of the law and terms of service. We end by reflecting on the ways in which technical, community, and legal governance may most effectively mitigate the production of abusive content.

Related papers

• It is not enough to give your moderation rules to ChatGPT: Policy-as-Prompt Moderation and Its Potential Impacts on Community Governance [0.0]
  Social media companies are focusing more on community approaches, relying on volunteers to provide accurate information and make correct decisions.<n>In decentralized moderation, communities have always relied on volunteers, updated community guidelines, and internal discussions thereof.<n>For both content moderation paradigms, Artificial Intelligence (AI) seems like it could help ease moderation burdens of time, mental health, and accuracy.<n>One possible way to operationalize AI in content moderation is a policy-as-prompt'' approach, where the policy is formulated as a natural-language prompt and then passed to a large language model.
  arXiv  Detail & Related papers  (2026-07-13T20:58:36Z)
• Reddit Deplatforming and Toxicity Dynamics on Generalist Voat Communities [73.88859384645264]
  Deplatforming, the permanent banning of entire communities, is a primary tool for content moderation on mainstream platforms.<n>We analyze four major Reddit ban waves (2015--2020) and their effects on generalist communities on Voat.
  arXiv  Detail & Related papers  (2025-12-26T19:13:45Z)
• Community Moderation and the New Epistemology of Fact Checking on Social Media [124.26693978503339]
  Social media platforms have traditionally relied on independent fact-checking organizations to identify and flag misleading content.<n>X (formerly Twitter) and Meta have shifted towards community-driven content moderation by launching their own versions of crowd-sourced fact-checking.<n>We examine the current approaches to misinformation detection across major platforms, explore the emerging role of community-driven moderation, and critically evaluate both the promises and challenges of crowd-checking at scale.
  arXiv  Detail & Related papers  (2025-05-26T14:50:18Z)
• Training AI to be Loyal [48.87020976513128]
  An AI is loyal to a community if the community has ownership, alignment, and control.<n>Community owned models can only be used with the approval of the community and share the economic rewards communally.<n>Since we would like permissionless access to the loyal AI's community, we need the AI to be open source.
  arXiv  Detail & Related papers  (2025-01-27T19:11:19Z)
• AI Rules? Characterizing Reddit Community Policies Towards AI-Generated Content [7.978143550070664]
  We collected the metadata and community rules for over $300,000$ public subreddits.<n>We labeled subreddits and AI rules according to existing literature and a new taxonomy specific to AI rules.<n>Our findings illustrate the emergence of varied concerns about AI, in different community contexts.
  arXiv  Detail & Related papers  (2024-10-15T15:31:41Z)
• Perceptions of Moderators as a Large-Scale Measure of Online Community Governance [13.80648276848838]
  We label 1.89 million posts and comments made on reddit over an 18 month period.<n>We identify types of communities where moderators are perceived particularly positively and negatively.<n>We show that strict rule enforcement is linked to more favorable perceptions of moderators of communities dedicated to certain topics, such as news communities, than others.
  arXiv  Detail & Related papers  (2024-01-29T22:43:12Z)
• "There Has To Be a Lot That We're Missing": Moderating AI-Generated Content on Reddit [5.202496456440801]
  We focus on online community moderators' experiences with AI-generated content (AIGC)<n>Our study finds that rules about AIGC are motivated by concerns about content quality, social dynamics, and governance challenges.<n>We find that, despite the absence of robust tools for detecting AIGC, moderators were able to somewhat limit the disruption it caused.
  arXiv  Detail & Related papers  (2023-11-21T16:15:21Z)
• Analyzing Norm Violations in Live-Stream Chat [49.120561596550395]
  We study the first NLP study dedicated to detecting norm violations in conversations on live-streaming platforms. We define norm violation categories in live-stream chats and annotate 4,583 moderated comments from Twitch. Our results show that appropriate contextual information can boost moderation performance by 35%.
  arXiv  Detail & Related papers  (2023-05-18T05:58:27Z)
• A Pathway Towards Responsible AI Generated Content [68.13835802977125]
  We focus on 8 main concerns that may hinder the healthy development and deployment of AIGC in practice. These concerns include risks from (1) privacy; (2) bias, toxicity, misinformation; (3) intellectual property (IP); (4) robustness; (5) open source and explanation; (6) technology abuse; (7) consent, credit, and compensation; (8) environment.
  arXiv  Detail & Related papers  (2023-03-02T14:58:40Z)
• Beyond Plain Toxic: Detection of Inappropriate Statements on Flammable Topics for the Russian Language [76.58220021791955]
  We present two text collections labelled according to binary notion of inapropriateness and a multinomial notion of sensitive topic. To objectivise the notion of inappropriateness, we define it in a data-driven way though crowdsourcing.
  arXiv  Detail & Related papers  (2022-03-04T15:59:06Z)
• Detecting Community Sensitive Norm Violations in Online Conversations [21.892867827127603]
  We focus on a more complete spectrum of community norms and their violations in the local conversational and global community contexts. We introduce a series of models that use this data to develop context- and community-sensitive norm violation detection.
  arXiv  Detail & Related papers  (2021-10-09T00:39:35Z)
• Quantifying the Vulnerabilities of the Online Public Square to Adversarial Manipulation Tactics [43.98568073610101]
  We use a social media model to quantify the impacts of several adversarial manipulation tactics on the quality of content. We find that the presence of influential accounts, a hallmark of social media, exacerbates the vulnerabilities of online communities to manipulation. These insights suggest countermeasures that platforms could employ to increase the resilience of social media users to manipulation.
  arXiv  Detail & Related papers  (2019-07-13T21:12:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.