Is This AI? Longitudinal Analysis of Strategies Used for AI Detection on Two Subreddits

• URL: http://arxiv.org/abs/2606.22689v2
• Date: Thu, 25 Jun 2026 19:37:43 GMT
• Title: Is This AI? Longitudinal Analysis of Strategies Used for AI Detection on Two Subreddits
• Abstract summary: We analyze 2 years and 8 months of the AI detection strategies discussed by users of two popular Reddit communities.<n>We find that these strategies and mental models shift over time in accordance with changing AI capabilities.
• Score: 12.19280352884721
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: As AI-generated content (e.g., "slop") becomes more prevalent online, people are developing strategies to attempt to identify it (or, conversely, to gain confidence that something is not AI-generated). What strategies are people using, and how are they changing over time as generative AI models themselves change? In this work, we catalog and analyze 2 years and 8 months of the AI detection strategies discussed by users of two popular Reddit communities (r/isthisAI and r/RealOrAI) that use the wisdom of crowds to identify AI-generated media. Through a mixed-method analysis of 13,098 posts and 222,060 comments within these communities, we catalog and analyze the prevalence of 12 AI-detection strategies, including examining fine-grained physical details, recognizing trends in AI-created content, and the assumptions people make about what models are capable of producing. Furthermore, we find that these strategies and mental models shift over time in accordance with changing AI capabilities and in response to online social trends. By systematically cataloging users' AI detection strategies, we lay the groundwork for user-facing guidance and future research.

Related papers

• One AI Signal, Many Human Judgments: A Bayesian Cascade Analysis of AI-based Credibility Indicators in Online Information Spread [39.0786847687173]
  Social media platforms increasingly use AI-based credibility indicators to help users judge misinformation.<n>We introduce a social-learning lens for this setting by extending the classical Bayesian cascade model with the AI indicator as a shared public signal.<n>We show that AI changes what public history means. Through this view, we show that AI changes what public history means.
  arXiv  Detail & Related papers  (2026-08-31T06:27:21Z)
• Method, Mind, and Morality: How People Make Sense of Artificial Intelligence [10.2319621391971]
  How can humans make sense of the rapid takeoff of artificial intelligence (AI)?<n>We studied the sensemaking dynamics of AI through an open-ended, mixed-methods study with computational text analysis of millions of AI-related newspaper articles and social media posts.<n>We identify a range of sociological frames (interpretive schemas that structure collective cognition) and show how AI professionals use frames to address significant cognitive challenges.
  arXiv  Detail & Related papers  (2026-08-25T15:52:55Z)
• CoAX: Cognitive-Oriented Attribution eXplanation User Model of Human Understanding of AI Explanations [8.572512533736312]
  XAI aims to improve user understanding and decisions when using AI models.<n>Recent user evaluations reveal that this goal remains elusive.<n>We examined various reasoning strategies for different XAI methods in the decision task of anticipating AI decisions.
  arXiv  Detail & Related papers  (2026-04-30T03:12:11Z)
• The Future of AI is Many, Not One [0.0]
  We show why we should expect breakthroughs from groups of AI agents working together rather than singular superintelligent agents.<n>Having a diverse team broadens the search for solutions, delays premature consensus, and allows for the pursuit of unconventional approaches.<n>The upshot, we argue, is that the future of transformative transformer-based AI is fundamentally many, not one.
  arXiv  Detail & Related papers  (2026-03-30T23:31:38Z)
• Explainable AI the Latest Advancements and New Trends [0.0]
  The concept of trustworthiness is cross-disciplinary; it must meet societal standards and principles.<n>We elaborate on the strong link between the explainability of AI and the meta-reasoning of autonomous systems.<n>The integration of approaches could pave the way for future interpretable AI systems.
  arXiv  Detail & Related papers  (2025-05-11T15:01:12Z)
• Almost AI, Almost Human: The Challenge of Detecting AI-Polished Writing [55.2480439325792]
  This study systematically evaluations twelve state-of-the-art AI-text detectors using our AI-Polished-Text Evaluation dataset.<n>Our findings reveal that detectors frequently flag even minimally polished text as AI-generated, struggle to differentiate between degrees of AI involvement, and exhibit biases against older and smaller models.
  arXiv  Detail & Related papers  (2025-02-21T18:45:37Z)
• Imagining and building wise machines: The centrality of AI metacognition [78.76893632793497]
  We examine what is known about human wisdom and sketch a vision of its AI counterpart.<n>We argue that AI systems particularly struggle with metacognition.<n>We discuss how wise AI might be benchmarked, trained, and implemented.
  arXiv  Detail & Related papers  (2024-11-04T18:10:10Z)
• Combining AI Control Systems and Human Decision Support via Robustness and Criticality [53.10194953873209]
  We extend a methodology for adversarial explanations (AE) to state-of-the-art reinforcement learning frameworks. We show that the learned AI control system demonstrates robustness against adversarial tampering. In a training / learning framework, this technology can improve both the AI's decisions and explanations through human interaction.
  arXiv  Detail & Related papers  (2024-07-03T15:38:57Z)
• Investigating the Role of Explainability and AI Literacy in User Compliance [2.8623940003518156]
  We find that users' compliance increases with the introduction of XAI but is also affected by AI literacy. We also find that the relationships between AI literacy XAI and users' compliance are mediated by the users' mental model of AI.
  arXiv  Detail & Related papers  (2024-06-18T14:28:12Z)
• Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledge [22.21959942886099]
  We introduce a process-oriented notion of appropriate reliance called critical use that centers the human's ability to situate AI predictions against knowledge that is uniquely available to them but unavailable to the AI model. We conduct a randomized online experiment in a complex social decision-making setting: child maltreatment screening. We find that, by providing participants with accelerated, low-stakes opportunities to practice AI-assisted decision-making, novices came to exhibit patterns of disagreement with AI that resemble those of experienced workers.
  arXiv  Detail & Related papers  (2023-08-30T01:54:31Z)
• Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
  Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches. We explore this process with 43 AI practitioners and real end-users.
  arXiv  Detail & Related papers  (2022-11-12T21:54:05Z)
• Cybertrust: From Explainable to Actionable and Interpretable AI (AI2) [58.981120701284816]
  Actionable and Interpretable AI (AI2) will incorporate explicit quantifications and visualizations of user confidence in AI recommendations. It will allow examining and testing of AI system predictions to establish a basis for trust in the systems' decision making.
  arXiv  Detail & Related papers  (2022-01-26T18:53:09Z)
• The Who in XAI: How AI Background Shapes Perceptions of AI Explanations [61.49776160925216]
  We conduct a mixed-methods study of how two different groups--people with and without AI background--perceive different types of AI explanations. We find that (1) both groups showed unwarranted faith in numbers for different reasons and (2) each group found value in different explanations beyond their intended design.
  arXiv  Detail & Related papers  (2021-07-28T17:32:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.