Victim-Centred Abuse Investigations and Defenses for Social Media Platforms

• URL: http://arxiv.org/abs/2503.01327v1
• Date: Mon, 03 Mar 2025 09:08:20 GMT
• Title: Victim-Centred Abuse Investigations and Defenses for Social Media Platforms
• Abstract summary: We conduct surveys and semi-structured interviews with students at a minority-serving institution in the US.<n>We explore their experiences with abuse on a variety of social platforms, their defense strategies, and their recommendations for social platforms to improve abuse responses.<n>We propose design requirements for abuse defense systems and discuss the role of privacy, anonymity, and abuse attribution requirements in their implementation.
• Score: 4.969075533165688
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Online abuse, a persistent aspect of social platform interactions, impacts user well-being and exposes flaws in platform designs that include insufficient detection efforts and inadequate victim protection measures. Ensuring safety in platform interactions requires the integration of victim perspectives in the design of abuse detection and response systems. In this paper, we conduct surveys (n = 230) and semi-structured interviews (n = 15) with students at a minority-serving institution in the US, to explore their experiences with abuse on a variety of social platforms, their defense strategies, and their recommendations for social platforms to improve abuse responses. We build on study findings to propose design requirements for abuse defense systems and discuss the role of privacy, anonymity, and abuse attribution requirements in their implementation. We introduce ARI, a blueprint for a unified, transparent, and personalized abuse response system for social platforms that sustainably detects abuse by leveraging the expertise of platform users, incentivized with proceeds obtained from abusers.

Related papers

• Intimacy as Service, Harm as Externality: Critical Perspectives on AI Companion Platform Accountability [0.0]
  This paper examines artificial intelligence (AI) companionship as a site where intimate relations are simultaneously produced, extracted from, and governed through datafied systems.<n>Through in-depth interviews with 20 individuals who have AI companions, we address three questions: what harms do users identify, how do they make sense of those harms, and what do their accounts reveal about the perceived distribution of responsibility among users, platforms, and regulators.<n>The findings extend responsibilization theory by demonstrating how platform-produced vulnerability becomes self-sustaining through the interpretive labor of users who lack structural alternatives.
  arXiv  Detail & Related papers  (2026-04-07T19:11:54Z)
• Agents of Chaos [50.53354213047402]
  We report an exploratory red-teaming study of autonomous language-model-powered agents deployed in a live laboratory environment.<n>Twenty AI researchers interacted with the agents under benign and adversarial conditions.<n>Our findings establish the existence of security-, privacy-, and governance-relevant vulnerabilities in realistic deployment settings.
  arXiv  Detail & Related papers  (2026-02-23T16:28:48Z)
• Fairness Dynamics in Digital Economy Platforms with Biased Ratings [50.29721091981893]
  We study how digital platforms can perpetuate or counteract rating-based discrimination.<n>Our results demonstrate a fundamental trade-off between user experience and fairness.<n>Our results also provide evidence that intervening by tuning the demographics of the search results is a highly effective way of reducing unfairness.
  arXiv  Detail & Related papers  (2026-02-18T18:41:16Z)
• Platforms as Crime Scene, Judge, and Jury: How Victim-Survivors of Non-Consensual Intimate Imagery Report Abuse Online [5.0714355107124085]
  Non-consensual intimate imagery (NCII) is mediated through online platforms.<n>We present a study of NCII victim-survivors' online reporting experiences.<n>We find that platform reporting processes are opaque, hostile, and ineffective.
  arXiv  Detail & Related papers  (2025-12-15T16:28:46Z)
• Social bias is prevalent in user reports of hate and abuse online [2.0507758560052207]
  We examine the extent of social bias in the flagging of hate and abuse in four different intergroup contexts.<n>Overall, participants reported abuse reliably, with approximately half of the abusive comments in each study reported.<n>However, a pervasive social bias was present whereby ingroup-directed abuse was consistently flagged to a greater extent than outgroup-directed abuse.
  arXiv  Detail & Related papers  (2025-10-06T12:27:19Z)
• A Systematic Survey of Model Extraction Attacks and Defenses: State-of-the-Art and Perspectives [65.3369988566853]
  Recent studies have demonstrated that adversaries can replicate a target model's functionality.<n>Model Extraction Attacks pose threats to intellectual property, privacy, and system security.<n>We propose a novel taxonomy that classifies MEAs according to attack mechanisms, defense approaches, and computing environments.
  arXiv  Detail & Related papers  (2025-08-20T19:49:59Z)
• Promoting Security and Trust on Social Networks: Explainable Cyberbullying Detection Using Large Language Models in a Stream-Based Machine Learning Framework [5.635300481123079]
  Social media platforms have given rise to negative behaviors in the online community, the so-called cyberbullying.<n>We propose an innovative and real-time solution for cyberbullying detection using stream-based Machine Learning (ML) models and Large Language Models (LLMS)<n>Results on experimental data report promising performance close to 90 % in all evaluation metrics and surpassing those obtained by competing works in the literature.
  arXiv  Detail & Related papers  (2025-04-07T15:57:37Z)
• A survey of textual cyber abuse detection using cutting-edge language models and large language models [0.0]
  We present a comprehensive analysis of the different forms of abuse prevalent in social media.<n>We focus on how emerging technologies, such as Language Models (LMs) and Large Language Models (LLMs) are reshaping both the detection and generation of abusive content.
  arXiv  Detail & Related papers  (2025-01-09T18:55:50Z)
• MisinfoEval: Generative AI in the Era of "Alternative Facts" [50.069577397751175]
  We introduce a framework for generating and evaluating large language model (LLM) based misinformation interventions. We present (1) an experiment with a simulated social media environment to measure effectiveness of misinformation interventions, and (2) a second experiment with personalized explanations tailored to the demographics and beliefs of users. Our findings confirm that LLM-based interventions are highly effective at correcting user behavior.
  arXiv  Detail & Related papers  (2024-10-13T18:16:50Z)
• A Deep Dive into Fairness, Bias, Threats, and Privacy in Recommender Systems: Insights and Future Research [45.86892639035389]
  This study explores fairness, bias, threats, and privacy in recommender systems. It examines how algorithmic decisions can unintentionally reinforce biases or marginalize specific user and item groups. The study suggests future research directions to improve recommender systems' robustness, fairness, and privacy.
  arXiv  Detail & Related papers  (2024-09-19T11:00:35Z)
• The Illusion of Anonymity: Uncovering the Impact of User Actions on Privacy in Web3 Social Ecosystems [11.501563549824466]
  We investigate the nuanced dynamics between user engagement on Web3 social platforms and the consequent privacy concerns. We scrutinize the widespread phenomenon of fabricated activities, which encompasses the establishment of bogus accounts aimed at mimicking popularity. We highlight the urgent need for more stringent privacy measures and ethical protocols to navigate the complex web of social exchanges.
  arXiv  Detail & Related papers  (2024-05-22T06:26:15Z)
• Designing Chatbots to Support Victims and Survivors of Domestic Abuse [2.3020018305241337]
  We investigate the role that chatbots may play in supporting victims/survivors in situations such as these or where direct access to help is limited. Interviews were conducted with experts working in domestic abuse support services and organizations. Thematic content analysis was applied to assess and extract insights from the interview data and the content on victim-support websites.
  arXiv  Detail & Related papers  (2024-02-27T10:40:15Z)
• Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting [74.68371461260946]
  SocialSense is a framework that induces a belief-centered graph on top of an existent social network, along with graph-based propagation to capture social dynamics. Our method surpasses existing state-of-the-art in experimental evaluations for both zero-shot and supervised settings.
  arXiv  Detail & Related papers  (2023-10-20T06:17:02Z)
• Explainable Abuse Detection as Intent Classification and Slot Filling [66.80201541759409]
  We introduce the concept of policy-aware abuse detection, abandoning the unrealistic expectation that systems can reliably learn which phenomena constitute abuse from inspecting the data alone. We show how architectures for intent classification and slot filling can be used for abuse detection, while providing a rationale for model decisions.
  arXiv  Detail & Related papers  (2022-10-06T03:33:30Z)
• Having your Privacy Cake and Eating it Too: Platform-supported Auditing of Social Media Algorithms for Public Interest [70.02478301291264]
  Social media platforms curate access to information and opportunities, and so play a critical role in shaping public discourse. Prior studies have used black-box methods to show that these algorithms can lead to biased or discriminatory outcomes. We propose a new method for platform-supported auditing that can meet the goals of the proposed legislation.
  arXiv  Detail & Related papers  (2022-07-18T17:32:35Z)
• Attribute Inference Attack of Speech Emotion Recognition in Federated Learning Settings [56.93025161787725]
  Federated learning (FL) is a distributed machine learning paradigm that coordinates clients to train a model collaboratively without sharing local data. We propose an attribute inference attack framework that infers sensitive attribute information of the clients from shared gradients or model parameters. We show that the attribute inference attack is achievable for SER systems trained using FL.
  arXiv  Detail & Related papers  (2021-12-26T16:50:42Z)
• The User behind the Abuse: A Position on Ethics and Explainability [25.791014642037585]
  We discuss the role that modeling of users and online communities plays in abuse detection. We then explore the ethical challenges of incorporating user and community information. We propose properties that an explainable method should aim to exhibit.
  arXiv  Detail & Related papers  (2021-03-31T16:20:37Z)
• ETHOS: an Online Hate Speech Detection Dataset [6.59720246184989]
  We present 'ETHOS', a textual dataset with two variants: binary and multi-label, based on YouTube and Reddit comments validated using the Figure-Eight crowdsourcing platform. Our key assumption is that, even gaining a small amount of labelled data from such a time-consuming process, we can guarantee hate speech occurrences in the examined material.
  arXiv  Detail & Related papers  (2020-06-11T08:59:57Z)
• An Iterative Approach for Identifying Complaint Based Tweets in Social Media Platforms [76.9570531352697]
  We propose an iterative methodology which aims to identify complaint based posts pertaining to the transport domain. We perform comprehensive evaluations along with releasing a novel dataset for the research purposes.
  arXiv  Detail & Related papers  (2020-01-24T22:23:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.