Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspective

• URL: http://arxiv.org/abs/2012.12305v1
• Date: Tue, 22 Dec 2020 19:27:11 GMT
• Title: Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspective
• Authors: Svetlana Kiritchenko, Isar Nejadgholi, Kathleen C. Fraser
• Abstract summary: We review a large body of NLP research on automatic abuse detection with a new focus on ethical challenges. We highlight the need to examine the broad social impacts of this technology. We identify several opportunities for rights-respecting, socio-technical solutions to detect and confront online abuse.
• Score: 4.916009028580767
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The pervasiveness of abusive content on the internet can lead to severe psychological and physical harm. Significant effort in Natural Language Processing (NLP) research has been devoted to addressing this problem through abusive content detection and related sub-areas, such as the detection of hate speech, toxicity, cyberbullying, etc. Although current technologies achieve high classification performance in research studies, it has been observed that the real-life application of this technology can cause unintended harms, such as the silencing of under-represented groups. We review a large body of NLP research on automatic abuse detection with a new focus on ethical challenges, organized around eight established ethical principles: privacy, accountability, safety and security, transparency and explainability, fairness and non-discrimination, human control of technology, professional responsibility, and promotion of human values. In many cases, these principles relate not only to situational ethical codes, which may be context-dependent, but are in fact connected to universal human rights, such as the right to privacy, freedom from discrimination, and freedom of expression. We highlight the need to examine the broad social impacts of this technology, and to bring ethical and human rights considerations to every stage of the application life-cycle, from task formulation and dataset design, to model training and evaluation, to application deployment. Guided by these principles, we identify several opportunities for rights-respecting, socio-technical solutions to detect and confront online abuse, including 'nudging', 'quarantining', value sensitive design, counter-narratives, style transfer, and AI-driven public education applications.

Related papers

• Assessing Privacy Policies with AI: Ethical, Legal, and Technical Challenges [6.916147439085307]
  Large Language Models (LLMs) can be used to assess privacy policies for users automatically. We explore the challenges of this approach in three pillars, namely technical feasibility, ethical implications, and legal compatibility. Our findings aim to identify potential for future research, and to foster a discussion on the use of LLM technologies.
  arXiv  Detail & Related papers  (2024-10-10T21:36:35Z)
• Applications of Generative AI in Healthcare: algorithmic, ethical, legal and societal considerations [0.0]
  Generative AI is rapidly transforming medical imaging and text analysis. This paper explores issues of accuracy, informed consent, data privacy, and algorithmic limitations. We aim to foster a roadmap for ethical and responsible implementation of generative AI in healthcare.
  arXiv  Detail & Related papers  (2024-06-15T13:28:07Z)
• The Call for Socially Aware Language Technologies [94.6762219597438]
  We argue that many of these issues share a common core: a lack of awareness of the factors, context, and implications of the social environment in which NLP operates. We argue that substantial challenges remain for NLP to develop social awareness and that we are just at the beginning of a new era for the field.
  arXiv  Detail & Related papers  (2024-05-03T18:12:39Z)
• RENOVI: A Benchmark Towards Remediating Norm Violations in Socio-Cultural Conversations [46.634702800643566]
  ReNoVi is a large-scale corpus of 9,258 multi-turn dialogues annotated with social norms. ReNoVi consists of two parts: 512 human-authored dialogues (real data), and 8,746 synthetic conversations generated by ChatGPT through prompt learning.
  arXiv  Detail & Related papers  (2024-02-17T03:13:42Z)
• Unpacking the Ethical Value Alignment in Big Models [46.560886177083084]
  This paper provides an overview of the risks and challenges associated with big models, surveys existing AI ethics guidelines, and examines the ethical implications arising from the limitations of these models. We introduce a novel conceptual paradigm for aligning the ethical values of big models and discuss promising research directions for alignment criteria, evaluation, and method.
  arXiv  Detail & Related papers  (2023-10-26T16:45:40Z)
• Is the U.S. Legal System Ready for AI's Challenges to Human Values? [16.510834081597377]
  This study investigates how effectively U.S. laws confront the challenges posed by Generative AI to human values. We identify notable gaps and uncertainties within the existing legal framework regarding the protection of fundamental values. We advocate for legal frameworks that evolve to recognize new threats and provide proactive, auditable guidelines to industry stakeholders.
  arXiv  Detail & Related papers  (2023-08-30T09:19:06Z)
• An interdisciplinary conceptual study of Artificial Intelligence (AI) for helping benefit-risk assessment practices: Towards a comprehensive qualification matrix of AI programs and devices (pre-print 2020) [55.41644538483948]
  This paper proposes a comprehensive analysis of existing concepts coming from different disciplines tackling the notion of intelligence. The aim is to identify shared notions or discrepancies to consider for qualifying AI systems.
  arXiv  Detail & Related papers  (2021-05-07T12:01:31Z)
• Case Study: Deontological Ethics in NLP [119.53038547411062]
  We study one ethical theory, namely deontological ethics, from the perspective of NLP. In particular, we focus on the generalization principle and the respect for autonomy through informed consent. We provide four case studies to demonstrate how these principles can be used with NLP systems.
  arXiv  Detail & Related papers  (2020-10-09T16:04:51Z)
• A survey of algorithmic recourse: definitions, formulations, solutions, and prospects [24.615500469071183]
  We focus on algorithmic recourse, which is concerned with providing explanations and recommendations to individuals who are unfavourably treated by automated decision-making systems. We perform an extensive literature review, and align the efforts of many authors by presenting unified definitions, formulations, and solutions to recourse.
  arXiv  Detail & Related papers  (2020-10-08T15:15:34Z)
• Differentially Private and Fair Deep Learning: A Lagrangian Dual Approach [54.32266555843765]
  This paper studies a model that protects the privacy of the individuals sensitive information while also allowing it to learn non-discriminatory predictors. The method relies on the notion of differential privacy and the use of Lagrangian duality to design neural networks that can accommodate fairness constraints.
  arXiv  Detail & Related papers  (2020-09-26T10:50:33Z)
• Designing for Human Rights in AI [0.0]
  AI systems can help us make evidence-driven, efficient decisions, but can also confront us with unjustified, discriminatory decisions. It is becoming evident that these technological developments are consequential to people's fundamental human rights. Technical solutions to these complex socio-ethical problems are often developed without empirical study of societal context.
  arXiv  Detail & Related papers  (2020-05-11T09:21:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.