Use of Formal Ethical Reviews in NLP Literature: Historical Trends and Current Practices

• URL: http://arxiv.org/abs/2106.01105v1
• Date: Wed, 2 Jun 2021 12:12:59 GMT
• Title: Use of Formal Ethical Reviews in NLP Literature: Historical Trends and Current Practices
• Authors: Sebastin Santy, Anku Rani, Monojit Choudhury
• Abstract summary: Ethical aspects of research in language technologies have received much attention recently. It is a standard practice to get a study involving human subjects reviewed and approved by a professional ethics committee/board of the institution. With the rising concerns and discourse around the ethics of NLP, do we also observe a rise in formal ethical reviews of NLP studies?
• Score: 6.195761193461355
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Ethical aspects of research in language technologies have received much attention recently. It is a standard practice to get a study involving human subjects reviewed and approved by a professional ethics committee/board of the institution. How commonly do we see mention of ethical approvals in NLP research? What types of research or aspects of studies are usually subject to such reviews? With the rising concerns and discourse around the ethics of NLP, do we also observe a rise in formal ethical reviews of NLP studies? And, if so, would this imply that there is a heightened awareness of ethical issues that was previously lacking? We aim to address these questions by conducting a detailed quantitative and qualitative analysis of the ACL Anthology, as well as comparing the trends in our field to those of other related disciplines, such as cognitive science, machine learning, data mining, and systems.

Related papers

• The Only Way is Ethics: A Guide to Ethical Research with Large Language Models [53.316174782223115]
  'LLM Ethics Whitepaper' is an open resource for NLP practitioners and those tasked with evaluating the ethical implications of others' work. Our goal is to translate ethics literature into concrete recommendations and provocations for thinking with clear first steps. 'LLM Ethics Whitepaper' distils a thorough literature review into clear Do's and Don'ts, which we present also in this paper.
  arXiv  Detail & Related papers  (2024-12-20T16:14:43Z)
• Ethical Concern Identification in NLP: A Corpus of ACL Anthology Ethics Statements [40.9861355779629]
  We introduce EthiCon, a corpus of 1,580 ethical concern statements extracted from scientific papers published in the ACL Anthology. Through a survey, we compare the ethical concerns of the corpus to the concerns listed by the general public and professionals in the field.
  arXiv  Detail & Related papers  (2024-11-12T14:53:12Z)
• Quelle {é}thique pour quelle IA ? [0.0]
  This study proposes an analysis of the different types of ethical approaches involved in the ethics of AI. The author introduces to the contemporary need for and meaning of ethics, distinguishes it from other registers of normativities and underlines its inadequacy to formalization. The study concludes with a reflection on the reasons why a human ethics of AI based on a pragmatic practice of contextual ethics remains necessary and irreducible to any formalization or automated treatment of the ethical questions that arise for humans.
  arXiv  Detail & Related papers  (2024-05-21T08:13:02Z)
• What Can Natural Language Processing Do for Peer Review? [173.8912784451817]
  In modern science, peer review is widely used, yet it is hard, time-consuming, and prone to error. Since the artifacts involved in peer review are largely text-based, Natural Language Processing has great potential to improve reviewing. We detail each step of the process from manuscript submission to camera-ready revision, and discuss the associated challenges and opportunities for NLP assistance.
  arXiv  Detail & Related papers  (2024-05-10T16:06:43Z)
• A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence [55.33653554387953]
  Pattern Analysis and Machine Intelligence (PAMI) has led to numerous literature reviews aimed at collecting and fragmented information. This paper presents a thorough analysis of these literature reviews within the PAMI field. We try to address three core research questions: (1) What are the prevalent structural and statistical characteristics of PAMI literature reviews; (2) What strategies can researchers employ to efficiently navigate the growing corpus of reviews; and (3) What are the advantages and limitations of AI-generated reviews compared to human-authored ones.
  arXiv  Detail & Related papers  (2024-02-20T11:28:50Z)
• Ethical Implications of ChatGPT in Higher Education: A Scoping Review [11.567239416304714]
  This scoping review explores the ethical challenges of using ChatGPT in higher education. By reviewing recent academic articles in English, Chinese, and Japanese, we aimed to provide a deep dive review and identify gaps in the literature.
  arXiv  Detail & Related papers  (2023-11-24T09:52:49Z)
• Responsible AI Considerations in Text Summarization Research: A Review of Current Practices [89.85174013619883]
  We focus on text summarization, a common NLP task largely overlooked by the responsible AI community. We conduct a multi-round qualitative analysis of 333 summarization papers from the ACL Anthology published between 2020-2022. We focus on how, which, and when responsible AI issues are covered, which relevant stakeholders are considered, and mismatches between stated and realized research goals.
  arXiv  Detail & Related papers  (2023-11-18T15:35:36Z)
• Values, Ethics, Morals? On the Use of Moral Concepts in NLP Research [13.28561989789828]
  We provide an overview of some important ethical concepts stemming from philosophy. We systematically survey the existing literature on moral NLP. Our findings show that, for instance, most papers neither provide a clear definition of the terms they use nor adhere to definitions from philosophy.
  arXiv  Detail & Related papers  (2023-10-21T06:04:10Z)
• Metaethical Perspectives on 'Benchmarking' AI Ethics [81.65697003067841]
  Benchmarks are seen as the cornerstone for measuring technical progress in Artificial Intelligence (AI) research. An increasingly prominent research area in AI is ethics, which currently has no set of benchmarks nor commonly accepted way for measuring the 'ethicality' of an AI system. We argue that it makes more sense to talk about 'values' rather than 'ethics' when considering the possible actions of present and future AI systems.
  arXiv  Detail & Related papers  (2022-04-11T14:36:39Z)
• Case Study: Deontological Ethics in NLP [119.53038547411062]
  We study one ethical theory, namely deontological ethics, from the perspective of NLP. In particular, we focus on the generalization principle and the respect for autonomy through informed consent. We provide four case studies to demonstrate how these principles can be used with NLP systems.
  arXiv  Detail & Related papers  (2020-10-09T16:04:51Z)
• Give Me Convenience and Give Her Death: Who Should Decide What Uses of NLP are Appropriate, and on What Basis? [40.75458460149429]
  We discuss whether datasets and tasks should be deemed off-limits for NLP research. We focus in particular on the role of data statements in ethically assessing research. We examine the outcomes of similar debates in other scientific disciplines.
  arXiv  Detail & Related papers  (2020-05-27T07:31:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.