Speciesism in Natural Language Processing Research

• URL: http://arxiv.org/abs/2410.14194v1
• Date: Fri, 18 Oct 2024 06:09:41 GMT
• Title: Speciesism in Natural Language Processing Research
• Abstract summary: The purpose of this study is to investigate whether there is speciesism, i.e., discrimination against nonhuman animals, in NLP research. The findings of this study suggest that speciesism exists within researchers, data, and models, respectively. Specifically, our survey and experiments show that (a) among NLP researchers, even those who study social bias in AI, do not recognize speciesism or speciesist bias; (b) among NLP data, speciesist bias is inherent in the data annotated in the datasets used to evaluate NLP models; (c) OpenAI GPTs, recent NLP models, exhibit
• Score: 3.1077024712075794
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Natural Language Processing (NLP) research on AI Safety and social bias in AI has focused on safety for humans and social bias against human minorities. However, some AI ethicists have argued that the moral significance of nonhuman animals has been ignored in AI research. Therefore, the purpose of this study is to investigate whether there is speciesism, i.e., discrimination against nonhuman animals, in NLP research. First, we explain why nonhuman animals are relevant in NLP research. Next, we survey the findings of existing research on speciesism in NLP researchers, data, and models and further investigate this problem in this study. The findings of this study suggest that speciesism exists within researchers, data, and models, respectively. Specifically, our survey and experiments show that (a) among NLP researchers, even those who study social bias in AI, do not recognize speciesism or speciesist bias; (b) among NLP data, speciesist bias is inherent in the data annotated in the datasets used to evaluate NLP models; (c) OpenAI GPTs, recent NLP models, exhibit speciesist bias by default. Finally, we discuss how we can reduce speciesism in NLP research.

Related papers

• Speciesism in AI: Evaluating Discrimination Against Animals in Large Language Models [0.0]
  We investigate whether large language models (LLMs) exhibit speciesist bias.<n>LLMs reliably detected speciesist statements but rarely condemned them.<n>We argue that expanding AI fairness and alignment frameworks to explicitly include non-human moral patients is essential.
  arXiv  Detail & Related papers  (2025-08-15T15:22:00Z)
• Lessons from a Chimp: AI "Scheming" and the Quest for Ape Language [6.363408523327004]
  We examine recent research that asks whether current AI systems may be developing a capacity for "scheming"<n>We compare current research practices in this field to those adopted in the 1970s to test whether non-human primates could master natural language.<n>We recommend that research into AI scheming actively seeks to avoid these pitfalls.
  arXiv  Detail & Related papers  (2025-07-04T09:16:11Z)
• Human Bias in the Face of AI: The Role of Human Judgement in AI Generated Text Evaluation [48.70176791365903]
  This study explores how bias shapes the perception of AI versus human generated content. We investigated how human raters respond to labeled and unlabeled content.
  arXiv  Detail & Related papers  (2024-09-29T04:31:45Z)
• The Nature of NLP: Analyzing Contributions in NLP Papers [77.31665252336157]
  We quantitatively investigate what constitutes NLP research by examining research papers. Our findings reveal a rising involvement of machine learning in NLP since the early nineties. In post-2020, there has been a resurgence of focus on language and people.
  arXiv  Detail & Related papers  (2024-09-29T01:29:28Z)
• A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why? [84.46288849132634]
  We propose a systematic framework for analyzing the evolution of research topics in a scientific field using causal discovery and inference techniques. We define three variables to encompass diverse facets of the evolution of research topics within NLP. We utilize a causal discovery algorithm to unveil the causal connections among these variables using observational data.
  arXiv  Detail & Related papers  (2023-05-22T11:08:00Z)
• On the Origins of Bias in NLP through the Lens of the Jim Code [1.256413718364189]
  We trace the biases in current natural language processing (NLP) models back to their origins in racism, sexism, and homophobia over the last 500 years. We show how the causes of the biases in the NLP pipeline are rooted in social issues.
  arXiv  Detail & Related papers  (2023-05-16T08:37:13Z)
• Beyond Good Intentions: Reporting the Research Landscape of NLP for Social Good [115.1507728564964]
  We introduce NLP4SG Papers, a scientific dataset with three associated tasks. These tasks help identify NLP4SG papers and characterize the NLP4SG landscape. We use state-of-the-art NLP models to address each of these tasks and use them on the entire ACL Anthology.
  arXiv  Detail & Related papers  (2023-05-09T14:16:25Z)
• Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP [84.08476873280644]
  Just 13% of papers had (i) sufficiently low barriers to reproduction, and (ii) enough obtainable information, to be considered for reproduction. As a result, we had to change our coordinated study design from a reproduce approach to a standardise-then-reproduce-twice approach.
  arXiv  Detail & Related papers  (2023-05-02T17:46:12Z)
• Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold [88.83876819883653]
  We show through a manual classification of recent NLP research papers that this is indeed the case. We observe that NLP research often goes beyond the square one setup, focusing not only on accuracy, but also on fairness or interpretability, but typically only along a single dimension.
  arXiv  Detail & Related papers  (2022-06-20T13:04:23Z)
• Speciesist Language and Nonhuman Animal Bias in English Masked Language Models [14.373699429792687]
  We analyze biases to nonhuman animals, i.e. speciesist bias, inherent in English Masked Language Models. Our code for reproducing the experiments will be made available on GitHub.
  arXiv  Detail & Related papers  (2022-03-10T03:32:29Z)
• Speciesist bias in AI -- How AI applications perpetuate discrimination and unfair outcomes against animals [0.0]
  This paper is the first to describe the'speciesist bias' and investigate it in several different AI systems. It stresses the influence AI systems can have on either increasing or reducing the violence that is inflicted on animals.
  arXiv  Detail & Related papers  (2022-02-22T12:23:21Z)
• A Survey of Race, Racism, and Anti-Racism in NLP [22.96153444777507]
  Despite inextricable ties between race and language, little work has considered race in NLP research and development. In this work, we survey 79 papers from the ACL anthology that mention race. These papers reveal various types of race-related bias in all stages of NLP model development.
  arXiv  Detail & Related papers  (2021-06-21T20:59:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.