Biases in gendered citation practices: an exploratory study and some reflections on the Matthew and Matilda effects

• URL: http://arxiv.org/abs/2410.02801v2
• Date: Sat, 19 Oct 2024 13:02:51 GMT
• Title: Biases in gendered citation practices: an exploratory study and some reflections on the Matthew and Matilda effects
• Authors: Karolina Tchilinguirova, Alvine Boaye Belle, Gouled Mahamud,
• Abstract summary: This paper aims at analyzing gendered citation practices in the software engineering literature. Our results show that some efforts still need to be done to achieve fairness in citation practices in the SE field.
• Score: 2.0277446818410994
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Recent studies conducted in different scientific disciplines have concluded that researchers belonging to some socio-cultural groups (e.g., women, racialized people) are usually less cited than other researchers belonging to dominating groups. This is usually due to the presence of citation biases in reference lists. These citation biases towards researchers from some socio-cultural groups may inevitably cause unfairness and inaccuracy in the assessment of articles impact. These citation biases may therefore translate to significant disparities in promotion, retention, grant funding, awards, collaborative opportunities, and publications. In this paper, we conduct the first study aiming at analyzing gendered citation practices in the software engineering (SE) literature. Our study allows reflecting on citations practices adopted in the SE field and serves as a starting point for more robust empirical studies on the analyzed topic. Our results show that some efforts still need to be done to achieve fairness in citation practices in the SE field. Such efforts may notably consist in the inclusion of citation diversity statements in manuscripts submitted for publication in SE journals and conferences.

Related papers

• Uncovering Political Bias in Emotion Inference Models: Implications for sentiment analysis in social science research [0.0]
  This paper investigates the presence of political bias in machine learning models used for sentiment analysis (SA) in social science research. We conducted a bias audit on a Polish sentiment analysis model developed in our lab. Our findings indicate that annotations by human raters propagate political biases into the model's predictions.
  arXiv  Detail & Related papers  (2024-07-18T20:31:07Z)
• Inclusivity in Large Language Models: Personality Traits and Gender Bias in Scientific Abstracts [49.97673761305336]
  We evaluate three large language models (LLMs) for their alignment with human narrative styles and potential gender biases. Our findings indicate that, while these models generally produce text closely resembling human authored content, variations in stylistic features suggest significant gender biases.
  arXiv  Detail & Related papers  (2024-06-27T19:26:11Z)
• Semantic Properties of cosine based bias scores for word embeddings [48.0753688775574]
  We propose requirements for bias scores to be considered meaningful for quantifying biases. We analyze cosine based scores from the literature with regard to these requirements. We underline these findings with experiments to show that the bias scores' limitations have an impact in the application case.
  arXiv  Detail & Related papers  (2024-01-27T20:31:10Z)
• Position: AI/ML Influencers Have a Place in the Academic Process [82.2069685579588]
  We investigate the role of social media influencers in enhancing the visibility of machine learning research. We have compiled a comprehensive dataset of over 8,000 papers, spanning tweets from December 2018 to October 2023. Our statistical and causal inference analysis reveals a significant increase in citations for papers endorsed by these influencers.
  arXiv  Detail & Related papers  (2024-01-24T20:05:49Z)
• Uncited articles and their effect on the concentration of citations [0.0]
  Empirical evidence shows that citations received by scholarly publications follow a pattern of preferential attachment, resulting in a power-law distribution. Are citations becoming more concentrated in a small number of articles? Or have recent geopolitical and technical changes in science led to more decentralized distributions? This article explores how reference-based and citation-based approaches, uncited articles, citation inflation, the expansion of bibliometric databases, disciplinary differences, and self-citations affect the evolution of citation concentration.
  arXiv  Detail & Related papers  (2023-06-16T15:38:12Z)
• Geographic Citation Gaps in NLP Research [63.13508571014673]
  This work asks a series of questions on the relationship between geographical location and publication success. We first created a dataset of 70,000 papers from the ACL Anthology, extracted their meta-information, and generated their citation network. We show that not only are there substantial geographical disparities in paper acceptance and citation but also that these disparities persist even when controlling for a number of variables such as venue of publication and sub-field of NLP.
  arXiv  Detail & Related papers  (2022-10-26T02:25:23Z)
• Detecting and analyzing missing citations to published scientific entities [5.811229506383401]
  We design a special method Citation Recommendation for Published Scientific Entity (CRPSE) based on the cooccurrences between published scientific entities and in-text citations. We conduct a statistical analysis on missing citations among papers published in prestigious computer science conferences in 2020. On a median basis, the papers proposing these published scientific entities with missing citations were published 8 years ago.
  arXiv  Detail & Related papers  (2022-10-18T18:08:20Z)
• Toward Understanding Bias Correlations for Mitigation in NLP [34.956581421295]
  This work aims to provide a first systematic study toward understanding bias correlations in mitigation. We examine bias mitigation in two common NLP tasks -- toxicity detection and word embeddings. Our findings suggest that biases are correlated and present scenarios in which independent debiasing approaches may be insufficient.
  arXiv  Detail & Related papers  (2022-05-24T22:48:47Z)
• The SAME score: Improved cosine based bias score for word embeddings [49.75878234192369]
  We introduce SAME, a novel bias score for semantic bias in embeddings. We show that SAME is capable of measuring semantic bias and identify potential causes for social bias in downstream tasks.
  arXiv  Detail & Related papers  (2022-03-28T09:28:13Z)
• A Measure of Research Taste [91.3755431537592]
  We present a citation-based measure that rewards both productivity and taste. The presented measure, CAP, balances the impact of publications and their quantity. We analyze the characteristics of CAP for highly-cited researchers in biology, computer science, economics, and physics.
  arXiv  Detail & Related papers  (2021-05-17T18:01:47Z)
• Emergence of Structural Inequalities in Scientific Citation Networks [20.754274052686355]
  We identify two types of structural inequalities in scientific citations. First, female authors, who represent a minority of researchers, receive less recognition for their work relative to male authors. Second, authors affiliated with top-ranked institutions, who are also a minority, receive substantially more recognition compared to other authors.
  arXiv  Detail & Related papers  (2021-03-19T17:53:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.