Cultural Differences and Perverse Incentives in Science Create a Bad Mix: Exploring Country-Level Publication Bias in Select ACM Conferences

• URL: http://arxiv.org/abs/2501.17150v2
• Date: Wed, 29 Jan 2025 21:22:36 GMT
• Title: Cultural Differences and Perverse Incentives in Science Create a Bad Mix: Exploring Country-Level Publication Bias in Select ACM Conferences
• Authors: Aksheytha Chelikavada, Casey C. Bennett,
• Abstract summary: National governments are helping to build well-funded teams of scientists to serve nationalistic ambitions. We have found evidence that indicates significant inequality among the publication rates of individual scientists from various countries. Scientists who were affiliated with the top-5 countries were found to be contributing significantly more to the inequality in publication rates than others.
• Score: 0.0789257770465417
• License:
• Abstract: In the era of big science, many national governments are helping to build well-funded teams of scientists to serve nationalistic ambitions, providing financial incentives for certain outcomes for purposes other than advancing science. This in turn can impact the behavior of scientists and create distorted country-level bias in publication rates, frequency, and publication venues targeted. To that end, we have found evidence that indicates significant inequality among the publication rates of individual scientists from various countries, based on an intensive analysis of papers published in several well-known ACM conferences (HRI, IUI, KDD, CHI, SIGGRAPH, UIST, and UBICOMP) over 15 years between 2010 to 2024. Furthermore, scientists who were affiliated with the top-5 countries (in terms of research expenditure) were found to be contributing significantly more to the inequality in publication rates than others. Given evidence of certain countries aggressively pushing their scientists via $\textit{perverse incentives}$ to publish in well-regarded publication venues and produce significant results (by any means necessary), we detected and present several examples of potential ethical problems in publications caused by such systems. Additionally, topic modeling using LDA and semantic similarity revealed that some countries are not pursuing diverse scientific topics relative to others, indicating those incentives may be limiting genuine scientific curiosity. All in all, our findings raise awareness of systems put in place by certain national governments that not only erodes the pursuit of truth through science, but also appears to be gradually undermining the integrity of the global scientific community.

Related papers

• Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation [58.064940977804596]
  A plethora of new AI models and tools has been proposed, promising to empower researchers and academics worldwide to conduct their research more effectively and efficiently. Ethical concerns regarding shortcomings of these tools and potential for misuse take a particularly prominent place in our discussion.
  arXiv  Detail & Related papers  (2025-02-07T18:26:45Z)
• AI Expands Scientists' Impact but Contracts Science's Focus [11.634306888037273]
  We analyze 67.9 million research papers across six major fields using a validated language model. Scientists who adopt AI tools publish 67.37% more papers, receive 3.16 times more citations, and become team leaders 4 years earlier than non-adopters.
  arXiv  Detail & Related papers  (2024-12-10T18:24:17Z)
• Biases in gendered citation practices: an exploratory study and some reflections on the Matthew and Matilda effects [2.0277446818410994]
  This paper aims at analyzing gendered citation practices in the software engineering literature. Our results show that some efforts still need to be done to achieve fairness in citation practices in the SE field.
  arXiv  Detail & Related papers  (2024-09-18T19:53:41Z)
• Past, Present, and Future of Citation Practices in HCI [5.498355194100662]
  We show how a change in editorial policies introduced at the ACM CHI Conference in 2016 destabilized the CHI research community. If this near-linear trend continues undisrupted, an article at CHI 2030 will include on average almost 130 references. Our exploratory analysis highlights the profound impact of meso-level policy adjustments on the evolution of scientific fields and disciplines.
  arXiv  Detail & Related papers  (2024-05-26T11:22:47Z)
• Understanding Fine-grained Distortions in Reports of Scientific Findings [46.96512578511154]
  Distorted science communication harms individuals and society as it can lead to unhealthy behavior change and decrease trust in scientific institutions. Given the rapidly increasing volume of science communication in recent years, a fine-grained understanding of how findings from scientific publications are reported to the general public is crucial.
  arXiv  Detail & Related papers  (2024-02-19T19:00:01Z)
• Position: AI/ML Influencers Have a Place in the Academic Process [82.2069685579588]
  We investigate the role of social media influencers in enhancing the visibility of machine learning research. We have compiled a comprehensive dataset of over 8,000 papers, spanning tweets from December 2018 to October 2023. Our statistical and causal inference analysis reveals a significant increase in citations for papers endorsed by these influencers.
  arXiv  Detail & Related papers  (2024-01-24T20:05:49Z)
• Geographic Citation Gaps in NLP Research [63.13508571014673]
  This work asks a series of questions on the relationship between geographical location and publication success. We first created a dataset of 70,000 papers from the ACL Anthology, extracted their meta-information, and generated their citation network. We show that not only are there substantial geographical disparities in paper acceptance and citation but also that these disparities persist even when controlling for a number of variables such as venue of publication and sub-field of NLP.
  arXiv  Detail & Related papers  (2022-10-26T02:25:23Z)
• Modeling Information Change in Science Communication with Semantically Matched Paraphrases [50.67030449927206]
  SPICED is the first paraphrase dataset of scientific findings annotated for degree of information change. SPICED contains 6,000 scientific finding pairs extracted from news stories, social media discussions, and full texts of original papers. Models trained on SPICED improve downstream performance on evidence retrieval for fact checking of real-world scientific claims.
  arXiv  Detail & Related papers  (2022-10-24T07:44:38Z)
• Detecting and analyzing missing citations to published scientific entities [5.811229506383401]
  We design a special method Citation Recommendation for Published Scientific Entity (CRPSE) based on the cooccurrences between published scientific entities and in-text citations. We conduct a statistical analysis on missing citations among papers published in prestigious computer science conferences in 2020. On a median basis, the papers proposing these published scientific entities with missing citations were published 8 years ago.
  arXiv  Detail & Related papers  (2022-10-18T18:08:20Z)
• Gender Imbalance and Spatiotemporal Patterns of Contributions to Citizen Science Projects: the case of Zooniverse [0.0]
  We report on the uneven geographical distribution of the citizen scientist and model the variations among countries based on the socio-economic conditions. We report on the temporal features of contributions as well as the leisurely nature of participation suggested by the time of the day that the citizen scientists were the most active. Our findings can help attract the attention of public and private stakeholders, as well as to inform the design of the platforms and science policy making processes.
  arXiv  Detail & Related papers  (2021-01-07T18:57:51Z)
• Brain Drain and Brain Gain in Russia: Analyzing International Migration of Researchers by Discipline using Scopus Bibliometric Data 1996-2020 [77.34726150561087]
  We analyze all researchers who have published with a Russian affiliation address in Scopus-indexed sources in 1996-2020. While Russia was a donor country in the late 1990s and early 2000s, it has experienced a relatively balanced circulation of researchers in more recent years. Overall, researchers emigrating from Russia outnumbered and outperformed researchers immigrating to Russia.
  arXiv  Detail & Related papers  (2020-08-07T12:47:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.