Internal and External Impacts of Natural Language Processing Papers

• URL: http://arxiv.org/abs/2505.16061v1
• Date: Wed, 21 May 2025 22:25:58 GMT
• Title: Internal and External Impacts of Natural Language Processing Papers
• Authors: Yu Zhang,
• Abstract summary: We examine how different NLP topics are consumed both within the academic community and by the broader public.<n>Our findings reveal that language modeling has the widest internal and external influence, while linguistic foundations have lower impacts.
• Score: 4.496989927037321
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We investigate the impacts of NLP research published in top-tier conferences (i.e., ACL, EMNLP, and NAACL) from 1979 to 2024. By analyzing citations from research articles and external sources such as patents, media, and policy documents, we examine how different NLP topics are consumed both within the academic community and by the broader public. Our findings reveal that language modeling has the widest internal and external influence, while linguistic foundations have lower impacts. We also observe that internal and external impacts generally align, but topics like ethics, bias, and fairness show significant attention in policy documents with much fewer academic citations. Additionally, external domains exhibit distinct preferences, with patents focusing on practical NLP applications and media and policy documents engaging more with the societal implications of NLP models.

Related papers

• Natural Language Processing of Privacy Policies: A Survey [2.4058538793689497]
  We conduct a literature review by analyzing 109 papers at the intersection of NLP and privacy policies.<n>We provide a brief introduction to privacy policies and discuss various facets of associated problems.<n>We identify the methodologies that can be further enhanced to provide robust privacy policies.
  arXiv  Detail & Related papers  (2025-01-17T17:47:15Z)
• Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Science [77.31665252336157]
  Large Language Models (LLMs) have ushered in a transformative era in Natural Language Processing (NLP) This work empirically examines the influence and use of LLMs in fields beyond NLP.
  arXiv  Detail & Related papers  (2024-09-29T01:32:35Z)
• The Nature of NLP: Analyzing Contributions in NLP Papers [77.31665252336157]
  We quantitatively investigate what constitutes NLP research by examining research papers. Our findings reveal a rising involvement of machine learning in NLP since the early nineties. In post-2020, there has been a resurgence of focus on language and people.
  arXiv  Detail & Related papers  (2024-09-29T01:29:28Z)
• From Insights to Actions: The Impact of Interpretability and Analysis Research on NLP [28.942812379900673]
  Interpretability and analysis (IA) research is a growing subfield within NLP. We seek to quantify the impact of IA research on the broader field of NLP.
  arXiv  Detail & Related papers  (2024-06-18T13:45:07Z)
• Position: AI/ML Influencers Have a Place in the Academic Process [82.2069685579588]
  We investigate the role of social media influencers in enhancing the visibility of machine learning research. We have compiled a comprehensive dataset of over 8,000 papers, spanning tweets from December 2018 to October 2023. Our statistical and causal inference analysis reveals a significant increase in citations for papers endorsed by these influencers.
  arXiv  Detail & Related papers  (2024-01-24T20:05:49Z)
• Responsible AI Considerations in Text Summarization Research: A Review of Current Practices [89.85174013619883]
  We focus on text summarization, a common NLP task largely overlooked by the responsible AI community. We conduct a multi-round qualitative analysis of 333 summarization papers from the ACL Anthology published between 2020-2022. We focus on how, which, and when responsible AI issues are covered, which relevant stakeholders are considered, and mismatches between stated and realized research goals.
  arXiv  Detail & Related papers  (2023-11-18T15:35:36Z)
• Exploring the Jungle of Bias: Political Bias Attribution in Language Models via Dependency Analysis [86.49858739347412]
  Large Language Models (LLMs) have sparked intense debate regarding the prevalence of bias in these models and its mitigation. We propose a prompt-based method for the extraction of confounding and mediating attributes which contribute to the decision process. We find that the observed disparate treatment can at least in part be attributed to confounding and mitigating attributes and model misalignment.
  arXiv  Detail & Related papers  (2023-11-15T00:02:25Z)
• We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fields [30.550895983110806]
  Cross-field engagement of Natural Language Processing has declined. Less than 8% of NLP citations are to linguistics. Less than 3% of NLP citations are to math and psychology.
  arXiv  Detail & Related papers  (2023-10-23T12:42:06Z)
• NLLG Quarterly arXiv Report 06/23: What are the most influential current AI Papers? [15.830129136642755]
  The objective is to offer a quick guide to the most relevant and widely discussed research, aiding both newcomers and established researchers in staying abreast of current trends. We observe the dominance of papers related to Large Language Models (LLMs) and specifically ChatGPT during the first half of 2023. NLP related papers are the most influential (around 60% of top papers) even though there are twice as many ML related papers in our data.
  arXiv  Detail & Related papers  (2023-07-31T11:53:52Z)
• Investigating Fairness Disparities in Peer Review: A Language Model Enhanced Approach [77.61131357420201]
  We conduct a thorough and rigorous study on fairness disparities in peer review with the help of large language models (LMs) We collect, assemble, and maintain a comprehensive relational database for the International Conference on Learning Representations (ICLR) conference from 2017 to date. We postulate and study fairness disparities on multiple protective attributes of interest, including author gender, geography, author, and institutional prestige.
  arXiv  Detail & Related papers  (2022-11-07T16:19:42Z)
• Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer Review [52.359007622096684]
  Peer review is a key component of the publishing process in most fields of science. Existing NLP studies focus on the analysis of individual texts. editorial assistance often requires modeling interactions between pairs of texts.
  arXiv  Detail & Related papers  (2022-04-22T16:39:38Z)
• We Need to Talk About Data: The Importance of Data Readiness in Natural Language Processing [3.096615629099618]
  We argue that there is a gap between academic research in NLP and its application to problems outside academia. We propose a method for improving the communication between researchers and external stakeholders regarding the accessibility, validity, and utility of data.
  arXiv  Detail & Related papers  (2021-10-11T17:55:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.