The Nature of NLP: Analyzing Contributions in NLP Papers

• URL: http://arxiv.org/abs/2409.19505v1
• Date: Sun, 29 Sep 2024 01:29:28 GMT
• Title: The Nature of NLP: Analyzing Contributions in NLP Papers
• Authors: Aniket Pramanick, Yufang Hou, Saif M. Mohammad, Iryna Gurevych,
• Abstract summary: We quantitatively investigate what constitutes NLP research by examining research papers. Our findings reveal a rising involvement of machine learning in NLP since the early nineties. In post-2020, there has been a resurgence of focus on language and people.
• Score: 77.31665252336157
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Natural Language Processing (NLP) is a dynamic, interdisciplinary field that integrates intellectual traditions from computer science, linguistics, social science, and more. Despite its established presence, the definition of what constitutes NLP research remains debated. In this work, we quantitatively investigate what constitutes NLP by examining research papers. For this purpose, we propose a taxonomy and introduce NLPContributions, a dataset of nearly $2k$ research paper abstracts, expertly annotated to identify scientific contributions and classify their types according to this taxonomy. We also propose a novel task to automatically identify these elements, for which we train a strong baseline on our dataset. We present experimental results from this task and apply our model to $\sim$$29k$ NLP research papers to analyze their contributions, aiding in the understanding of the nature of NLP research. Our findings reveal a rising involvement of machine learning in NLP since the early nineties, alongside a declining focus on adding knowledge about language or people; again, in post-2020, there has been a resurgence of focus on language and people. We hope this work will spark discussions on our community norms and inspire efforts to consciously shape the future.

Related papers

• Towards Systematic Monolingual NLP Surveys: GenA of Greek NLP [2.3499129784547663]
  This study fills the gap by introducing a method for creating systematic and comprehensive monolingual NLP surveys. Characterized by a structured search protocol, it can be used to select publications and organize them through a taxonomy of NLP tasks. By applying our method, we conducted a systematic literature review of Greek NLP from 2012 to 2022.
  arXiv  Detail & Related papers  (2024-07-13T12:01:52Z)
• Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art [70.1063219524999]
  The surge of interest in culturally aware and adapted Natural Language Processing has inspired much recent research. The lack of common understanding of the concept of "culture" has made it difficult to evaluate progress in this emerging area. We propose an extensive taxonomy of elements of culture that can provide a systematic framework for analyzing and understanding research progress.
  arXiv  Detail & Related papers  (2024-06-06T10:16:43Z)
• What Can Natural Language Processing Do for Peer Review? [173.8912784451817]
  In modern science, peer review is widely used, yet it is hard, time-consuming, and prone to error. Since the artifacts involved in peer review are largely text-based, Natural Language Processing has great potential to improve reviewing. We detail each step of the process from manuscript submission to camera-ready revision, and discuss the associated challenges and opportunities for NLP assistance.
  arXiv  Detail & Related papers  (2024-05-10T16:06:43Z)
• Natural Language Processing for Dialects of a Language: A Survey [56.93337350526933]
  State-of-the-art natural language processing (NLP) models are trained on massive training corpora, and report a superlative performance on evaluation datasets. This survey delves into an important attribute of these datasets: the dialect of a language. Motivated by the performance degradation of NLP models for dialectic datasets and its implications for the equity of language technologies, we survey past research in NLP for dialects in terms of datasets, and approaches.
  arXiv  Detail & Related papers  (2024-01-11T03:04:38Z)
• Ling-CL: Understanding NLP Models through Linguistic Curricula [17.44112549879293]
  We employ a characterization of linguistic complexity from psycholinguistic and language acquisition research. We develop data-driven curricula to understand the underlying linguistic knowledge that models learn to address NLP tasks.
  arXiv  Detail & Related papers  (2023-10-31T01:44:33Z)
• To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processing [14.15370310437262]
  We study factors that shape NLP as a field, including culture, incentives, and infrastructure. Our interviewees identify cyclical patterns in the field, as well as new shifts without historical parallel. We conclude by discussing shared visions, concerns, and hopes for the future of NLP.
  arXiv  Detail & Related papers  (2023-10-11T17:59:36Z)
• Exploring the Landscape of Natural Language Processing Research [3.3916160303055567]
  Several NLP-related approaches have been surveyed in the research community. A comprehensive study that categorizes established topics, identifies trends, and outlines areas for future research remains absent. As a result, we present a structured overview of the research landscape, provide a taxonomy of fields of study in NLP, analyze recent developments in NLP, summarize our findings, and highlight directions for future work.
  arXiv  Detail & Related papers  (2023-07-20T07:33:30Z)
• Beyond Good Intentions: Reporting the Research Landscape of NLP for Social Good [115.1507728564964]
  We introduce NLP4SG Papers, a scientific dataset with three associated tasks. These tasks help identify NLP4SG papers and characterize the NLP4SG landscape. We use state-of-the-art NLP models to address each of these tasks and use them on the entire ACL Anthology.
  arXiv  Detail & Related papers  (2023-05-09T14:16:25Z)
• Meta Learning for Natural Language Processing: A Survey [88.58260839196019]
  Deep learning has been the mainstream technique in natural language processing (NLP) area. Deep learning requires many labeled data and is less generalizable across domains. Meta-learning is an arising field in machine learning studying approaches to learn better algorithms.
  arXiv  Detail & Related papers  (2022-05-03T13:58:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.