Revealing the Technology Development of Natural Language Processing: A Scientific Entity-Centric Perspective

• URL: http://arxiv.org/abs/2606.29836v1
• Date: Mon, 29 Jun 2026 06:23:29 GMT
• Title: Revealing the Technology Development of Natural Language Processing: A Scientific Entity-Centric Perspective
• Abstract summary: The development of automatic entity recognition techniques makes it possible to extract technology-related entities on a large scale.<n>We extract technology-related entities such as methods, datasets, metrics, and tools in articles on Natural Language Processing (NLP)<n>We calculate the z-scores of entities based on their co-occurrence networks to measure their impact.
• Score: 8.115514447630156
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Most studies on technology development have been conducted from a thematic perspective, but the topics are coarse-grained and insufficient to accurately represent technology. The development of automatic entity recognition techniques makes it possible to extract technology-related entities on a large scale. Thus, we perform a more accurate analysis of technology development from an entity-centric perspective. To begin with, we extract technology-related entities such as methods, datasets, metrics, and tools in articles on Natural Language Processing (NLP), and we apply a semi-automatic approach to normalize the entities. Subsequently, we calculate the z-scores of entities based on their co-occurrence networks to measure their impact. We then analyze the development trends of new technologies in the NLP domain since the beginning of the 21st century. The findings of this paper include three aspects: Firstly, the continued increase in the average number of entities per paper implies a growing burden on researchers to acquire relevant technical background knowledge. However, the emergence of pre-trained language models has injected new vitality into the technological innovation of the NLP domain. Secondly, Methods dominate among the 179 high-impact entities. An analysis of the z-score trend about the top 10 entities reveals that pre-trained language models, exemplified by BERT and Transformer, have become mainstream in recent years. Unlike the trend of the other eight method entities, the impact of Wikipedia dataset and BLEU metric has continued to rise in the long term. Thirdly, in recent years, there has been a remarkable surge in popularity for new high-impact technologies than ever before, and their acceptance by researchers has accelerated at an unprecedented speed. Our study provides a new perspective on analyzing technology development in a specific domain.

Related papers

• Advances and Challenges in Semantic Textual Similarity: A Comprehensive Survey [0.0]
  This survey reviews progress across six key areas: transformer-based models, contrastive learning, domain-focused solutions, multi-modal methods, graph-based approaches, and knowledge-enhanced techniques.<n>It aims to guide researchers and practitioners alike in navigating rapid advancements, highlighting emerging trends and future opportunities in the evolving field of Semantic Textual Similarity.
  arXiv  Detail & Related papers  (2025-12-19T18:07:36Z)
• Monitoring Transformative Technological Convergence Through LLM-Extracted Semantic Entity Triple Graphs [35.70283902821063]
  We propose a novel, data-driven pipeline to monitor the emergence of transformative technologies.<n>Our approach leverages advances in Large Language Models (LLMs) to extract semantic triples from unstructured text.<n>The pipeline includes multi-stage filtering, domain-specific clustering, and a temporal trend analysis of topic co-occurence.
  arXiv  Detail & Related papers  (2025-10-29T10:41:03Z)
• A Global Dataset Mapping the AI Innovation from Academic Research to Industrial Patents [2.8191246153416243]
  DeepInnovationAI is a comprehensive global dataset containing three structured files.<n>DeepInnovationAI enables researchers, policymakers, and industry leaders to anticipate trends and identify collaboration opportunities.
  arXiv  Detail & Related papers  (2025-03-12T10:56:02Z)
• Reflection on Data Storytelling Tools in the Generative AI Era from the Human-AI Collaboration Perspective [54.152639172274]
  Large-scale generative AI techniques have the potential to enhance data storytelling with their power in visual and narration generation.<n>We compare the collaboration patterns of the latest tools with those of earlier ones using a dedicated framework for understanding human-AI collaboration in data storytelling.<n>The benefits of these AI techniques and implications to human-AI collaboration are also revealed.
  arXiv  Detail & Related papers  (2025-03-04T13:56:18Z)
• Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation [58.064940977804596]
  A plethora of new AI models and tools has been proposed, promising to empower researchers and academics worldwide to conduct their research more effectively and efficiently.<n>Ethical concerns regarding shortcomings of these tools and potential for misuse take a particularly prominent place in our discussion.
  arXiv  Detail & Related papers  (2025-02-07T18:26:45Z)
• A Survey of Spatio-Temporal EEG data Analysis: from Models to Applications [20.54846023209402]
  This survey focuses on emerging methods and technologies that are poised to transform our comprehension and interpretation of brain activity. We delve into self-supervised learning methods that enable the robust representation of brain signals. We also explore emerging discriminative methods, including graph neural networks (GNN), foundation models, and large language models (LLMs)-based approaches. The survey provides an extensive overview of these cutting-edge techniques, their current applications, and the profound implications they hold for future research and clinical practice.
  arXiv  Detail & Related papers  (2024-09-26T08:09:15Z)
• Deepfake Generation and Detection: A Benchmark and Survey [134.19054491600832]
  Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions. This survey comprehensively reviews the latest developments in deepfake generation and detection. We focus on researching four representative deepfake fields: face swapping, face reenactment, talking face generation, and facial attribute editing.
  arXiv  Detail & Related papers  (2024-03-26T17:12:34Z)
• The Future of Fundamental Science Led by Generative Closed-Loop Artificial Intelligence [67.70415658080121]
  Recent advances in machine learning and AI are disrupting technological innovation, product development, and society as a whole. AI has contributed less to fundamental science in part because large data sets of high-quality data for scientific practice and model discovery are more difficult to access. Here we explore and investigate aspects of an AI-driven, automated, closed-loop approach to scientific discovery.
  arXiv  Detail & Related papers  (2023-07-09T21:16:56Z)
• A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models [21.124096884958337]
  Controllable Text Generation (CTG) is emerging area in the field of natural language generation (NLG) We present a systematic critical review on the common tasks, main approaches, and evaluation methods in this area. We discuss the challenges that the field is facing, and put forward various promising future directions.
  arXiv  Detail & Related papers  (2022-01-14T08:32:20Z)
• Systematic Inequalities in Language Technology Performance across the World's Languages [94.65681336393425]
  We introduce a framework for estimating the global utility of language technologies. Our analyses involve the field at large, but also more in-depth studies on both user-facing technologies and more linguistic NLP tasks.
  arXiv  Detail & Related papers  (2021-10-13T14:03:07Z)
• Deep Technology Tracing for High-tech Companies [67.86308971806322]
  We develop a novel data-driven solution, i.e., Deep Technology Forecasting (DTF) framework, to automatically find the most possible technology directions customized to each high-tech company. DTF consists of three components: Potential Competitor Recognition (PCR), Collaborative Technology Recognition (CTR), and Deep Technology Tracing (DTT) neural network.
  arXiv  Detail & Related papers  (2020-01-02T07:44:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.