Optimizing Research Portfolio For Semantic Impact

• URL: http://arxiv.org/abs/2502.13912v1
• Date: Wed, 19 Feb 2025 17:44:13 GMT
• Title: Optimizing Research Portfolio For Semantic Impact
• Authors: Alexander V. Belikov,
• Abstract summary: Citation metrics are widely used to assess academic impact but suffer from social biases. We introduce rXiv Semantic Impact (XSI), a novel framework that predicts research impact. XSI tracks the evolution of research concepts in the academic knowledge graph.
• Score: 55.2480439325792
• License:
• Abstract: Citation metrics are widely used to assess academic impact but suffer from social biases, including institutional prestige and journal visibility. Here we introduce rXiv Semantic Impact (XSI), a novel framework that predicts research impact by analyzing how scientific semantic graphs evolve in underlying fabric of science. Rather than counting citations, XSI tracks the evolution of research concepts in the academic knowledge graph (KG). Starting with a construction of a comprehensive KG from 324K biomedical publications (2003-2025), we demonstrate that XSI can predict a paper's future semantic impact (SI) with remarkable accuracy ($R^2$ = 0.69) three years in advance. We leverage these predictions to develop an optimization framework for research portfolio selection that systematically outperforms random allocation. We propose SI as a complementary metric to citations and present XSI as a tool to guide funding and publishing decisions, enhancing research impact while mitigating risk.

Related papers

• From Words to Worth: Newborn Article Impact Prediction with LLM [69.41680520058418]
  This paper introduces a promising approach, leveraging the capabilities of LLMs to predict the future impact of newborn articles. The proposed method employs LLM to discern the shared semantic features of highly impactful papers from a large collection of title-abstract pairs. The quantitative results, with an MAE of 0.216 and an NDCG@20 of 0.901, demonstrate that the proposed approach achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-08-07T17:52:02Z)
• Mapping the Increasing Use of LLMs in Scientific Papers [99.67983375899719]
  We conduct the first systematic, large-scale analysis across 950,965 papers published between January 2020 and February 2024 on the arXiv, bioRxiv, and Nature portfolio journals. Our findings reveal a steady increase in LLM usage, with the largest and fastest growth observed in Computer Science papers.
  arXiv  Detail & Related papers  (2024-04-01T17:45:15Z)
• Mapping Computer Science Research: Trends, Influences, and Predictions [0.0]
  We employ advanced machine learning techniques, including Decision Tree and Logistic Regression models, to predict trending research areas. Our analysis reveals that the number of references cited in research papers (Reference Count) plays a pivotal role in determining trending research areas. The Logistic Regression model outperforms the Decision Tree model in predicting trends, exhibiting higher accuracy, precision, recall, and F1 score.
  arXiv  Detail & Related papers  (2023-08-01T16:59:25Z)
• A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why? [84.46288849132634]
  We propose a systematic framework for analyzing the evolution of research topics in a scientific field using causal discovery and inference techniques. We define three variables to encompass diverse facets of the evolution of research topics within NLP. We utilize a causal discovery algorithm to unveil the causal connections among these variables using observational data.
  arXiv  Detail & Related papers  (2023-05-22T11:08:00Z)
• Application of targeted maximum likelihood estimation in public health and epidemiological studies: a systematic review [0.0]
  The Targeted Maximum Likelihood Estimation framework integrates machine learning, statistical theory, and statistical inference. We conduct a systematic literature review in PubMed for articles that applied any form of TMLE in observational studies. Of the 81 publications included, 25% originated from the University of California at Berkeley, where the framework was first developed.
  arXiv  Detail & Related papers  (2023-03-13T17:50:03Z)
• Citation Trajectory Prediction via Publication Influence Representation Using Temporal Knowledge Graph [52.07771598974385]
  Existing approaches mainly rely on mining temporal and graph data from academic articles. Our framework is composed of three modules: difference-preserved graph embedding, fine-grained influence representation, and learning-based trajectory calculation. Experiments are conducted on both the APS academic dataset and our contributed AIPatent dataset.
  arXiv  Detail & Related papers  (2022-10-02T07:43:26Z)
• Deep forecasting of translational impact in medical research [1.8130872753848115]
  We develop a suite of representational and discriminative mathematical models of multi-scale publication data. We show that citations are only moderately predictive of translational impact as judged by inclusion in patents, guidelines, or policy documents. We argue that content-based models of impact are superior in performance to conventional, citation-based measures.
  arXiv  Detail & Related papers  (2021-10-17T19:29:41Z)
• Semantic Analysis for Automated Evaluation of the Potential Impact of Research Articles [62.997667081978825]
  This paper presents a novel method for vector representation of text meaning based on information theory. We show how this informational semantics is used for text classification on the basis of the Leicester Scientific Corpus. We show that an informational approach to representing the meaning of a text has offered a way to effectively predict the scientific impact of research papers.
  arXiv  Detail & Related papers  (2021-04-26T20:37:13Z)
• Attention: to Better Stand on the Shoulders of Giants [34.5017808610466]
  This paper develops an attention mechanism for the long-term scientific impact prediction. It validates the method based on a real large-scale citation data set.
  arXiv  Detail & Related papers  (2020-05-27T00:25:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.