Longitudinal Citation Prediction using Temporal Graph Neural Networks

• URL: http://arxiv.org/abs/2012.05742v2
• Date: Thu, 15 Apr 2021 14:48:17 GMT
• Title: Longitudinal Citation Prediction using Temporal Graph Neural Networks
• Authors: Andreas Nugaard Holm, Barbara Plank, Dustin Wright, Isabelle Augenstein
• Abstract summary: We introduce the task of sequence citation prediction. The goal is to accurately predict the trajectory of the number of citations a scholarly work receives over time.
• Score: 27.589741169713825
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Citation count prediction is the task of predicting the number of citations a paper has gained after a period of time. Prior work viewed this as a static prediction task. As papers and their citations evolve over time, considering the dynamics of the number of citations a paper will receive would seem logical. Here, we introduce the task of sequence citation prediction. The goal is to accurately predict the trajectory of the number of citations a scholarly work receives over time. We propose to view papers as a structured network of citations, allowing us to use topological information as a learning signal. Additionally, we learn how this dynamic citation network changes over time and the impact of paper meta-data such as authors, venues and abstracts. To approach the new task, we derive a dynamic citation network from Semantic Scholar spanning over 42 years. We present a model which exploits topological and temporal information using graph convolution networks paired with sequence prediction, and compare it against multiple baselines, testing the importance of topological and temporal information and analyzing model performance. Our experiments show that leveraging both the temporal and topological information greatly increases the performance of predicting citation counts over time.

Related papers

• Temporal Graph Neural Network-Powered Paper Recommendation on Dynamic Citation Networks [4.666226480911492]
  This paper introduces a temporal dimension to paper recommendation strategies. The core idea is to continuously update a paper's embedding when new citation relationships appear. A learnable memory update module based on a Recurrent Neural Network (RNN) is utilized to study the evolution of the embedding.
  arXiv  Detail & Related papers  (2024-08-27T19:10:21Z)
• Time to Cite: Modeling Citation Networks using the Dynamic Impact Single-Event Embedding Model [0.33123773366516646]
  citation networks are a prominent example of single-event dynamic networks. We propose a novel likelihood function for the characterization of such single-event networks. The Dynamic Impact Single-Event Embedding model (DISEE) reconciles static latent distance network embedding approaches with classical dynamic impact assessments.
  arXiv  Detail & Related papers  (2024-02-28T22:59:26Z)
• CiteBench: A benchmark for Scientific Citation Text Generation [69.37571393032026]
  CiteBench is a benchmark for citation text generation. We make the code for CiteBench publicly available at https://github.com/UKPLab/citebench.
  arXiv  Detail & Related papers  (2022-12-19T16:10:56Z)
• Scientific Paper Extractive Summarization Enhanced by Citation Graphs [50.19266650000948]
  We focus on leveraging citation graphs to improve scientific paper extractive summarization under different settings. Preliminary results demonstrate that citation graph is helpful even in a simple unsupervised framework. Motivated by this, we propose a Graph-based Supervised Summarization model (GSS) to achieve more accurate results on the task when large-scale labeled data are available.
  arXiv  Detail & Related papers  (2022-12-08T11:53:12Z)
• Towards generating citation sentences for multiple references with intent control [86.53829532976303]
  We build a novel generation model with the Fusion-in-Decoder approach to cope with multiple long inputs. Experiments demonstrate that the proposed approaches provide much more comprehensive features for generating citation sentences.
  arXiv  Detail & Related papers  (2021-12-02T15:32:24Z)
• Temporal Graph Network Embedding with Causal Anonymous Walks Representations [54.05212871508062]
  We propose a novel approach for dynamic network representation learning based on Temporal Graph Network. For evaluation, we provide a benchmark pipeline for the evaluation of temporal network embeddings. We show the applicability and superior performance of our model in the real-world downstream graph machine learning task provided by one of the top European banks.
  arXiv  Detail & Related papers  (2021-08-19T15:39:52Z)
• Scientometric engineering: Exploring citation dynamics via arXiv eprints [0.0]
  We investigate the citation data of more than 1.5 million eprints on arXiv. We find that the typical growth and obsolescence patterns vary across disciplines. We derive a model consistent with the observed quantitative and temporal characteristics of citation growth and obsolescence.
  arXiv  Detail & Related papers  (2021-06-09T12:38:44Z)
• Semantic Analysis for Automated Evaluation of the Potential Impact of Research Articles [62.997667081978825]
  This paper presents a novel method for vector representation of text meaning based on information theory. We show how this informational semantics is used for text classification on the basis of the Leicester Scientific Corpus. We show that an informational approach to representing the meaning of a text has offered a way to effectively predict the scientific impact of research papers.
  arXiv  Detail & Related papers  (2021-04-26T20:37:13Z)
• Enhancing Scientific Papers Summarization with Citation Graph [78.65955304229863]
  We redefine the task of scientific papers summarization by utilizing their citation graph. We construct a novel scientific papers summarization dataset Semantic Scholar Network (SSN) which contains 141K research papers in different domains. Our model can achieve competitive performance when compared with the pretrained models.
  arXiv  Detail & Related papers  (2021-04-07T11:13:35Z)
• Structured Citation Trend Prediction Using Graph Neural Networks [6.325999141414098]
  We present a GNN-based architecture that predicts the top set of papers at the time of publication. For experiments, we curate a set of academic citation graphs for a variety of conferences and show that the proposed model outperforms other classic machine learning models in terms of the F1-score.
  arXiv  Detail & Related papers  (2021-04-06T14:58:29Z)
• Chronological Citation Recommendation with Time Preference [20.179186544131337]
  This paper predicts the time preference based on user queries, which is a probability distribution of citing papers published in different time slices. We use this time preference to re-rank the initial citation list obtained by content-based filtering.
  arXiv  Detail & Related papers  (2021-01-19T13:18:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.