Dual Attention Model for Citation Recommendation

• URL: http://arxiv.org/abs/2010.00182v5
• Date: Thu, 3 Dec 2020 05:16:08 GMT
• Title: Dual Attention Model for Citation Recommendation
• Authors: Yang Zhang, Qiang Ma
• Abstract summary: We propose a novel embedding-based neural network called "dual attention model for citation recommendation" A neural network is designed to maximize the similarity between the embedding of the three input (local context words, section and structural contexts) and the target citation appearing in the context.
• Score: 7.244791479777266
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Based on an exponentially increasing number of academic articles, discovering and citing comprehensive and appropriate resources has become a non-trivial task. Conventional citation recommender methods suffer from severe information loss. For example, they do not consider the section of the paper that the user is writing and for which they need to find a citation, the relatedness between the words in the local context (the text span that describes a citation), or the importance on each word from the local context. These shortcomings make such methods insufficient for recommending adequate citations to academic manuscripts. In this study, we propose a novel embedding-based neural network called "dual attention model for citation recommendation (DACR)" to recommend citations during manuscript preparation. Our method adapts embedding of three dimensions of semantic information: words in the local context, structural contexts, and the section on which a user is working. A neural network is designed to maximize the similarity between the embedding of the three input (local context words, section and structural contexts) and the target citation appearing in the context. The core of the neural network is composed of self-attention and additive attention, where the former aims to capture the relatedness between the contextual words and structural context, and the latter aims to learn the importance of them. The experiments on real-world datasets demonstrate the effectiveness of the proposed approach.

Related papers

• Contextualizing Generated Citation Texts [11.531517736126657]
  We propose a simple modification to the citation text generation task. The generation target is not only the citation itself, but the entire context window, including the target citation.
  arXiv  Detail & Related papers  (2024-02-28T05:24:21Z)
• Description-Enhanced Label Embedding Contrastive Learning for Text Classification [65.01077813330559]
  Self-Supervised Learning (SSL) in model learning process and design a novel self-supervised Relation of Relation (R2) classification task. Relation of Relation Learning Network (R2-Net) for text classification, in which text classification and R2 classification are treated as optimization targets. external knowledge from WordNet to obtain multi-aspect descriptions for label semantic learning.
  arXiv  Detail & Related papers  (2023-06-15T02:19:34Z)
• Inline Citation Classification using Peripheral Context and Time-evolving Augmentation [23.88211560188731]
  We propose a new dataset, named 3Cext, which provides discourse information using the cited sentences. We propose PeriCite, a Transformer-based deep neural network that fuses peripheral sentences and domain knowledge.
  arXiv  Detail & Related papers  (2023-03-01T09:11:07Z)
• Contextual information integration for stance detection via cross-attention [59.662413798388485]
  Stance detection deals with identifying an author's stance towards a target. Most existing stance detection models are limited because they do not consider relevant contextual information. We propose an approach to integrate contextual information as text.
  arXiv  Detail & Related papers  (2022-11-03T15:04:29Z)
• LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching [66.65398852962177]
  We develop a novel Dynamic Re-read Network (DRr-Net) for sentence semantic matching. We extend DRr-Net to Locally-Aware Dynamic Re-read Attention Net (LadRa-Net) Experiments on two popular sentence semantic matching tasks demonstrate that DRr-Net can significantly improve the performance of sentence semantic matching.
  arXiv  Detail & Related papers  (2021-08-06T02:07:04Z)
• Semantic Representation and Inference for NLP [2.969705152497174]
  This thesis investigates the use of deep learning for novel semantic representation and inference. We contribute the largest publicly available dataset of real-life factual claims for the purpose of automatic claim verification. We operationalize the compositionality of a phrase contextually by enriching the phrase representation with external word embeddings and knowledge graphs.
  arXiv  Detail & Related papers  (2021-06-15T13:22:48Z)
• On the Use of Context for Predicting Citation Worthiness of Sentences in Scholarly Articles [10.28696219236292]
  We formulate this problem as a sequence labeling task solved using a hierarchical BiLSTM model. We contribute a new benchmark dataset containing over two million sentences and their corresponding labels. Our results quantify the benefits of using context and contextual embeddings for citation worthiness.
  arXiv  Detail & Related papers  (2021-04-18T21:47:30Z)
• R$^2$-Net: Relation of Relation Learning Network for Sentence Semantic Matching [58.72111690643359]
  We propose a Relation of Relation Learning Network (R2-Net) for sentence semantic matching. We first employ BERT to encode the input sentences from a global perspective. Then a CNN-based encoder is designed to capture keywords and phrase information from a local perspective. To fully leverage labels for better relation information extraction, we introduce a self-supervised relation of relation classification task.
  arXiv  Detail & Related papers  (2020-12-16T13:11:30Z)
• Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language [148.0843278195794]
  We propose a new model architecture for learning multi-modal neuro-symbolic representations for video captioning. Our approach uses a dictionary learning-based method of learning relations between videos and their paired text descriptions.
  arXiv  Detail & Related papers  (2020-11-18T20:21:19Z)
• Virtual Proximity Citation (VCP): A Supervised Deep Learning Method to Relate Uncited Papers On Grounds of Citation Proximity [0.0]
  This paper discusses the approach Virtual Citation Proximity (VCP) The actual distance between the two citations in a document is used as ground truth. This can be used to calculate relatedness between two documents in a way they would have been cited in the proximity even if the documents are uncited.
  arXiv  Detail & Related papers  (2020-09-25T12:24:00Z)
• Word Sense Disambiguation for 158 Languages using Word Embeddings Only [80.79437083582643]
  Disambiguation of word senses in context is easy for humans, but a major challenge for automatic approaches. We present a method that takes as input a standard pre-trained word embedding model and induces a fully-fledged word sense inventory. We use this method to induce a collection of sense inventories for 158 languages on the basis of the original pre-trained fastText word embeddings.
  arXiv  Detail & Related papers  (2020-03-14T14:50:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.