On Representation Learning for Scientific News Articles Using Heterogeneous Knowledge Graphs

• URL: http://arxiv.org/abs/2104.05866v1
• Date: Mon, 12 Apr 2021 23:46:54 GMT
• Title: On Representation Learning for Scientific News Articles Using Heterogeneous Knowledge Graphs
• Authors: Angelika Romanou, Panayiotis Smeros, Karl Aberer
• Abstract summary: We present a methodology for creating scientific news article representations by modeling the directed graph between the scientific news articles and the cited scientific publications. The results show promising applications of graph neural network approaches in the domains of knowledge tracing and scientific news credibility assessment.
• Score: 4.186267062202487
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In the era of misinformation and information inflation, the credibility assessment of the produced news is of the essence. However, fact-checking can be challenging considering the limited references presented in the news. This challenge can be transcended by utilizing the knowledge graph that is related to the news articles. In this work, we present a methodology for creating scientific news article representations by modeling the directed graph between the scientific news articles and the cited scientific publications. The network used for the experiments is comprised of the scientific news articles, their topic, the cited research literature, and their corresponding authors. We implement and present three different approaches: 1) a baseline Relational Graph Convolutional Network (R-GCN), 2) a Heterogeneous Graph Neural Network (HetGNN) and 3) a Heterogeneous Graph Transformer (HGT). We test these models in the downstream task of link prediction on the: a) news article - paper links and b) news article - article topic links. The results show promising applications of graph neural network approaches in the domains of knowledge tracing and scientific news credibility assessment.

Related papers

• The Semantic Scholar Open Data Platform [79.4493235243312]
  Semantic Scholar (S2) is an open data platform and website aimed at accelerating science by helping scholars discover and understand scientific literature. We combine public and proprietary data sources using state-of-the-art techniques for scholarly PDF content extraction and automatic knowledge graph construction. The graph includes advanced semantic features such as structurally parsed text, natural language summaries, and vector embeddings.
  arXiv  Detail & Related papers  (2023-01-24T17:13:08Z)
• SciLander: Mapping the Scientific News Landscape [8.504643390943409]
  We introduce SciLander, a method for learning representations of news sources reporting on science-based topics. We evaluate our method on a novel COVID-19 dataset containing nearly 1M news articles from 500 sources spanning a period of 18 months since the beginning of the pandemic in 2020.
  arXiv  Detail & Related papers  (2022-05-16T20:20:43Z)
• Discovering the Representation Bottleneck of Graph Neural Networks from Multi-order Interactions [51.597480162777074]
  Graph neural networks (GNNs) rely on the message passing paradigm to propagate node features and build interactions. Recent works point out that different graph learning tasks require different ranges of interactions between nodes. We study two common graph construction methods in scientific domains, i.e., emphK-nearest neighbor (KNN) graphs and emphfully-connected (FC) graphs.
  arXiv  Detail & Related papers  (2022-05-15T11:38:14Z)
• Fake News Quick Detection on Dynamic Heterogeneous Information Networks [3.599616699656401]
  We propose a novel Dynamic Heterogeneous Graph Neural Network (DHGNN) for fake news quick detection. We first implement BERT and fine-tuned BERT to get a semantic representation of the news article contents and author profiles. Then, we construct the heterogeneous news-author graph to reflect contextual information and relationships.
  arXiv  Detail & Related papers  (2022-05-14T11:23:25Z)
• A comparative analysis of Graph Neural Networks and commonly used machine learning algorithms on fake news detection [0.0]
  Low cost, simple accessibility via social platforms, and a plethora of low-budget online news sources are some of the factors that contribute to the spread of false news. Most of the existing fake news detection algorithms are solely focused on the news content only. engaged users prior posts or social activities provide a wealth of information about their views on news and have significant ability to improve fake news identification.
  arXiv  Detail & Related papers  (2022-03-26T18:40:03Z)
• Graph Neural Networks for Graphs with Heterophily: A Survey [98.45621222357397]
  We provide a comprehensive review of graph neural networks (GNNs) for heterophilic graphs. Specifically, we propose a systematic taxonomy that essentially governs existing heterophilic GNN models. We discuss the correlation between graph heterophily and various graph research domains, aiming to facilitate the development of more effective GNNs.
  arXiv  Detail & Related papers  (2022-02-14T23:07:47Z)
• Enhancing Scientific Papers Summarization with Citation Graph [78.65955304229863]
  We redefine the task of scientific papers summarization by utilizing their citation graph. We construct a novel scientific papers summarization dataset Semantic Scholar Network (SSN) which contains 141K research papers in different domains. Our model can achieve competitive performance when compared with the pretrained models.
  arXiv  Detail & Related papers  (2021-04-07T11:13:35Z)
• Adversarial Active Learning based Heterogeneous Graph Neural Network for Fake News Detection [18.847254074201953]
  We propose a novel fake news detection framework, namely Adversarial Active Learning-based Heterogeneous Graph Neural Network (AA-HGNN) AA-HGNN utilizes an active learning framework to enhance learning performance, especially when facing the paucity of labeled data. Experiments with two real-world fake news datasets show that our model can outperform text-based models and other graph-based models.
  arXiv  Detail & Related papers  (2021-01-27T05:05:25Z)
• What's New? Summarizing Contributions in Scientific Literature [85.95906677964815]
  We introduce a new task of disentangled paper summarization, which seeks to generate separate summaries for the paper contributions and the context of the work. We extend the S2ORC corpus of academic articles by adding disentangled "contribution" and "context" reference labels. We propose a comprehensive automatic evaluation protocol which reports the relevance, novelty, and disentanglement of generated outputs.
  arXiv  Detail & Related papers  (2020-11-06T02:23:01Z)
• A Heterogeneous Graph with Factual, Temporal and Logical Knowledge for Question Answering Over Dynamic Contexts [81.4757750425247]
  We study question answering over a dynamic textual environment. We develop a graph neural network over the constructed graph, and train the model in an end-to-end manner.
  arXiv  Detail & Related papers  (2020-04-25T04:53:54Z)
• Fake News Detection on News-Oriented Heterogeneous Information Networks through Hierarchical Graph Attention [12.250335118888891]
  We propose a novel fake news detection framework, namely Hierarchical Graph Attention Network(HGAT) HGAT uses a novel hierarchical attention mechanism to perform node representation learning in HIN, and then detects fake news by classifying news article nodes. Experiments on two real-world fake news datasets show that HGAT can outperform text-based models and other network-based models.
  arXiv  Detail & Related papers  (2020-02-05T19:09:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.