Exploring Topic Trends in COVID-19 Research Literature using Non-Negative Matrix Factorization

• URL: http://arxiv.org/abs/2503.18182v1
• Date: Sun, 23 Mar 2025 19:37:52 GMT
• Title: Exploring Topic Trends in COVID-19 Research Literature using Non-Negative Matrix Factorization
• Authors: Divya Patel, Vansh Parikh, Om Patel, Agam Shah, Bhaskar Chaudhury,
• Abstract summary: We apply topic modeling using Non-Negative Matrix Factorization (NMF) on the COVID-19 Open Research dataset.<n>NMF factorizes the document-term matrix into two non-negative matrices, effectively representing the topics and their distribution across the documents.<n>Our findings contribute to the understanding of the knowledge structure of the COVID-19 research landscape.
• Score: 2.8777530051393314
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this work, we apply topic modeling using Non-Negative Matrix Factorization (NMF) on the COVID-19 Open Research Dataset (CORD-19) to uncover the underlying thematic structure and its evolution within the extensive body of COVID-19 research literature. NMF factorizes the document-term matrix into two non-negative matrices, effectively representing the topics and their distribution across the documents. This helps us see how strongly documents relate to topics and how topics relate to words. We describe the complete methodology which involves a series of rigorous pre-processing steps to standardize the available text data while preserving the context of phrases, and subsequently feature extraction using the term frequency-inverse document frequency (tf-idf), which assigns weights to words based on their frequency and rarity in the dataset. To ensure the robustness of our topic model, we conduct a stability analysis. This process assesses the stability scores of the NMF topic model for different numbers of topics, enabling us to select the optimal number of topics for our analysis. Through our analysis, we track the evolution of topics over time within the CORD-19 dataset. Our findings contribute to the understanding of the knowledge structure of the COVID-19 research landscape, providing a valuable resource for future research in this field.

Related papers

• Dynamic Topic Analysis in Academic Journals using Convex Non-negative Matrix Factorization Method [13.479775419940283]
  This paper presents a two-stage dynamic topic analysis framework. It incorporates convex optimization to improve topic consistency, sparsity, and interpretability. Applying the proposed method to IEEE journal abstracts from 2004 to 2022 effectively identifies and quantifies emerging research topics.
  arXiv  Detail & Related papers  (2025-03-23T14:31:47Z)
• SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documents [49.54155332262579]
  We release a new entity and relation extraction dataset for entities related to datasets, methods, and tasks in scientific articles. Our dataset contains 106 manually annotated full-text scientific publications with over 24k entities and 12k relations.
  arXiv  Detail & Related papers  (2024-10-28T15:56:49Z)
• MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understanding [59.41495657570397]
  We present a comprehensive dataset compiled from Nature Communications articles covering 72 scientific fields.<n>We evaluated 19 proprietary and open-source models on two benchmark tasks, figure captioning and multiple-choice, and conducted human expert annotation.<n>Fine-tuning Qwen2-VL-7B with our task-specific data achieved better performance than GPT-4o and even human experts in multiple-choice evaluations.
  arXiv  Detail & Related papers  (2024-07-06T00:40:53Z)
• Interactive Topic Models with Optimal Transport [75.26555710661908]
  We present EdTM, as an approach for label name supervised topic modeling. EdTM models topic modeling as an assignment problem while leveraging LM/LLM based document-topic affinities.
  arXiv  Detail & Related papers  (2024-06-28T13:57:27Z)
• An Information Retrieval and Extraction Tool for Covid-19 Related Papers [0.0]
  The main focus of this paper is to provide researchers with a better search tool for COVID-19 related papers. Our tool has shown the potential to assist researchers by automating a topic-based search of CORD-19 papers.
  arXiv  Detail & Related papers  (2024-01-20T01:34:50Z)
• Exploring the evolution of research topics during the COVID-19 pandemic [3.234641429290768]
  We present the CORD-19 Topic Visualizer (CORToViz), a method and associated visualization tool for inspecting the CORD-19 textual corpus of scientific abstracts. Our method is based upon a careful selection of up-to-date technologies (including large language models) and extraction techniques for temporal topic mining. Topic inspection is supported by an interactive dashboard, providing fast, one-click visualization of topic contents as word clouds and topic trends as time series.
  arXiv  Detail & Related papers  (2023-10-05T22:16:41Z)
• Application of Transformers based methods in Electronic Medical Records: A Systematic Literature Review [77.34726150561087]
  This work presents a systematic literature review of state-of-the-art advances using transformer-based methods on electronic medical records (EMRs) in different NLP tasks.
  arXiv  Detail & Related papers  (2023-04-05T22:19:42Z)
• Knowledge-Aware Bayesian Deep Topic Model [50.58975785318575]
  We propose a Bayesian generative model for incorporating prior domain knowledge into hierarchical topic modeling. Our proposed model efficiently integrates the prior knowledge and improves both hierarchical topic discovery and document representation.
  arXiv  Detail & Related papers  (2022-09-20T09:16:05Z)
• A Data-driven Latent Semantic Analysis for Automatic Text Summarization using LDA Topic Modelling [0.0]
  This study presents the Latent Dirichlet Allocation (LDA) approach used to perform topic modelling. The visualisation provides an overarching view of the main topics while allowing and attributing deep meaning to the prevalence individual topic. The results suggest the terms ranked purely by considering their probability of the topic prevalence within the processed document.
  arXiv  Detail & Related papers  (2022-07-23T11:04:03Z)
• COVID-19 Multidimensional Kaggle Literature Organization [3.201839066679614]
  We show that factorization is a powerful unsupervised learning method capable of discovering hidden patterns in a document corpus. We show that a higher-order representation of the corpus allows for the simultaneous grouping of similar articles, relevant journals, authors with similar research interests, and topic keywords.
  arXiv  Detail & Related papers  (2021-07-17T06:16:36Z)
• Rapidly Bootstrapping a Question Answering Dataset for COVID-19 [88.86456834766288]
  We present CovidQA, the beginnings of a question answering dataset specifically designed for COVID-19. This is the first publicly available resource of its type, and intended as a stopgap measure for guiding research until more substantial evaluation resources become available.
  arXiv  Detail & Related papers  (2020-04-23T17:35:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.