Generalized knowledge-enhanced framework for biomedical entity and relation extraction

• URL: http://arxiv.org/abs/2408.06618v1
• Date: Tue, 13 Aug 2024 04:06:45 GMT
• Title: Generalized knowledge-enhanced framework for biomedical entity and relation extraction
• Authors: Minh Nguyen, Phuong Le,
• Abstract summary: We develop a novel framework to construct a task-independent and reusable background knowledge graph for biomedical entity and relation extraction. The design of our model is inspired by how humans learn domain-specific topics. Our framework employs such common-knowledge-sharing mechanism to build a general neural-network knowledge graph that is learning transferable to different domain-specific biomedical texts effectively.
• Score: 0.6856896119187885
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In recent years, there has been an increasing number of frameworks developed for biomedical entity and relation extraction. This research effort aims to address the accelerating growth in biomedical publications and the intricate nature of biomedical texts, which are written for mainly domain experts. To handle these challenges, we develop a novel framework that utilizes external knowledge to construct a task-independent and reusable background knowledge graph for biomedical entity and relation extraction. The design of our model is inspired by how humans learn domain-specific topics. In particular, humans often first acquire the most basic and common knowledge regarding a field to build the foundational knowledge and then use that as a basis for extending to various specialized topics. Our framework employs such common-knowledge-sharing mechanism to build a general neural-network knowledge graph that is learning transferable to different domain-specific biomedical texts effectively. Experimental evaluations demonstrate that our model, equipped with this generalized and cross-transferable knowledge base, achieves competitive performance benchmarks, including BioRelEx for binding interaction detection and ADE for Adverse Drug Effect identification.

Related papers

• Unified Representation of Genomic and Biomedical Concepts through Multi-Task, Multi-Source Contrastive Learning [45.6771125432388]
  We introduce GENomic REpresentation with Language Model (GENEREL) GENEREL is a framework designed to bridge genetic and biomedical knowledge bases. Our experiments demonstrate GENEREL's ability to effectively capture the nuanced relationships between SNPs and clinical concepts.
  arXiv  Detail & Related papers  (2024-10-14T04:19:52Z)
• Enhancing Biomedical Knowledge Discovery for Diseases: An Open-Source Framework Applied on Rett Syndrome and Alzheimer's Disease [28.68816381566995]
  We introduce an open-source framework designed to construct knowledge around specific diseases directly from raw text. To facilitate research in disease-related knowledge discovery, we create two annotated datasets focused on Rett syndrome and Alzheimer's disease.
  arXiv  Detail & Related papers  (2024-07-18T13:20:53Z)
• Progress and Opportunities of Foundation Models in Bioinformatics [77.74411726471439]
  Foundations models (FMs) have ushered in a new era in computational biology, especially in the realm of deep learning. Central to our focus is the application of FMs to specific biological problems, aiming to guide the research community in choosing appropriate FMs for their research needs. Review analyses challenges and limitations faced by FMs in biology, such as data noise, model explainability, and potential biases.
  arXiv  Detail & Related papers  (2024-02-06T02:29:17Z)
• Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs [54.223394825528665]
  We develop an approach that uses lightweight adapter modules to inject structured biomedical knowledge into pre-trained language models. We use two large KGs, the biomedical knowledge system UMLS and the novel biochemical OntoChem, with two prominent biomedical PLMs, PubMedBERT and BioLinkBERT. We show that our methodology leads to performance improvements in several instances while keeping requirements in computing power low.
  arXiv  Detail & Related papers  (2023-12-21T14:26:57Z)
• Enhancing Biomedical Lay Summarisation with External Knowledge Graphs [28.956500948255677]
  We investigate the effectiveness of three different approaches for incorporating knowledge graphs within lay summarisation models. Our results confirm that integrating graph-based domain knowledge can significantly benefit lay summarisation by substantially increasing the readability of generated text.
  arXiv  Detail & Related papers  (2023-10-24T10:25:21Z)
• Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Papers [24.481854035628434]
  Existing language models struggle to generate technical summaries that are on par with those produced by biomedical experts. We propose a novel attention-based citation aggregation model that integrates domain-specific knowledge from citation papers. Our model outperforms state-of-the-art approaches and achieves substantial improvements in abstractive biomedical text summarisation.
  arXiv  Detail & Related papers  (2023-10-24T09:56:46Z)
• BERT Based Clinical Knowledge Extraction for Biomedical Knowledge Graph Construction and Analysis [0.4893345190925178]
  We propose an end-to-end approach for knowledge extraction and analysis from biomedical clinical notes. The proposed framework can successfully extract relevant structured information with high accuracy.
  arXiv  Detail & Related papers  (2023-04-21T14:45:33Z)
• EBOCA: Evidences for BiOmedical Concepts Association Ontology [55.41644538483948]
  This paper proposes EBOCA, an ontology that describes (i) biomedical domain concepts and associations between them, and (ii) evidences supporting these associations. Test data coming from a subset of DISNET and automatic association extractions from texts has been transformed to create a Knowledge Graph that can be used in real scenarios.
  arXiv  Detail & Related papers  (2022-08-01T18:47:03Z)
• Discovering Drug-Target Interaction Knowledge from Biomedical Literature [107.98712673387031]
  The Interaction between Drugs and Targets (DTI) in human body plays a crucial role in biomedical science and applications. As millions of papers come out every year in the biomedical domain, automatically discovering DTI knowledge from literature becomes an urgent demand in the industry. We explore the first end-to-end solution for this task by using generative approaches. We regard the DTI triplets as a sequence and use a Transformer-based model to directly generate them without using the detailed annotations of entities and relations.
  arXiv  Detail & Related papers  (2021-09-27T17:00:14Z)
• Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction [21.858440542249934]
  We introduce a novel framework that enables the model to learn multi-omnics biological information about entities (proteins) with the help of additional multi-modal cues like molecular structure. We evaluate our proposed method on ProteinProtein Interaction task from the biomedical corpus.
  arXiv  Detail & Related papers  (2021-07-01T16:37:17Z)
• Extracting a Knowledge Base of Mechanisms from COVID-19 Papers [50.17242035034729]
  We pursue the construction of a knowledge base (KB) of mechanisms. We develop a broad, unified schema that strikes a balance between relevance and breadth. Experiments demonstrate the utility of our KB in supporting interdisciplinary scientific search over COVID-19 literature.
  arXiv  Detail & Related papers  (2020-10-08T07:54:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.