Unifying Neural Learning and Symbolic Reasoning for Spinal Medical Report Generation

• URL: http://arxiv.org/abs/2004.13577v1
• Date: Tue, 28 Apr 2020 15:06:24 GMT
• Title: Unifying Neural Learning and Symbolic Reasoning for Spinal Medical Report Generation
• Authors: Zhongyi Han, Benzheng Wei, Yilong Yin, Shuo Li
• Abstract summary: We propose the neural-symbolic learning framework that performs human-like learning by unifying deep neural learning and symbolic logical reasoning. Our algorithm remarkably exceeds existing methods in the detection of spinal structures.
• Score: 33.818136671925444
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automated medical report generation in spine radiology, i.e., given spinal medical images and directly create radiologist-level diagnosis reports to support clinical decision making, is a novel yet fundamental study in the domain of artificial intelligence in healthcare. However, it is incredibly challenging because it is an extremely complicated task that involves visual perception and high-level reasoning processes. In this paper, we propose the neural-symbolic learning (NSL) framework that performs human-like learning by unifying deep neural learning and symbolic logical reasoning for the spinal medical report generation. Generally speaking, the NSL framework firstly employs deep neural learning to imitate human visual perception for detecting abnormalities of target spinal structures. Concretely, we design an adversarial graph network that interpolates a symbolic graph reasoning module into a generative adversarial network through embedding prior domain knowledge, achieving semantic segmentation of spinal structures with high complexity and variability. NSL secondly conducts human-like symbolic logical reasoning that realizes unsupervised causal effect analysis of detected entities of abnormalities through meta-interpretive learning. NSL finally fills these discoveries of target diseases into a unified template, successfully achieving a comprehensive medical report generation. When it employed in a real-world clinical dataset, a series of empirical studies demonstrate its capacity on spinal medical report generation as well as show that our algorithm remarkably exceeds existing methods in the detection of spinal structures. These indicate its potential as a clinical tool that contributes to computer-aided diagnosis.

Related papers

• Adversarial Neural Networks in Medical Imaging Advancements and Challenges in Semantic Segmentation [6.88255677115486]
  Recent advancements in artificial intelligence (AI) have precipitated a paradigm shift in medical imaging. This paper systematically investigates the integration of deep learning -- a principal branch of AI -- into the semantic segmentation of brain images. adversarial neural networks, a novel AI approach that not only automates but also refines the semantic segmentation process.
  arXiv  Detail & Related papers  (2024-10-17T00:05:05Z)
• AutoRG-Brain: Grounded Report Generation for Brain MRI [57.22149878985624]
  Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment delays, increased healthcare costs, revenue loss, and operational inefficiencies. We initiate a series of work on grounded Automatic Report Generation (AutoRG) This system supports the delineation of brain structures, the localization of anomalies, and the generation of well-organized findings.
  arXiv  Detail & Related papers  (2024-07-23T17:50:00Z)
• Radiology Report Generation Using Transformers Conditioned with Non-imaging Data [55.17268696112258]
  This paper proposes a novel multi-modal transformer network that integrates chest x-ray (CXR) images and associated patient demographic information. The proposed network uses a convolutional neural network to extract visual features from CXRs and a transformer-based encoder-decoder network that combines the visual features with semantic text embeddings of patient demographic information.
  arXiv  Detail & Related papers  (2023-11-18T14:52:26Z)
• Don't PANIC: Prototypical Additive Neural Network for Interpretable Classification of Alzheimer's Disease [2.4469484645516837]
  We propose PANIC, a prototypical additive neural network for interpretable Alzheimer's disease (AD) classification. We show that PANIC achieves state-of-the-art performance in AD classification, while directly providing local and global explanations.
  arXiv  Detail & Related papers  (2023-03-13T13:56:20Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infants [73.85768093666582]
  We propose an explainable geometric deep network dubbed NeuroExplainer. NeuroExplainer is used to uncover altered infant cortical development patterns associated with preterm birth.
  arXiv  Detail & Related papers  (2023-01-01T12:48:12Z)
• Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis [31.281194583900998]
  We propose an interpretable framework to analyze disorder-specific Regions of Interest (ROIs) and prominent connections. The proposed framework consists of two modules: a brain-network-oriented backbone model for disease prediction and a globally shared explanation generator.
  arXiv  Detail & Related papers  (2022-06-30T08:02:05Z)
• Functional2Structural: Cross-Modality Brain Networks Representation Learning [55.24969686433101]
  Graph mining on brain networks may facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. We propose a novel graph learning framework, known as Deep Signed Brain Networks (DSBN), with a signed graph encoder. We validate our framework on clinical phenotype and neurodegenerative disease prediction tasks using two independent, publicly available datasets.
  arXiv  Detail & Related papers  (2022-05-06T03:45:36Z)
• Deep Learning Identifies Neuroimaging Signatures of Alzheimer's Disease Using Structural and Synthesized Functional MRI Data [8.388888908045406]
  We propose a potential solution by first learning a structural-to-functional transformation in brain MRI. We then synthesize spatially matched functional images from large-scale structural scans. We identify the temporal lobe to be the most predictive structural-region and the parieto-occipital lobe to be the most predictive functional-region of our model.
  arXiv  Detail & Related papers  (2021-04-10T03:16:33Z)
• In-Line Image Transformations for Imbalanced, Multiclass Computer Vision Classification of Lung Chest X-Rays [91.3755431537592]
  This study aims to leverage a body of literature in order to apply image transformations that would serve to balance the lack of COVID-19 LCXR data. Deep learning techniques such as convolutional neural networks (CNNs) are able to select features that distinguish between healthy and disease states. This study utilizes a simple CNN architecture for high-performance multiclass LCXR classification at 94 percent accuracy.
  arXiv  Detail & Related papers  (2021-04-06T02:01:43Z)
• Longitudinal Self-Supervised Learning [13.094393751939837]
  Ground-truth labels are often missing or expensive to obtain in neuroscience. We propose a new definition of disentanglement by formulating a multivariate mapping between factors associated with an MRI and a latent image representation. We implement this model, named Longitudinal Self-Supervised Learning (LSSL), via a standard autoencoding structure with a cosine loss to disentangle brain age from the image representation.
  arXiv  Detail & Related papers  (2020-06-12T03:35:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.