A Survey on Incorporating Domain Knowledge into Deep Learning for Medical Image Analysis

• URL: http://arxiv.org/abs/2004.12150v4
• Date: Mon, 8 Feb 2021 06:55:26 GMT
• Title: A Survey on Incorporating Domain Knowledge into Deep Learning for Medical Image Analysis
• Authors: Xiaozheng Xie, Jianwei Niu, Xuefeng Liu, Zhengsu Chen, Shaojie Tang and Shui Yu
• Abstract summary: Small size of medical datasets remains a major bottleneck in deep learning. Traditional approaches leverage the information from natural images via transfer learning. More recent works utilize the domain knowledge from medical doctors to create networks that resemble how medical doctors are trained.
• Score: 38.90186125141749
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although deep learning models like CNNs have achieved great success in medical image analysis, the small size of medical datasets remains a major bottleneck in this area. To address this problem, researchers have started looking for external information beyond current available medical datasets. Traditional approaches generally leverage the information from natural images via transfer learning. More recent works utilize the domain knowledge from medical doctors, to create networks that resemble how medical doctors are trained, mimic their diagnostic patterns, or focus on the features or areas they pay particular attention to. In this survey, we summarize the current progress on integrating medical domain knowledge into deep learning models for various tasks, such as disease diagnosis, lesion, organ and abnormality detection, lesion and organ segmentation. For each task, we systematically categorize different kinds of medical domain knowledge that have been utilized and their corresponding integrating methods. We also provide current challenges and directions for future research.

Related papers

• Deep Learning Applications in Medical Image Analysis: Advancements, Challenges, and Future Directions [0.0]
  Recent breakthroughs in deep learning, a subset of artificial intelligence, have markedly revolutionized the analysis of medical pictures. CNNs have demonstrated remarkable proficiency in autonomously learning features from multidimensional medical pictures. These models have been utilized across multiple medical disciplines, including pathology, radiology, ophthalmology, and cardiology.
  arXiv  Detail & Related papers  (2024-10-18T02:57:14Z)
• A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis [48.84443450990355]
  Deep networks have achieved broad success in analyzing natural images, when applied to medical scans, they often fail in unexcepted situations. We investigate this challenge and focus on model sensitivity to domain shifts, such as data sampled from different hospitals or data confounded by demographic variables such as sex, race, etc, in the context of chest X-rays and skin lesion images. Taking inspiration from medical training, we propose giving deep networks a prior grounded in explicit medical knowledge communicated in natural language.
  arXiv  Detail & Related papers  (2024-05-23T17:55:02Z)
• Continual Learning in Medical Imaging: A Survey and Practical Analysis [0.7794090852114541]
  Continual Learning offers promise in enabling the sequential acquisition of new knowledge without forgetting previous learnings in neural networks. We review the recent literature on continual learning in the medical domain, highlight recent trends, and point out the practical issues. We critically discuss the current state of continual learning in medical imaging, including identifying open problems and outlining promising future directions.
  arXiv  Detail & Related papers  (2024-05-22T09:48:04Z)
• A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data [41.8344712915454]
  Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources. It is a challenging task, as the computational model needs to mimic physicians to obtain information from multi-modal input data. Recent works emerged to address this issue using deep learning-based methods, such as transformers, contrastive learning, and knowledge-base construction. This survey summarizes the key techniques developed in the most recent works and proposes a general workflow for deep learning-based report generation.
  arXiv  Detail & Related papers  (2024-05-21T14:37:35Z)
• Medical Vision-Language Pre-Training for Brain Abnormalities [96.1408455065347]
  We show how to automatically collect medical image-text aligned data for pretraining from public resources such as PubMed. In particular, we present a pipeline that streamlines the pre-training process by initially collecting a large brain image-text dataset. We also investigate the unique challenge of mapping subfigures to subcaptions in the medical domain.
  arXiv  Detail & Related papers  (2024-04-27T05:03:42Z)
• Federated Learning for Medical Image Analysis: A Survey [16.800565615106784]
  Machine learning in medical imaging often faces a fundamental dilemma, namely, the small sample size problem. As a promising solution, federated learning, which enables collaborative training of machine learning models based on data from different sites without cross-site data sharing, has attracted considerable attention recently.
  arXiv  Detail & Related papers  (2023-06-09T15:46:42Z)
• Domain Generalization on Medical Imaging Classification using Episodic Training with Task Augmentation [62.49837463676111]
  We propose a novel scheme of episodic training with task augmentation on medical imaging classification. Motivated by the limited number of source domains in real-world medical deployment, we consider the unique task-level overfitting.
  arXiv  Detail & Related papers  (2021-06-13T03:56:59Z)
• Recent advances and clinical applications of deep learning in medical image analysis [7.132678647070632]
  We reviewed and summarized more than 200 recently published papers to provide a comprehensive overview of applying deep learning methods in various medical image analysis tasks. Especially, we emphasize the latest progress and contributions of state-of-the-art unsupervised and semi-supervised deep learning in medical images.
  arXiv  Detail & Related papers  (2021-05-27T18:05:12Z)
• Cross-Modal Information Maximization for Medical Imaging: CMIM [62.28852442561818]
  In hospitals, data are siloed to specific information systems that make the same information available under different modalities. This offers unique opportunities to obtain and use at train-time those multiple views of the same information that might not always be available at test-time. We propose an innovative framework that makes the most of available data by learning good representations of a multi-modal input that are resilient to modality dropping at test-time.
  arXiv  Detail & Related papers  (2020-10-20T20:05:35Z)
• Domain Shift in Computer Vision models for MRI data analysis: An Overview [64.69150970967524]
  Machine learning and computer vision methods are showing good performance in medical imagery analysis. Yet only a few applications are now in clinical use. Poor transferability of themodels to data from different sources or acquisition domains is one of the reasons for that.
  arXiv  Detail & Related papers  (2020-10-14T16:34:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.