Reinforcement Learning in Medical Image Analysis: Concepts, Applications, Challenges, and Future Directions

• URL: http://arxiv.org/abs/2206.14302v1
• Date: Tue, 28 Jun 2022 22:07:17 GMT
• Title: Reinforcement Learning in Medical Image Analysis: Concepts, Applications, Challenges, and Future Directions
• Authors: Mingzhe Hu, Jiahan Zhang, Luke Matkovic, Tian Liu and Xiaofeng Yang
• Abstract summary: Reinforcement learning has gradually gained momentum in recent years. Many researchers in the medical analysis field find it hard to understand and deploy in clinics. This paper may help the readers to learn how to formulate and solve their medical image analysis research as reinforcement learning problems.
• Score: 1.9065960619519515
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Motivation: Medical image analysis involves tasks to assist physicians in qualitative and quantitative analysis of lesions or anatomical structures, significantly improving the accuracy and reliability of diagnosis and prognosis. Traditionally, these tasks are finished by physicians or medical physicists and lead to two major problems: (i) low efficiency; (ii) biased by personal experience. In the past decade, many machine learning methods have been applied to accelerate and automate the image analysis process. Compared to the enormous deployments of supervised and unsupervised learning models, attempts to use reinforcement learning in medical image analysis are scarce. This review article could serve as the stepping-stone for related research. Significance: From our observation, though reinforcement learning has gradually gained momentum in recent years, many researchers in the medical analysis field find it hard to understand and deploy in clinics. One cause is lacking well-organized review articles targeting readers lacking professional computer science backgrounds. Rather than providing a comprehensive list of all reinforcement learning models in medical image analysis, this paper may help the readers to learn how to formulate and solve their medical image analysis research as reinforcement learning problems. Approach & Results: We selected published articles from Google Scholar and PubMed. Considering the scarcity of related articles, we also included some outstanding newest preprints. The papers are carefully reviewed and categorized according to the type of image analysis task. We first review the basic concepts and popular models of reinforcement learning. Then we explore the applications of reinforcement learning models in landmark detection. Finally, we conclude the article by discussing the reviewed reinforcement learning approaches' limitations and possible improvements.

Related papers

• A comprehensive survey on deep active learning in medical image analysis [23.849628978883707]
  Deep learning has achieved widespread success in medical image analysis, leading to an increasing demand for large-scale expert-annotated medical image datasets. Yet, the high cost of annotating medical images severely hampers the development of deep learning in this field. To reduce annotation costs, active learning aims to select the most informative samples for annotation and train high-performance models with as few labeled samples as possible.
  arXiv  Detail & Related papers  (2023-10-22T08:46:40Z)
• A Systematic Review of Few-Shot Learning in Medical Imaging [1.049712834719005]
  Few-shot learning techniques can reduce data scarcity issues and enhance medical image analysis. This systematic review gives a comprehensive overview of few-shot learning in medical imaging.
  arXiv  Detail & Related papers  (2023-09-20T16:10:53Z)
• XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models [60.437091462613544]
  We introduce XrayGPT, a novel conversational medical vision-language model. It can analyze and answer open-ended questions about chest radiographs. We generate 217k interactive and high-quality summaries from free-text radiology reports.
  arXiv  Detail & Related papers  (2023-06-13T17:59:59Z)
• Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challenges [64.63744409431001]
  We present a comprehensive survey on advances in adversarial attacks and defenses for medical image analysis. For a fair comparison, we establish a new benchmark for adversarially robust medical diagnosis models.
  arXiv  Detail & Related papers  (2023-03-24T16:38:58Z)
• A Trustworthy Framework for Medical Image Analysis with Deep Learning [71.48204494889505]
  TRUDLMIA is a trustworthy deep learning framework for medical image analysis. It is anticipated that the framework will support researchers and clinicians in advancing the use of deep learning for dealing with public health crises including COVID-19.
  arXiv  Detail & Related papers  (2022-12-06T05:30:22Z)
• A Review of Causality for Learning Algorithms in Medical Image Analysis [12.249809900292798]
  We analyze machine learning for medical image analysis within the framework of Technology Readiness Levels. We review how causal analysis methods can fill a gap when creating robust and adaptable medical image analysis algorithms.
  arXiv  Detail & Related papers  (2022-06-11T11:04:13Z)
• Self-supervised learning methods and applications in medical imaging analysis: A survey [0.0]
  The article reviews the state-of-the-art research directions in self-supervised learning approaches for image data with concentration on their applications in the field of medical imaging analysis. The article covers (40) of the most recent researches in the field of self-supervised learning in medical imaging analysis aiming at shedding the light on the recent innovation in the field.
  arXiv  Detail & Related papers  (2021-09-17T17:01:42Z)
• On the Robustness of Pretraining and Self-Supervision for a Deep Learning-based Analysis of Diabetic Retinopathy [70.71457102672545]
  We compare the impact of different training procedures for diabetic retinopathy grading. We investigate different aspects such as quantitative performance, statistics of the learned feature representations, interpretability and robustness to image distortions. Our results indicate that models from ImageNet pretraining report a significant increase in performance, generalization and robustness to image distortions.
  arXiv  Detail & Related papers  (2021-06-25T08:32:45Z)
• Recent advances and clinical applications of deep learning in medical image analysis [7.132678647070632]
  We reviewed and summarized more than 200 recently published papers to provide a comprehensive overview of applying deep learning methods in various medical image analysis tasks. Especially, we emphasize the latest progress and contributions of state-of-the-art unsupervised and semi-supervised deep learning in medical images.
  arXiv  Detail & Related papers  (2021-05-27T18:05:12Z)
• Machine Learning Methods for Histopathological Image Analysis: A Review [62.14548392474976]
  Histopathological images (HIs) are the gold standard for evaluating some types of tumors for cancer diagnosis. One of the ways of accelerating such an analysis is to use computer-aided diagnosis (CAD) systems.
  arXiv  Detail & Related papers  (2021-02-07T19:12:32Z)
• Confident Coreset for Active Learning in Medical Image Analysis [57.436224561482966]
  We propose a novel active learning method, confident coreset, which considers both uncertainty and distribution for effectively selecting informative samples. By comparative experiments on two medical image analysis tasks, we show that our method outperforms other active learning methods.
  arXiv  Detail & Related papers  (2020-04-05T13:46:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.