COLosSAL: A Benchmark for Cold-start Active Learning for 3D Medical Image Segmentation

• URL: http://arxiv.org/abs/2307.12004v1
• Date: Sat, 22 Jul 2023 07:19:15 GMT
• Title: COLosSAL: A Benchmark for Cold-start Active Learning for 3D Medical Image Segmentation
• Authors: Han Liu, Hao Li, Xing Yao, Yubo Fan, Dewei Hu, Benoit Dawant, Vishwesh Nath, Zhoubing Xu, Ipek Oguz
• Abstract summary: Active learning (AL) is a promising solution for efficient annotation but requires an initial set of labeled samples to start active selection. This is also known as the cold-start AL, which permits only one chance to request annotations from experts without access to previously annotated data. We present a benchmark named COSAL by evaluating six cold-start AL strategies on five 3D medical segmentation tasks from the public Medical Decathlon collection.
• Score: 10.80144764655265
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Medical image segmentation is a critical task in medical image analysis. In recent years, deep learning based approaches have shown exceptional performance when trained on a fully-annotated dataset. However, data annotation is often a significant bottleneck, especially for 3D medical images. Active learning (AL) is a promising solution for efficient annotation but requires an initial set of labeled samples to start active selection. When the entire data pool is unlabeled, how do we select the samples to annotate as our initial set? This is also known as the cold-start AL, which permits only one chance to request annotations from experts without access to previously annotated data. Cold-start AL is highly relevant in many practical scenarios but has been under-explored, especially for 3D medical segmentation tasks requiring substantial annotation effort. In this paper, we present a benchmark named COLosSAL by evaluating six cold-start AL strategies on five 3D medical image segmentation tasks from the public Medical Segmentation Decathlon collection. We perform a thorough performance analysis and explore important open questions for cold-start AL, such as the impact of budget on different strategies. Our results show that cold-start AL is still an unsolved problem for 3D segmentation tasks but some important trends have been observed. The code repository, data partitions, and baseline results for the complete benchmark are publicly available at https://github.com/MedICL-VU/COLosSAL.

Related papers

• PCDAL: A Perturbation Consistency-Driven Active Learning Approach for Medical Image Segmentation and Classification [12.560273908522714]
  Supervised learning deeply relies on large-scale annotated data, which is expensive, time-consuming, and impractical to acquire in medical imaging applications. Active Learning (AL) methods have been widely applied in natural image classification tasks to reduce annotation costs. We propose an AL-based method that can be simultaneously applied to 2D medical image classification, segmentation, and 3D medical image segmentation tasks.
  arXiv  Detail & Related papers  (2023-06-29T13:11:46Z)
• Extraction of volumetric indices from echocardiography: which deep learning solution for clinical use? [6.144041824426555]
  We show that the proposed 3D nnU-Net outperforms alternative 2D and recurrent segmentation methods. Overall, the experimental results suggest that with sufficient training data, 3D nnU-Net could become the first automated tool to meet the standards of an everyday clinical device.
  arXiv  Detail & Related papers  (2023-05-03T09:38:52Z)
• Making Your First Choice: To Address Cold Start Problem in Vision Active Learning [90.24315238412407]
  Active learning promises to improve annotation efficiency by iteratively selecting the most important data to be annotated first. We identify this as the cold start problem in vision active learning, caused by a biased and outlier initial query. This paper seeks to address the cold start problem by exploiting the three advantages of contrastive learning.
  arXiv  Detail & Related papers  (2022-10-05T17:59:50Z)
• Warm Start Active Learning with Proxy Labels \& Selection via Semi-Supervised Fine-Tuning [10.086685855244664]
  We propose two novel strategies for active learning (AL) specifically for 3D image segmentation. First, we tackle the cold start problem by proposing a proxy task and then utilizing uncertainty generated from the proxy task to rank the unlabeled data to be annotated. Second, we craft a two-stage learning framework for each active iteration where the unlabeled data is also used in the second stage as a semi-supervised fine-tuning strategy.
  arXiv  Detail & Related papers  (2022-09-13T20:21:40Z)
• Self-Supervised Learning as a Means To Reduce the Need for Labeled Data in Medical Image Analysis [64.4093648042484]
  We use a dataset of chest X-ray images with bounding box labels for 13 different classes of anomalies. We show that it is possible to achieve similar performance to a fully supervised model in terms of mean average precision and accuracy with only 60% of the labeled data.
  arXiv  Detail & Related papers  (2022-06-01T09:20:30Z)
• CvS: Classification via Segmentation For Small Datasets [52.821178654631254]
  This paper presents CvS, a cost-effective classifier for small datasets that derives the classification labels from predicting the segmentation maps. We evaluate the effectiveness of our framework on diverse problems showing that CvS is able to achieve much higher classification results compared to previous methods when given only a handful of examples.
  arXiv  Detail & Related papers  (2021-10-29T18:41:15Z)
• Hierarchical Self-Supervised Learning for Medical Image Segmentation Based on Multi-Domain Data Aggregation [23.616336382437275]
  We propose Hierarchical Self-Supervised Learning (HSSL) for medical image segmentation. We first aggregate a dataset from several medical challenges, then pre-train the network in a self-supervised manner, and finally fine-tune on labeled data. Compared to learning from scratch, our new method yields better performance on various tasks.
  arXiv  Detail & Related papers  (2021-07-10T18:17:57Z)
• Weakly-supervised Learning For Catheter Segmentation in 3D Frustum Ultrasound [74.22397862400177]
  We propose a novel Frustum ultrasound based catheter segmentation method. The proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume.
  arXiv  Detail & Related papers  (2020-10-19T13:56:22Z)
• The Devil is in Classification: A Simple Framework for Long-tail Object Detection and Instance Segmentation [93.17367076148348]
  We investigate performance drop of the state-of-the-art two-stage instance segmentation model Mask R-CNN on the recent long-tail LVIS dataset. We unveil that a major cause is the inaccurate classification of object proposals. We propose a simple calibration framework to more effectively alleviate classification head bias with a bi-level class balanced sampling approach.
  arXiv  Detail & Related papers  (2020-07-23T12:49:07Z)
• LRTD: Long-Range Temporal Dependency based Active Learning for Surgical Workflow Recognition [67.86810761677403]
  We propose a novel active learning method for cost-effective surgical video analysis. Specifically, we propose a non-local recurrent convolutional network (NL-RCNet), which introduces non-local block to capture the long-range temporal dependency. We validate our approach on a large surgical video dataset (Cholec80) by performing surgical workflow recognition task.
  arXiv  Detail & Related papers  (2020-04-21T09:21:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.