Active Learning Enabled Low-cost Cell Image Segmentation Using Bounding Box Annotation

• URL: http://arxiv.org/abs/2405.01701v1
• Date: Thu, 2 May 2024 19:53:56 GMT
• Title: Active Learning Enabled Low-cost Cell Image Segmentation Using Bounding Box Annotation
• Authors: Yu Zhu, Qiang Yang, Li Xu,
• Abstract summary: We propose an active learning framework for cell segmentation using bounding box annotations. Our model saves more than ninety percent of data annotation time compared to mask-supervised deep learning methods.
• Score: 16.091598987865783
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cell image segmentation is usually implemented using fully supervised deep learning methods, which heavily rely on extensive annotated training data. Yet, due to the complexity of cell morphology and the requirement for specialized knowledge, pixel-level annotation of cell images has become a highly labor-intensive task. To address the above problems, we propose an active learning framework for cell segmentation using bounding box annotations, which greatly reduces the data annotation cost of cell segmentation algorithms. First, we generate a box-supervised learning method (denoted as YOLO-SAM) by combining the YOLOv8 detector with the Segment Anything Model (SAM), which effectively reduces the complexity of data annotation. Furthermore, it is integrated into an active learning framework that employs the MC DropBlock method to train the segmentation model with fewer box-annotated samples. Extensive experiments demonstrate that our model saves more than ninety percent of data annotation time compared to mask-supervised deep learning methods.

Related papers

• Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning [53.00683059396803]
  Mask image model (MIM) has been widely used due to its simplicity and effectiveness in recovering original information from masked images. We propose a decision-based MIM that utilizes reinforcement learning (RL) to automatically search for optimal image masking ratio and masking strategy. Our approach has a significant advantage over alternative self-supervised methods on the task of neuron segmentation.
  arXiv  Detail & Related papers  (2023-10-06T10:40:46Z)
• Semantic-SAM: Segment and Recognize Anything at Any Granularity [83.64686655044765]
  We introduce Semantic-SAM, a universal image segmentation model to enable segment and recognize anything at any desired granularity. We consolidate multiple datasets across three granularities and introduce decoupled classification for objects and parts. For the multi-granularity capability, we propose a multi-choice learning scheme during training, enabling each click to generate masks at multiple levels.
  arXiv  Detail & Related papers  (2023-07-10T17:59:40Z)
• Scribble-supervised Cell Segmentation Using Multiscale Contrastive Regularization [9.849498498869258]
  Scribble2Label (S2L) demonstrated that using only a handful of scribbles with self-supervised learning can generate accurate segmentation results without full annotation. In this work, we employ a novel multiscale contrastive regularization term for S2L. The main idea is to extract features from intermediate layers of the neural network for contrastive loss so that structures at various scales can be effectively separated.
  arXiv  Detail & Related papers  (2023-06-25T06:00:33Z)
• Cyclic Learning: Bridging Image-level Labels and Nuclei Instance Segmentation [19.526504045149895]
  We propose a novel image-level weakly supervised method, called cyclic learning, to solve this problem. Cyclic learning comprises a front-end classification task and a back-end semi-supervised instance segmentation task. Experiments on three datasets demonstrate the good generality of our method, which outperforms other image-level weakly supervised methods for nuclei instance segmentation.
  arXiv  Detail & Related papers  (2023-06-05T08:32:12Z)
• Point-supervised Single-cell Segmentation via Collaborative Knowledge Sharing [0.0]
  This paper focuses on a weakly-supervised training setting for single-cell segmentation models. Of more interest is a proposed selflearning method called collaborative knowledge sharing. This strategy achieves selflearning by sharing knowledge between a principal model and a very lightweight collaborator model.
  arXiv  Detail & Related papers  (2023-04-20T23:22:41Z)
• One-shot and Partially-Supervised Cell Image Segmentation Using Small Visual Prompt [9.873635079670091]
  We consider an efficient learning framework with as little data as possible. We propose two types of learning strategies: One-shot segmentation which can learn with only one training sample, and Partially-supervised segmentation which assigns annotations to only a part of images. Our proposed methods use a pre-trained model based on only cell images and teach the information of the prompt pairs to the target image.
  arXiv  Detail & Related papers  (2023-04-17T05:04:41Z)
• De-coupling and De-positioning Dense Self-supervised Learning [65.56679416475943]
  Dense Self-Supervised Learning (SSL) methods address the limitations of using image-level feature representations when handling images with multiple objects. We show that they suffer from coupling and positional bias, which arise from the receptive field increasing with layer depth and zero-padding. We demonstrate the benefits of our method on COCO and on a new challenging benchmark, OpenImage-MINI, for object classification, semantic segmentation, and object detection.
  arXiv  Detail & Related papers  (2023-03-29T18:07:25Z)
• Semantic Segmentation with Active Semi-Supervised Learning [23.79742108127707]
  We propose a novel algorithm that combines active learning and semi-supervised learning. Our method obtains over 95% of the network's performance on the full-training set.
  arXiv  Detail & Related papers  (2022-03-21T04:16:25Z)
• Learning from Partially Overlapping Labels: Image Segmentation under Annotation Shift [68.6874404805223]
  We propose several strategies for learning from partially overlapping labels in the context of abdominal organ segmentation. We find that combining a semi-supervised approach with an adaptive cross entropy loss can successfully exploit heterogeneously annotated data.
  arXiv  Detail & Related papers  (2021-07-13T09:22:24Z)
• Deep Semi-supervised Knowledge Distillation for Overlapping Cervical Cell Instance Segmentation [54.49894381464853]
  We propose to leverage both labeled and unlabeled data for instance segmentation with improved accuracy by knowledge distillation. We propose a novel Mask-guided Mean Teacher framework with Perturbation-sensitive Sample Mining. Experiments show that the proposed method improves the performance significantly compared with the supervised method learned from labeled data only.
  arXiv  Detail & Related papers  (2020-07-21T13:27:09Z)
• A Trainable Optimal Transport Embedding for Feature Aggregation and its Relationship to Attention [96.77554122595578]
  We introduce a parametrized representation of fixed size, which embeds and then aggregates elements from a given input set according to the optimal transport plan between the set and a trainable reference. Our approach scales to large datasets and allows end-to-end training of the reference, while also providing a simple unsupervised learning mechanism with small computational cost.
  arXiv  Detail & Related papers  (2020-06-22T08:35:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.