GradMix for nuclei segmentation and classification in imbalanced pathology image datasets

• URL: http://arxiv.org/abs/2210.12938v1
• Date: Mon, 24 Oct 2022 03:54:46 GMT
• Title: GradMix for nuclei segmentation and classification in imbalanced pathology image datasets
• Authors: Tan Nhu Nhat Doan, Kyungeun Kim, Boram Song, and Jin Tae Kwak
• Abstract summary: Current deep learning-based approaches require a vast amount of annotated datasets by pathologists. The existing datasets are imbalanced among different types of nuclei in general, leading to a substantial performance degradation. We propose a simple but effective data augmentation technique, termed GradMix, that is specifically designed for nuclei segmentation and classification.
• Score: 2.2780974560958
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: An automated segmentation and classification of nuclei is an essential task in digital pathology. The current deep learning-based approaches require a vast amount of annotated datasets by pathologists. However, the existing datasets are imbalanced among different types of nuclei in general, leading to a substantial performance degradation. In this paper, we propose a simple but effective data augmentation technique, termed GradMix, that is specifically designed for nuclei segmentation and classification. GradMix takes a pair of a major-class nucleus and a rare-class nucleus, creates a customized mixing mask, and combines them using the mask to generate a new rare-class nucleus. As it combines two nuclei, GradMix considers both nuclei and the neighboring environment by using the customized mixing mask. This allows us to generate realistic rare-class nuclei with varying environments. We employed two datasets to evaluate the effectiveness of GradMix. The experimental results suggest that GradMix is able to improve the performance of nuclei segmentation and classification in imbalanced pathology image datasets.

Related papers

• NucleiMix: Realistic Data Augmentation for Nuclei Instance Segmentation [2.6954348706500766]
  NucleiMix is designed to balance the distribution of nuclei types by increasing the number of rare-type nuclei within datasets. In the first phase, it identifies candidate locations similar to the surroundings of rare-type nuclei and inserts rare-type nuclei into the candidate locations. In the second phase, it employs a progressive inpainting strategy using a pre-trained diffusion model to seamlessly integrate rare-type nuclei into their new environments.
  arXiv  Detail & Related papers  (2024-10-22T04:03:36Z)
• UniCell: Universal Cell Nucleus Classification via Prompt Learning [76.11864242047074]
  We propose a universal cell nucleus classification framework (UniCell) It employs a novel prompt learning mechanism to uniformly predict the corresponding categories of pathological images from different dataset domains. In particular, our framework adopts an end-to-end architecture for nuclei detection and classification, and utilizes flexible prediction heads for adapting various datasets.
  arXiv  Detail & Related papers  (2024-02-20T11:50:27Z)
• Diffusion-based Data Augmentation for Nuclei Image Segmentation [68.28350341833526]
  We introduce the first diffusion-based augmentation method for nuclei segmentation. The idea is to synthesize a large number of labeled images to facilitate training the segmentation model. The experimental results show that by augmenting 10% labeled real dataset with synthetic samples, one can achieve comparable segmentation results.
  arXiv  Detail & Related papers  (2023-10-22T06:16:16Z)
• Prompt-based Grouping Transformer for Nucleus Detection and Classification [70.55961378096116]
  nuclei detection and classification can produce effective information for disease diagnosis. Most existing methods classify nuclei independently or do not make full use of the semantic similarity between nuclei and their grouping features. We propose a novel end-to-end nuclei detection and classification framework based on a grouping transformer-based classifier.
  arXiv  Detail & Related papers  (2023-10-22T04:50:48Z)
• DiffMix: Diffusion Model-based Data Synthesis for Nuclei Segmentation and Classification in Imbalanced Pathology Image Datasets [8.590026259176806]
  We propose a realistic data synthesis method using a diffusion model. We generate two types of virtual patches to enlarge the training data distribution. We use a semantic-label-conditioned diffusion model to generate realistic and high-quality image samples.
  arXiv  Detail & Related papers  (2023-06-25T05:31:08Z)
• Which Pixel to Annotate: a Label-Efficient Nuclei Segmentation Framework [70.18084425770091]
  Deep neural networks have been widely applied in nuclei instance segmentation of H&E stained pathology images. It is inefficient and unnecessary to label all pixels for a dataset of nuclei images which usually contain similar and redundant patterns. We propose a novel full nuclei segmentation framework that chooses only a few image patches to be annotated, augments the training set from the selected samples, and achieves nuclei segmentation in a semi-supervised manner.
  arXiv  Detail & Related papers  (2022-12-20T14:53:26Z)
• InsMix: Towards Realistic Generative Data Augmentation for Nuclei Instance Segmentation [29.78647170035808]
  We propose a realistic data augmentation method for nuclei segmentation, named InsMix, that follows a Copy-Paste-Smooth principle. Specifically, we propose morphology constraints that enable the augmented images to acquire luxuriant information about nuclei. To fully exploit the pixel redundancy of the background, we propose a background perturbation method, which randomly shuffles the background patches.
  arXiv  Detail & Related papers  (2022-06-30T08:58:05Z)
• PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classification [23.466331358975044]
  We study and design a new method to simultaneously detect, segment, and classify nuclei from Haematoxylin and Eosin stained histopathology data. We demonstrate the superior performance of our proposed approach for nuclei segmentation and classification across 19 different tissue types.
  arXiv  Detail & Related papers  (2021-11-01T08:29:40Z)
• Bend-Net: Bending Loss Regularized Multitask Learning Network for Nuclei Segmentation in Histopathology Images [65.47507533905188]
  We propose a novel multitask learning network with a bending loss regularizer to separate overlapped nuclei accurately. The newly proposed multitask learning architecture enhances the generalization by learning shared representation from three tasks. The proposed bending loss defines high penalties to concave contour points with large curvatures, and applies small penalties to convex contour points with small curvatures.
  arXiv  Detail & Related papers  (2021-09-30T17:29:44Z)
• Nuclei Grading of Clear Cell Renal Cell Carcinoma in Histopathological Image by Composite High-Resolution Network [31.00452985964065]
  Computer-aided nuclei grading aims to improve pathologists' work efficiency and reduce misdiagnosis rate. Most of the existing nuclei segmentation and classification methods can not handle the inter-class similarity property of nuclei grading. We propose a Composite High-Resolution Network for ccRCC nuclei grading.
  arXiv  Detail & Related papers  (2021-06-20T07:32:26Z)
• Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images [51.893494939675314]
  We propose a novel weakly supervised segmentation framework based on partial points annotation. We show that our method can achieve competitive performance compared to the fully supervised counterpart and the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-07-10T15:41:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.