Keep It Accurate and Robust: An Enhanced Nuclei Analysis Framework

• URL: http://arxiv.org/abs/2203.03415v4
• Date: Fri, 17 Jan 2025 01:13:19 GMT
• Title: Keep It Accurate and Robust: An Enhanced Nuclei Analysis Framework
• Authors: Wenhua Zhang, Sen Yang, Meiwei Luo, Chuan He, Yuchen Li, Jun Zhang, Xiyue Wang, Fang Wang,
• Abstract summary: We propose a new framework to address issues stemming from limited dataset variation. We achieve state-of-the-art results on public benchmarks, including 1st place for nuclear composition prediction. This work proposes an improved framework advancing the state-of-the-art in nuclei analysis.
• Score: 18.07080933081179
• License:
• Abstract: Accurate segmentation and classification of nuclei in histology images is critical but challenging due to nuclei heterogeneity, staining variations, and tissue complexity. Existing methods often struggle with limited dataset variability, with patches extracted from similar whole slide images (WSI), making models prone to falling into local optima. Here we propose a new framework to address this limitation and enable robust nuclear analysis. Our method leverages dual-level ensemble modeling to overcome issues stemming from limited dataset variation. Intra-ensembling applies diverse transformations to individual samples, while inter-ensembling combines networks of different scales. We also introduce enhancements to the HoVer-Net architecture, including updated encoders, nested dense decoding and model regularization strategy. We achieve state-of-the-art results on public benchmarks, including 1st place for nuclear composition prediction and 3rd place for segmentation/classification in the 2022 Colon Nuclei Identification and Counting (CoNIC) Challenge. This success validates our approach for accurate histological nuclei analysis. Extensive experiments and ablation studies provide insights into optimal network design choices and training techniques. In conclusion, this work proposes an improved framework advancing the state-of-the-art in nuclei analysis. We release our code and models (https://github.com/WinnieLaugh/CONIC_Pathology_AI) to serve as a toolkit for the community.

Related papers

• NucleiMix: Realistic Data Augmentation for Nuclei Instance Segmentation [2.6954348706500766]
  NucleiMix is designed to balance the distribution of nuclei types by increasing the number of rare-type nuclei within datasets. In the first phase, it identifies candidate locations similar to the surroundings of rare-type nuclei and inserts rare-type nuclei into the candidate locations. In the second phase, it employs a progressive inpainting strategy using a pre-trained diffusion model to seamlessly integrate rare-type nuclei into their new environments.
  arXiv  Detail & Related papers  (2024-10-22T04:03:36Z)
• Diffusion-based Data Augmentation for Nuclei Image Segmentation [68.28350341833526]
  We introduce the first diffusion-based augmentation method for nuclei segmentation. The idea is to synthesize a large number of labeled images to facilitate training the segmentation model. The experimental results show that by augmenting 10% labeled real dataset with synthetic samples, one can achieve comparable segmentation results.
  arXiv  Detail & Related papers  (2023-10-22T06:16:16Z)
• Enhancing Nucleus Segmentation with HARU-Net: A Hybrid Attention Based Residual U-Blocks Network [9.718765096478371]
  Current methods for nucleus segmentation rely on nuclear morphology or contour-based approaches. We propose a dual-branch network using hybrid attention based residual U-blocks for nucleus instance segmentation. Within the network, we propose a context fusion block (CF-block) that effectively extracts and merges contextual information from the network.
  arXiv  Detail & Related papers  (2023-08-07T08:03:20Z)
• Enhanced Sharp-GAN For Histopathology Image Synthesis [63.845552349914186]
  Histopathology image synthesis aims to address the data shortage issue in training deep learning approaches for accurate cancer detection. We propose a novel approach that enhances the quality of synthetic images by using nuclei topology and contour regularization. The proposed approach outperforms Sharp-GAN in all four image quality metrics on two datasets.
  arXiv  Detail & Related papers  (2023-01-24T17:54:01Z)
• Which Pixel to Annotate: a Label-Efficient Nuclei Segmentation Framework [70.18084425770091]
  Deep neural networks have been widely applied in nuclei instance segmentation of H&E stained pathology images. It is inefficient and unnecessary to label all pixels for a dataset of nuclei images which usually contain similar and redundant patterns. We propose a novel full nuclei segmentation framework that chooses only a few image patches to be annotated, augments the training set from the selected samples, and achieves nuclei segmentation in a semi-supervised manner.
  arXiv  Detail & Related papers  (2022-12-20T14:53:26Z)
• InsMix: Towards Realistic Generative Data Augmentation for Nuclei Instance Segmentation [29.78647170035808]
  We propose a realistic data augmentation method for nuclei segmentation, named InsMix, that follows a Copy-Paste-Smooth principle. Specifically, we propose morphology constraints that enable the augmented images to acquire luxuriant information about nuclei. To fully exploit the pixel redundancy of the background, we propose a background perturbation method, which randomly shuffles the background patches.
  arXiv  Detail & Related papers  (2022-06-30T08:58:05Z)
• PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classification [23.466331358975044]
  We study and design a new method to simultaneously detect, segment, and classify nuclei from Haematoxylin and Eosin stained histopathology data. We demonstrate the superior performance of our proposed approach for nuclei segmentation and classification across 19 different tissue types.
  arXiv  Detail & Related papers  (2021-11-01T08:29:40Z)
• Bend-Net: Bending Loss Regularized Multitask Learning Network for Nuclei Segmentation in Histopathology Images [65.47507533905188]
  We propose a novel multitask learning network with a bending loss regularizer to separate overlapped nuclei accurately. The newly proposed multitask learning architecture enhances the generalization by learning shared representation from three tasks. The proposed bending loss defines high penalties to concave contour points with large curvatures, and applies small penalties to convex contour points with small curvatures.
  arXiv  Detail & Related papers  (2021-09-30T17:29:44Z)
• An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
  We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks. We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem. We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
  arXiv  Detail & Related papers  (2020-12-06T18:55:07Z)
• Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images [51.893494939675314]
  We propose a novel weakly supervised segmentation framework based on partial points annotation. We show that our method can achieve competitive performance compared to the fully supervised counterpart and the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-07-10T15:41:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.