Keep It Accurate and Robust: An Enhanced Nuclei Analysis Framework

• URL: http://arxiv.org/abs/2203.03415v4
• Date: Fri, 17 Jan 2025 01:13:19 GMT
• Title: Keep It Accurate and Robust: An Enhanced Nuclei Analysis Framework
• Authors: Wenhua Zhang, Sen Yang, Meiwei Luo, Chuan He, Yuchen Li, Jun Zhang, Xiyue Wang, Fang Wang,
• Abstract summary: We propose a new framework to address issues stemming from limited dataset variation.<n>We achieve state-of-the-art results on public benchmarks, including 1st place for nuclear composition prediction.<n>This work proposes an improved framework advancing the state-of-the-art in nuclei analysis.
• Score: 18.07080933081179
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Accurate segmentation and classification of nuclei in histology images is critical but challenging due to nuclei heterogeneity, staining variations, and tissue complexity. Existing methods often struggle with limited dataset variability, with patches extracted from similar whole slide images (WSI), making models prone to falling into local optima. Here we propose a new framework to address this limitation and enable robust nuclear analysis. Our method leverages dual-level ensemble modeling to overcome issues stemming from limited dataset variation. Intra-ensembling applies diverse transformations to individual samples, while inter-ensembling combines networks of different scales. We also introduce enhancements to the HoVer-Net architecture, including updated encoders, nested dense decoding and model regularization strategy. We achieve state-of-the-art results on public benchmarks, including 1st place for nuclear composition prediction and 3rd place for segmentation/classification in the 2022 Colon Nuclei Identification and Counting (CoNIC) Challenge. This success validates our approach for accurate histological nuclei analysis. Extensive experiments and ablation studies provide insights into optimal network design choices and training techniques. In conclusion, this work proposes an improved framework advancing the state-of-the-art in nuclei analysis. We release our code and models (https://github.com/WinnieLaugh/CONIC_Pathology_AI) to serve as a toolkit for the community.

Related papers

• NucleiMix: Realistic Data Augmentation for Nuclei Instance Segmentation [2.6954348706500766]
  NucleiMix is designed to balance the distribution of nuclei types by increasing the number of rare-type nuclei within datasets. In the first phase, it identifies candidate locations similar to the surroundings of rare-type nuclei and inserts rare-type nuclei into the candidate locations. In the second phase, it employs a progressive inpainting strategy using a pre-trained diffusion model to seamlessly integrate rare-type nuclei into their new environments.
  arXiv  Detail & Related papers  (2024-10-22T04:03:36Z)
• Class and Region-Adaptive Constraints for Network Calibration [17.583536041845402]
  We present a novel approach to calibrate segmentation networks that considers the inherent challenges posed by different categories and object regions. Finding the optimal penalty weights manually might be unfeasible, and potentially hinder the optimization process. We propose an approach based on Class and Region-Adaptive constraints (CRaC), which allows to learn the class and region-wise penalty weights during training.
  arXiv  Detail & Related papers  (2024-03-19T02:19:57Z)
• Diffusion-based Data Augmentation for Nuclei Image Segmentation [68.28350341833526]
  We introduce the first diffusion-based augmentation method for nuclei segmentation. The idea is to synthesize a large number of labeled images to facilitate training the segmentation model. The experimental results show that by augmenting 10% labeled real dataset with synthetic samples, one can achieve comparable segmentation results.
  arXiv  Detail & Related papers  (2023-10-22T06:16:16Z)
• A three in one bottom-up framework for simultaneous semantic segmentation, instance segmentation and classification of multi-organ nuclei in digital cancer histology [3.2228025627337864]
  Simultaneous segmentation and classification of nuclei in digital histology play an essential role in computer-assisted cancer diagnosis. The highest achieved binary and multi-class Panoptic Quality (PQ) remains as low as 0.68 bPQ and 0.49 mPQ, respectively. This work extends our previous model to simultaneous instance segmentation and classification.
  arXiv  Detail & Related papers  (2023-08-22T04:10:14Z)
• Enhancing Nucleus Segmentation with HARU-Net: A Hybrid Attention Based Residual U-Blocks Network [9.718765096478371]
  Current methods for nucleus segmentation rely on nuclear morphology or contour-based approaches. We propose a dual-branch network using hybrid attention based residual U-blocks for nucleus instance segmentation. Within the network, we propose a context fusion block (CF-block) that effectively extracts and merges contextual information from the network.
  arXiv  Detail & Related papers  (2023-08-07T08:03:20Z)
• Efficient Subclass Segmentation in Medical Images [3.383033695275859]
  One feasible way to reduce the cost is to annotate with coarse-grained superclass labels while using limited fine-grained annotations as a complement. There is a lack of research on efficient learning of fine-grained subclasses in semantic segmentation tasks. Our approach achieves comparable accuracy to a model trained with full subclass annotations, with limited subclass annotations and sufficient superclass annotations.
  arXiv  Detail & Related papers  (2023-07-01T07:39:08Z)
• Enhanced Sharp-GAN For Histopathology Image Synthesis [63.845552349914186]
  Histopathology image synthesis aims to address the data shortage issue in training deep learning approaches for accurate cancer detection. We propose a novel approach that enhances the quality of synthetic images by using nuclei topology and contour regularization. The proposed approach outperforms Sharp-GAN in all four image quality metrics on two datasets.
  arXiv  Detail & Related papers  (2023-01-24T17:54:01Z)
• A Novel Dataset and a Deep Learning Method for Mitosis Nuclei Segmentation and Classification [10.960222475663006]
  Mitosis nuclei count is one of the important indicators for the pathological diagnosis of breast cancer. We propose a two-stage mitosis segmentation and classification method, named SCMitosis. The proposed model is verified on the ICPR 2012 dataset, and the highest F-score value of 0.8687 is obtained.
  arXiv  Detail & Related papers  (2022-12-27T08:12:42Z)
• Which Pixel to Annotate: a Label-Efficient Nuclei Segmentation Framework [70.18084425770091]
  Deep neural networks have been widely applied in nuclei instance segmentation of H&E stained pathology images. It is inefficient and unnecessary to label all pixels for a dataset of nuclei images which usually contain similar and redundant patterns. We propose a novel full nuclei segmentation framework that chooses only a few image patches to be annotated, augments the training set from the selected samples, and achieves nuclei segmentation in a semi-supervised manner.
  arXiv  Detail & Related papers  (2022-12-20T14:53:26Z)
• InsMix: Towards Realistic Generative Data Augmentation for Nuclei Instance Segmentation [29.78647170035808]
  We propose a realistic data augmentation method for nuclei segmentation, named InsMix, that follows a Copy-Paste-Smooth principle. Specifically, we propose morphology constraints that enable the augmented images to acquire luxuriant information about nuclei. To fully exploit the pixel redundancy of the background, we propose a background perturbation method, which randomly shuffles the background patches.
  arXiv  Detail & Related papers  (2022-06-30T08:58:05Z)
• Class-Incremental Learning with Strong Pre-trained Models [97.84755144148535]
  Class-incremental learning (CIL) has been widely studied under the setting of starting from a small number of classes (base classes) We explore an understudied real-world setting of CIL that starts with a strong model pre-trained on a large number of base classes. Our proposed method is robust and generalizes to all analyzed CIL settings.
  arXiv  Detail & Related papers  (2022-04-07T17:58:07Z)
• PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classification [23.466331358975044]
  We study and design a new method to simultaneously detect, segment, and classify nuclei from Haematoxylin and Eosin stained histopathology data. We demonstrate the superior performance of our proposed approach for nuclei segmentation and classification across 19 different tissue types.
  arXiv  Detail & Related papers  (2021-11-01T08:29:40Z)
• Gated recurrent units and temporal convolutional network for multilabel classification [122.84638446560663]
  This work proposes a new ensemble method for managing multilabel classification. The core of the proposed approach combines a set of gated recurrent units and temporal convolutional neural networks trained with variants of the Adam gradients optimization approach.
  arXiv  Detail & Related papers  (2021-10-09T00:00:16Z)
• Bend-Net: Bending Loss Regularized Multitask Learning Network for Nuclei Segmentation in Histopathology Images [65.47507533905188]
  We propose a novel multitask learning network with a bending loss regularizer to separate overlapped nuclei accurately. The newly proposed multitask learning architecture enhances the generalization by learning shared representation from three tasks. The proposed bending loss defines high penalties to concave contour points with large curvatures, and applies small penalties to convex contour points with small curvatures.
  arXiv  Detail & Related papers  (2021-09-30T17:29:44Z)
• GistNet: a Geometric Structure Transfer Network for Long-Tailed Recognition [95.93760490301395]
  Long-tailed recognition is a problem where the number of examples per class is highly unbalanced. GistNet is proposed to support this goal, using constellations of classifier parameters to encode the class geometry. A new learning algorithm is then proposed for GeometrIc Structure Transfer (GIST), with resort to a combination of loss functions that combine class-balanced and random sampling to guarantee that, while overfitting to the popular classes is restricted to geometric parameters, it is leveraged to transfer class geometry from popular to few-shot classes.
  arXiv  Detail & Related papers  (2021-05-01T00:37:42Z)
• A Multiple Classifier Approach for Concatenate-Designed Neural Networks [13.017053017670467]
  We give the design of the classifiers, which collects the features produced between the network sets. We use the L2 normalization method to obtain the classification score instead of the Softmax Dense. As a result, the proposed classifiers are able to improve the accuracy in the experimental cases.
  arXiv  Detail & Related papers  (2021-01-14T04:32:40Z)
• An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
  We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks. We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem. We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
  arXiv  Detail & Related papers  (2020-12-06T18:55:07Z)
• Prior Guided Feature Enrichment Network for Few-Shot Segmentation [64.91560451900125]
  State-of-the-art semantic segmentation methods require sufficient labeled data to achieve good results. Few-shot segmentation is proposed to tackle this problem by learning a model that quickly adapts to new classes with a few labeled support samples. Theses frameworks still face the challenge of generalization ability reduction on unseen classes due to inappropriate use of high-level semantic information.
  arXiv  Detail & Related papers  (2020-08-04T10:41:32Z)
• Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images [51.893494939675314]
  We propose a novel weakly supervised segmentation framework based on partial points annotation. We show that our method can achieve competitive performance compared to the fully supervised counterpart and the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-07-10T15:41:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.