A Survey on Cell Nuclei Instance Segmentation and Classification: Leveraging Context and Attention

• URL: http://arxiv.org/abs/2407.18673v1
• Date: Fri, 26 Jul 2024 11:30:22 GMT
• Title: A Survey on Cell Nuclei Instance Segmentation and Classification: Leveraging Context and Attention
• Authors: João D. Nunes, Diana Montezuma, Domingos Oliveira, Tania Pereira, Jaime S. Cardoso,
• Abstract summary: We conduct a survey on context and attention methods for cell nuclei instance segmentation and classification from H&E-stained microscopy imaging. We extend both a general instance segmentation and classification method (Mask-RCNN) and a tailored cell nuclei instance segmentation and classification model (HoVer-Net) with context- and attention-based mechanisms. Our findings suggest translating that domain knowledge into algorithm design is no trivial task, but to fully exploit these mechanisms should be addressed.
• Score: 2.574831636177296
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Manually annotating nuclei from the gigapixel Hematoxylin and Eosin (H&E)-stained Whole Slide Images (WSIs) is a laborious and costly task, meaning automated algorithms for cell nuclei instance segmentation and classification could alleviate the workload of pathologists and clinical researchers and at the same time facilitate the automatic extraction of clinically interpretable features. But due to high intra- and inter-class variability of nuclei morphological and chromatic features, as well as H&E-stains susceptibility to artefacts, state-of-the-art algorithms cannot correctly detect and classify instances with the necessary performance. In this work, we hypothesise context and attention inductive biases in artificial neural networks (ANNs) could increase the generalization of algorithms for cell nuclei instance segmentation and classification. We conduct a thorough survey on context and attention methods for cell nuclei instance segmentation and classification from H&E-stained microscopy imaging, while providing a comprehensive discussion of the challenges being tackled with context and attention. Besides, we illustrate some limitations of current approaches and present ideas for future research. As a case study, we extend both a general instance segmentation and classification method (Mask-RCNN) and a tailored cell nuclei instance segmentation and classification model (HoVer-Net) with context- and attention-based mechanisms, and do a comparative analysis on a multi-centre colon nuclei identification and counting dataset. Although pathologists rely on context at multiple levels while paying attention to specific Regions of Interest (RoIs) when analysing and annotating WSIs, our findings suggest translating that domain knowledge into algorithm design is no trivial task, but to fully exploit these mechanisms, the scientific understanding of these methods should be addressed.

Related papers

• Few-Shot Learning for Annotation-Efficient Nucleus Instance Segmentation [50.407071700154674]
  We propose to formulate annotation-efficient nucleus instance segmentation from the perspective of few-shot learning (FSL) Our work was motivated by that, with the prosperity of computational pathology, an increasing number of fully-annotated datasets are publicly accessible. Extensive experiments on a couple of publicly accessible datasets demonstrate that SGFSIS can outperform other annotation-efficient learning baselines.
  arXiv  Detail & Related papers  (2024-02-26T03:49:18Z)
• UniCell: Universal Cell Nucleus Classification via Prompt Learning [76.11864242047074]
  We propose a universal cell nucleus classification framework (UniCell) It employs a novel prompt learning mechanism to uniformly predict the corresponding categories of pathological images from different dataset domains. In particular, our framework adopts an end-to-end architecture for nuclei detection and classification, and utilizes flexible prediction heads for adapting various datasets.
  arXiv  Detail & Related papers  (2024-02-20T11:50:27Z)
• Single-Cell Deep Clustering Method Assisted by Exogenous Gene Information: A Novel Approach to Identifying Cell Types [50.55583697209676]
  We develop an attention-enhanced graph autoencoder, which is designed to efficiently capture the topological features between cells. During the clustering process, we integrated both sets of information and reconstructed the features of both cells and genes to generate a discriminative representation. This research offers enhanced insights into the characteristics and distribution of cells, thereby laying the groundwork for early diagnosis and treatment of diseases.
  arXiv  Detail & Related papers  (2023-11-28T09:14:55Z)
• Prompt-based Grouping Transformer for Nucleus Detection and Classification [70.55961378096116]
  nuclei detection and classification can produce effective information for disease diagnosis. Most existing methods classify nuclei independently or do not make full use of the semantic similarity between nuclei and their grouping features. We propose a novel end-to-end nuclei detection and classification framework based on a grouping transformer-based classifier.
  arXiv  Detail & Related papers  (2023-10-22T04:50:48Z)
• Enhancing Nucleus Segmentation with HARU-Net: A Hybrid Attention Based Residual U-Blocks Network [9.718765096478371]
  Current methods for nucleus segmentation rely on nuclear morphology or contour-based approaches. We propose a dual-branch network using hybrid attention based residual U-blocks for nucleus instance segmentation. Within the network, we propose a context fusion block (CF-block) that effectively extracts and merges contextual information from the network.
  arXiv  Detail & Related papers  (2023-08-07T08:03:20Z)
• Domain Adaptive Nuclei Instance Segmentation and Classification via Category-aware Feature Alignment and Pseudo-labelling [65.40672505658213]
  We propose a novel deep neural network, namely Category-Aware feature alignment and Pseudo-Labelling Network (CAPL-Net) for UDA nuclei instance segmentation and classification. Our approach outperforms state-of-the-art UDA methods with a remarkable margin.
  arXiv  Detail & Related papers  (2022-07-04T07:05:06Z)
• Nuclei panoptic segmentation and composition regression with multi-task deep neural networks [0.12183405753834559]
  This report describes our proposed method submitted to the Colon Nuclei Identification and Counting (CoNIC) challenge. Our method employs a multi-task learning framework, which performs a panoptic segmentation task and a regression task. For the panoptic segmentation task, we use encoder-decoder type deep neural networks predicting a direction map in addition to a segmentation map in order to separate neighboring nuclei into different instances.
  arXiv  Detail & Related papers  (2022-02-23T22:09:37Z)
• PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classification [23.466331358975044]
  We study and design a new method to simultaneously detect, segment, and classify nuclei from Haematoxylin and Eosin stained histopathology data. We demonstrate the superior performance of our proposed approach for nuclei segmentation and classification across 19 different tissue types.
  arXiv  Detail & Related papers  (2021-11-01T08:29:40Z)
• Nuclei Grading of Clear Cell Renal Cell Carcinoma in Histopathological Image by Composite High-Resolution Network [31.00452985964065]
  Computer-aided nuclei grading aims to improve pathologists' work efficiency and reduce misdiagnosis rate. Most of the existing nuclei segmentation and classification methods can not handle the inter-class similarity property of nuclei grading. We propose a Composite High-Resolution Network for ccRCC nuclei grading.
  arXiv  Detail & Related papers  (2021-06-20T07:32:26Z)
• Instance-aware Self-supervised Learning for Nuclei Segmentation [47.07869311690419]
  We propose a novel self-supervised learning framework to exploit the capacity of convolutional neural networks (CNNs) on the nuclei instance segmentation task. The proposed approach involves two sub-tasks, which enable neural networks to implicitly leverage the prior-knowledge of nuclei size and quantity. Experimental results on the publicly available MoNuSeg dataset show that the proposed self-supervised learning approach can remarkably boost the segmentation accuracy of nuclei instance.
  arXiv  Detail & Related papers  (2020-07-22T03:37:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.