Assessment of Cell Nuclei AI Foundation Models in Kidney Pathology

• URL: http://arxiv.org/abs/2408.06381v1
• Date: Fri, 9 Aug 2024 22:34:13 GMT
• Title: Assessment of Cell Nuclei AI Foundation Models in Kidney Pathology
• Authors: Junlin Guo, Siqi Lu, Can Cui, Ruining Deng, Tianyuan Yao, Zhewen Tao, Yizhe Lin, Marilyn Lionts, Quan Liu, Juming Xiong, Catie Chang, Mitchell Wilkes, Mengmeng Yin, Haichun Yang, Yuankai Huo,
• Abstract summary: This study is the largest-scale evaluation of its kind to date. To our knowledge, this is the largest-scale evaluation of its kind to date. Among the evaluated models, CellViT demonstrated superior performance in segmenting nuclei in kidney pathology. However, none of the foundation models are perfect; a performance gap remains in general nuclei segmentation for kidney pathology.
• Score: 10.574005822664034
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cell nuclei instance segmentation is a crucial task in digital kidney pathology. Traditional automatic segmentation methods often lack generalizability when applied to unseen datasets. Recently, the success of foundation models (FMs) has provided a more generalizable solution, potentially enabling the segmentation of any cell type. In this study, we perform a large-scale evaluation of three widely used state-of-the-art (SOTA) cell nuclei foundation models (Cellpose, StarDist, and CellViT). Specifically, we created a highly diverse evaluation dataset consisting of 2,542 kidney whole slide images (WSIs) collected from both human and rodent sources, encompassing various tissue types, sizes, and staining methods. To our knowledge, this is the largest-scale evaluation of its kind to date. Our quantitative analysis of the prediction distribution reveals a persistent performance gap in kidney pathology. Among the evaluated models, CellViT demonstrated superior performance in segmenting nuclei in kidney pathology. However, none of the foundation models are perfect; a performance gap remains in general nuclei segmentation for kidney pathology.

Related papers

• How Good Are We? Evaluating Cell AI Foundation Models in Kidney Pathology with Human-in-the-Loop Enrichment [11.60167559546617]
  Training AI foundation models have emerged as a promising large-scale learning approach for addressing real-world healthcare challenges. While many of these models have been developed for tasks like disease diagnosis and tissue quantification, their readiness for deployment on some arguably simplest tasks, such as nuclei segmentation within a single organ, remains uncertain. This paper seeks to answer this key question, "How good are we?" by thoroughly evaluating the performance of recent cell foundation models on a curated dataset.
  arXiv  Detail & Related papers  (2024-10-31T17:00:33Z)
• KaLDeX: Kalman Filter based Linear Deformable Cross Attention for Retina Vessel Segmentation [46.57880203321858]
  We propose a novel network (KaLDeX) for vascular segmentation leveraging a Kalman filter based linear deformable cross attention (LDCA) module. Our approach is based on two key components: Kalman filter (KF) based linear deformable convolution (LD) and cross-attention (CA) modules. The proposed method is evaluated on retinal fundus image datasets (DRIVE, CHASE_BD1, and STARE) as well as the 3mm and 6mm of the OCTA-500 dataset.
  arXiv  Detail & Related papers  (2024-10-28T16:00:42Z)
• DinoBloom: A Foundation Model for Generalizable Cell Embeddings in Hematology [1.3551232282678036]
  We introduce DinoBloom, the first foundation model for single cell images in hematology. Our model is built upon an extensive collection of 13 diverse, publicly available datasets of peripheral blood and bone marrow smears. A family of four DinoBloom models can be adapted for a wide range of downstream applications.
  arXiv  Detail & Related papers  (2024-04-07T17:25:52Z)
• Certification of Deep Learning Models for Medical Image Segmentation [44.177565298565966]
  We present for the first time a certified segmentation baseline for medical imaging based on randomized smoothing and diffusion models. Our results show that leveraging the power of denoising diffusion probabilistic models helps us overcome the limits of randomized smoothing.
  arXiv  Detail & Related papers  (2023-10-05T16:40:33Z)
• Evaluation Kidney Layer Segmentation on Whole Slide Imaging using Convolutional Neural Networks and Transformers [13.602882723160388]
  The segmentation of kidney layer structures plays an essential role in automated image analysis in renal pathology. The current manual segmentation process proves labor-intensive and infeasible for handling the extensive digital pathology images. This study employs the representative convolutional neural network (CNN) and Transformer segmentation approaches.
  arXiv  Detail & Related papers  (2023-09-05T20:24:27Z)
• Imbalanced Domain Generalization for Robust Single Cell Classification in Hematological Cytomorphology [3.7007225479462402]
  We train a robust CNN for WBC classification by addressing cross-domain data imbalance and domain shifts. Our approach achieves the best F1 macro score compared to other existing methods.
  arXiv  Detail & Related papers  (2023-03-14T10:20:31Z)
• CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Counting [46.45578907156356]
  We setup a community-wide challenge using the largest available dataset of its kind to assess nuclear segmentation and cellular composition. We conducted an extensive post-challenge analysis based on the top-performing models using 1,658 whole-slide images of colon tissue. Our findings suggest that nuclei and eosinophils play an important role in the tumour microevironment.
  arXiv  Detail & Related papers  (2023-03-11T01:21:13Z)
• TotalSegmentator: robust segmentation of 104 anatomical structures in CT images [48.50994220135258]
  We present a deep learning segmentation model for body CT images. The model can segment 104 anatomical structures relevant for use cases such as organ volumetry, disease characterization, and surgical or radiotherapy planning.
  arXiv  Detail & Related papers  (2022-08-11T15:16:40Z)
• Deep CNNs for Peripheral Blood Cell Classification [0.0]
  We benchmark 27 popular deep convolutional neural network architectures on the microscopic peripheral blood cell images dataset. We fine-tune the state-of-the-art image classification models pre-trained on the ImageNet dataset for blood cell classification.
  arXiv  Detail & Related papers  (2021-10-18T17:56:07Z)
• Medulloblastoma Tumor Classification using Deep Transfer Learning with Multi-Scale EfficientNets [63.62764375279861]
  We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions. Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
  arXiv  Detail & Related papers  (2021-09-10T13:07:11Z)
• An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
  We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks. We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem. We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
  arXiv  Detail & Related papers  (2020-12-06T18:55:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.