Cracking the PUMA Challenge in 24 Hours with CellViT++ and nnU-Net

• URL: http://arxiv.org/abs/2503.12269v1
• Date: Sat, 15 Mar 2025 21:46:35 GMT
• Title: Cracking the PUMA Challenge in 24 Hours with CellViT++ and nnU-Net
• Authors: Negar Shahamiri, Moritz Rempe, Lukas Heine, Jens Kleesiek, Fabian Hörst,
• Abstract summary: The panoptic segmentation of nuclei and tissue in advanced melanoma (PUMA) challenge aims to improve tissue segmentation and nuclei detection in melanoma histopathology.<n>The pipeline combines two models, namely CellViT++ for nuclei detection and nnU-Net for tissue segmentation.<n>Results demonstrate a significant improvement in tissue segmentation, achieving a Dice score of 0.750, surpassing the baseline score of 0.629.
• Score: 1.8727813539150509
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Automatic tissue segmentation and nuclei detection is an important task in pathology, aiding in biomarker extraction and discovery. The panoptic segmentation of nuclei and tissue in advanced melanoma (PUMA) challenge aims to improve tissue segmentation and nuclei detection in melanoma histopathology. Unlike many challenge submissions focusing on extensive model tuning, our approach emphasizes delivering a deployable solution within a 24-hour development timeframe, using out-of-the-box frameworks. The pipeline combines two models, namely CellViT++ for nuclei detection and nnU-Net for tissue segmentation. Our results demonstrate a significant improvement in tissue segmentation, achieving a Dice score of 0.750, surpassing the baseline score of 0.629. For nuclei detection, we obtained results comparable to the baseline in both challenge tracks. The code is publicly available at https://github.com/TIO-IKIM/PUMA.

Related papers

• A Multi-Stage Auto-Context Deep Learning Framework for Tissue and Nuclei Segmentation and Classification in H&E-Stained Histological Images of Advanced Melanoma [0.774770116605161]
  Melanoma is the most lethal form of skin cancer, with an increasing incidence rate worldwide. We propose a novel multi-stage deep learning approach by combining tissue and nuclei information in a unified framework. Our approach achieved second and first place rankings in the PUMA challenge.
  arXiv  Detail & Related papers  (2025-03-31T11:15:50Z)
• Segmentation of Pediatric Brain Tumors using a Radiologically informed, Deep Learning Cascade [0.0]
  Monitoring Diffuse Intrinsic Pontine Glioma (DIPG) and Diffuse Midline Glioma (DMG) brain tumors in pediatric patients is key for assessment of treatment response. RAPNO guidelines recommend the measurement of these tumors using MRI volumetric challenges. Current study presents a novel adaptation of existing nnU-Net approaches for pediatric brain tumor segmentation.
  arXiv  Detail & Related papers  (2024-10-17T20:46:13Z)
• CellViT: Vision Transformers for Precise Cell Segmentation and Classification [3.6000652088960785]
  We introduce a new method for automated instance segmentation of cell nuclei in digitized tissue samples using a deep learning architecture based on Vision Transformer called CellViT. We demonstrate the superiority of large-scale in-domain and out-of-domain pre-trained Vision Transformers by leveraging the recently published Segment Anything Model and a ViT-encoder pre-trained on 104 million histological image patches.
  arXiv  Detail & Related papers  (2023-06-27T10:03:15Z)
• CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Counting [46.45578907156356]
  We setup a community-wide challenge using the largest available dataset of its kind to assess nuclear segmentation and cellular composition. We conducted an extensive post-challenge analysis based on the top-performing models using 1,658 whole-slide images of colon tissue. Our findings suggest that nuclei and eosinophils play an important role in the tumour microevironment.
  arXiv  Detail & Related papers  (2023-03-11T01:21:13Z)
• Comparative analysis of deep learning approaches for AgNOR-stained cytology samples interpretation [52.77024349608834]
  This paper provides a way to analyze argyrophilic nucleolar organizer regions (AgNOR) stained slide using deep learning approaches. Our results show that the semantic segmentation using U-Net with ResNet-18 or ResNet-34 as the backbone have similar results. The best model shows an IoU for nucleus, cluster, and satellites of 0.83, 0.92, and 0.99 respectively.
  arXiv  Detail & Related papers  (2022-10-19T15:15:32Z)
• PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classification [23.466331358975044]
  We study and design a new method to simultaneously detect, segment, and classify nuclei from Haematoxylin and Eosin stained histopathology data. We demonstrate the superior performance of our proposed approach for nuclei segmentation and classification across 19 different tissue types.
  arXiv  Detail & Related papers  (2021-11-01T08:29:40Z)
• Bend-Net: Bending Loss Regularized Multitask Learning Network for Nuclei Segmentation in Histopathology Images [65.47507533905188]
  We propose a novel multitask learning network with a bending loss regularizer to separate overlapped nuclei accurately. The newly proposed multitask learning architecture enhances the generalization by learning shared representation from three tasks. The proposed bending loss defines high penalties to concave contour points with large curvatures, and applies small penalties to convex contour points with small curvatures.
  arXiv  Detail & Related papers  (2021-09-30T17:29:44Z)
• An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
  We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks. We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem. We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
  arXiv  Detail & Related papers  (2020-12-06T18:55:07Z)
• A Global Benchmark of Algorithms for Segmenting Late Gadolinium-Enhanced Cardiac Magnetic Resonance Imaging [90.29017019187282]
  " 2018 Left Atrium Challenge" using 154 3D LGE-MRIs, currently the world's largest cardiac LGE-MRI dataset. Analyse of the submitted algorithms using technical and biological metrics was performed. Results show the top method achieved a dice score of 93.2% and a mean surface to a surface distance of 0.7 mm.
  arXiv  Detail & Related papers  (2020-04-26T08:49:17Z)
• Inf-Net: Automatic COVID-19 Lung Infection Segmentation from CT Images [152.34988415258988]
  Automated detection of lung infections from computed tomography (CT) images offers a great potential to augment the traditional healthcare strategy for tackling COVID-19. segmenting infected regions from CT slices faces several challenges, including high variation in infection characteristics, and low intensity contrast between infections and normal tissues. To address these challenges, a novel COVID-19 Deep Lung Infection Network (Inf-Net) is proposed to automatically identify infected regions from chest CT slices.
  arXiv  Detail & Related papers  (2020-04-22T07:30:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.