Evaluating the Effects of Inter-Observer and Model Variability on Radiological Peritoneal Cancer Index Assessment

• URL: http://arxiv.org/abs/2608.28716v1
• Date: Fri, 28 Aug 2026 09:15:19 GMT
• Title: Evaluating the Effects of Inter-Observer and Model Variability on Radiological Peritoneal Cancer Index Assessment
• Abstract summary: The metric-to-decision gap is examined using radiological Peritoneal Cancer Index (r PCI) region segmentation on contrast-enhanced CT.<n>A published nnU-Net based r PCI segmentation model is benchmarked against a human reference using Dice, HD95, and ASD.<n>Observers showed high agreement (mean Dice $0.87$), while the model matched human performance in most regions but deviated more in regions 4, 8, and the small-bowel regions (9-12)<n>Across simulations, score differences were typically small (mean $$r PCI $approx 0.3$-$0.6$) for both observers
• Score: 3.763338927424874
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Deep learning segmentation models are often evaluated using geometric metrics such as Dice, HD95, and ASD, yet it remains unclear to what extent improvements in these metrics translate into clinically meaningful changes in downstream decision-making. The metric-to-decision gap is examined using radiological Peritoneal Cancer Index (rPCI) region segmentation on contrast-enhanced CT, where a consensus definition provides anatomically grounded 3D regions and the clinically used PCI 20 threshold enables decision-level evaluation. Inter-observer variability is quantified across four experts on ten abdominal CT scans, and a published nnU-Net based rPCI segmentation model is benchmarked against this human reference using Dice, HD95, and ASD across all 13 regions. To relate geometric differences to clinical impact, a probabilistic peritoneal metastasis simulation is implemented on majority-vote rPCI maps, propagating region-boundary variability into variability of derived (r)PCI scores and classification at the PCI 20 cutoff. Observers showed high agreement (mean Dice $0.87$), while the model matched human performance in most regions but deviated more in regions 4, 8, and the small-bowel regions (9-12). Across simulations, score differences were typically small (mean $Δ$rPCI $\approx 0.3$-$0.6$) for both observers and the model, and decision flips occurred predominantly when the reference score was near 20. These results suggest that rPCI-derived scoring is generally robust to typical segmentation variability, while highlighting borderline cases as the main setting where expert review remains essential.

Related papers

• ALTER: Modeling Longitudinal Changes via Regional Differencing for 3D CT Report Generation [2.9905735389905153]
  Anatomically Localized Temporal Evidence Representation (ALTER)<n>General Prior Integration (GPI) incorporates the prior CT and report to establish historical context for the current examination.<n>Regional Proxy Differencing (RPD) enables each current anatomical region to retrieve a historical proxy from a single shared encoding of the prior volume and to derive localized interval evidence.<n> Interval Change Fusion (ICF) converts current abnormality states with region-distributed differences into change-aware soft prompts that guide report generation.
  arXiv  Detail & Related papers  (2026-08-06T05:27:38Z)
• Beyond Local Inspection: Global, Guideline-Grounded Evaluation of Post-hoc XAI Methods for ECG Classification [0.0]
  We introduce a framework that aggregates explanations across heartbeats to evaluate them against clinically defined regions of interest.<n>Our results reveal a systematic failure of methods transferred from computer vision.<n>Nine of 13 methods fall below chance for at least one condition, indicating inconsistent reliability across patterns.
  arXiv  Detail & Related papers  (2026-07-27T06:16:28Z)
• Histopathological Spectrum-Guided Prostate Stratification via Segmentation-Assisted Diagnostic Transformer [29.021037203684227]
  We construct a Prostate Cancer Histopathology Spectrum dataset (PCa-HSD)<n>We formulate a clinically meaningful four-class classification task, addressing the underrepresentation of benign lesions that are easily confounded with prostate cancer in existing datasets.<n>Our proposed method consistently improves accuracy across backbones, achieving the best average accuracy of 0.633 and JointRecall of 0.768 in five-fold cross-validation on a cohort of 344 patients.
  arXiv  Detail & Related papers  (2026-07-19T10:03:47Z)
• Deep Learning-Based Segmentation of Peritoneal Cancer Index Regions from CT Imaging [4.122270062114755]
  Peritoneal metastases are currently assessed using diagnostic laparoscopy to determine Sugarbaker's Peritoneal Cancer Index (s PCI)<n>Recent consensus study defined 3D regions to facilitate a radiological PCI (r PCI)<n>We propose a deep learning-based approach to automatically segment the r PCI regions on CT.
  arXiv  Detail & Related papers  (2026-04-30T10:39:18Z)
• PanTS: The Pancreatic Tumor Segmentation Dataset [49.32814895560867]
  PanTS is a large-scale, multi-institutional dataset curated to advance research in pancreatic CT analysis.<n>It contains 36,390 CT scans from 145 medical centers, with expert-validated, voxel-wise annotations of over 993,000 anatomical structures.
  arXiv  Detail & Related papers  (2025-07-02T02:10:46Z)
• MSWAL: 3D Multi-class Segmentation of Whole Abdominal Lesions Dataset [41.69818086021188]
  We introduce MSWAL, the first 3D Multi-class of the Whole Abdominal Lesions dataset.<n>MSWAL broadens the coverage of various common lesion types, such as gallstones, kidney stones, liver tumors, kidney tumors, pancreatic cancer, liver cysts, and kidney cysts.<n>We propose Inception nnU-Net, a novel segmentation framework that effectively integrates an Inception module with the nnU-Net architecture to extract information from different fields.
  arXiv  Detail & Related papers  (2025-03-17T06:31:25Z)
• Analysis of the BraTS 2023 Intracranial Meningioma Segmentation Challenge [44.76736949127792]
  We describe the design and results from the BraTS 2023 Intracranial Meningioma Challenge.<n>The BraTS Meningioma Challenge differed from prior BraTS Glioma challenges in that it focused on meningiomas.<n>The top ranked team had a lesion-wise median dice similarity coefficient (DSC) of 0.976, 0.976, and 0.964 for enhancing tumor, tumor core, and whole tumor.
  arXiv  Detail & Related papers  (2024-05-16T03:23:57Z)
• Assessing the performance of deep learning-based models for prostate cancer segmentation using uncertainty scores [1.0499611180329804]
  The aim is to improve the workflow of prostate cancer detection and diagnosis. The top-performing model is the Attention R2U-Net, achieving a mean Intersection over Union (IoU) of 76.3% and Dice Similarity Coefficient (DSC) of 85% for segmenting all zones.
  arXiv  Detail & Related papers  (2023-08-09T01:38:58Z)
• TotalSegmentator: robust segmentation of 104 anatomical structures in CT images [48.50994220135258]
  We present a deep learning segmentation model for body CT images. The model can segment 104 anatomical structures relevant for use cases such as organ volumetry, disease characterization, and surgical or radiotherapy planning.
  arXiv  Detail & Related papers  (2022-08-11T15:16:40Z)
• Improving Classification Model Performance on Chest X-Rays through Lung Segmentation [63.45024974079371]
  We propose a deep learning approach to enhance abnormal chest x-ray (CXR) identification performance through segmentations. Our approach is designed in a cascaded manner and incorporates two modules: a deep neural network with criss-cross attention modules (XLSor) for localizing lung region in CXR images and a CXR classification model with a backbone of a self-supervised momentum contrast (MoCo) model pre-trained on large-scale CXR data sets.
  arXiv  Detail & Related papers  (2022-02-22T15:24:06Z)
• Systematic Clinical Evaluation of A Deep Learning Method for Medical Image Segmentation: Radiosurgery Application [48.89674088331313]
  We systematically evaluate a Deep Learning (DL) method in a 3D medical image segmentation task. Our method is integrated into the radiosurgery treatment process and directly impacts the clinical workflow.
  arXiv  Detail & Related papers  (2021-08-21T16:15:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.