Interactive Whole Slide Images for RL-based Tumour Segmentation

• URL: http://arxiv.org/abs/2608.16607v1
• Date: Mon, 17 Aug 2026 14:10:30 GMT
• Title: Interactive Whole Slide Images for RL-based Tumour Segmentation
• Abstract summary: Whole-slide image (WSI) analysis remains computationally challenging due to the large spatial resolution of slides and the sparse distribution of tumour regions.<n>We propose an end-to-end reinforcement learning framework for sequential tumour segmentation directly on WSIs.<n>Our results suggest that modelling WSIs as interactive environments provides a promising direction for RL-based computational pathology.
• Score: 0.7095350526841507
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Whole-slide image (WSI) analysis remains computationally challenging due to the extremely large spatial resolution of slides and the sparse distribution of tumour regions. We propose an end-to-end reinforcement learning framework for sequential tumour segmentation directly on WSIs. Instead of treating the slide as a predefined collection of candidate patches, we formulate the WSI itself as a hierarchical multi-resolution environment through which an agent navigates using movement, zooming, and tumour selection actions. The agent jointly processes local observations and a global thumbnail representation within an actor-critic architecture trained using proximal policy optimization (PPO). Experiments on pulmonary adenocarcinoma WSIs demonstrate the feasibility of direct sequential tumour segmentation on full slides, achieving comparable coarse segmentation quality relative to patch-based approaches operating at similar magnification levels, while reducing inference time to a few seconds per slide. We further analyse the impact of environment design and action-space granularity. Our results suggest that modelling WSIs as interactive environments provides a promising direction for RL-based computational pathology

Related papers

• Towards Voxel Spacing Consistency for Medical Image Segmentation [56.992050146446495]
  We study the correlation between image resampling and segmentation, and propose Consispace, a semantic-aware resampling framework.<n> Consispace achieves consistent voxel spacing in the axial direction while preserving anatomical and semantic consistency.
  arXiv  Detail & Related papers  (2026-06-30T15:42:23Z)
• WSI-INR: Implicit Neural Representations for Lesion Segmentation in Whole-Slide Images [18.13897875757054]
  Whole-slide images (WSIs) are fundamental for computational pathology, where accurate lesion segmentation is critical for clinical decision making.<n>Existing methods partition WSIs into discrete patches, disrupting spatial continuity and treating multi-resolution views as independent samples.<n>We propose WSI-INR, a novel patch-free framework based on Implicit Neural Representations (INRs)<n> WSI-INR models the WSI as a continuous implicit function mapping spatial coordinates directly to tissue semantics features, outputting segmentation results while preserving intrinsic spatial information across the entire slide.
  arXiv  Detail & Related papers  (2026-03-04T05:41:53Z)
• Zero-shot segmentation of skin tumors in whole-slide images with vision-language foundation models [1.2488173903877113]
  We introduce a zero-shot visual-language segmentation pipeline for whole-slide images (ZEUS)<n>ZEUS generates high-resolution tumor masks in gigapixel whole-slide images.<n>We demonstrate competitive performance on two in-house datasets.
  arXiv  Detail & Related papers  (2025-11-24T10:50:30Z)
• PhysLLM: Harnessing Large Language Models for Cross-Modal Remote Physiological Sensing [49.243031514520794]
  Large Language Models (LLMs) excel at capturing long-range signals due to their text-centric design.<n>PhysLLM achieves state-the-art accuracy and robustness, demonstrating superior generalization across lighting variations and motion scenarios.
  arXiv  Detail & Related papers  (2025-05-06T15:18:38Z)
• CGAM: Click-Guided Attention Module for Interactive Pathology Image Segmentation via Backpropagating Refinement [8.590026259176806]
  Tumor region segmentation is an essential task for the quantitative analysis of digital pathology. Recent deep neural networks have shown state-of-the-art performance in various image-segmentation tasks. We propose an interactive segmentation method that allows users to refine the output of deep neural networks through click-type user interactions.
  arXiv  Detail & Related papers  (2023-07-03T13:45:24Z)
• ARHNet: Adaptive Region Harmonization for Lesion-aware Augmentation to Improve Segmentation Performance [61.04246102067351]
  We propose a foreground harmonization framework (ARHNet) to tackle intensity disparities and make synthetic images look more realistic. We demonstrate the efficacy of our method in improving the segmentation performance using real and synthetic images.
  arXiv  Detail & Related papers  (2023-07-02T10:39:29Z)
• RLogist: Fast Observation Strategy on Whole-slide Images with Deep Reinforcement Learning [15.955265218706467]
  Whole-slide images (WSI) in computational pathology have high resolution with gigapixel size, but are generally with sparse regions of interest. We develop RLogist, a deep reinforcement learning (DRL) method for fast observation strategy on WSIs.
  arXiv  Detail & Related papers  (2022-12-04T04:03:34Z)
• Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
  In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network. We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module. Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
  arXiv  Detail & Related papers  (2022-12-01T07:32:56Z)
• Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomics [63.76637479503006]
  Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. This paper proposes a hierarchical-based multimodal transformer framework that learns a hierarchical mapping between pathology images and corresponding genes. Our architecture requires fewer GPU resources compared with benchmark methods while maintaining better WSI representation ability.
  arXiv  Detail & Related papers  (2022-11-29T23:47:56Z)
• RetiFluidNet: A Self-Adaptive and Multi-Attention Deep Convolutional Network for Retinal OCT Fluid Segmentation [3.57686754209902]
  Quantification of retinal fluids is necessary for OCT-guided treatment management. New convolutional neural architecture named RetiFluidNet is proposed for multi-class retinal fluid segmentation. Model benefits from hierarchical representation learning of textural, contextual, and edge features.
  arXiv  Detail & Related papers  (2022-09-26T07:18:00Z)
• Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation [73.84166499988443]
  We present a novel unsupervised domain adaptation framework, named as Synergistic Image and Feature Alignment (SIFA) Our proposed SIFA conducts synergistic alignment of domains from both image and feature perspectives. Experimental results on two different tasks demonstrate that our SIFA method is effective in improving segmentation performance on unlabeled target images.
  arXiv  Detail & Related papers  (2020-02-06T13:49:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.