Learning Whole-Slide Segmentation from Inexact and Incomplete Labels using Tissue Graphs

• URL: http://arxiv.org/abs/2103.03129v1
• Date: Thu, 4 Mar 2021 16:04:24 GMT
• Title: Learning Whole-Slide Segmentation from Inexact and Incomplete Labels using Tissue Graphs
• Authors: Valentin Anklin, Pushpak Pati, Guillaume Jaume, Behzad Bozorgtabar, Antonio Foncubierta-Rodr\'iguez, Jean-Philippe Thiran, Mathilde Sibony, Maria Gabrani, Orcun Goksel
• Abstract summary: We propose SegGini, a weakly supervised semantic segmentation method using graphs. SegGini segment arbitrary and large images, scaling from tissue microarray (TMA) to whole slide image (WSI)
• Score: 11.315178576537768
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Segmenting histology images into diagnostically relevant regions is imperative to support timely and reliable decisions by pathologists. To this end, computer-aided techniques have been proposed to delineate relevant regions in scanned histology slides. However, the techniques necessitate task-specific large datasets of annotated pixels, which is tedious, time-consuming, expensive, and infeasible to acquire for many histology tasks. Thus, weakly-supervised semantic segmentation techniques are proposed to utilize weak supervision that is cheaper and quicker to acquire. In this paper, we propose SegGini, a weakly supervised segmentation method using graphs, that can utilize weak multiplex annotations, i.e. inexact and incomplete annotations, to segment arbitrary and large images, scaling from tissue microarray (TMA) to whole slide image (WSI). Formally, SegGini constructs a tissue-graph representation for an input histology image, where the graph nodes depict tissue regions. Then, it performs weakly-supervised segmentation via node classification by using inexact image-level labels, incomplete scribbles, or both. We evaluated SegGini on two public prostate cancer datasets containing TMAs and WSIs. Our method achieved state-of-the-art segmentation performance on both datasets for various annotation settings while being comparable to a pathologist baseline.

Related papers

• Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation [78.54656076915565]
  Topological correctness plays a critical role in many image segmentation tasks. Most networks are trained using pixel-wise loss functions, such as Dice, neglecting topological accuracy. We propose a novel, graph-based framework for topologically accurate image segmentation.
  arXiv  Detail & Related papers  (2024-11-05T16:20:14Z)
• Deep Spectral Methods for Unsupervised Ultrasound Image Interpretation [53.37499744840018]
  This paper proposes a novel unsupervised deep learning strategy tailored to ultrasound to obtain easily interpretable tissue separations. We integrate key concepts from unsupervised deep spectral methods, which combine spectral graph theory with deep learning methods. We utilize self-supervised transformer features for spectral clustering to generate meaningful segments based on ultrasound-specific metrics and shape and positional priors, ensuring semantic consistency across the dataset.
  arXiv  Detail & Related papers  (2024-08-04T14:30:14Z)
• Learning Semantic Segmentation with Query Points Supervision on Aerial Images [57.09251327650334]
  We present a weakly supervised learning algorithm to train semantic segmentation algorithms. Our proposed approach performs accurate semantic segmentation and improves efficiency by significantly reducing the cost and time required for manual annotation.
  arXiv  Detail & Related papers  (2023-09-11T14:32:04Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• Human-machine Interactive Tissue Prototype Learning for Label-efficient Histopathology Image Segmentation [18.755759024796216]
  Deep neural networks have greatly advanced histopathology image segmentation but usually require abundant data. We present a label-efficient tissue prototype dictionary building pipeline and propose to use the obtained prototypes to guide histopathology image segmentation. We show that our human-machine interactive tissue prototype learning method can achieve comparable segmentation performance as the fully-supervised baselines.
  arXiv  Detail & Related papers  (2022-11-26T06:17:21Z)
• Nuclei Segmentation with Point Annotations from Pathology Images via Self-Supervised Learning and Co-Training [44.13451004973818]
  We propose a weakly-supervised learning method for nuclei segmentation. coarse pixel-level labels are derived from the point annotations based on the Voronoi diagram. A self-supervised visual representation learning method is tailored for nuclei segmentation of pathology images.
  arXiv  Detail & Related papers  (2022-02-16T17:08:44Z)
• Multi-Layer Pseudo-Supervision for Histopathology Tissue Semantic Segmentation using Patch-level Classification Labels [26.349051136954195]
  In this paper, we use only patch-level classification labels to achieve tissue semantic segmentation on histopathology images. Several technical novelties have been proposed to reduce the information gap between pixel-level and patch-level annotations. Our proposed model outperforms two state-of-the-art WSSS approaches.
  arXiv  Detail & Related papers  (2021-10-14T08:02:07Z)
• Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentation [88.49669148290306]
  We propose a novel weakly supervised multi-task framework called AuxSegNet to leverage saliency detection and multi-label image classification as auxiliary tasks. Inspired by their similar structured semantics, we also propose to learn a cross-task global pixel-level affinity map from the saliency and segmentation representations. The learned cross-task affinity can be used to refine saliency predictions and propagate CAM maps to provide improved pseudo labels for both tasks.
  arXiv  Detail & Related papers  (2021-07-25T11:39:58Z)
• Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization [112.68171734288237]
  We propose a novel framework for discriminative pixel-level tasks using a generative model of both images and labels. We learn a generative adversarial network that captures the joint image-label distribution and is trained efficiently using a large set of unlabeled images. We demonstrate strong in-domain performance compared to several baselines, and are the first to showcase extreme out-of-domain generalization.
  arXiv  Detail & Related papers  (2021-04-12T21:41:25Z)
• NINEPINS: Nuclei Instance Segmentation with Point Annotations [2.19221864553448]
  We propose an algorithm for instance segmentation that uses pseudo-label segmentations generated automatically from point annotations. With the generated segmentation masks, the proposed method trains a modified version of HoVer-Net model to achieve instance segmentation. Experimental results show that the proposed method is robust to inaccuracies in point annotations and comparison with Hover-Net trained with fully annotated instance masks shows that a degradation in segmentation performance does not always imply a degradation in higher order tasks such as tissue classification.
  arXiv  Detail & Related papers  (2020-06-24T08:28:52Z)
• Manifold-driven Attention Maps for Weakly Supervised Segmentation [9.289524646688244]
  We propose a manifold driven attention-based network to enhance visual salient regions. Our method generates superior attention maps directly during inference without the need of extra computations.
  arXiv  Detail & Related papers  (2020-04-07T00:03:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.