Boundary-RL: Reinforcement Learning for Weakly-Supervised Prostate
Segmentation in TRUS Images
- URL: http://arxiv.org/abs/2308.11376v1
- Date: Tue, 22 Aug 2023 12:02:05 GMT
- Title: Boundary-RL: Reinforcement Learning for Weakly-Supervised Prostate
Segmentation in TRUS Images
- Authors: Weixi Yi, Vasilis Stavrinides, Zachary M.C. Baum, Qianye Yang, Dean C.
Barratt, Matthew J. Clarkson, Yipeng Hu, Shaheer U. Saeed
- Abstract summary: We propose Boundary-RL, a novel weakly supervised segmentation method.
We envision the segmentation as a boundary detection problem, rather than a pixel-level classification as in previous works.
Particularly of interest, ultrasound images, where intensity values represent acoustic impedance differences between boundaries, may also benefit from the boundary delineation approach.
- Score: 8.057488225592605
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose Boundary-RL, a novel weakly supervised segmentation method that
utilises only patch-level labels for training. We envision the segmentation as
a boundary detection problem, rather than a pixel-level classification as in
previous works. This outlook on segmentation may allow for boundary delineation
under challenging scenarios such as where noise artefacts may be present within
the region-of-interest (ROI) boundaries, where traditional pixel-level
classification-based weakly supervised methods may not be able to effectively
segment the ROI. Particularly of interest, ultrasound images, where intensity
values represent acoustic impedance differences between boundaries, may also
benefit from the boundary delineation approach. Our method uses reinforcement
learning to train a controller function to localise boundaries of ROIs using a
reward derived from a pre-trained boundary-presence classifier. The classifier
indicates when an object boundary is encountered within a patch, as the
controller modifies the patch location in a sequential Markov decision process.
The classifier itself is trained using only binary patch-level labels of object
presence, which are the only labels used during training of the entire boundary
delineation framework, and serves as a weak signal to inform the boundary
delineation. The use of a controller function ensures that a sliding window
over the entire image is not necessary. It also prevents possible
false-positive or -negative cases by minimising number of patches passed to the
boundary-presence classifier. We evaluate our proposed approach for a
clinically relevant task of prostate gland segmentation on trans-rectal
ultrasound images. We show improved performance compared to other tested weakly
supervised methods, using the same labels e.g., multiple instance learning.
Related papers
- Competing for pixels: a self-play algorithm for weakly-supervised segmentation [7.416217935677032]
We propose a novel WSS method that gamifies image segmentation of a region.
Agents compete to select ROI-containing patches until exhaustion of all such patches.
This competitive setup ensures minimisation of over- or under-segmentation.
arXiv Detail & Related papers (2024-05-26T17:00:17Z) - Semantic Connectivity-Driven Pseudo-labeling for Cross-domain
Segmentation [89.41179071022121]
Self-training is a prevailing approach in cross-domain semantic segmentation.
We propose a novel approach called Semantic Connectivity-driven pseudo-labeling.
This approach formulates pseudo-labels at the connectivity level and thus can facilitate learning structured and low-noise semantics.
arXiv Detail & Related papers (2023-12-11T12:29:51Z) - PNT-Edge: Towards Robust Edge Detection with Noisy Labels by Learning
Pixel-level Noise Transitions [119.17602768128806]
It is hard to manually label edges accurately, especially for large datasets.
This paper proposes to learn Pixel-level NoiseTransitions to model the label-corruption process.
arXiv Detail & Related papers (2023-07-26T09:45:17Z) - Regularizing Self-training for Unsupervised Domain Adaptation via
Structural Constraints [14.593782939242121]
We propose to incorporate structural cues from auxiliary modalities, such as depth, to regularise conventional self-training objectives.
Specifically, we introduce a contrastive pixel-level objectness constraint that pulls the pixel representations within a region of an object instance closer.
We show that our regularizer significantly improves top performing self-training methods in various UDA benchmarks for semantic segmentation.
arXiv Detail & Related papers (2023-04-29T00:12:26Z) - RCPS: Rectified Contrastive Pseudo Supervision for Semi-Supervised
Medical Image Segmentation [26.933651788004475]
We propose a novel semi-supervised segmentation method named Rectified Contrastive Pseudo Supervision (RCPS)
RCPS combines a rectified pseudo supervision and voxel-level contrastive learning to improve the effectiveness of semi-supervised segmentation.
Experimental results reveal that the proposed method yields better segmentation performance compared with the state-of-the-art methods in semi-supervised medical image segmentation.
arXiv Detail & Related papers (2023-01-13T12:03:58Z) - Pointly-Supervised Panoptic Segmentation [106.68888377104886]
We propose a new approach to applying point-level annotations for weakly-supervised panoptic segmentation.
Instead of the dense pixel-level labels used by fully supervised methods, point-level labels only provide a single point for each target as supervision.
We formulate the problem in an end-to-end framework by simultaneously generating panoptic pseudo-masks from point-level labels and learning from them.
arXiv Detail & Related papers (2022-10-25T12:03:51Z) - Active Boundary Loss for Semantic Segmentation [58.72057610093194]
This paper proposes a novel active boundary loss for semantic segmentation.
It can progressively encourage the alignment between predicted boundaries and ground-truth boundaries during end-to-end training.
Experimental results show that training with the active boundary loss can effectively improve the boundary F-score and mean Intersection-over-Union.
arXiv Detail & Related papers (2021-02-04T15:47:54Z) - Dense Label Encoding for Boundary Discontinuity Free Rotation Detection [69.75559390700887]
This paper explores a relatively less-studied methodology based on classification.
We propose new techniques to push its frontier in two aspects.
Experiments and visual analysis on large-scale public datasets for aerial images show the effectiveness of our approach.
arXiv Detail & Related papers (2020-11-19T05:42:02Z) - Contrastive Rendering for Ultrasound Image Segmentation [59.23915581079123]
The lack of sharp boundaries in US images remains an inherent challenge for segmentation.
We propose a novel and effective framework to improve boundary estimation in US images.
Our proposed method outperforms state-of-the-art methods and has the potential to be used in clinical practice.
arXiv Detail & Related papers (2020-10-10T07:14:03Z) - Unsupervised Learning of Image Segmentation Based on Differentiable
Feature Clustering [14.074732867392008]
The usage of convolutional neural networks (CNNs) for unsupervised image segmentation was investigated in this study.
We present a novel end-to-end network of unsupervised image segmentation that consists of normalization and an argmax function for differentiable clustering.
Third, we present an extension of the proposed method for segmentation with scribbles as user input, which showed better accuracy than existing methods.
arXiv Detail & Related papers (2020-07-20T10:28:36Z) - Weakly-Supervised Segmentation for Disease Localization in Chest X-Ray
Images [0.0]
We propose a novel approach to the semantic segmentation of medical chest X-ray images with only image-level class labels as supervision.
We show that this approach is applicable to chest X-rays for detecting an anomalous volume of air between the lung and the chest wall.
arXiv Detail & Related papers (2020-07-01T20:48:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.