Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with
Extremely Limited Labels
- URL: http://arxiv.org/abs/2209.13476v2
- Date: Wed, 28 Sep 2022 20:19:01 GMT
- Title: Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with
Extremely Limited Labels
- Authors: Chenyu You, Weicheng Dai, Fenglin Liu, Haoran Su, Xiaoran Zhang,
Lawrence Staib, James S. Duncan
- Abstract summary: We introduce a novel semi-supervised medical image segmentation framework termed Mine yOur owN Anatomy (MONA)
First, prior work argues that every pixel equally matters to the model training; we observe empirically that this alone is unlikely to define meaningful anatomical features.
Second, we construct a set of objectives that encourage the model to be capable of decomposing medical images into a collection of anatomical features.
- Score: 20.390832929798577
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Recent studies on contrastive learning have achieved remarkable performance
solely by leveraging few labels in the context of medical image segmentation.
Existing methods mainly focus on instance discrimination and invariant mapping.
However, they face three common pitfalls: (1) tailness: medical image data
usually follows an implicit long-tail class distribution. Blindly leveraging
all pixels in training hence can lead to the data imbalance issues, and cause
deteriorated performance; (2) consistency: it remains unclear whether a
segmentation model has learned meaningful and yet consistent anatomical
features due to the intra-class variations between different anatomical
features; and (3) diversity: the intra-slice correlations within the entire
dataset have received significantly less attention. This motivates us to seek a
principled approach for strategically making use of the dataset itself to
discover similar yet distinct samples from different anatomical views. In this
paper, we introduce a novel semi-supervised medical image segmentation
framework termed Mine yOur owN Anatomy (MONA), and make three contributions.
First, prior work argues that every pixel equally matters to the model
training; we observe empirically that this alone is unlikely to define
meaningful anatomical features, mainly due to lacking the supervision signal.
We show two simple solutions towards learning invariances - through the use of
stronger data augmentations and nearest neighbors. Second, we construct a set
of objectives that encourage the model to be capable of decomposing medical
images into a collection of anatomical features in an unsupervised manner.
Lastly, our extensive results on three benchmark datasets with different
labeled settings validate the effectiveness of our proposed MONA which achieves
new state-of-the-art under different labeled settings.
Related papers
- Separating common from salient patterns with Contrastive Representation
Learning [2.250968907999846]
Contrastive Analysis aims at separating common factors of variation between two datasets.
Current models based on Variational Auto-Encoders have shown poor performance in learning semantically-expressive representations.
We propose to leverage the ability of Contrastive Learning to learn semantically expressive representations well adapted for Contrastive Analysis.
arXiv Detail & Related papers (2024-02-19T08:17:13Z) - Multi-Scale Cross Contrastive Learning for Semi-Supervised Medical Image
Segmentation [14.536384387956527]
We develop a novel Multi-Scale Cross Supervised Contrastive Learning framework to segment structures in medical images.
Our approach contrasts multi-scale features based on ground-truth and cross-predicted labels, in order to extract robust feature representations.
It outperforms state-of-the-art semi-supervised methods by more than 3.0% in Dice.
arXiv Detail & Related papers (2023-06-25T16:55:32Z) - Rethinking Semi-Supervised Medical Image Segmentation: A
Variance-Reduction Perspective [51.70661197256033]
We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation.
We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks.
We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
arXiv Detail & Related papers (2023-02-03T13:50:25Z) - Self-Supervised Correction Learning for Semi-Supervised Biomedical Image
Segmentation [84.58210297703714]
We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation.
We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting.
Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
arXiv Detail & Related papers (2023-01-12T08:19:46Z) - GraVIS: Grouping Augmented Views from Independent Sources for
Dermatology Analysis [52.04899592688968]
We propose GraVIS, which is specifically optimized for learning self-supervised features from dermatology images.
GraVIS significantly outperforms its transfer learning and self-supervised learning counterparts in both lesion segmentation and disease classification tasks.
arXiv Detail & Related papers (2023-01-11T11:38:37Z) - Few-shot image segmentation for cross-institution male pelvic organs
using registration-assisted prototypical learning [13.567073992605797]
This work presents the first 3D few-shot interclass segmentation network for medical images.
It uses a labelled multi-institution dataset from prostate cancer patients with eight regions of interest.
A built-in registration mechanism can effectively utilise the prior knowledge of consistent anatomy between subjects.
arXiv Detail & Related papers (2022-01-17T11:44:10Z) - One-shot Weakly-Supervised Segmentation in Medical Images [12.184590794655517]
We present an innovative framework for 3D medical image segmentation with one-shot and weakly-supervised settings.
A propagation-reconstruction network is proposed to project scribbles from annotated volume to unlabeled 3D images.
A dual-level feature denoising module is designed to refine the scribbles based on anatomical- and pixel-level features.
arXiv Detail & Related papers (2021-11-21T09:14:13Z) - Relational Subsets Knowledge Distillation for Long-tailed Retinal
Diseases Recognition [65.77962788209103]
We propose class subset learning by dividing the long-tailed data into multiple class subsets according to prior knowledge.
It enforces the model to focus on learning the subset-specific knowledge.
The proposed framework proved to be effective for the long-tailed retinal diseases recognition task.
arXiv Detail & Related papers (2021-04-22T13:39:33Z) - Cascaded Robust Learning at Imperfect Labels for Chest X-ray
Segmentation [61.09321488002978]
We present a novel cascaded robust learning framework for chest X-ray segmentation with imperfect annotation.
Our model consists of three independent network, which can effectively learn useful information from the peer networks.
Our methods could achieve a significant improvement on the accuracy in segmentation tasks compared to the previous methods.
arXiv Detail & Related papers (2021-04-05T15:50:16Z) - Few-shot Medical Image Segmentation using a Global Correlation Network
with Discriminative Embedding [60.89561661441736]
We propose a novel method for few-shot medical image segmentation.
We construct our few-shot image segmentor using a deep convolutional network trained episodically.
We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
arXiv Detail & Related papers (2020-12-10T04:01:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.