Devil is in Channels: Contrastive Single Domain Generalization for
Medical Image Segmentation
- URL: http://arxiv.org/abs/2306.05254v2
- Date: Sat, 24 Jun 2023 08:34:37 GMT
- Title: Devil is in Channels: Contrastive Single Domain Generalization for
Medical Image Segmentation
- Authors: Shishuai Hu, Zehui Liao, Yong Xia
- Abstract summary: We propose a textbfChannel-level textbfContrastive textbfSingle textbfDomain textbfGeneralization model for medical image segmentation.
Our method is novel in the contrastive perspective that enables channel-wise feature disentanglement using a single source domain.
- Score: 21.079667938055668
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Deep learning-based medical image segmentation models suffer from performance
degradation when deployed to a new healthcare center. To address this issue,
unsupervised domain adaptation and multi-source domain generalization methods
have been proposed, which, however, are less favorable for clinical practice
due to the cost of acquiring target-domain data and the privacy concerns
associated with redistributing the data from multiple source domains. In this
paper, we propose a \textbf{C}hannel-level \textbf{C}ontrastive \textbf{S}ingle
\textbf{D}omain \textbf{G}eneralization (\textbf{C$^2$SDG}) model for medical
image segmentation. In C$^2$SDG, the shallower features of each image and its
style-augmented counterpart are extracted and used for contrastive training,
resulting in the disentangled style representations and structure
representations. The segmentation is performed based solely on the structure
representations. Our method is novel in the contrastive perspective that
enables channel-wise feature disentanglement using a single source domain. We
evaluated C$^2$SDG against six SDG methods on a multi-domain joint optic cup
and optic disc segmentation benchmark. Our results suggest the effectiveness of
each module in C$^2$SDG and also indicate that C$^2$SDG outperforms the
baseline and all competing methods with a large margin. The code will be
available at \url{https://github.com/ShishuaiHu/CCSDG}.
Related papers
- Style Content Decomposition-based Data Augmentation for Domain Generalizable Medical Image Segmentation [22.69909762038458]
We decompose an image into its style code and content map and reveal that domain shifts in medical images involve: textbfstyle shifts (emphi.e., differences in image appearance) and textbfcontent shifts (emphi.e., variations in anatomical structures)
We propose textbfStyCona, a textbfstyle textbfcontent decomposition-based data textbfaugmentation method that innovatively augments both image style and content
arXiv Detail & Related papers (2025-02-28T00:56:46Z) - Prompting Segment Anything Model with Domain-Adaptive Prototype for Generalizable Medical Image Segmentation [49.5901368256326]
We propose a novel Domain-Adaptive Prompt framework for fine-tuning the Segment Anything Model (termed as DAPSAM) in segmenting medical images.
Our DAPSAM achieves state-of-the-art performance on two medical image segmentation tasks with different modalities.
arXiv Detail & Related papers (2024-09-19T07:28:33Z) - DARC: Distribution-Aware Re-Coloring Model for Generalizable Nucleus
Segmentation [68.43628183890007]
We argue that domain gaps can also be caused by different foreground (nucleus)-background ratios.
First, we introduce a re-coloring method that relieves dramatic image color variations between different domains.
Second, we propose a new instance normalization method that is robust to the variation in the foreground-background ratios.
arXiv Detail & Related papers (2023-09-01T01:01:13Z) - Frequency-mixed Single-source Domain Generalization for Medical Image
Segmentation [29.566769388674473]
The scarcity of medical image segmentation poses challenges in collecting sufficient training data for deep learning models.
We propose a novel approach called the Frequency-mixed Single-source Domain Generalization method (FreeSDG)
Experimental results on five datasets of three modalities demonstrate the effectiveness of the proposed algorithm.
arXiv Detail & Related papers (2023-07-18T06:44:45Z) - I2F: A Unified Image-to-Feature Approach for Domain Adaptive Semantic
Segmentation [55.633859439375044]
Unsupervised domain adaptation (UDA) for semantic segmentation is a promising task freeing people from heavy annotation work.
Key idea to tackle this problem is to perform both image-level and feature-level adaptation jointly.
This paper proposes a novel UDA pipeline for semantic segmentation that unifies image-level and feature-level adaptation.
arXiv Detail & Related papers (2023-01-03T15:19:48Z) - ProSFDA: Prompt Learning based Source-free Domain Adaptation for Medical
Image Segmentation [21.079667938055668]
We propose a textbfPrompt learning based textbfSFDA (textbfProSFDA) method for medical image segmentation.
Our results indicate that the proposed ProSFDA outperforms substantially other SFDA methods and is even comparable to UDA methods.
arXiv Detail & Related papers (2022-11-21T14:57:04Z) - Semantic-Aware Domain Generalized Segmentation [67.49163582961877]
Deep models trained on source domain lack generalization when evaluated on unseen target domains with different data distributions.
We propose a framework including two novel modules: Semantic-Aware Normalization (SAN) and Semantic-Aware Whitening (SAW)
Our approach shows significant improvements over existing state-of-the-art on various backbone networks.
arXiv Detail & Related papers (2022-04-02T09:09:59Z) - Causality-inspired Single-source Domain Generalization for Medical Image
Segmentation [12.697945585457441]
We propose a simple data augmentation approach to expose a segmentation model to synthesized domain-shifted training examples.
Specifically, 1) to make the deep model robust to discrepancies in image intensities and textures, we employ a family of randomly-weighted shallow networks.
We remove spurious correlations among objects in an image that might be taken by the network as domain-specific clues for making predictions, and they may break on unseen domains.
arXiv Detail & Related papers (2021-11-24T14:45:17Z) - Unsupervised Domain Adaptation with Variational Approximation for
Cardiac Segmentation [15.2292571922932]
Unsupervised domain adaptation is useful in medical image segmentation.
We propose a new framework, where the latent features of both domains are driven towards a common and parameterized variational form.
This is achieved by two networks based on variational auto-encoders (VAEs) and a regularization for this variational approximation.
arXiv Detail & Related papers (2021-06-16T13:00:39Z) - Cross-Modality Brain Tumor Segmentation via Bidirectional
Global-to-Local Unsupervised Domain Adaptation [61.01704175938995]
In this paper, we propose a novel Bidirectional Global-to-Local (BiGL) adaptation framework under a UDA scheme.
Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor.
The proposed method outperforms several state-of-the-art unsupervised domain adaptation methods by a large margin.
arXiv Detail & Related papers (2021-05-17T10:11:45Z) - Semantic Distribution-aware Contrastive Adaptation for Semantic
Segmentation [50.621269117524925]
Domain adaptive semantic segmentation refers to making predictions on a certain target domain with only annotations of a specific source domain.
We present a semantic distribution-aware contrastive adaptation algorithm that enables pixel-wise representation alignment.
We evaluate SDCA on multiple benchmarks, achieving considerable improvements over existing algorithms.
arXiv Detail & Related papers (2021-05-11T13:21:25Z) - Adapt Everywhere: Unsupervised Adaptation of Point-Clouds and Entropy
Minimisation for Multi-modal Cardiac Image Segmentation [10.417009344120917]
We present a novel UDA method for multi-modal cardiac image segmentation.
The proposed method is based on adversarial learning and adapts network features between source and target domain in different spaces.
We validated our method on two cardiac datasets by adapting from the annotated source domain to the unannotated target domain.
arXiv Detail & Related papers (2021-03-15T08:59:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.