GraphEcho: Graph-Driven Unsupervised Domain Adaptation for
Echocardiogram Video Segmentation
- URL: http://arxiv.org/abs/2309.11145v1
- Date: Wed, 20 Sep 2023 08:44:10 GMT
- Title: GraphEcho: Graph-Driven Unsupervised Domain Adaptation for
Echocardiogram Video Segmentation
- Authors: Jiewen Yang, Xinpeng Ding, Ziyang Zheng, Xiaowei Xu, Xiaomeng Li
- Abstract summary: This paper studies the unsupervised domain adaption (UDA) for echocardiogram video segmentation, where the goal is to generalize the model trained on the source domain to other unlabelled target domains.
Existing UDA segmentation methods are not suitable for this task because they do not model local information and the cyclical consistency of heartbeat.
In this paper, we introduce a newly collected CardiacUDA dataset and a novel GraphEcho method for cardiac structure segmentation.
- Score: 15.8851111502473
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Echocardiogram video segmentation plays an important role in cardiac disease
diagnosis. This paper studies the unsupervised domain adaption (UDA) for
echocardiogram video segmentation, where the goal is to generalize the model
trained on the source domain to other unlabelled target domains. Existing UDA
segmentation methods are not suitable for this task because they do not model
local information and the cyclical consistency of heartbeat. In this paper, we
introduce a newly collected CardiacUDA dataset and a novel GraphEcho method for
cardiac structure segmentation. Our GraphEcho comprises two innovative modules,
the Spatial-wise Cross-domain Graph Matching (SCGM) and the Temporal Cycle
Consistency (TCC) module, which utilize prior knowledge of echocardiogram
videos, i.e., consistent cardiac structure across patients and centers and the
heartbeat cyclical consistency, respectively. These two modules can better
align global and local features from source and target domains, improving UDA
segmentation results. Experimental results showed that our GraphEcho
outperforms existing state-of-the-art UDA segmentation methods. Our collected
dataset and code will be publicly released upon acceptance. This work will lay
a new and solid cornerstone for cardiac structure segmentation from
echocardiogram videos. Code and dataset are available at:
https://github.com/xmed-lab/GraphEcho
Related papers
- Training-Free Condition Video Diffusion Models for single frame Spatial-Semantic Echocardiogram Synthesis [0.16874375111244325]
Conditional video diffusion models (CDM) have shown promising results for video synthesis.
We present a new method called Free-Echo for generating realistic echocardiograms from a single end-diastolic segmentation map.
Our model can generate plausible echocardiograms that are spatially aligned with the input segmentation map, achieving performance comparable to training-based CDMs.
arXiv Detail & Related papers (2024-08-06T08:31:34Z) - Semantic-aware Temporal Channel-wise Attention for Cardiac Function
Assessment [69.02116920364311]
Existing video-based methods do not pay much attention to the left ventricular region, nor the left ventricular changes caused by motion.
We propose a semi-supervised auxiliary learning paradigm with a left ventricular segmentation task, which contributes to the representation learning for the left ventricular region.
Our approach achieves state-of-the-art performance on the Stanford dataset with an improvement of 0.22 MAE, 0.26 RMSE, and 1.9% $R2$.
arXiv Detail & Related papers (2023-10-09T05:57:01Z) - Towards Robust Cardiac Segmentation using Graph Convolutional Networks [0.9507020058422264]
We propose a graph architecture that uses two convolutional rings based on cardiac anatomy and show that this eliminates anatomical incorrect multi-structure segmentations.
We show this predictor can detect out-of-distribution and unsuitable input images in real-time.
arXiv Detail & Related papers (2023-10-02T13:55:06Z) - GL-Fusion: Global-Local Fusion Network for Multi-view Echocardiogram
Video Segmentation [15.8851111502473]
We propose a novel Gobal-Local fusion (GL-Fusion) network to jointly utilize multi-view information globally and locally.
A Multi-view Global-based Fusion Module (MGFM) is proposed to extract global context information.
A Multi-view Local-based Fusion Module (MLFM) is designed to extract correlations of cardiac structures from different views.
arXiv Detail & Related papers (2023-09-20T08:43:40Z) - Self-Supervised Correction Learning for Semi-Supervised Biomedical Image
Segmentation [84.58210297703714]
We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation.
We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting.
Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
arXiv Detail & Related papers (2023-01-12T08:19:46Z) - Light-weight spatio-temporal graphs for segmentation and ejection
fraction prediction in cardiac ultrasound [5.597394612661975]
We propose an automated method called EchoGraphs for predicting ejection fraction and segmenting the left ventricle.
Models for direct coordinate regression based on Graph Conal Networks (GCNs) are used to detect the keypoints.
Compared to semantic segmentation, GCNs show accurate segmentation and improvements in robustness and inference runtime.
arXiv Detail & Related papers (2022-07-06T10:03:44Z) - Source Free Unsupervised Graph Domain Adaptation [60.901775859601685]
Unsupervised Graph Domain Adaptation (UGDA) shows its practical value of reducing the labeling cost for node classification.
Most existing UGDA methods heavily rely on the labeled graph in the source domain.
In some real-world scenarios, the source graph is inaccessible because of privacy issues.
We propose a novel scenario named Source Free Unsupervised Graph Domain Adaptation (SFUGDA)
arXiv Detail & Related papers (2021-12-02T03:18:18Z) - PSGR: Pixel-wise Sparse Graph Reasoning for COVID-19 Pneumonia
Segmentation in CT Images [83.26057031236965]
We propose a pixel-wise sparse graph reasoning (PSGR) module to enhance the modeling of long-range dependencies for COVID-19 infected region segmentation in CT images.
The PSGR module avoids imprecise pixel-to-node projections and preserves the inherent information of each pixel for global reasoning.
The solution has been evaluated against four widely-used segmentation models on three public datasets.
arXiv Detail & Related papers (2021-08-09T04:58:23Z) - An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks.
We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem.
We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
arXiv Detail & Related papers (2020-12-06T18:55:07Z) - Learning Directional Feature Maps for Cardiac MRI Segmentation [13.389141642517762]
We propose a novel method to exploit the directional feature maps, which can simultaneously strengthen the differences between classes and the similarities within classes.
Specifically, we perform cardiac segmentation and learn a direction field pointing away from the nearest cardiac tissue boundary to each pixel.
Based on the learned direction field, we then propose a feature rectification and fusion (FRF) module to improve the original segmentation features.
arXiv Detail & Related papers (2020-07-22T11:31:04Z) - Class-wise Dynamic Graph Convolution for Semantic Segmentation [63.08061813253613]
We propose a class-wise dynamic graph convolution (CDGC) module to adaptively propagate information.
We also introduce the Class-wise Dynamic Graph Convolution Network(CDGCNet), which consists of two main parts including the CDGC module and a basic segmentation network.
We conduct extensive experiments on three popular semantic segmentation benchmarks including Cityscapes, PASCAL VOC 2012 and COCO Stuff.
arXiv Detail & Related papers (2020-07-19T15:26:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.