Generalize Ultrasound Image Segmentation via Instant and Plug & Play
Style Transfer
- URL: http://arxiv.org/abs/2101.03711v1
- Date: Mon, 11 Jan 2021 05:45:30 GMT
- Title: Generalize Ultrasound Image Segmentation via Instant and Plug & Play
Style Transfer
- Authors: Zhendong Liu, Xiaoqiong Huang, Xin Yang, Rui Gao, Rui Li, Yuanji
Zhang, Yankai Huang, Guangquan Zhou, Yi Xiong, Alejandro F Frangi, Dong Ni
- Abstract summary: Deep segmentation models generalize to images with unknown appearance.
Retraining models leads to high latency and complex pipelines.
We propose a novel method for robust segmentation under unknown appearance shifts.
- Score: 65.71330448991166
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep segmentation models that generalize to images with unknown appearance
are important for real-world medical image analysis. Retraining models leads to
high latency and complex pipelines, which are impractical in clinical settings.
The situation becomes more severe for ultrasound image analysis because of
their large appearance shifts. In this paper, we propose a novel method for
robust segmentation under unknown appearance shifts. Our contribution is
three-fold. First, we advance a one-stage plug-and-play solution by embedding
hierarchical style transfer units into a segmentation architecture. Our
solution can remove appearance shifts and perform segmentation simultaneously.
Second, we adopt Dynamic Instance Normalization to conduct precise and dynamic
style transfer in a learnable manner, rather than previously fixed style
normalization. Third, our solution is fast and lightweight for routine clinical
adoption. Given 400*400 image input, our solution only needs an additional
0.2ms and 1.92M FLOPs to handle appearance shifts compared to the baseline
pipeline. Extensive experiments are conducted on a large dataset from three
vendors demonstrate our proposed method enhances the robustness of deep
segmentation models.
Related papers
- Dual-scale Enhanced and Cross-generative Consistency Learning for
Semi-supervised Polyp Segmentation [52.06525450636897]
Automatic polyp segmentation plays a crucial role in the early diagnosis and treatment of colorectal cancer.
Existing methods rely heavily on fully supervised training, which requires a large amount of labeled data with time-consuming pixel-wise annotations.
We propose a novel Dual-scale Enhanced and Cross-generative consistency learning framework for semi-supervised polyp (DEC-Seg) from colonoscopy images.
arXiv Detail & Related papers (2023-12-26T12:56:31Z) - Hyper-VolTran: Fast and Generalizable One-Shot Image to 3D Object
Structure via HyperNetworks [53.67497327319569]
We introduce a novel neural rendering technique to solve image-to-3D from a single view.
Our approach employs the signed distance function as the surface representation and incorporates generalizable priors through geometry-encoding volumes and HyperNetworks.
Our experiments show the advantages of our proposed approach with consistent results and rapid generation.
arXiv Detail & Related papers (2023-12-24T08:42:37Z) - A Simple and Robust Framework for Cross-Modality Medical Image
Segmentation applied to Vision Transformers [0.0]
We propose a simple framework to achieve fair image segmentation of multiple modalities using a single conditional model.
We show that our framework outperforms other cross-modality segmentation methods on the Multi-Modality Whole Heart Conditional Challenge.
arXiv Detail & Related papers (2023-10-09T09:51:44Z) - Omni-Seg+: A Scale-aware Dynamic Network for Pathological Image
Segmentation [13.182646724406291]
The cross-sectional areas of glomeruli can be 64 times larger than that of peritubular capillaries.
We propose the Omni-Seg+ network, a scale-aware dynamic neural network that achieves multi-object (six tissue types) and multi-scale (5X to 40X scale) pathological image segmentation.
arXiv Detail & Related papers (2022-06-27T21:09:55Z) - Two-Stream Graph Convolutional Network for Intra-oral Scanner Image
Segmentation [133.02190910009384]
We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes.
Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
arXiv Detail & Related papers (2022-04-19T10:41:09Z) - Class-Aware Generative Adversarial Transformers for Medical Image
Segmentation [39.14169989603906]
We present CA-GANformer, a novel type of generative adversarial transformers, for medical image segmentation.
First, we take advantage of the pyramid structure to construct multi-scale representations and handle multi-scale variations.
We then design a novel class-aware transformer module to better learn the discriminative regions of objects with semantic structures.
arXiv Detail & Related papers (2022-01-26T03:50:02Z) - Automatic size and pose homogenization with spatial transformer network
to improve and accelerate pediatric segmentation [51.916106055115755]
We propose a new CNN architecture that is pose and scale invariant thanks to the use of Spatial Transformer Network (STN)
Our architecture is composed of three sequential modules that are estimated together during training.
We test the proposed method in kidney and renal tumor segmentation on abdominal pediatric CT scanners.
arXiv Detail & Related papers (2021-07-06T14:50:03Z) - Weakly-supervised Learning For Catheter Segmentation in 3D Frustum
Ultrasound [74.22397862400177]
We propose a novel Frustum ultrasound based catheter segmentation method.
The proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume.
arXiv Detail & Related papers (2020-10-19T13:56:22Z) - Style-invariant Cardiac Image Segmentation with Test-time Augmentation [10.234493507401618]
Deep models often suffer from severe performance drop due to the appearance shift in the real clinical setting.
In this paper, we propose a novel style-invariant method for cardiac image segmentation.
arXiv Detail & Related papers (2020-09-24T08:27:40Z) - Anatomical Data Augmentation via Fluid-based Image Registration [23.280420626023755]
We introduce a fluid-based image augmentation method for medical image analysis.
In contrast to existing methods, our framework generates meaningful images via a geodesic subspace.
arXiv Detail & Related papers (2020-07-05T21:06:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.