StyleSeg V2: Towards Robust One-shot Segmentation of Brain Tissue via Optimization-free Registration Error Perception

• URL: http://arxiv.org/abs/2405.03197v2
• Date: Sat, 18 May 2024 13:45:58 GMT
• Title: StyleSeg V2: Towards Robust One-shot Segmentation of Brain Tissue via Optimization-free Registration Error Perception
• Authors: Zhiwei Wang, Xiaoyu Zeng, Chongwei Wu, Jinxin lv, Xu Zhang, Wei Fang, Qiang Li,
• Abstract summary: One-shot segmentation of brain tissue requires training registration-segmentation (reg-seg) dual-model iteratively. Recent StyleSeg bypasses this bottleneck by replacing the unlabeled images with their warped copies of atlas. Here, we present StyleSeg V2, inherited from StyleSeg but granted the ability of perceiving the registration errors.
• Score: 15.118588568951253
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: One-shot segmentation of brain tissue requires training registration-segmentation (reg-seg) dual-model iteratively, where reg-model aims to provide pseudo masks of unlabeled images for seg-model by warping a carefully-labeled atlas. However, the imperfect reg-model induces image-mask misalignment, poisoning the seg-model subsequently. Recent StyleSeg bypasses this bottleneck by replacing the unlabeled images with their warped copies of atlas, but needs to borrow the diverse image patterns via style transformation. Here, we present StyleSeg V2, inherited from StyleSeg but granted the ability of perceiving the registration errors. The motivation is that good registration behaves in a mirrored fashion for mirrored images. Therefore, almost at no cost, StyleSeg V2 can have reg-model itself "speak out" incorrectly-aligned regions by simply mirroring (symmetrically flipping the brain) its input, and the registration errors are symmetric inconsistencies between the outputs of original and mirrored inputs. Consequently, StyleSeg V2 allows the seg-model to make use of correctly-aligned regions of unlabeled images and also enhances the fidelity of style-transformed warped atlas image by weighting the local transformation strength according to registration errors. The experimental results on three public datasets demonstrate that our proposed StyleSeg V2 outperforms other state-of-the-arts by considerable margins, and exceeds StyleSeg by increasing the average Dice by at least 2.4%.

Related papers

• MsMorph: An Unsupervised pyramid learning network for brain image registration [4.000367245594772]
  MsMorph is an image registration framework aimed at mimicking the manual process of registering image pairs. It decodes semantic information at different scales and continuously compen-sates for the predicted deformation field. The proposed method simulates the manual approach to registration, focusing on different regions of the image pairs and their neighborhoods.
  arXiv  Detail & Related papers  (2024-10-23T19:20:57Z)
• Distractors-Immune Representation Learning with Cross-modal Contrastive Regularization for Change Captioning [71.14084801851381]
  Change captioning aims to succinctly describe the semantic change between a pair of similar images. Most existing methods directly capture the difference between them, which risk obtaining error-prone difference features. We propose a distractors-immune representation learning network that correlates the corresponding channels of two image representations.
  arXiv  Detail & Related papers  (2024-07-16T13:00:33Z)
• Image2Sentence based Asymmetrical Zero-shot Composed Image Retrieval [92.13664084464514]
  The task of composed image retrieval (CIR) aims to retrieve images based on the query image and the text describing the users' intent. Existing methods have made great progress with the advanced large vision-language (VL) model in CIR task, however, they generally suffer from two main issues: lack of labeled triplets for model training and difficulty of deployment on resource-restricted environments. We propose Image2Sentence based Asymmetric zero-shot composed image retrieval (ISA), which takes advantage of the VL model and only relies on unlabeled images for composition learning.
  arXiv  Detail & Related papers  (2024-03-03T07:58:03Z)
• Self-supervised Cross-view Representation Reconstruction for Change Captioning [113.08380679787247]
  Change captioning aims to describe the difference between a pair of similar images. Its key challenge is how to learn a stable difference representation under pseudo changes caused by viewpoint change. We propose a self-supervised cross-view representation reconstruction network.
  arXiv  Detail & Related papers  (2023-09-28T09:28:50Z)
• Robust One-shot Segmentation of Brain Tissues via Image-aligned Style Transformation [13.430851964063534]
  We propose a novel image-aligned style transformation to reinforce the dual-model iterative learning for one-shot segmentation of brain tissues. Experimental results on two public datasets demonstrate 1) a competitive segmentation performance of our method compared to the fully-supervised method, and 2) a superior performance over other state-of-the-art with an increase of average Dice by up to 4.67%.
  arXiv  Detail & Related papers  (2022-11-26T09:14:01Z)
• Refign: Align and Refine for Adaptation of Semantic Segmentation to Adverse Conditions [78.71745819446176]
  Refign is a generic extension to self-training-based UDA methods which leverages cross-domain correspondences. Refign consists of two steps: (1) aligning the normal-condition image to the corresponding adverse-condition image using an uncertainty-aware dense matching network, and (2) refining the adverse prediction with the normal prediction using an adaptive label correction mechanism. The approach introduces no extra training parameters, minimal computational overhead -- during training only -- and can be used as a drop-in extension to improve any given self-training-based UDA method.
  arXiv  Detail & Related papers  (2022-07-14T11:30:38Z)
• $\texttt{GradICON}$: Approximate Diffeomorphisms via Gradient Inverse Consistency [16.72466200341455]
  We use a neural network to predict a map between a source and a target image as well as the map when swapping the source and target images. We achieve state-of-the-art registration performance on a variety of real-world medical image datasets.
  arXiv  Detail & Related papers  (2022-06-13T04:03:49Z)
• Siamese Image Modeling for Self-Supervised Vision Representation Learning [73.78790119050056]
  Self-supervised learning (SSL) has delivered superior performance on a variety of downstream vision tasks. Two main-stream SSL frameworks have been proposed, i.e., Instance Discrimination (ID) and Masked Image Modeling (MIM) We propose Siamese Image Modeling (SIM), which predicts the dense representations of an augmented view.
  arXiv  Detail & Related papers  (2022-06-02T17:59:58Z)
• Coarse-to-Fine Gaze Redirection with Numerical and Pictorial Guidance [74.27389895574422]
  We propose a novel gaze redirection framework which exploits both a numerical and a pictorial direction guidance. The proposed method outperforms the state-of-the-art approaches in terms of both image quality and redirection precision.
  arXiv  Detail & Related papers  (2020-04-07T01:17:27Z)
• Scene Text Recognition With Finer Grid Rectification [6.598317412802175]
  This paper proposed an end-to-end trainable model consists of a finer rectification module and a bidirectional attentional recognition network(Firbarn) The results of extensive evaluation on the standard benchmarks show Firbarn outperforms previous works, especially on irregular datasets.
  arXiv  Detail & Related papers  (2020-01-26T02:40:11Z)
• A Comparative Study for Non-rigid Image Registration and Rigid Image Registration [1.7878745477602331]
  In this study, we compare the state-of-art deep learning-based non-rigid registration approach with rigid registration approach. The Voxelmorph is trained on rigidset and nonrigidset separately for comparison. The best quantitative results in both root-mean-square error (RMSE) and mean absolute error (MAE) metrics for rigid registration are produced by SimpleElastix and non-rigid registration by Voxelmorph.
  arXiv  Detail & Related papers  (2020-01-12T02:32:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.