SelfReg-UNet: Self-Regularized UNet for Medical Image Segmentation

• URL: http://arxiv.org/abs/2406.14896v1
• Date: Fri, 21 Jun 2024 06:34:56 GMT
• Title: SelfReg-UNet: Self-Regularized UNet for Medical Image Segmentation
• Authors: Wenhui Zhu, Xiwen Chen, Peijie Qiu, Mohammad Farazi, Aristeidis Sotiras, Abolfazl Razi, Yalin Wang,
• Abstract summary: We explore the patterns learned in a UNet and observe two important factors that potentially affect its performance. We propose to balance the supervision between encoder and decoder and reduce the redundant information in the UNet. The proposed method can be easily integrated into existing UNet architecture in a plug-and-play fashion with negligible computational cost.
• Score: 2.0792866989795864
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Since its introduction, UNet has been leading a variety of medical image segmentation tasks. Although numerous follow-up studies have also been dedicated to improving the performance of standard UNet, few have conducted in-depth analyses of the underlying interest pattern of UNet in medical image segmentation. In this paper, we explore the patterns learned in a UNet and observe two important factors that potentially affect its performance: (i) irrelative feature learned caused by asymmetric supervision; (ii) feature redundancy in the feature map. To this end, we propose to balance the supervision between encoder and decoder and reduce the redundant information in the UNet. Specifically, we use the feature map that contains the most semantic information (i.e., the last layer of the decoder) to provide additional supervision to other blocks to provide additional supervision and reduce feature redundancy by leveraging feature distillation. The proposed method can be easily integrated into existing UNet architecture in a plug-and-play fashion with negligible computational cost. The experimental results suggest that the proposed method consistently improves the performance of standard UNets on four medical image segmentation datasets. The code is available at \url{https://github.com/ChongQingNoSubway/SelfReg-UNet}

Related papers

• iSeg: An Iterative Refinement-based Framework for Training-free Segmentation [85.58324416386375]
  We present a deep experimental analysis on iteratively refining cross-attention map with self-attention map. We propose an effective iterative refinement framework for training-free segmentation, named iSeg. Our proposed iSeg achieves an absolute gain of 3.8% in terms of mIoU compared to the best existing training-free approach in literature.
  arXiv  Detail & Related papers  (2024-09-05T03:07:26Z)
• DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cut [62.63481844384229]
  Foundation models have emerged as powerful tools across various domains including language, vision, and multimodal tasks. In this paper, we use a diffusion UNet encoder as a foundation vision encoder and introduce DiffCut, an unsupervised zero-shot segmentation method. Our work highlights the remarkably accurate semantic knowledge embedded within diffusion UNet encoders that could then serve as foundation vision encoders for downstream tasks.
  arXiv  Detail & Related papers  (2024-06-05T01:32:31Z)
• Dual-scale Enhanced and Cross-generative Consistency Learning for Semi-supervised Medical Image Segmentation [49.57907601086494]
  Medical image segmentation plays a crucial role in computer-aided diagnosis. We propose a novel Dual-scale Enhanced and Cross-generative consistency learning framework for semi-supervised medical image (DEC-Seg)
  arXiv  Detail & Related papers  (2023-12-26T12:56:31Z)
• Self-supervised Few-shot Learning for Semantic Segmentation: An Annotation-free Approach [4.855689194518905]
  Few-shot semantic segmentation (FSS) offers immense potential in the field of medical image analysis. Existing FSS techniques heavily rely on annotated semantic classes, rendering them unsuitable for medical images. We propose a novel self-supervised FSS framework that does not rely on any annotation. Instead, it adaptively estimates the query mask by leveraging the eigenvectors obtained from the support images.
  arXiv  Detail & Related papers  (2023-07-26T18:33:30Z)
• DIAS: A Dataset and Benchmark for Intracranial Artery Segmentation in DSA sequences [19.61593883367223]
  Intracranial Arteries (IA) in Digital Subtraction Angiography (DSA) plays a crucial role in the quantification of vascular morphology. Current research primarily focuses on the segmentation of single-frame DSA using proprietary datasets. We introduce DIAS, a dataset specifically developed for IA segmentation in DSA sequences.
  arXiv  Detail & Related papers  (2023-06-21T10:03:56Z)
• Cross-supervised Dual Classifiers for Semi-supervised Medical Image Segmentation [10.18427897663732]
  Semi-supervised medical image segmentation offers a promising solution for large-scale medical image analysis. This paper proposes a cross-supervised learning framework based on dual classifiers (DC-Net) Experiments on LA and Pancreas-CT dataset illustrate that DC-Net outperforms other state-of-the-art methods for semi-supervised segmentation.
  arXiv  Detail & Related papers  (2023-05-25T16:23:39Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• Scribble-Supervised Medical Image Segmentation via Dual-Branch Network and Dynamically Mixed Pseudo Labels Supervision [15.414578073908906]
  We propose a simple yet efficient scribble-supervised image segmentation method and apply it to cardiac MRI segmentation. By combining the scribble supervision and auxiliary pseudo labels supervision, the dual-branch network can efficiently learn from scribble annotations end-to-end.
  arXiv  Detail & Related papers  (2022-03-04T02:50:30Z)
• Contrastive and Selective Hidden Embeddings for Medical Image Segmentation [25.80192874762209]
  We propose contrastive learning-based weight pre-training for medical image segmentation. New structure dubbed uncertainty-aware feature selection block (UAFS) is designed to handle the learning target shift caused by minority features. We achieve state-of-the-art results across 8 public datasets from 6 domains.
  arXiv  Detail & Related papers  (2022-01-21T16:52:19Z)
• Visual Alignment Constraint for Continuous Sign Language Recognition [74.26707067455837]
  Vision-based Continuous Sign Language Recognition aims to recognize unsegmented gestures from image sequences. In this work, we revisit the overfitting problem in recent CTC-based CSLR works and attribute it to the insufficient training of the feature extractor. We propose a Visual Alignment Constraint (VAC) to enhance the feature extractor with more alignment supervision.
  arXiv  Detail & Related papers  (2021-04-06T07:24:58Z)
• Towards Robust Partially Supervised Multi-Structure Medical Image Segmentation on Small-Scale Data [123.03252888189546]
  We propose Vicinal Labels Under Uncertainty (VLUU) to bridge the methodological gaps in partially supervised learning (PSL) under data scarcity. Motivated by multi-task learning and vicinal risk minimization, VLUU transforms the partially supervised problem into a fully supervised problem by generating vicinal labels. Our research suggests a new research direction in label-efficient deep learning with partial supervision.
  arXiv  Detail & Related papers  (2020-11-28T16:31:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.