A Spatial-Temporal Progressive Fusion Network for Breast Lesion Segmentation in Ultrasound Videos

• URL: http://arxiv.org/abs/2403.11699v1
• Date: Mon, 18 Mar 2024 11:56:32 GMT
• Title: A Spatial-Temporal Progressive Fusion Network for Breast Lesion Segmentation in Ultrasound Videos
• Authors: Zhengzheng Tu, Zigang Zhu, Yayang Duan, Bo Jiang, Qishun Wang, Chaoxue Zhang,
• Abstract summary: The main challenge for ultrasound video-based breast lesion segmentation is how to exploit the lesion cues of both intraframe and inter-frame simultaneously. We propose a novel Spatial Progressive Fusion Network (STPFNet) for video based breast lesion segmentation problem. STPFNet achieves better breast lesion detection performance than state-of-the-art methods.
• Score: 7.0117363464728815
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Ultrasound video-based breast lesion segmentation provides a valuable assistance in early breast lesion detection and treatment. However, existing works mainly focus on lesion segmentation based on ultrasound breast images which usually can not be adapted well to obtain desirable results on ultrasound videos. The main challenge for ultrasound video-based breast lesion segmentation is how to exploit the lesion cues of both intra-frame and inter-frame simultaneously. To address this problem, we propose a novel Spatial-Temporal Progressive Fusion Network (STPFNet) for video based breast lesion segmentation problem. The main aspects of the proposed STPFNet are threefold. First, we propose to adopt a unified network architecture to capture both spatial dependences within each ultrasound frame and temporal correlations between different frames together for ultrasound data representation. Second, we propose a new fusion module, termed Multi-Scale Feature Fusion (MSFF), to fuse spatial and temporal cues together for lesion detection. MSFF can help to determine the boundary contour of lesion region to overcome the issue of lesion boundary blurring. Third, we propose to exploit the segmentation result of previous frame as the prior knowledge to suppress the noisy background and learn more robust representation. In particular, we introduce a new publicly available ultrasound video breast lesion segmentation dataset, termed UVBLS200, which is specifically dedicated to breast lesion segmentation. It contains 200 videos, including 80 videos of benign lesions and 120 videos of malignant lesions. Experiments on the proposed dataset demonstrate that the proposed STPFNet achieves better breast lesion detection performance than state-of-the-art methods.

Related papers

• A2DMN: Anatomy-Aware Dilated Multiscale Network for Breast Ultrasound Semantic Segmentation [44.99833362998488]
  We propose a novel breast anatomy-aware network for capturing fine image details and a new smoothness term that encodes breast anatomy. It incorporates context information across multiple spatial scales to generate more accurate semantic boundaries. The results demonstrate the proposed method significantly improves the segmentation of the muscle, mammary, and tumor classes.
  arXiv  Detail & Related papers  (2024-03-22T18:31:24Z)
• Is Two-shot All You Need? A Label-efficient Approach for Video Segmentation in Breast Ultrasound [4.113689581316844]
  We propose a novel two-shot training paradigm for BUS video segmentation. It not only is able to capture free-range space-time consistency but also utilizes a source-dependent augmentation scheme. Results showed that it gained comparable performance to the fully annotated ones given only 1.9% training labels.
  arXiv  Detail & Related papers  (2024-02-07T14:47:08Z)
• Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videos [43.454994341021276]
  We meticulously curated a US video breast lesion segmentation dataset comprising 572 videos and 34,300 annotated frames. We propose a novel frequency and localization feature aggregation network (FLA-Net) that learns temporal features from the frequency domain. Our experiments on our annotated dataset and two public video polyp segmentation datasets demonstrate that our proposed FLA-Net achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-10-03T07:50:32Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• A New Dataset and A Baseline Model for Breast Lesion Detection in Ultrasound Videos [43.42513012531214]
  We first collect and annotate an ultrasound video dataset (188 videos) for breast lesion detection. We propose a clip-level and video-level feature aggregated network (CVA-Net) for addressing breast lesion detection in ultrasound videos.
  arXiv  Detail & Related papers  (2022-07-01T01:37:50Z)
• FetReg: Placental Vessel Segmentation and Registration in Fetoscopy Challenge Dataset [57.30136148318641]
  Fetoscopy laser photocoagulation is a widely used procedure for the treatment of Twin-to-Twin Transfusion Syndrome (TTTS) This may lead to increased procedural time and incomplete ablation, resulting in persistent TTTS. Computer-assisted intervention may help overcome these challenges by expanding the fetoscopic field of view through video mosaicking and providing better visualization of the vessel network. We present a large-scale multi-centre dataset for the development of generalized and robust semantic segmentation and video mosaicking algorithms for the fetal environment with a focus on creating drift-free mosaics from long duration fetoscopy videos.
  arXiv  Detail & Related papers  (2021-06-10T17:14:27Z)
• Global Guidance Network for Breast Lesion Segmentation in Ultrasound Images [84.03487786163781]
  We develop a deep convolutional neural network equipped with a global guidance block (GGB) and breast lesion boundary detection modules. Our network outperforms other medical image segmentation methods and the recent semantic segmentation methods on breast ultrasound lesion segmentation.
  arXiv  Detail & Related papers  (2021-04-05T13:15:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.