Scale-specific auxiliary multi-task contrastive learning for deep liver vessel segmentation
- URL: http://arxiv.org/abs/2409.12333v1
- Date: Wed, 18 Sep 2024 22:03:22 GMT
- Title: Scale-specific auxiliary multi-task contrastive learning for deep liver vessel segmentation
- Authors: Amine Sadikine, Bogdan Badic, Jean-Pierre Tasu, Vincent Noblet, Pascal Ballet, Dimitris Visvikis, Pierre-Henri Conze,
- Abstract summary: This paper provides a new deep supervised approach for vessel segmentation.
We propose a new clustering technique to decompose the tree into various scale levels.
Then, we extend standard 3D UNet to multi-task learning by incorporating scale-specific auxiliary tasks and contrastive learning to encourage the discrimination between scales in the shared representation.
- Score: 0.8713453935346684
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Extracting hepatic vessels from abdominal images is of high interest for clinicians since it allows to divide the liver into functionally-independent Couinaud segments. In this respect, an automated liver blood vessel extraction is widely summoned. Despite the significant growth in performance of semantic segmentation methodologies, preserving the complex multi-scale geometry of main vessels and ramifications remains a major challenge. This paper provides a new deep supervised approach for vessel segmentation, with a strong focus on representations arising from the different scales inherent to the vascular tree geometry. In particular, we propose a new clustering technique to decompose the tree into various scale levels, from tiny to large vessels. Then, we extend standard 3D UNet to multi-task learning by incorporating scale-specific auxiliary tasks and contrastive learning to encourage the discrimination between scales in the shared representation. Promising results, depicted in several evaluation metrics, are revealed on the public 3D-IRCADb dataset.
Related papers
- Enhancing the automatic segmentation and analysis of 3D liver vasculature models [0.3957768262206625]
Venous trees - the portal (perfusing) and the hepatic (draining) trees are important for understanding the liver anatomy and disease state.
This research aims to improve the 3D segmentation, skeletonization, and subsequent analysis of vessel trees.
arXiv Detail & Related papers (2024-11-24T10:58:48Z) - A Graph Attention-Guided Diffusion Model for Liver Vessel Segmentation [44.706905779969404]
It is difficult for existing methods to obtain segmented liver vessel trees simultaneously with continuous geometry and detail in small vessels.
We proposed a diffusion model-based method with a multi-scale graph attention guidance to break through the bottleneck to segment the liver vessels.
Experiments show that the proposed method outperforms the other state-of-the-art methods used in this study.
arXiv Detail & Related papers (2024-11-01T14:25:54Z) - Dual-scale Enhanced and Cross-generative Consistency Learning for Semi-supervised Medical Image Segmentation [49.57907601086494]
Medical image segmentation plays a crucial role in computer-aided diagnosis.
We propose a novel Dual-scale Enhanced and Cross-generative consistency learning framework for semi-supervised medical image (DEC-Seg)
arXiv Detail & Related papers (2023-12-26T12:56:31Z) - Adaptive Semi-Supervised Segmentation of Brain Vessels with Ambiguous
Labels [63.415444378608214]
Our approach incorporates innovative techniques including progressive semi-supervised learning, adaptative training strategy, and boundary enhancement.
Experimental results on 3DRA datasets demonstrate the superiority of our method in terms of mesh-based segmentation metrics.
arXiv Detail & Related papers (2023-08-07T14:16:52Z) - Simultaneous segmentation and classification of the retinal arteries and
veins from color fundus images [6.027522272446452]
The study of the retinal vasculature is a fundamental stage in the screening and diagnosis of many diseases.
We propose a novel approach for the simultaneous segmentation and classification of the retinal A/V from eye fundus images.
arXiv Detail & Related papers (2022-09-20T09:54:01Z) - UNet#: A UNet-like Redesigning Skip Connections for Medical Image
Segmentation [13.767615201220138]
We propose a novel network structure combining dense skip connections and full-scale skip connections, named UNet-sharp (UNet#) for its shape similar to symbol #.
The proposed UNet# can aggregate feature maps of different scales in the decoder sub-network and capture fine-grained details and coarse-grained semantics from the full scale.
arXiv Detail & Related papers (2022-05-24T03:40:48Z) - Hepatic vessel segmentation based on 3Dswin-transformer with inductive
biased multi-head self-attention [46.46365941681487]
We propose a robust end-to-end vessel segmentation network called Indu BIased Multi-Head Attention Vessel Net.
We introduce the voxel-wise embedding rather than patch-wise embedding to locate precise liver vessel voxels.
On the other hand, we propose inductive biased multi-head self-attention which learns inductive biased relative positional embedding from absolute position embedding.
arXiv Detail & Related papers (2021-11-05T10:17:08Z) - Hierarchical Deep Network with Uncertainty-aware Semi-supervised
Learning for Vessel Segmentation [58.45470500617549]
We propose a hierarchical deep network where an attention mechanism localizes the low-contrast capillary regions guided by the whole vessels.
The proposed method achieves the state-of-the-art performance in the benchmarks of both retinal artery/vein segmentation in fundus images and liver portal/hepatic vessel segmentation in CT images.
arXiv Detail & Related papers (2021-05-31T06:55:43Z) - Towards Robust Partially Supervised Multi-Structure Medical Image
Segmentation on Small-Scale Data [123.03252888189546]
We propose Vicinal Labels Under Uncertainty (VLUU) to bridge the methodological gaps in partially supervised learning (PSL) under data scarcity.
Motivated by multi-task learning and vicinal risk minimization, VLUU transforms the partially supervised problem into a fully supervised problem by generating vicinal labels.
Our research suggests a new research direction in label-efficient deep learning with partial supervision.
arXiv Detail & Related papers (2020-11-28T16:31:00Z) - Rethinking the Extraction and Interaction of Multi-Scale Features for
Vessel Segmentation [53.187152856583396]
We propose a novel deep learning model called PC-Net to segment retinal vessels and major arteries in 2D fundus image and 3D computed tomography angiography (CTA) scans.
In PC-Net, the pyramid squeeze-and-excitation (PSE) module introduces spatial information to each convolutional block, boosting its ability to extract more effective multi-scale features.
arXiv Detail & Related papers (2020-10-09T08:22:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.