Topology-Aware Focal Loss for 3D Image Segmentation
- URL: http://arxiv.org/abs/2304.12223v2
- Date: Thu, 27 Apr 2023 15:54:41 GMT
- Title: Topology-Aware Focal Loss for 3D Image Segmentation
- Authors: Andac Demir, Elie Massaad, Bulent Kiziltan
- Abstract summary: We introduce a novel loss function, namely Topology-Aware Focal Loss (TAFL), that incorporates the conventional Focal Loss with a topological constraint term.
We evaluate our approach by training a 3D U-Net with the MICCAI Brain Tumor (BraTS) challenge validation dataset.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The efficacy of segmentation algorithms is frequently compromised by
topological errors like overlapping regions, disrupted connections, and voids.
To tackle this problem, we introduce a novel loss function, namely
Topology-Aware Focal Loss (TAFL), that incorporates the conventional Focal Loss
with a topological constraint term based on the Wasserstein distance between
the ground truth and predicted segmentation masks' persistence diagrams. By
enforcing identical topology as the ground truth, the topological constraint
can effectively resolve topological errors, while Focal Loss tackles class
imbalance. We begin by constructing persistence diagrams from filtered cubical
complexes of the ground truth and predicted segmentation masks. We subsequently
utilize the Sinkhorn-Knopp algorithm to determine the optimal transport plan
between the two persistence diagrams. The resultant transport plan minimizes
the cost of transporting mass from one distribution to the other and provides a
mapping between the points in the two persistence diagrams. We then compute the
Wasserstein distance based on this travel plan to measure the topological
dissimilarity between the ground truth and predicted masks. We evaluate our
approach by training a 3D U-Net with the MICCAI Brain Tumor Segmentation
(BraTS) challenge validation dataset, which requires accurate segmentation of
3D MRI scans that integrate various modalities for the precise identification
and tracking of malignant brain tumors. Then, we demonstrate that the quality
of segmentation performance is enhanced by regularizing the focal loss through
the addition of a topological constraint as a penalty term.
Related papers
- Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation [78.54656076915565]
Topological correctness plays a critical role in many image segmentation tasks.
Most networks are trained using pixel-wise loss functions, such as Dice, neglecting topological accuracy.
We propose a novel, graph-based framework for topologically accurate image segmentation.
arXiv Detail & Related papers (2024-11-05T16:20:14Z) - Enhancing Boundary Segmentation for Topological Accuracy with Skeleton-based Methods [7.646983689651424]
Topological consistency plays a crucial role in the task of boundary segmentation for reticular images.
We propose the Skea-Topo Aware loss, which is a novel loss function that takes into account the shape of each object and topological significance of the pixels.
Experiments prove that our method improves topological consistency by up to 7 points in VI compared to 13 state-of-art methods.
arXiv Detail & Related papers (2024-04-29T09:27:31Z) - Cascaded multitask U-Net using topological loss for vessel segmentation
and centerline extraction [2.264332709661011]
We propose to replace the soft-skeleton algorithm by a U-Net which computes the vascular skeleton directly from the segmentation.
We build upon this network a cascaded U-Net trained with the clDice loss to embed topological constraints during the segmentation.
arXiv Detail & Related papers (2023-07-21T14:12:28Z) - TA-Net: Topology-Aware Network for Gland Segmentation [71.52681611057271]
We propose a novel topology-aware network (TA-Net) to accurately separate densely clustered and severely deformed glands.
TA-Net has a multitask learning architecture and enhances the generalization of gland segmentation.
It achieves state-of-the-art performance on the two datasets.
arXiv Detail & Related papers (2021-10-27T17:10:58Z) - Residual Moment Loss for Medical Image Segmentation [56.72261489147506]
Location information is proven to benefit the deep learning models on capturing the manifold structure of target objects.
Most existing methods encode the location information in an implicit way, for the network to learn.
We propose a novel loss function, namely residual moment (RM) loss, to explicitly embed the location information of segmentation targets.
arXiv Detail & Related papers (2021-06-27T09:31:49Z) - Semi-supervised, Topology-Aware Segmentation of Tubular Structures from
Live Imaging 3D Microscopy [6.2651370198971295]
This paper tackles two commonly encountered problems in biomedical imaging: Topological consistency of the segmentation, and limited annotations.
We propose a topological score which measures both topological and geometric consistency between the predicted and ground truth segmentations.
Our contributions are validated on a challenging segmentation task, locating tubular structures in the fetal pancreas from noisy live imaging confocal microscopy.
arXiv Detail & Related papers (2021-05-20T13:35:44Z) - Data-driven generation of plausible tissue geometries for realistic
photoacoustic image synthesis [53.65837038435433]
Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties.
We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate"
We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
arXiv Detail & Related papers (2021-03-29T11:30:18Z) - Topology-Aware Segmentation Using Discrete Morse Theory [38.65353702366932]
We propose a new approach to train deep image segmentation networks for better topological accuracy.
We identify global structures, including 1D skeletons and 2D patches, which are important for topological accuracy.
On diverse datasets, our method achieves superior performance on both the DICE score and topological metrics.
arXiv Detail & Related papers (2021-03-18T02:47:21Z) - Topological obstructions in neural networks learning [67.8848058842671]
We study global properties of the loss gradient function flow.
We use topological data analysis of the loss function and its Morse complex to relate local behavior along gradient trajectories with global properties of the loss surface.
arXiv Detail & Related papers (2020-12-31T18:53:25Z) - Unsupervised Instance Segmentation in Microscopy Images via Panoptic
Domain Adaptation and Task Re-weighting [86.33696045574692]
We propose a Cycle Consistency Panoptic Domain Adaptive Mask R-CNN (CyC-PDAM) architecture for unsupervised nuclei segmentation in histopathology images.
We first propose a nuclei inpainting mechanism to remove the auxiliary generated objects in the synthesized images.
Secondly, a semantic branch with a domain discriminator is designed to achieve panoptic-level domain adaptation.
arXiv Detail & Related papers (2020-05-05T11:08:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.