BuyTheDips: PathLoss for improved topology-preserving deep
learning-based image segmentation
- URL: http://arxiv.org/abs/2207.11446v1
- Date: Sat, 23 Jul 2022 07:19:30 GMT
- Title: BuyTheDips: PathLoss for improved topology-preserving deep
learning-based image segmentation
- Authors: Minh On Vu Ngoc, Yizi Chen, Nicolas Boutry, Jonathan Fabrizio and
Clement Mallet
- Abstract summary: We propose a new deep image segmentation method which relies on a new leakage loss: the Pathloss.
Our method outperforms state-of-the-art topology-aware methods on two representative datasets of different natures.
- Score: 1.8899300124593648
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Capturing the global topology of an image is essential for proposing an
accurate segmentation of its domain. However, most of existing segmentation
methods do not preserve the initial topology of the given input, which is
detrimental for numerous downstream object-based tasks. This is all the more
true for deep learning models which most work at local scales. In this paper,
we propose a new topology-preserving deep image segmentation method which
relies on a new leakage loss: the Pathloss. Our method is an extension of the
BALoss [1], in which we want to improve the leakage detection for better
recovering the closeness property of the image segmentation. This loss allows
us to correctly localize and fix the critical points (a leakage in the
boundaries) that could occur in the predictions, and is based on a
shortest-path search algorithm. This way, loss minimization enforces
connectivity only where it is necessary and finally provides a good
localization of the boundaries of the objects in the image. Moreover, according
to our research, our Pathloss learns to preserve stronger elongated structure
compared to methods without using topology-preserving loss. Training with our
topological loss function, our method outperforms state-of-the-art
topology-aware methods on two representative datasets of different natures:
Electron Microscopy and Historical Map.
Related papers
- Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation [78.54656076915565]
Topological correctness plays a critical role in many image segmentation tasks.
Most networks are trained using pixel-wise loss functions, such as Dice, neglecting topological accuracy.
We propose a novel, graph-based framework for topologically accurate image segmentation.
arXiv Detail & Related papers (2024-11-05T16:20:14Z) - PI-Att: Topology Attention for Segmentation Networks through Adaptive Persistence Image Representation [1.4680035572775534]
We introduce a new topology-aware loss function, which explicitly forces the network to minimize the topological dissimilarity between the ground truth and prediction maps.
We quantify the topology of each map by the persistence image representation, for the first time in the context of a segmentation network loss.
The effectiveness of the proposed PI-Att loss is demonstrated on two different datasets for aorta and great vessel segmentation in computed tomography images.
arXiv Detail & Related papers (2024-08-15T09:06:49Z) - Enhancing Boundary Segmentation for Topological Accuracy with Skeleton-based Methods [7.646983689651424]
Topological consistency plays a crucial role in the task of boundary segmentation for reticular images.
We propose the Skea-Topo Aware loss, which is a novel loss function that takes into account the shape of each object and topological significance of the pixels.
Experiments prove that our method improves topological consistency by up to 7 points in VI compared to 13 state-of-art methods.
arXiv Detail & Related papers (2024-04-29T09:27:31Z) - DTU-Net: Learning Topological Similarity for Curvilinear Structure
Segmentation [2.9398911304923447]
We present DTU-Net, a dual-decoder and topology-aware deep neural network consisting of two sequential light-weight U-Nets.
The texture net makes a coarse prediction using image texture information.
The topology net learns topological information from the coarse prediction by employing a triplet loss trained to recognize false and missed splits.
arXiv Detail & Related papers (2022-05-23T08:15:26Z) - Self-Supervised Video Object Segmentation via Cutout Prediction and
Tagging [117.73967303377381]
We propose a novel self-supervised Video Object (VOS) approach that strives to achieve better object-background discriminability.
Our approach is based on a discriminative learning loss formulation that takes into account both object and background information.
Our proposed approach, CT-VOS, achieves state-of-the-art results on two challenging benchmarks: DAVIS-2017 and Youtube-VOS.
arXiv Detail & Related papers (2022-04-22T17:53:27Z) - Image Segmentation with Homotopy Warping [10.093435601073484]
topological correctness is crucial for the segmentation of images with fine-scale structures.
By leveraging the theory of digital topology, we identify locations in an image that are critical for topology.
We propose a new homotopy warping loss to train deep image segmentation networks for better topological accuracy.
arXiv Detail & Related papers (2021-12-15T00:33:15Z) - Residual Moment Loss for Medical Image Segmentation [56.72261489147506]
Location information is proven to benefit the deep learning models on capturing the manifold structure of target objects.
Most existing methods encode the location information in an implicit way, for the network to learn.
We propose a novel loss function, namely residual moment (RM) loss, to explicitly embed the location information of segmentation targets.
arXiv Detail & Related papers (2021-06-27T09:31:49Z) - The Spatially-Correlative Loss for Various Image Translation Tasks [69.62228639870114]
We propose a novel spatially-correlative loss that is simple, efficient and yet effective for preserving scene structure consistency.
Previous methods attempt this by using pixel-level cycle-consistency or feature-level matching losses.
We show distinct improvement over baseline models in all three modes of unpaired I2I translation: single-modal, multi-modal, and even single-image translation.
arXiv Detail & Related papers (2021-04-02T02:13:30Z) - Image Restoration by Deep Projected GSURE [115.57142046076164]
Ill-posed inverse problems appear in many image processing applications, such as deblurring and super-resolution.
We propose a new image restoration framework that is based on minimizing a loss function that includes a "projected-version" of the Generalized SteinUnbiased Risk Estimator (GSURE) and parameterization of the latent image by a CNN.
arXiv Detail & Related papers (2021-02-04T08:52:46Z) - Self-Learning with Rectification Strategy for Human Parsing [73.06197841003048]
We propose a trainable graph reasoning method to correct two typical errors in the pseudo-labels.
The reconstructed features have a stronger ability to represent the topology structure of the human body.
Our method outperforms other state-of-the-art methods in supervised human parsing tasks.
arXiv Detail & Related papers (2020-04-17T03:51:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.