Topology-Preserving Image Segmentation with Spatial-Aware Persistent Feature Matching

• URL: http://arxiv.org/abs/2412.02076v1
• Date: Tue, 03 Dec 2024 01:38:15 GMT
• Title: Topology-Preserving Image Segmentation with Spatial-Aware Persistent Feature Matching
• Authors: Bo Wen, Haochen Zhang, Dirk-Uwe G. Bartsch, William R. Freeman, Truong Q. Nguyen, Cheolhong An,
• Abstract summary: We propose an effective and efficient Spatial-Aware Topological Loss Function that further leverages the information in the original spatial domain of the image. Experiments on images of various types of tubular structures show that the proposed method has superior performance in improving the topological accuracy of the segmentation.
• Score: 14.569312113899043
• License:
• Abstract: Topological correctness is critical for segmentation of tubular structures. Existing topological segmentation loss functions are primarily based on the persistent homology of the image. They match the persistent features from the segmentation with the persistent features from the ground truth and minimize the difference between them. However, these methods suffer from an ambiguous matching problem since the matching only relies on the information in the topological space. In this work, we propose an effective and efficient Spatial-Aware Topological Loss Function that further leverages the information in the original spatial domain of the image to assist the matching of persistent features. Extensive experiments on images of various types of tubular structures show that the proposed method has superior performance in improving the topological accuracy of the segmentation compared with state-of-the-art methods.

Related papers

• Pitfalls of topology-aware image segmentation [81.19923502845441]
  We identify critical pitfalls in model evaluation that include inadequate connectivity choices, overlooked topological artifacts, and inappropriate use of evaluation metrics. We propose a set of actionable recommendations to establish fair and robust evaluation standards for topology-aware medical image segmentation methods.
  arXiv  Detail & Related papers  (2024-12-19T08:11:42Z)
• Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation [78.54656076915565]
  Topological correctness plays a critical role in many image segmentation tasks. Most networks are trained using pixel-wise loss functions, such as Dice, neglecting topological accuracy. We propose a novel, graph-based framework for topologically accurate image segmentation.
  arXiv  Detail & Related papers  (2024-11-05T16:20:14Z)
• Relative Representations: Topological and Geometric Perspectives [53.88896255693922]
  Relative representations are an established approach to zero-shot model stitching. We introduce a normalization procedure in the relative transformation, resulting in invariance to non-isotropic rescalings and permutations. Second, we propose to deploy topological densification when fine-tuning relative representations, a topological regularization loss encouraging clustering within classes.
  arXiv  Detail & Related papers  (2024-09-17T08:09:22Z)
• Enhancing Boundary Segmentation for Topological Accuracy with Skeleton-based Methods [7.646983689651424]
  Topological consistency plays a crucial role in the task of boundary segmentation for reticular images. We propose the Skea-Topo Aware loss, which is a novel loss function that takes into account the shape of each object and topological significance of the pixels. Experiments prove that our method improves topological consistency by up to 7 points in VI compared to 13 state-of-art methods.
  arXiv  Detail & Related papers  (2024-04-29T09:27:31Z)
• EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models [52.3015009878545]
  We develop an image segmentor capable of generating fine-grained segmentation maps without any additional training. Our framework identifies semantic correspondences between image pixels and spatial locations of low-dimensional feature maps. In extensive experiments, the produced segmentation maps are demonstrated to be well delineated and capture detailed parts of the images.
  arXiv  Detail & Related papers  (2024-01-22T07:34:06Z)
• Topologically faithful image segmentation via induced matching of persistence barcodes [2.575096947175758]
  We propose the first topologically and feature-wise accurate metric and loss function for supervised image segmentation. We show how induced matchings guarantee the spatially correct matching between barcodes in a segmentation setting. We show that the Betti matching error is an interpretable metric to evaluate the topological correctness of segmentations.
  arXiv  Detail & Related papers  (2022-11-28T12:57:57Z)
• Image Segmentation with Homotopy Warping [10.093435601073484]
  topological correctness is crucial for the segmentation of images with fine-scale structures. By leveraging the theory of digital topology, we identify locations in an image that are critical for topology. We propose a new homotopy warping loss to train deep image segmentation networks for better topological accuracy.
  arXiv  Detail & Related papers  (2021-12-15T00:33:15Z)
• A persistent homology-based topological loss function for multi-class CNN segmentation of cardiac MRI [7.993897173085253]
  We build a richer description of segmentation topology by considering all possible labels and label pairs. These topological priors allow us to resolve all topological errors in a subset of 150 examples from the ACDC short axis CMR training data set.
  arXiv  Detail & Related papers  (2020-08-21T17:09:13Z)
• Out-of-distribution Generalization via Partial Feature Decorrelation [72.96261704851683]
  We present a novel Partial Feature Decorrelation Learning (PFDL) algorithm, which jointly optimize a feature decomposition network and the target image classification model. The experiments on real-world datasets demonstrate that our method can improve the backbone model's accuracy on OOD image classification datasets.
  arXiv  Detail & Related papers  (2020-07-30T05:48:48Z)
• Phase Consistent Ecological Domain Adaptation [76.75730500201536]
  We focus on the task of semantic segmentation, where annotated synthetic data are aplenty, but annotating real data is laborious. The first criterion, inspired by visual psychophysics, is that the map between the two image domains be phase-preserving. The second criterion aims to leverage ecological statistics, or regularities in the scene which are manifest in any image of it, regardless of the characteristics of the illuminant or the imaging sensor.
  arXiv  Detail & Related papers  (2020-04-10T06:58:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.