A Learning-based Framework for Topology-Preserving Segmentation using Quasiconformal Mappings
- URL: http://arxiv.org/abs/2210.03299v3
- Date: Sun, 16 Jun 2024 13:36:52 GMT
- Title: A Learning-based Framework for Topology-Preserving Segmentation using Quasiconformal Mappings
- Authors: Han Zhang, Lok Ming Lui,
- Abstract summary: We propose a deformation-based model that can extract objects in an image while maintaining their topological properties.
This network generates segmentation masks that have the same topology as the template mask, even when trained with limited data.
- Score: 3.4798343542796593
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose the Topology-Preserving Segmentation Network, a deformation-based model that can extract objects in an image while maintaining their topological properties. This network generates segmentation masks that have the same topology as the template mask, even when trained with limited data. The network consists of two components: the Deformation Estimation Network, which produces a deformation map that warps the template mask to enclose the region of interest, and the Beltrami Adjustment Module, which ensures the bijectivity of the deformation map by truncating the associated Beltrami coefficient based on Quasiconformal theories. The proposed network can also be trained in an unsupervised manner, eliminating the need for labeled training data. This is achieved by incorporating an unsupervised segmentation loss. Our experimental results on various image datasets show that TPSN achieves better segmentation accuracy than state-of-the-art models with correct topology. Furthermore, we demonstrate TPSN's ability to handle multiple object segmentation.
Related papers
- Slender Object Scene Segmentation in Remote Sensing Image Based on Learnable Morphological Skeleton with Segment Anything Model [23.419029471215325]
We propose a new approach that integrates learnable morphological skeleton prior into deep neural networks.
Experimental results on remote sensing datasets, including buildings and roads, demonstrate that our method outperforms the original Segment Anything Model.
arXiv Detail & Related papers (2024-11-13T13:19:51Z) - SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshes [61.110517195874074]
We present a scheme to directly generate manifold, polygonal meshes of complex connectivity as the output of a neural network.
Our key innovation is to define a continuous latent connectivity space at each mesh, which implies the discrete mesh.
In applications, this approach not only yields high-quality outputs from generative models, but also enables directly learning challenging geometry processing tasks such as mesh repair.
arXiv Detail & Related papers (2024-09-30T17:59:03Z) - A rank decomposition for the topological classification of neural representations [0.0]
In this work, we leverage the fact that neural networks are equivalent to continuous piecewise-affine maps.
We study the homology groups of the quotient of a manifold $mathcalM$ and a subset $A$, assuming some minimal properties on these spaces.
We show that in randomly narrow networks, there will be regions in which the (co)homology groups of a data manifold can change.
arXiv Detail & Related papers (2024-04-30T17:01:20Z) - Distilling Ensemble of Explanations for Weakly-Supervised Pre-Training
of Image Segmentation Models [54.49581189337848]
We propose a method to enable the end-to-end pre-training for image segmentation models based on classification datasets.
The proposed method leverages a weighted segmentation learning procedure to pre-train the segmentation network en masse.
Experiment results show that, with ImageNet accompanied by PSSL as the source dataset, the proposed end-to-end pre-training strategy successfully boosts the performance of various segmentation models.
arXiv Detail & Related papers (2022-07-04T13:02:32Z) - Topology-Preserving Segmentation Network: A Deep Learning Segmentation
Framework for Connected Component [7.95119530218428]
In medical imaging, the topology of the structure, such as the kidney or lung, is usually known.
A it topology-preserving segmentation network (TPSN) is trained to give an accurate segmentation result.
TPSN is a deformation-based model that yields a deformation map through a UNet.
A multi-scale TPSN is developed in this paper that incorporates multi-level information of images to produce more precise segmentation results.
arXiv Detail & Related papers (2022-02-27T09:56:33Z) - A Topology-Attention ConvLSTM Network and Its Application to EM Images [11.081936935096873]
We propose a novel TopologyAttention ConvLSTM Network (TACNet) for 3D image segmentation.
Specifically, we propose a Spatial Topology-Attention (STA) module to process a 3D image as a stack of 2D image slices.
In order to effectively transfer topology-critical information across slices, we propose an Iterative-Topology Attention (ITA) module.
arXiv Detail & Related papers (2022-02-07T01:33:01Z) - Pairwise Relation Learning for Semi-supervised Gland Segmentation [90.45303394358493]
We propose a pairwise relation-based semi-supervised (PRS2) model for gland segmentation on histology images.
This model consists of a segmentation network (S-Net) and a pairwise relation network (PR-Net)
We evaluate our model against five recent methods on the GlaS dataset and three recent methods on the CRAG dataset.
arXiv Detail & Related papers (2020-08-06T15:02:38Z) - Pre-Trained Models for Heterogeneous Information Networks [57.78194356302626]
We propose a self-supervised pre-training and fine-tuning framework, PF-HIN, to capture the features of a heterogeneous information network.
PF-HIN consistently and significantly outperforms state-of-the-art alternatives on each of these tasks, on four datasets.
arXiv Detail & Related papers (2020-07-07T03:36:28Z) - Neural Subdivision [58.97214948753937]
This paper introduces Neural Subdivision, a novel framework for data-driven coarseto-fine geometry modeling.
We optimize for the same set of network weights across all local mesh patches, thus providing an architecture that is not constrained to a specific input mesh, fixed genus, or category.
We demonstrate that even when trained on a single high-resolution mesh our method generates reasonable subdivisions for novel shapes.
arXiv Detail & Related papers (2020-05-04T20:03:21Z) - Deep Semantic Matching with Foreground Detection and Cycle-Consistency [103.22976097225457]
We address weakly supervised semantic matching based on a deep network.
We explicitly estimate the foreground regions to suppress the effect of background clutter.
We develop cycle-consistent losses to enforce the predicted transformations across multiple images to be geometrically plausible and consistent.
arXiv Detail & Related papers (2020-03-31T22:38:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.