Joint reconstruction-segmentation on graphs

• URL: http://arxiv.org/abs/2208.05834v1
• Date: Thu, 11 Aug 2022 14:01:38 GMT
• Title: Joint reconstruction-segmentation on graphs
• Authors: Jeremy Budd, Yves van Gennip, Jonas Latz, Simone Parisotto, and Carola-Bibiane Sch\"onlieb
• Abstract summary: We present a method for joint reconstruction-segmentation using graph-based segmentation methods. Complications arise due to the large size of the matrices involved, and we show how these complications can be managed. We apply this scheme to distorted versions of two cows'' images familiar from previous graph-based segmentation literature.
• Score: 0.7829352305480285
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Practical image segmentation tasks concern images which must be reconstructed from noisy, distorted, and/or incomplete observations. A recent approach for solving such tasks is to perform this reconstruction jointly with the segmentation, using each to guide the other. However, this work has so far employed relatively simple segmentation methods, such as the Chan--Vese algorithm. In this paper, we present a method for joint reconstruction-segmentation using graph-based segmentation methods, which have been seeing increasing recent interest. Complications arise due to the large size of the matrices involved, and we show how these complications can be managed. We then analyse the convergence properties of our scheme. Finally, we apply this scheme to distorted versions of ``two cows'' images familiar from previous graph-based segmentation literature, first to a highly noised version and second to a blurred version, achieving highly accurate segmentations in both cases. We compare these results to those obtained by sequential reconstruction-segmentation approaches, finding that our method competes with, or even outperforms, those approaches in terms of reconstruction and segmentation accuracy.

Related papers

• Contour-weighted loss for class-imbalanced image segmentation [2.183832403223894]
  Image segmentation is critically important in almost all medical image analysis for automatic interpretations and processing. It is often challenging to perform image segmentation due to data imbalance between intra- and inter-class. We propose a new methodology to address the issue, with a compact yet effective contour-weighted loss function.
  arXiv  Detail & Related papers  (2024-06-07T07:43:52Z)
• Revisiting Image Reconstruction for Semi-supervised Semantic Segmentation [16.27277238968567]
  We revisit the idea of using image reconstruction as an auxiliary task and incorporate it with a modern semi-supervised semantic segmentation framework. Surprisingly, we discover that such an old idea in semi-supervised learning can produce results competitive with state-of-the-art semantic segmentation algorithms.
  arXiv  Detail & Related papers  (2023-03-17T06:31:06Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• Using the Polar Transform for Efficient Deep Learning-Based Aorta Segmentation in CTA Images [0.0]
  Medical image segmentation often requires segmenting multiple elliptical objects on a single image. In this paper, we present a general approach to improving the semantic segmentation performance of neural networks. We show that our approach improves robustness and pixel-level recall while achieving segmentation in line with the state of the art.
  arXiv  Detail & Related papers  (2022-06-21T12:18:02Z)
• SegDiff: Image Segmentation with Diffusion Probabilistic Models [81.16986859755038]
  Diffusion Probabilistic Methods are employed for state-of-the-art image generation. We present a method for extending such models for performing image segmentation. The method learns end-to-end, without relying on a pre-trained backbone.
  arXiv  Detail & Related papers  (2021-12-01T10:17:25Z)
• Uncertainty-Based Dynamic Graph Neighborhoods For Medical Segmentation [0.0]
  Post-processing and refining the results of segmentation is a common practice to decrease the misclassifications originating from the segmentation network. A graph-based approach makes use of certain and uncertain points in a graph and refines the segmentation according to a small graph convolutional network (GCN) We propose a new neighbor-selection mechanism according to feature distances and combine the two networks in the training procedure.
  arXiv  Detail & Related papers  (2021-08-06T13:39:35Z)
• Learning from Partially Overlapping Labels: Image Segmentation under Annotation Shift [68.6874404805223]
  We propose several strategies for learning from partially overlapping labels in the context of abdominal organ segmentation. We find that combining a semi-supervised approach with an adaptive cross entropy loss can successfully exploit heterogeneously annotated data.
  arXiv  Detail & Related papers  (2021-07-13T09:22:24Z)
• A Few Guidelines for Incremental Few-Shot Segmentation [57.34237650765928]
  Given a pretrained segmentation model and few images containing novel classes, our goal is to learn to segment novel classes while retaining the ability to segment previously seen ones. We show how the main problems of end-to-end training in this scenario are. i) the drift of the batch-normalization statistics toward novel classes that we can fix with batch renormalization and. ii) the forgetting of old classes, that we can fix with regularization strategies.
  arXiv  Detail & Related papers  (2020-11-30T20:45:56Z)
• Image Co-skeletonization via Co-segmentation [102.59781674888657]
  We propose a new joint processing topic: image co-skeletonization. Object skeletonization in a single natural image is a challenging problem because there is hardly any prior knowledge about the object. We propose a coupled framework for co-skeletonization and co-segmentation tasks so that they are well informed by each other.
  arXiv  Detail & Related papers  (2020-04-12T09:35:54Z)
• Motion-supervised Co-Part Segmentation [88.40393225577088]
  We propose a self-supervised deep learning method for co-part segmentation. Our approach develops the idea that motion information inferred from videos can be leveraged to discover meaningful object parts.
  arXiv  Detail & Related papers  (2020-04-07T09:56:45Z)
• Image Embedded Segmentation: Uniting Supervised and Unsupervised Objectives for Segmenting Histopathological Images [0.0]
  This paper presents a new regularization method to train a fully convolutional network for semantic tissue segmentation. It relies on the benefit of unsupervised learning, in the form of image reconstruction, for network training. Our experiments demonstrate that it leads to better segmentation results in these datasets, compared to its counterparts.
  arXiv  Detail & Related papers  (2020-01-30T08:09:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.