Towards High-Quality Image Segmentation: Improving Topology Accuracy by Penalizing Neighbor Pixels

• URL: http://arxiv.org/abs/2603.18671v1
• Date: Thu, 19 Mar 2026 09:33:12 GMT
• Title: Towards High-Quality Image Segmentation: Improving Topology Accuracy by Penalizing Neighbor Pixels
• Abstract summary: We present SCNP, an efficient method that improves topology accuracy by penalizing the logits with their poorest-classified neighbor.<n>We show the effectiveness of SCNP across 13 datasets, covering different structure morphologies and image modalities.<n>We show that SCNP can be integrated into several loss functions, making them improve topology accuracy.
• Score: 8.08667523501433
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Standard deep learning models for image segmentation cannot guarantee topology accuracy, failing to preserve the correct number of connected components or structures. This, in turn, affects the quality of the segmentations and compromises the reliability of the subsequent quantification analyses. Previous works have proposed to enhance topology accuracy with specialized frameworks, architectures, and loss functions. However, these methods are often cumbersome to integrate into existing training pipelines, they are computationally very expensive, or they are restricted to structures with tubular morphology. We present SCNP, an efficient method that improves topology accuracy by penalizing the logits with their poorest-classified neighbor, forcing the model to improve the prediction at the pixels' neighbors before allowing it to improve the pixels themselves. We show the effectiveness of SCNP across 13 datasets, covering different structure morphologies and image modalities, and integrate it into three frameworks for semantic and instance segmentation. Additionally, we show that SCNP can be integrated into several loss functions, making them improve topology accuracy. Our code can be found at https://jmlipman.github.io/SCNP-SameClassNeighborPenalization.

Related papers

• ContextLoss: Context Information for Topology-Preserving Segmentation [2.2742404315918927]
  We propose the novel loss function ContextLoss (CLoss) that improves topological correctness by considering topological errors with their whole context in the critical pixel mask.<n>We benchmark our proposed CLoss on three public datasets (2D & 3D) and our own 3D nano-imaging dataset of bone cement lines.
  arXiv  Detail & Related papers  (2025-06-10T19:09:52Z)
• A Graph-Based Framework for Interpretable Whole Slide Image Analysis [86.37618055724441]
  We develop a framework that transforms whole-slide images into biologically-informed graph representations.<n>Our approach builds graph nodes from tissue regions that respect natural structures, not arbitrary grids.<n>We demonstrate strong performance on challenging cancer staging and survival prediction tasks.
  arXiv  Detail & Related papers  (2025-03-14T20:15:04Z)
• Approximate Size Targets Are Sufficient for Accurate Semantic Segmentation [52.239136918460616]
  Extending binary class tags to approximate relative object-size distributions allows off-the-shelf architectures to solve the segmentation problem.<n>A straightforward zero-avoiding KL-divergence loss for average predictions produces segmentation accuracy comparable to the standard pixel-precise supervision.<n>Our ideas are validated on PASCAL VOC using our new human annotations of approximate object sizes.
  arXiv  Detail & Related papers  (2025-03-10T06:02:13Z)
• Disconnect to Connect: A Data Augmentation Method for Improving Topology Accuracy in Image Segmentation [0.493599216374976]
  Deep neural networks classify individual pixels, and even minor misclassifications can break the thin connections within these structures.<n>Existing methods for improving topology accuracy, such as topology loss functions, rely on very precise, topologically-accurate training labels.<n>We present CoLeTra, a data augmentation strategy that integrates to the models the prior knowledge that structures that appear broken are actually connected.
  arXiv  Detail & Related papers  (2025-03-07T16:11:55Z)
• Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation [78.54656076915565]
  Topological correctness plays a critical role in many image segmentation tasks.<n>Most networks are trained using pixel-wise loss functions, such as Dice, neglecting topological accuracy.<n>We propose a novel, graph-based framework for topologically accurate image segmentation.
  arXiv  Detail & Related papers  (2024-11-05T16:20:14Z)
• Distance Weighted Trans Network for Image Completion [52.318730994423106]
  We propose a new architecture that relies on Distance-based Weighted Transformer (DWT) to better understand the relationships between an image's components. CNNs are used to augment the local texture information of coarse priors. DWT blocks are used to recover certain coarse textures and coherent visual structures.
  arXiv  Detail & Related papers  (2023-10-11T12:46:11Z)
• PNM: Pixel Null Model for General Image Segmentation [17.971090313814447]
  We present a prior model that weights each pixel according to its probability of being correctly classified by a random segmenter. Experiments on semantic, instance, and panoptic segmentation tasks over three datasets confirm that PNM consistently improves the segmentation quality. We propose a new metric, textitPNM IoU, which perceives the boundary sharpness and better reflects the model segmentation performance in error-prone regions.
  arXiv  Detail & Related papers  (2022-03-13T15:17:41Z)
• Image Segmentation with Homotopy Warping [10.093435601073484]
  topological correctness is crucial for the segmentation of images with fine-scale structures. By leveraging the theory of digital topology, we identify locations in an image that are critical for topology. We propose a new homotopy warping loss to train deep image segmentation networks for better topological accuracy.
  arXiv  Detail & Related papers  (2021-12-15T00:33:15Z)
• A persistent homology-based topological loss for CNN-based multi-class segmentation of CMR [5.898114915426535]
  Multi-class segmentation of cardiac magnetic resonance (CMR) images seeks a separation of data into anatomical components with known structure and configuration. Most popular CNN-based methods are optimised using pixel wise loss functions, ignorant of the spatially extended features that characterise anatomy. We extend these approaches to the task of multi-class segmentation by building an enriched topological description of all class labels and class label pairs.
  arXiv  Detail & Related papers  (2021-07-27T09:21:38Z)
• Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action Recognition [126.51241919472356]
  We design a simple and highly modularized graph convolutional network architecture for skeleton-based action recognition. Our network is constructed by repeating a building block that aggregates multi-granularity information from both the spatial and temporal paths.
  arXiv  Detail & Related papers  (2020-11-26T14:43:04Z)
• SegFix: Model-Agnostic Boundary Refinement for Segmentation [75.58050758615316]
  We present a model-agnostic post-processing scheme to improve the boundary quality for the segmentation result that is generated by any existing segmentation model. Motivated by the empirical observation that the label predictions of interior pixels are more reliable, we propose to replace the originally unreliable predictions of boundary pixels by the predictions of interior pixels.
  arXiv  Detail & Related papers  (2020-07-08T17:08:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.