Efficient Connectivity-Preserving Instance Segmentation with Supervoxel-Based Loss Function

• URL: http://arxiv.org/abs/2501.01022v2
• Date: Mon, 06 Jan 2025 22:05:46 GMT
• Title: Efficient Connectivity-Preserving Instance Segmentation with Supervoxel-Based Loss Function
• Authors: Anna Grim, Jayaram Chandrashekar, Uygar Sumbul,
• Abstract summary: We propose a topology-aware neural network segmentation method with minimal computational overhead. We demonstrate its effectiveness on a new public dataset of 3-d light microscopy images of mouse brains.
• Score: 2.501693072047969
• License:
• Abstract: Reconstructing the intricate local morphology of neurons and their long-range projecting axons can address many connectivity related questions in neuroscience. The main bottleneck in connectomics pipelines is correcting topological errors, as multiple entangled neuronal arbors is a challenging instance segmentation problem. More broadly, segmentation of curvilinear, filamentous structures continues to pose significant challenges. To address this problem, we extend the notion of simple points from digital topology to connected sets of voxels (i.e. supervoxels) and propose a topology-aware neural network segmentation method with minimal computational overhead. We demonstrate its effectiveness on a new public dataset of 3-d light microscopy images of mouse brains, along with the benchmark datasets DRIVE, ISBI12, and CrackTree.

Related papers

• Sequencing the Neurome: Towards Scalable Exact Parameter Reconstruction of Black-Box Neural Networks [7.0710630443004705]
  Inferring exact parameters of a neural network with only query access is an NP-Hard problem. We present a novel query generation algorithm that produces maximally informative samples, letting us untangle the non-linear relationships efficiently. We demonstrate reconstruction of a hidden network containing over 1.5 million parameters, and of one 7 layers deep, the largest and deepest reconstructions to date, with max parameter difference less than 0.0001.
  arXiv  Detail & Related papers  (2024-09-27T21:02:04Z)
• FISBe: A real-world benchmark dataset for instance segmentation of long-range thin filamentous structures [4.9246627979592725]
  Instance segmentation of neurons in volumetric light microscopy images of nervous systems enables groundbreaking research in neuroscience. Yet said multi-neuron light microscopy data exhibits extremely challenging properties for the task of instance segmentation. We release FlyLight Instance Benchmark (FISBe) dataset, the first publicly available multi-neuron light microscopy dataset with pixel-wise annotations.
  arXiv  Detail & Related papers  (2024-03-29T19:51:34Z)
• Leveraging Frequency Domain Learning in 3D Vessel Segmentation [50.54833091336862]
  In this study, we leverage Fourier domain learning as a substitute for multi-scale convolutional kernels in 3D hierarchical segmentation models. We show that our novel network achieves remarkable dice performance (84.37% on ASACA500 and 80.32% on ImageCAS) in tubular vessel segmentation tasks.
  arXiv  Detail & Related papers  (2024-01-11T19:07:58Z)
• Learning Multimodal Volumetric Features for Large-Scale Neuron Tracing [72.45257414889478]
  We aim to reduce human workload by predicting connectivity between over-segmented neuron pieces. We first construct a dataset, named FlyTracing, that contains millions of pairwise connections of segments expanding the whole fly brain. We propose a novel connectivity-aware contrastive learning method to generate dense volumetric EM image embedding.
  arXiv  Detail & Related papers  (2024-01-05T19:45:12Z)
• NexToU: Efficient Topology-Aware U-Net for Medical Image Segmentation [3.8336080345323227]
  CNN and Transformer variants have emerged as the leading medical image segmentation backbones. We propose NexToU, a novel hybrid architecture for medical image segmentation. Our method consistently outperforms other state-of-the-art (SOTA) architectures.
  arXiv  Detail & Related papers  (2023-05-25T10:18:57Z)
• Single Neuron Segmentation using Graph-based Global Reasoning with Auxiliary Skeleton Loss from 3D Optical Microscope Images [30.539098538610013]
  We present an end-to-end segmentation network by jointly considering the local appearance and the global geometry traits. The evaluation results on the Janelia dataset from the BigNeuron project demonstrate that our proposed method exceeds the counterpart algorithms in performance.
  arXiv  Detail & Related papers  (2021-01-22T01:27:14Z)
• Topological obstructions in neural networks learning [67.8848058842671]
  We study global properties of the loss gradient function flow. We use topological data analysis of the loss function and its Morse complex to relate local behavior along gradient trajectories with global properties of the loss surface.
  arXiv  Detail & Related papers  (2020-12-31T18:53:25Z)
• Learning Connectivity of Neural Networks from a Topological Perspective [80.35103711638548]
  We propose a topological perspective to represent a network into a complete graph for analysis. By assigning learnable parameters to the edges which reflect the magnitude of connections, the learning process can be performed in a differentiable manner. This learning process is compatible with existing networks and owns adaptability to larger search spaces and different tasks.
  arXiv  Detail & Related papers  (2020-08-19T04:53:31Z)
• Multipole Graph Neural Operator for Parametric Partial Differential Equations [57.90284928158383]
  One of the main challenges in using deep learning-based methods for simulating physical systems is formulating physics-based data. We propose a novel multi-level graph neural network framework that captures interaction at all ranges with only linear complexity. Experiments confirm our multi-graph network learns discretization-invariant solution operators to PDEs and can be evaluated in linear time.
  arXiv  Detail & Related papers  (2020-06-16T21:56:22Z)
• clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentation [57.20783326661043]
  We introduce a novel similarity measure termed centerlineDice (short clDice) We theoretically prove that clDice guarantees topology preservation up to homotopy equivalence for binary 2D and 3D segmentation. We benchmark the soft-clDice loss on five public datasets, including vessels, roads and neurons (2D and 3D)
  arXiv  Detail & Related papers  (2020-03-16T16:27:49Z)
• DVNet: A Memory-Efficient Three-Dimensional CNN for Large-Scale Neurovascular Reconstruction [1.9199289015460215]
  We present a fully-convolutional, deep, and densely-connected encoder-decoder for pixel-wise semantic segmentation. The proposed network provides superior performance for semantic segmentation problems applied to open-source benchmarks.
  arXiv  Detail & Related papers  (2020-02-04T22:39:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.