Contour Proposal Networks for Biomedical Instance Segmentation
- URL: http://arxiv.org/abs/2104.03393v1
- Date: Wed, 7 Apr 2021 21:00:45 GMT
- Title: Contour Proposal Networks for Biomedical Instance Segmentation
- Authors: Eric Upschulte, Stefan Harmeling, Katrin Amunts and Timo Dickscheid
- Abstract summary: We present a conceptually simple framework for object instance segmentation called Contour Proposal Network (CPN)
CPN detects possibly overlapping objects in an image while simultaneously fitting closed object contours using an interpretable, fixed-sized representation based on Fourier Descriptors.
We show CPNs that outperform U-Nets and Mask R-CNNs in instance segmentation accuracy and present variants with execution times suitable for real-time applications.
- Score: 0.8602553195689513
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: We present a conceptually simple framework for object instance segmentation
called Contour Proposal Network (CPN), which detects possibly overlapping
objects in an image while simultaneously fitting closed object contours using
an interpretable, fixed-sized representation based on Fourier Descriptors. The
CPN can incorporate state of the art object detection architectures as backbone
networks into a single-stage instance segmentation model that can be trained
end-to-end. We construct CPN models with different backbone networks, and apply
them to instance segmentation of cells in datasets from different modalities.
In our experiments, we show CPNs that outperform U-Nets and Mask R-CNNs in
instance segmentation accuracy, and present variants with execution times
suitable for real-time applications. The trained models generalize well across
different domains of cell types. Since the main assumption of the framework are
closed object contours, it is applicable to a wide range of detection problems
also outside the biomedical domain. An implementation of the model architecture
in PyTorch is freely available.
Related papers
- Probabilistic U-Net with Kendall Shape Spaces for Geometry-Aware Segmentations of Images [0.3499042782396683]
We propose a probabilistic image segmentation model that can incorporate the geometry of a segmentation.
Our model also adopts the Kendall Shape Variational Auto-Encoder of citevadgama2023kendall to encode a Kendall shape space.
arXiv Detail & Related papers (2024-10-17T20:32:43Z) - Detecting and Approximating Redundant Computational Blocks in Neural Networks [25.436785396394804]
intra-network similarities present new opportunities for designing more efficient neural networks.
We introduce a simple metric, Block Redundancy, to detect redundant blocks, and propose Redundant Blocks Approximation (RBA) to approximate redundant blocks.
RBA reduces model parameters and time complexity while maintaining good performance.
arXiv Detail & Related papers (2024-10-07T11:35:24Z) - Placing Objects in Context via Inpainting for Out-of-distribution Segmentation [59.00092709848619]
Placing Objects in Context (POC) is a pipeline to realistically add objects to an image.
POC can be used to extend any dataset with an arbitrary number of objects.
We present different anomaly segmentation datasets based on POC-generated data and show that POC can improve the performance of recent state-of-the-art anomaly fine-tuning methods.
arXiv Detail & Related papers (2024-02-26T08:32:41Z) - FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects [55.77542145604758]
FoundationPose is a unified foundation model for 6D object pose estimation and tracking.
Our approach can be instantly applied at test-time to a novel object without fine-tuning.
arXiv Detail & Related papers (2023-12-13T18:28:09Z) - Self-supervised Pre-training for Semantic Segmentation in an Indoor
Scene [8.357801312689622]
We propose RegConsist, a method for self-supervised pre-training of a semantic segmentation model.
We use a variant of contrastive learning to train a DCNN model for predicting semantic segmentation from RGB views in the target environment.
The proposed method outperforms models pre-trained on ImageNet and achieves competitive performance when using models that are trained for exactly the same task but on a different dataset.
arXiv Detail & Related papers (2022-10-04T20:10:14Z) - Occlusion-Aware Instance Segmentation via BiLayer Network Architectures [73.45922226843435]
We propose Bilayer Convolutional Network (BCNet), where the top layer detects occluding objects (occluders) and the bottom layer infers partially occluded instances (occludees)
We investigate the efficacy of bilayer structure using two popular convolutional network designs, namely, Fully Convolutional Network (FCN) and Graph Convolutional Network (GCN)
arXiv Detail & Related papers (2022-08-08T21:39:26Z) - Sparse Instance Activation for Real-Time Instance Segmentation [72.23597664935684]
We propose a conceptually novel, efficient, and fully convolutional framework for real-time instance segmentation.
SparseInst has extremely fast inference speed and achieves 40 FPS and 37.9 AP on the COCO benchmark.
arXiv Detail & Related papers (2022-03-24T03:15:39Z) - Prototype Guided Network for Anomaly Segmentation [5.504546777149307]
Prototype Guided Anomaly segmentation Network (PGAN) is proposed to extract semantic prototypes for in-distribution training data.
The proposed PGAN model includes a semantic segmentation network and a prototype extraction network.
On the StreetHazards dataset, the proposed PGAN model produced mIoU of 53.4% for anomaly segmentation.
arXiv Detail & Related papers (2022-01-15T15:07:38Z) - CREPO: An Open Repository to Benchmark Credal Network Algorithms [78.79752265884109]
Credal networks are imprecise probabilistic graphical models based on, so-called credal, sets of probability mass functions.
A Java library called CREMA has been recently released to model, process and query credal networks.
We present CREPO, an open repository of synthetic credal networks, provided together with the exact results of inference tasks on these models.
arXiv Detail & Related papers (2021-05-10T07:31:59Z) - CRNet: Cross-Reference Networks for Few-Shot Segmentation [59.85183776573642]
Few-shot segmentation aims to learn a segmentation model that can be generalized to novel classes with only a few training images.
With a cross-reference mechanism, our network can better find the co-occurrent objects in the two images.
Experiments on the PASCAL VOC 2012 dataset show that our network achieves state-of-the-art performance.
arXiv Detail & Related papers (2020-03-24T04:55:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.