Instance Segmentation of Biomedical Images with an Object-aware Embedding Learned with Local Constraints

• URL: http://arxiv.org/abs/2004.09821v1
• Date: Tue, 21 Apr 2020 08:33:29 GMT
• Title: Instance Segmentation of Biomedical Images with an Object-aware Embedding Learned with Local Constraints
• Authors: Long Chen, Martin Strauch, Dorit Merhof
• Abstract summary: State-of-the-art approaches either perform semantic segmentation or refine object bounding boxes. Both suffer from crowded objects to varying degrees, merging adjacent objects or suppressing a valid object. In this work, we assign an embedding vector to each pixel through a deep neural network.
• Score: 7.151685185368064
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automatic instance segmentation is a problem that occurs in many biomedical applications. State-of-the-art approaches either perform semantic segmentation or refine object bounding boxes obtained from detection methods. Both suffer from crowded objects to varying degrees, merging adjacent objects or suppressing a valid object. In this work, we assign an embedding vector to each pixel through a deep neural network. The network is trained to output embedding vectors of similar directions for pixels from the same object, while adjacent objects are orthogonal in the embedding space, which effectively avoids the fusion of objects in a crowd. Our method yields state-of-the-art results even with a light-weighted backbone network on a cell segmentation (BBBC006 + DSB2018) and a leaf segmentation data set (CVPPP2017). The code and model weights are public available.

Related papers

• Depth-aware Panoptic Segmentation [1.4170154234094008]
  We present a novel CNN-based method for panoptic segmentation. We propose a new depth-aware dice loss term which penalises the assignment of pixels to the same thing instance. Experiments carried out on the Cityscapes dataset show that the proposed method reduces the number of objects that are erroneously merged into one thing instance.
  arXiv  Detail & Related papers  (2024-03-21T08:06:49Z)
• Instance Segmentation of Dense and Overlapping Objects via Layering [8.870513218826083]
  We propose a novel approach to solve the problem via object layering. By grouping spatially separated objects in the same layer, instances can be effortlessly isolated. With minimal post-processing, our method yields very competitive results on a diverse line of datasets.
  arXiv  Detail & Related papers  (2022-10-07T13:37:56Z)
• SOLO: A Simple Framework for Instance Segmentation [84.00519148562606]
  "instance categories" assigns categories to each pixel within an instance according to the instance's location. "SOLO" is a simple, direct, and fast framework for instance segmentation with strong performance. Our approach achieves state-of-the-art results for instance segmentation in terms of both speed and accuracy.
  arXiv  Detail & Related papers  (2021-06-30T09:56:54Z)
• Object-Guided Instance Segmentation With Auxiliary Feature Refinement for Biological Images [58.914034295184685]
  Instance segmentation is of great importance for many biological applications, such as study of neural cell interactions, plant phenotyping, and quantitatively measuring how cells react to drug treatment. Box-based instance segmentation methods capture objects via bounding boxes and then perform individual segmentation within each bounding box region. Our method first detects the center points of the objects, from which the bounding box parameters are then predicted. The segmentation branch reuses the object features as guidance to separate target object from the neighboring ones within the same bounding box region.
  arXiv  Detail & Related papers  (2021-06-14T04:35:36Z)
• SegmentMeIfYouCan: A Benchmark for Anomaly Segmentation [111.61261419566908]
  Deep neural networks (DNNs) are usually trained on a closed set of semantic classes. They are ill-equipped to handle previously-unseen objects. detecting and localizing such objects is crucial for safety-critical applications such as perception for automated driving.
  arXiv  Detail & Related papers  (2021-04-30T07:58:19Z)
• Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentation [64.2719590819468]
  We propose a non-salient region object mining approach for weakly supervised semantic segmentation. A potential object mining module is proposed to reduce the false-negative rate in pseudo labels. Our non-salient region masking module helps further discover the objects in the non-salient region.
  arXiv  Detail & Related papers  (2021-03-26T16:44:03Z)
• DyStaB: Unsupervised Object Segmentation via Dynamic-Static Bootstrapping [72.84991726271024]
  We describe an unsupervised method to detect and segment portions of images of live scenes that are seen moving as a coherent whole. Our method first partitions the motion field by minimizing the mutual information between segments. It uses the segments to learn object models that can be used for detection in a static image.
  arXiv  Detail & Related papers  (2020-08-16T22:05:13Z)
• Learning RGB-D Feature Embeddings for Unseen Object Instance Segmentation [67.88276573341734]
  We propose a new method for unseen object instance segmentation by learning RGB-D feature embeddings from synthetic data. A metric learning loss function is utilized to learn to produce pixel-wise feature embeddings. We further improve the segmentation accuracy with a new two-stage clustering algorithm.
  arXiv  Detail & Related papers  (2020-07-30T00:23:07Z)
• A Survey on Instance Segmentation: State of the art [1.8782750537161614]
  Instance segmentation is the technique of simultaneously solving the problem of object detection as well as that of semantic segmentation. The paper provides valuable information for those who want to do research in the field of instance segmentation.
  arXiv  Detail & Related papers  (2020-06-28T14:39:20Z)
• Reinforced Coloring for End-to-End Instance Segmentation [10.73460247817528]
  We propose a novel iterative deep reinforcement learning agent that learns how to differentiate multiple objects in parallel. Our reward function for the trainable agent is designed to favor grouping pixels belonging to the same object using a graph coloring algorithm.
  arXiv  Detail & Related papers  (2020-05-14T15:15:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.