Instance Segmentation of Dense and Overlapping Objects via Layering
- URL: http://arxiv.org/abs/2210.03551v1
- Date: Fri, 7 Oct 2022 13:37:56 GMT
- Title: Instance Segmentation of Dense and Overlapping Objects via Layering
- Authors: Long Chen and Yuli Wu and Dorit Merhof
- Abstract summary: We propose a novel approach to solve the problem via object layering.
By grouping spatially separated objects in the same layer, instances can be effortlessly isolated.
With minimal post-processing, our method yields very competitive results on a diverse line of datasets.
- Score: 8.870513218826083
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Instance segmentation aims to delineate each individual object of interest in
an image. State-of-the-art approaches achieve this goal by either partitioning
semantic segmentations or refining coarse representations of detected objects.
In this work, we propose a novel approach to solve the problem via object
layering, i.e. by distributing crowded, even overlapping objects into different
layers. By grouping spatially separated objects in the same layer, instances
can be effortlessly isolated by extracting connected components in each layer.
In comparison to previous methods, our approach is not affected by complex
object shapes or object overlaps. With minimal post-processing, our method
yields very competitive results on a diverse line of datasets: C. elegans
(BBBC), Overlapping Cervical Cells (OCC) and cultured neuroblastoma cells
(CCDB). The source code is publicly available.
Related papers
- De-coupling and De-positioning Dense Self-supervised Learning [65.56679416475943]
Dense Self-Supervised Learning (SSL) methods address the limitations of using image-level feature representations when handling images with multiple objects.
We show that they suffer from coupling and positional bias, which arise from the receptive field increasing with layer depth and zero-padding.
We demonstrate the benefits of our method on COCO and on a new challenging benchmark, OpenImage-MINI, for object classification, semantic segmentation, and object detection.
arXiv Detail & Related papers (2023-03-29T18:07:25Z) - Image Segmentation-based Unsupervised Multiple Objects Discovery [1.7674345486888503]
Unsupervised object discovery aims to localize objects in images.
We propose a fully unsupervised, bottom-up approach, for multiple objects discovery.
We provide state-of-the-art results for both unsupervised class-agnostic object detection and unsupervised image segmentation.
arXiv Detail & Related papers (2022-12-20T09:48:24Z) - Occlusion-Aware Instance Segmentation via BiLayer Network Architectures [73.45922226843435]
We propose Bilayer Convolutional Network (BCNet), where the top layer detects occluding objects (occluders) and the bottom layer infers partially occluded instances (occludees)
We investigate the efficacy of bilayer structure using two popular convolutional network designs, namely, Fully Convolutional Network (FCN) and Graph Convolutional Network (GCN)
arXiv Detail & Related papers (2022-08-08T21:39:26Z) - Discovering Objects that Can Move [55.743225595012966]
We study the problem of object discovery -- separating objects from the background without manual labels.
Existing approaches utilize appearance cues, such as color, texture, and location, to group pixels into object-like regions.
We choose to focus on dynamic objects -- entities that can move independently in the world.
arXiv Detail & Related papers (2022-03-18T21:13:56Z) - SOLO: A Simple Framework for Instance Segmentation [84.00519148562606]
"instance categories" assigns categories to each pixel within an instance according to the instance's location.
"SOLO" is a simple, direct, and fast framework for instance segmentation with strong performance.
Our approach achieves state-of-the-art results for instance segmentation in terms of both speed and accuracy.
arXiv Detail & Related papers (2021-06-30T09:56:54Z) - Object-Guided Instance Segmentation With Auxiliary Feature Refinement
for Biological Images [58.914034295184685]
Instance segmentation is of great importance for many biological applications, such as study of neural cell interactions, plant phenotyping, and quantitatively measuring how cells react to drug treatment.
Box-based instance segmentation methods capture objects via bounding boxes and then perform individual segmentation within each bounding box region.
Our method first detects the center points of the objects, from which the bounding box parameters are then predicted.
The segmentation branch reuses the object features as guidance to separate target object from the neighboring ones within the same bounding box region.
arXiv Detail & Related papers (2021-06-14T04:35:36Z) - Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers [72.38919601150175]
We propose Bilayer Convolutional Network (BCNet) to segment highly-overlapping objects.
BCNet detects the occluding objects (occluder) and the bottom GCN layer infers partially occluded instance (occludee)
arXiv Detail & Related papers (2021-03-23T06:25:42Z) - Robust Instance Segmentation through Reasoning about Multi-Object
Occlusion [9.536947328412198]
We propose a deep network for multi-object instance segmentation that is robust to occlusion.
Our work builds on Compositional Networks, which learn a generative model of neural feature activations to locate occluders.
In particular, we obtain feed-forward predictions of the object classes and their instance and occluder segmentations.
arXiv Detail & Related papers (2020-12-03T17:41:55Z) - Reinforced Coloring for End-to-End Instance Segmentation [10.73460247817528]
We propose a novel iterative deep reinforcement learning agent that learns how to differentiate multiple objects in parallel.
Our reward function for the trainable agent is designed to favor grouping pixels belonging to the same object using a graph coloring algorithm.
arXiv Detail & Related papers (2020-05-14T15:15:47Z) - Instance Segmentation of Biomedical Images with an Object-aware
Embedding Learned with Local Constraints [7.151685185368064]
State-of-the-art approaches either perform semantic segmentation or refine object bounding boxes.
Both suffer from crowded objects to varying degrees, merging adjacent objects or suppressing a valid object.
In this work, we assign an embedding vector to each pixel through a deep neural network.
arXiv Detail & Related papers (2020-04-21T08:33:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.