Learning to Detect Instance-level Salient Objects Using Complementary
Image Labels
- URL: http://arxiv.org/abs/2111.10137v1
- Date: Fri, 19 Nov 2021 10:15:22 GMT
- Title: Learning to Detect Instance-level Salient Objects Using Complementary
Image Labels
- Authors: Xin Tian, Ke Xu, Xin Yang, Baocai Yin, Rynson W.H. Lau,
- Abstract summary: We present the first weakly-supervised approach to the salient instance detection problem.
We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids.
- Score: 55.049347205603304
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Existing salient instance detection (SID) methods typically learn from
pixel-level annotated datasets. In this paper, we present the first
weakly-supervised approach to the SID problem. Although weak supervision has
been considered in general saliency detection, it is mainly based on using
class labels for object localization. However, it is non-trivial to use only
class labels to learn instance-aware saliency information, as salient instances
with high semantic affinities may not be easily separated by the labels. As the
subitizing information provides an instant judgement on the number of salient
items, it is naturally related to detecting salient instances and may help
separate instances of the same class while grouping different parts of the same
instance. Inspired by this observation, we propose to use class and subitizing
labels as weak supervision for the SID problem. We propose a novel
weakly-supervised network with three branches: a Saliency Detection Branch
leveraging class consistency information to locate candidate objects; a
Boundary Detection Branch exploiting class discrepancy information to delineate
object boundaries; and a Centroid Detection Branch using subitizing information
to detect salient instance centroids. This complementary information is then
fused to produce a salient instance map. To facilitate the learning process, we
further propose a progressive training scheme to reduce label noise and the
corresponding noise learned by the model, via reciprocating the model with
progressive salient instance prediction and model refreshing. Our extensive
evaluations show that the proposed method plays favorably against carefully
designed baseline methods adapted from related tasks.
Related papers
- Weakly Supervised 3D Instance Segmentation without Instance-level
Annotations [57.615325809883636]
3D semantic scene understanding tasks have achieved great success with the emergence of deep learning, but often require a huge amount of manually annotated training data.
We propose the first weakly-supervised 3D instance segmentation method that only requires categorical semantic labels as supervision.
By generating pseudo instance labels from categorical semantic labels, our designed approach can also assist existing methods for learning 3D instance segmentation at reduced annotation cost.
arXiv Detail & Related papers (2023-08-03T12:30:52Z) - SIM: Semantic-aware Instance Mask Generation for Box-Supervised Instance
Segmentation [22.930296667684125]
We propose a new box-supervised instance segmentation approach by developing a Semantic-aware Instance Mask (SIM) generation paradigm.
Considering that the semantic-aware prototypes cannot distinguish different instances of the same semantics, we propose a self-correction mechanism.
Extensive experimental results demonstrate the superiority of our proposed SIM approach over other state-of-the-art methods.
arXiv Detail & Related papers (2023-03-14T05:59:25Z) - Collaborative Propagation on Multiple Instance Graphs for 3D Instance
Segmentation with Single-point Supervision [63.429704654271475]
We propose a novel weakly supervised method RWSeg that only requires labeling one object with one point.
With these sparse weak labels, we introduce a unified framework with two branches to propagate semantic and instance information.
Specifically, we propose a Cross-graph Competing Random Walks (CRW) algorithm that encourages competition among different instance graphs.
arXiv Detail & Related papers (2022-08-10T02:14:39Z) - Weakly-supervised Salient Instance Detection [65.0408760733005]
We present the first weakly-supervised approach to the salient instance detection problem.
We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids.
arXiv Detail & Related papers (2020-09-29T09:47:23Z) - UniT: Unified Knowledge Transfer for Any-shot Object Detection and
Segmentation [52.487469544343305]
Methods for object detection and segmentation rely on large scale instance-level annotations for training.
We propose an intuitive and unified semi-supervised model that is applicable to a range of supervision.
arXiv Detail & Related papers (2020-06-12T22:45:47Z) - Weakly-Supervised Salient Object Detection via Scribble Annotations [54.40518383782725]
We propose a weakly-supervised salient object detection model to learn saliency from scribble labels.
We present a new metric, termed saliency structure measure, to measure the structure alignment of the predicted saliency maps.
Our method not only outperforms existing weakly-supervised/unsupervised methods, but also is on par with several fully-supervised state-of-the-art models.
arXiv Detail & Related papers (2020-03-17T12:59:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.