Towards End-to-End Unsupervised Saliency Detection with Self-Supervised
Top-Down Context
- URL: http://arxiv.org/abs/2310.09533v1
- Date: Sat, 14 Oct 2023 08:43:22 GMT
- Title: Towards End-to-End Unsupervised Saliency Detection with Self-Supervised
Top-Down Context
- Authors: Yicheng Song, Shuyong Gao, Haozhe Xing, Yiting Cheng, Yan Wang,
Wenqiang Zhang
- Abstract summary: We propose a self-supervised end-to-end salient object detection framework via top-down context.
We exploit the self-localization from the deepest feature to construct the location maps which are then leveraged to learn the most instructive segmentation guidance.
Our method achieves leading performance among the recent end-to-end methods and most of the multi-stage solutions.
- Score: 25.85453873366275
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Unsupervised salient object detection aims to detect salient objects without
using supervision signals eliminating the tedious task of manually labeling
salient objects. To improve training efficiency, end-to-end methods for USOD
have been proposed as a promising alternative. However, current solutions rely
heavily on noisy handcraft labels and fail to mine rich semantic information
from deep features. In this paper, we propose a self-supervised end-to-end
salient object detection framework via top-down context. Specifically,
motivated by contrastive learning, we exploit the self-localization from the
deepest feature to construct the location maps which are then leveraged to
learn the most instructive segmentation guidance. Further considering the lack
of detailed information in deepest features, we exploit the detail-boosting
refiner module to enrich the location labels with details. Moreover, we observe
that due to lack of supervision, current unsupervised saliency models tend to
detect non-salient objects that are salient in some other samples of
corresponding scenarios. To address this widespread issue, we design a novel
Unsupervised Non-Salient Suppression (UNSS) method developing the ability to
ignore non-salient objects. Extensive experiments on benchmark datasets
demonstrate that our method achieves leading performance among the recent
end-to-end methods and most of the multi-stage solutions. The code is
available.
Related papers
- DINOSTAR: Deep Iterative Neural Object Detector Self-Supervised Training for Roadside LiDAR Applications [1.675857332621569]
This paper develops an end-to-end, scalable, and self-supervised framework for training deep object detectors tailored for roadside point-cloud data.
It is presented that by training the student model over the combined noisy annotations from multitude of teachers, it enhances its capacity to discern background/foreground more effectively.
The evaluations, involving publicly available roadside datasets and state-of-art deep object detectors, demonstrate that the proposed framework achieves comparable performance to deep object detectors trained on human-annotated labels.
arXiv Detail & Related papers (2025-01-28T17:01:42Z) - Seamless Detection: Unifying Salient Object Detection and Camouflaged Object Detection [73.85890512959861]
We propose a task-agnostic framework to unify Salient Object Detection (SOD) and Camouflaged Object Detection (COD)
We design a simple yet effective contextual decoder involving the interval-layer and global context, which achieves an inference speed of 67 fps.
Experiments on public SOD and COD datasets demonstrate the superiority of our proposed framework in both supervised and unsupervised settings.
arXiv Detail & Related papers (2024-12-22T03:25:43Z) - Weakly-supervised Contrastive Learning for Unsupervised Object Discovery [52.696041556640516]
Unsupervised object discovery is promising due to its ability to discover objects in a generic manner.
We design a semantic-guided self-supervised learning model to extract high-level semantic features from images.
We introduce Principal Component Analysis (PCA) to localize object regions.
arXiv Detail & Related papers (2023-07-07T04:03:48Z) - Open-Set Semi-Supervised Object Detection [43.464223594166654]
Recent developments for Semi-Supervised Object Detection (SSOD) have shown the promise of leveraging unlabeled data to improve an object detector.
We consider a more practical yet challenging problem, Open-Set Semi-Supervised Object Detection (OSSOD)
Our proposed framework effectively addresses the semantic expansion issue and shows consistent improvements on many OSSOD benchmarks.
arXiv Detail & Related papers (2022-08-29T17:04:30Z) - Scribble-based Boundary-aware Network for Weakly Supervised Salient
Object Detection in Remote Sensing Images [10.628932392896374]
We propose a novel weakly-supervised salient object detection framework to predict the saliency of remote sensing images from sparse scribble annotations.
Specifically, we design a boundary-aware module (BAM) to explore the object boundary semantics, which is explicitly supervised by the high-confidence object boundary (pseudo) labels.
Then, the boundary semantics are integrated with high-level features to guide the salient object detection under the supervision of scribble labels.
arXiv Detail & Related papers (2022-02-07T20:32:21Z) - Learning to Detect Instance-level Salient Objects Using Complementary
Image Labels [55.049347205603304]
We present the first weakly-supervised approach to the salient instance detection problem.
We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids.
arXiv Detail & Related papers (2021-11-19T10:15:22Z) - Discovery-and-Selection: Towards Optimal Multiple Instance Learning for
Weakly Supervised Object Detection [86.86602297364826]
We propose a discoveryand-selection approach fused with multiple instance learning (DS-MIL)
Our proposed DS-MIL approach can consistently improve the baselines, reporting state-of-the-art performance.
arXiv Detail & Related papers (2021-10-18T07:06:57Z) - Unsupervised Object Detection with LiDAR Clues [70.73881791310495]
We present the first practical method for unsupervised object detection with the aid of LiDAR clues.
In our approach, candidate object segments based on 3D point clouds are firstly generated.
Then, an iterative segment labeling process is conducted to assign segment labels and to train a segment labeling network.
The labeling process is carefully designed so as to mitigate the issue of long-tailed and open-ended distribution.
arXiv Detail & Related papers (2020-11-25T18:59:54Z) - Instance-aware, Context-focused, and Memory-efficient Weakly Supervised
Object Detection [184.563345153682]
We develop an instance-aware and context-focused unified framework for weakly supervised learning.
It employs an instance-aware self-training algorithm and a learnable Concrete DropBlock while devising a memory-efficient sequential batch back-propagation.
Our proposed method state-of-the-art results on COCO ($12.1% AP$, $24.8% AP_50$), VOC 2007 ($54.9% AP$), and VOC 2012 ($52.1% AP$)
arXiv Detail & Related papers (2020-04-09T17:57:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.