Simultaneously Localize, Segment and Rank the Camouflaged Objects
- URL: http://arxiv.org/abs/2103.04011v1
- Date: Sat, 6 Mar 2021 02:53:36 GMT
- Title: Simultaneously Localize, Segment and Rank the Camouflaged Objects
- Authors: Yunqiu Lyu and Jing Zhang and Yuchao Dai and Aixuan Li and Bowen Liu
and Nick Barnes and Deng-Ping Fan
- Abstract summary: Camouflaged object detection aims to segment camouflaged objects hiding in their surroundings.
We argue that explicitly modeling the conspicuousness of camouflaged objects against their particular backgrounds can lead to a better understanding about camouflage and evolution of animals.
We present the first ranking based COD network (Rank-Net) to simultaneously localize, segment and rank camouflaged objects.
- Score: 55.46101599577343
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Camouflage is a key defence mechanism across species that is critical to
survival. Common strategies for camouflage include background matching,
imitating the color and pattern of the environment, and disruptive coloration,
disguising body outlines [35]. Camouflaged object detection (COD) aims to
segment camouflaged objects hiding in their surroundings. Existing COD models
are built upon binary ground truth to segment the camouflaged objects without
illustrating the level of camouflage. In this paper, we revisit this task and
argue that explicitly modeling the conspicuousness of camouflaged objects
against their particular backgrounds can not only lead to a better
understanding about camouflage and evolution of animals, but also provide
guidance to design more sophisticated camouflage techniques. Furthermore, we
observe that it is some specific parts of the camouflaged objects that make
them detectable by predators. With the above understanding about camouflaged
objects, we present the first ranking based COD network (Rank-Net) to
simultaneously localize, segment and rank camouflaged objects. The localization
model is proposed to find the discriminative regions that make the camouflaged
object obvious. The segmentation model segments the full scope of the
camouflaged objects. And, the ranking model infers the detectability of
different camouflaged objects. Moreover, we contribute a large COD testing set
to evaluate the generalization ability of COD models. Experimental results show
that our model achieves new state-of-the-art, leading to a more interpretable
COD network.
Related papers
- The Making and Breaking of Camouflage [95.37449361842656]
We show that camouflage can be measured by the similarity between background and foreground features and boundary visibility.
We incorporate the proposed camouflage score into a generative model as an auxiliary loss and show that effective camouflage images or videos can be synthesised in a scalable manner.
arXiv Detail & Related papers (2023-09-07T17:58:05Z) - Camouflaged Image Synthesis Is All You Need to Boost Camouflaged
Detection [65.8867003376637]
We propose a framework for synthesizing camouflage data to enhance the detection of camouflaged objects in natural scenes.
Our approach employs a generative model to produce realistic camouflage images, which can be used to train existing object detection models.
Our framework outperforms the current state-of-the-art method on three datasets.
arXiv Detail & Related papers (2023-08-13T06:55:05Z) - Strategic Preys Make Acute Predators: Enhancing Camouflaged Object
Detectors by Generating Camouflaged Objects [107.47530456103758]
Camouflaged object detection (COD) is the challenging task of identifying camouflaged objects visually blended into surroundings.
We draw inspiration from the prey-vs-predator game that leads preys to develop better camouflage and predators to acquire more acute vision systems.
We introduce a novel COD method, called Internal Coherence and Edge Guidance (ICEG), which introduces a camouflaged feature coherence module.
arXiv Detail & Related papers (2023-08-06T17:27:08Z) - The Art of Camouflage: Few-Shot Learning for Animal Detection and Segmentation [21.047026366450197]
We address the problem of few-shot learning for camouflaged object detection and segmentation.
We propose FS-CDIS, a framework to efficiently detect and segment camouflaged instances.
Our proposed method achieves state-of-the-art performance on the newly collected dataset.
arXiv Detail & Related papers (2023-04-15T01:33:14Z) - CamoFormer: Masked Separable Attention for Camouflaged Object Detection [94.2870722866853]
We present a simple masked separable attention (MSA) for camouflaged object detection.
We first separate the multi-head self-attention into three parts, which are responsible for distinguishing the camouflaged objects from the background using different mask strategies.
We propose to capture high-resolution semantic representations progressively based on a simple top-down decoder with the proposed MSA to attain precise segmentation results.
arXiv Detail & Related papers (2022-12-10T10:03:27Z) - Towards Deeper Understanding of Camouflaged Object Detection [64.81987999832032]
We argue that the binary segmentation setting fails to fully understand the concept of camouflage.
We present the first triple-task learning framework to simultaneously localize, segment and rank camouflaged objects.
arXiv Detail & Related papers (2022-05-23T14:26:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.