Depth-Guided Camouflaged Object Detection

• URL: http://arxiv.org/abs/2106.13217v2
• Date: Sat, 26 Jun 2021 03:38:01 GMT
• Title: Depth-Guided Camouflaged Object Detection
• Authors: Jing Zhang, Yunqiu Lv, Mochu Xiang, Aixuan Li, Yuchao Dai, Yiran Zhong
• Abstract summary: Research in biology suggests that depth can provide useful object localization cues for camouflaged object discovery. depth information has not been exploited for camouflaged object detection. We present a depth-guided camouflaged object detection network with pre-computed depth maps from existing monocular depth estimation methods.
• Score: 31.99397550848777
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Camouflaged object detection (COD) aims to segment camouflaged objects hiding in the environment, which is challenging due to the similar appearance of camouflaged objects and their surroundings. Research in biology suggests that depth can provide useful object localization cues for camouflaged object discovery, as all the animals have 3D perception ability. However, the depth information has not been exploited for camouflaged object detection. To explore the contribution of depth for camouflage detection, we present a depth-guided camouflaged object detection network with pre-computed depth maps from existing monocular depth estimation methods. Due to the domain gap between the depth estimation dataset and our camouflaged object detection dataset, the generated depth may not be accurate enough to be directly used in our framework. We then introduce a depth quality assessment module to evaluate the quality of depth based on the model prediction from both RGB COD branch and RGB-D COD branch. During training, only high-quality depth is used to update the modal interaction module for multi-modal learning. During testing, our depth quality assessment module can effectively determine the contribution of depth and select the RGB branch or RGB-D branch for camouflage prediction. Extensive experiments on various camouflaged object detection datasets prove the effectiveness of our solution in exploring the depth information for camouflaged object detection. Our code and data is publicly available at: \url{https://github.com/JingZhang617/RGBD-COD}.

Related papers

• OPEN: Object-wise Position Embedding for Multi-view 3D Object Detection [102.0744303467713]
  We propose a new multi-view 3D object detector named OPEN. Our main idea is to effectively inject object-wise depth information into the network through our proposed object-wise position embedding. OPEN achieves a new state-of-the-art performance with 64.4% NDS and 56.7% mAP on the nuScenes test benchmark.
  arXiv  Detail & Related papers  (2024-07-15T14:29:15Z)
• Depth Awakens: A Depth-perceptual Attention Fusion Network for RGB-D Camouflaged Object Detection [1.0535324143528204]
  Most existing COD models overlook the fact that visual systems operate within a genuine 3D environment. We propose a novel depth-perception attention fusion network that leverages the depth map as an auxiliary input. The network uses a trident-branch encoder to extract chromatic and depth information and their communications.
  arXiv  Detail & Related papers  (2024-05-09T08:17:43Z)
• Camouflaged Image Synthesis Is All You Need to Boost Camouflaged Detection [65.8867003376637]
  We propose a framework for synthesizing camouflage data to enhance the detection of camouflaged objects in natural scenes. Our approach employs a generative model to produce realistic camouflage images, which can be used to train existing object detection models. Our framework outperforms the current state-of-the-art method on three datasets.
  arXiv  Detail & Related papers  (2023-08-13T06:55:05Z)
• Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision [13.593246617391266]
  We propose a method to boost the RGB image-based 3D detector by jointly training the detection network with a depth prediction loss analogous to the depth estimation task. Our novel object-centric depth prediction loss focuses on depth around foreground objects, which is important for 3D object detection. Our depth regression model is further trained to predict the uncertainty of depth to represent the 3D confidence of objects.
  arXiv  Detail & Related papers  (2022-10-29T11:32:28Z)
• Towards Deeper Understanding of Camouflaged Object Detection [64.81987999832032]
  We argue that the binary segmentation setting fails to fully understand the concept of camouflage. We present the first triple-task learning framework to simultaneously localize, segment and rank camouflaged objects.
  arXiv  Detail & Related papers  (2022-05-23T14:26:18Z)
• Does depth estimation help object detection? [16.904673709059622]
  Many factors affect the performance of object detection when estimated depth is used. We propose an early concatenation strategy of depth, which yields higher mAP than previous works' while using significantly fewer parameters.
  arXiv  Detail & Related papers  (2022-04-13T17:03:25Z)
• Joint Learning of Salient Object Detection, Depth Estimation and Contour Extraction [91.43066633305662]
  We propose a novel multi-task and multi-modal filtered transformer (MMFT) network for RGB-D salient object detection (SOD) Specifically, we unify three complementary tasks: depth estimation, salient object detection and contour estimation. The multi-task mechanism promotes the model to learn the task-aware features from the auxiliary tasks. Experiments show that it not only significantly surpasses the depth-based RGB-D SOD methods on multiple datasets, but also precisely predicts a high-quality depth map and salient contour at the same time.
  arXiv  Detail & Related papers  (2022-03-09T17:20:18Z)
• RGB-D Salient Object Detection with Ubiquitous Target Awareness [37.6726410843724]
  We make the first attempt to solve the RGB-D salient object detection problem with a novel depth-awareness framework. We propose a Ubiquitous Target Awareness (UTA) network to solve three important challenges in RGB-D SOD task. Our proposed UTA network is depth-free for inference and runs in real-time with 43 FPS.
  arXiv  Detail & Related papers  (2021-09-08T04:27:29Z)
• Simultaneously Localize, Segment and Rank the Camouflaged Objects [55.46101599577343]
  Camouflaged object detection aims to segment camouflaged objects hiding in their surroundings. We argue that explicitly modeling the conspicuousness of camouflaged objects against their particular backgrounds can lead to a better understanding about camouflage and evolution of animals. We present the first ranking based COD network (Rank-Net) to simultaneously localize, segment and rank camouflaged objects.
  arXiv  Detail & Related papers  (2021-03-06T02:53:36Z)
• Deep Texture-Aware Features for Camouflaged Object Detection [69.84122372541506]
  This paper formulates texture-aware refinement modules to learn the texture-aware features in a deep convolutional neural network. We evaluate our network on the benchmark dataset for camouflaged object detection both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2021-02-05T04:38:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.