FastInstShadow: A Simple Query-Based Model for Instance Shadow Detection

• URL: http://arxiv.org/abs/2503.07517v1
• Date: Mon, 10 Mar 2025 16:39:01 GMT
• Title: FastInstShadow: A Simple Query-Based Model for Instance Shadow Detection
• Authors: Takeru Inoue, Ryusuke Miyamoto,
• Abstract summary: This paper introduces FastInstShadow, a method that enhances detection accuracy through a query-based architecture.<n> Experimental results using the SOBA dataset showed that the proposed method outperforms all existing methods across all criteria.
• Score: 1.651302646429312
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Instance shadow detection is the task of detecting pairs of shadows and objects, where existing methods first detect shadows and objects independently, then associate them. This paper introduces FastInstShadow, a method that enhances detection accuracy through a query-based architecture featuring an association transformer decoder with two dual-path transformer decoders to assess relationships between shadows and objects during detection. Experimental results using the SOBA dataset showed that the proposed method outperforms all existing methods across all criteria. This method makes real-time processing feasible for moderate-resolution images with better accuracy than SSISv2, the most accurate existing method. Our code is available at https://github.com/wlotkr/FastInstShadow.

Related papers

• SwinShadow: Shifted Window for Ambiguous Adjacent Shadow Detection [90.4751446041017]
  We present SwinShadow, a transformer-based architecture that fully utilizes the powerful shifted window mechanism for detecting adjacent shadows. The whole process can be divided into three parts: encoder, decoder, and feature integration. Experiments on three shadow detection benchmark datasets, SBU, UCF, and ISTD, demonstrate that our network achieves good performance in terms of balance error rate (BER)
  arXiv  Detail & Related papers  (2024-08-07T03:16:33Z)
• Linear Object Detection in Document Images using Multiple Object Tracking [58.720142291102135]
  Linear objects convey substantial information about document structure. Many approaches can recover some vector representation, but only one closed-source technique introduced in 1994. We propose a framework for accurate instance segmentation of linear objects in document images using Multiple Object Tracking.
  arXiv  Detail & Related papers  (2023-05-26T14:22:03Z)
• Detect Any Shadow: Segment Anything for Video Shadow Detection [105.19693622157462]
  We propose ShadowSAM, a framework for fine-tuning segment anything model (SAM) to detect shadows. By combining it with long short-term attention mechanism, we extend its capability for efficient video shadow detection. Our method exhibits accelerated inference speed compared to previous video shadow detection approaches.
  arXiv  Detail & Related papers  (2023-05-26T07:39:10Z)
• Learning to Detect Good Keypoints to Match Non-Rigid Objects in RGB Images [7.428474910083337]
  We present a novel learned keypoint detection method designed to maximize the number of correct matches for the task of non-rigid image correspondence. Our training framework uses true correspondences, obtained by matching annotated image pairs with a predefined descriptor extractor, as a ground-truth to train a convolutional neural network (CNN) Experiments show that our method outperforms the state-of-the-art keypoint detector on real images of non-rigid objects by 20 p.p. on Mean Matching Accuracy.
  arXiv  Detail & Related papers  (2022-12-13T11:59:09Z)
• Instance Shadow Detection with A Single-Stage Detector [126.73011063999695]
  We first compile a new dataset with the masks for shadow instances, object instances, and shadow-object associations. We then design an evaluation metric for quantitative evaluation of the performance of instance shadow detection. We quantitatively and qualitatively evaluate our method on the benchmark dataset of instance shadow detection and show the applicability of our method on light direction estimation and photo editing.
  arXiv  Detail & Related papers  (2022-07-11T04:15:42Z)
• R2D: Learning Shadow Removal to Enhance Fine-Context Shadow Detection [64.10636296274168]
  Current shadow detection methods perform poorly when detecting shadow regions that are small, unclear or have blurry edges. We propose a new method called Restore to Detect (R2D), where a deep neural network is trained for restoration (shadow removal) We show that our proposed method R2D improves the shadow detection performance while being able to detect fine context better compared to the other recent methods.
  arXiv  Detail & Related papers  (2021-09-20T15:09:22Z)
• SAR image matching algorithm based on multi-class features [0.27624021966289597]
  Synthetic aperture radar has the ability to work 24/7 and 24/7, and has high application value. Propose a new SAR image matching algorithm based on multi class features, mainly using two different types of features: straight lines and regions to enhance the robustness of the matching algorithm. The experimental results have verified that this algorithm can obtain high-precision matching results, achieve precise target positioning, and has good robustness to changes in perspective and lighting.
  arXiv  Detail & Related papers  (2021-08-13T01:07:51Z)
• Temporal Feature Warping for Video Shadow Detection [30.82493923485278]
  We propose a simple but powerful method to better aggregate information temporally. We use an optical flow based warping module to align and then combine features between frames. We apply this warping module across multiple deep-network layers to retrieve information from neighboring frames including both local details and high-level semantic information.
  arXiv  Detail & Related papers  (2021-07-29T19:12:50Z)
• QuickBrowser: A Unified Model to Detect and Read Simple Object in Real-time [3.098115480186737]
  This work aims to solve this detect-and-read problem in a lightweight way by integrating multi-digit recognition into a one-stage object detection model. Our choice of backbones and modifications in architecture, loss function, data augmentation and training make the method robust, efficient and speedy.
  arXiv  Detail & Related papers  (2021-02-15T05:47:40Z)
• Frustratingly Simple Few-Shot Object Detection [98.42824677627581]
  We find that fine-tuning only the last layer of existing detectors on rare classes is crucial to the few-shot object detection task. Such a simple approach outperforms the meta-learning methods by roughly 220 points on current benchmarks.
  arXiv  Detail & Related papers  (2020-03-16T00:29:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.