R2D: Learning Shadow Removal to Enhance Fine-Context Shadow Detection
- URL: http://arxiv.org/abs/2109.09609v1
- Date: Mon, 20 Sep 2021 15:09:22 GMT
- Title: R2D: Learning Shadow Removal to Enhance Fine-Context Shadow Detection
- Authors: Jeya Maria Jose Valanarasu, Christina Chen, and Vishal M. Patel
- Abstract summary: Current shadow detection methods perform poorly when detecting shadow regions that are small, unclear or have blurry edges.
We propose a new method called Restore to Detect (R2D), where a deep neural network is trained for restoration (shadow removal)
We show that our proposed method R2D improves the shadow detection performance while being able to detect fine context better compared to the other recent methods.
- Score: 64.10636296274168
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Current shadow detection methods perform poorly when detecting shadow regions
that are small, unclear or have blurry edges. To tackle this problem, we
propose a new method called Restore to Detect (R2D), where we show that when a
deep neural network is trained for restoration (shadow removal), it learns
meaningful features to delineate the shadow masks as well. To make use of this
complementary nature of shadow detection and removal tasks, we train an
auxiliary network for shadow removal and propose a complementary feature
learning block (CFL) to learn and fuse meaningful features from shadow removal
network to the shadow detection network. For the detection network in R2D, we
propose a Fine Context-aware Shadow Detection Network (FCSD-Net) where we
constraint the receptive field size and focus on low-level features to learn
fine context features better. Experimental results on three public shadow
detection datasets (ISTD, SBU and UCF) show that our proposed method R2D
improves the shadow detection performance while being able to detect fine
context better compared to the other recent methods.
Related papers
- Delving into Dark Regions for Robust Shadow Detection [47.60700654394781]
State-of-the-art deep methods tend to have higher error rates in differentiating shadow pixels from non-shadow pixels in dark regions.
We propose a novel shadow detection approach that first learns global contextual cues over the entire image and then zooms into the dark regions to learn local shadow representations.
arXiv Detail & Related papers (2024-02-21T09:07:07Z) - Progressive Recurrent Network for Shadow Removal [99.1928825224358]
Single-image shadow removal is a significant task that is still unresolved.
Most existing deep learning-based approaches attempt to remove the shadow directly, which can not deal with the shadow well.
We propose a simple but effective Progressive Recurrent Network (PRNet) to remove the shadow progressively.
arXiv Detail & Related papers (2023-11-01T11:42:45Z) - SILT: Shadow-aware Iterative Label Tuning for Learning to Detect Shadows
from Noisy Labels [53.30604926018168]
We propose SILT, the Shadow-aware Iterative Label Tuning framework, which explicitly considers noise in shadow labels and trains the deep model in a self-training manner.
We also devise a simple yet effective label tuning strategy with global-local fusion and shadow-aware filtering to encourage the network to make significant refinements on the noisy labels.
Our results show that even a simple U-Net trained with SILT can outperform all state-of-the-art methods by a large margin.
arXiv Detail & Related papers (2023-08-23T11:16:36Z) - Estimating Reflectance Layer from A Single Image: Integrating
Reflectance Guidance and Shadow/Specular Aware Learning [66.36104525390316]
We propose a two-stage learning method, including reflectance guidance and a Shadow/Specular-Aware (S-Aware) network to tackle the problem.
In the first stage, an initial reflectance layer free from shadows and specularities is obtained with the constraint of novel losses.
To further enforce the reflectance layer to be independent of shadows and specularities in the second-stage refinement, we introduce an S-Aware network that distinguishes the reflectance image from the input image.
arXiv Detail & Related papers (2022-11-27T07:26:41Z) - CNSNet: A Cleanness-Navigated-Shadow Network for Shadow Removal [4.951051823391577]
We propose a shadow-oriented adaptive normalization (SOAN) module and a shadow-aware aggregation with transformer (SAAT) module based on the shadow mask.
Under the guidance of the shadow mask, the SOAN module formulates the statistics from the non-shadow region and adaptively applies them to the shadow region for region-wise restoration.
The SAAT module utilizes the shadow mask to precisely guide the restoration of each shadowed pixel by considering the highly relevant pixels from the shadow-free regions for global pixel-wise restoration.
arXiv Detail & Related papers (2022-09-06T01:33:38Z) - DC-ShadowNet: Single-Image Hard and Soft Shadow Removal Using
Unsupervised Domain-Classifier Guided Network [28.6541488555978]
We propose an unsupervised domain-classifier guided shadow removal network, DC-ShadowNet.
We introduce novel losses based on physics-based shadow-free chromaticity, shadow-robust perceptual features, and boundary smoothness.
Our experiments show that all these novel components allow our method to handle soft shadows, and also to perform better on hard shadows.
arXiv Detail & Related papers (2022-07-21T12:04:16Z) - Controllable Shadow Generation Using Pixel Height Maps [58.59256060452418]
Physics-based shadow rendering methods require 3D geometries, which are not always available.
Deep learning-based shadow synthesis methods learn a mapping from the light information to an object's shadow without explicitly modeling the shadow geometry.
We introduce pixel heigh, a novel geometry representation that encodes the correlations between objects, ground, and camera pose.
arXiv Detail & Related papers (2022-07-12T08:29:51Z) - UnShadowNet: Illumination Critic Guided Contrastive Learning For Shadow
Removal [14.898039056038789]
We introduce a novel weakly supervised shadow removal framework UnShadowNet.
It is composed of a DeShadower network responsible for the removal of the extracted shadow under the guidance of an Illumination network.
We show that UnShadowNet can be easily extended to a fully-supervised set-up to exploit the ground-truth when available.
arXiv Detail & Related papers (2022-03-29T11:17:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.