SARU: A Shadow-Aware and Removal Unified Framework for Remote Sensing Images with New Benchmarks

• URL: http://arxiv.org/abs/2604.25432v1
• Date: Tue, 28 Apr 2026 09:38:02 GMT
• Title: SARU: A Shadow-Aware and Removal Unified Framework for Remote Sensing Images with New Benchmarks
• Abstract summary: Shadows are a prevalent problem in remote sensing imagery (RSI)<n>Most prior works treat shadow detection and removal as separate, cascaded tasks.<n>We propose Shadow-Aware and Removal Unified (SARU) Framework.
• Score: 13.514199503432467
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Shadows are a prevalent problem in remote sensing imagery (RSI), degrading visual quality and severely limiting the performance of downstream tasks like object detection and semantic segmentation. Most prior works treat shadow detection and removal as separate, cascaded tasks, which can lead to cumbersome process and error accumulation. Furthermore, many deep learning methods rely on paired shadow and non-shadow images for training, which are often unavailable in practice. To address these challenges, we propose Shadow-Aware and Removal Unified (SARU) Framework , a cohesive two-stage framework. First, its dual-branch detection module (DBCSF-Net) fuses multi-color space and semantic features to generate high-fidelity shadow masks, effectively distinguishing shadows from dark objects. Then, leveraging these masks, a novel, training-free physical algorithm (N$^2$SGSR) restores illumination by transferring properties from adjacent non-shadow regions within the single input image. To facilitate rigorous evaluation and foster future work, we also introduce two new benchmark datasets: the RSI Shadow Detection (RSISD) dataset and the Single-image Shadow Removal Benchmark (SiSRB). Extensive experiments demonstrate that SARU achieves state-of-the-art performance on both the public AISD dataset and our newly introduced benchmarks. By holistically integrating shadow detection and removal to mitigate error propagation and eliminating the dependency on paired training data, SARU establishes a robust, practical framework for real-world RSI analysis. The source code and datasets are publicly available at: https://github.com/AeroVILab-AHU/SARU-Framework.

Related papers

• deSEO: Physics-Aware Dataset Creation for High-Resolution Satellite Image Shadow Removal [36.90985364531957]
  Shadows cast by terrain and tall structures remain a major obstacle for high-resolution satellite image analysis.<n>Most Earth-observation datasets are designed for shadow detection or 3D modelling rather than removal.<n>We develop a geometry-aware and physics-informed methodology that is the first to derive paired supervision for satellite shadow removal.
  arXiv  Detail & Related papers  (2026-05-05T10:35:59Z)
• Soft-Hard Attention U-Net Model and Benchmark Dataset for Multiscale Image Shadow Removal [2.999888908665659]
  This study proposes a novel deep learning architecture, named Soft-Hard Attention U-net (SHAU), focusing on multiscale shadow removal. It provides a novel synthetic dataset, named Multiscale Shadow Removal dataset (MSRD), containing complex shadow patterns of multiple scales. The results demonstrate the effectiveness of SHAU over the relevant state-of-the-art shadow removal methods across various benchmark datasets.
  arXiv  Detail & Related papers  (2024-08-07T12:42:06Z)
• SwinShadow: Shifted Window for Ambiguous Adjacent Shadow Detection [90.4751446041017]
  We present SwinShadow, a transformer-based architecture that fully utilizes the powerful shifted window mechanism for detecting adjacent shadows. The whole process can be divided into three parts: encoder, decoder, and feature integration. Experiments on three shadow detection benchmark datasets, SBU, UCF, and ISTD, demonstrate that our network achieves good performance in terms of balance error rate (BER)
  arXiv  Detail & Related papers  (2024-08-07T03:16:33Z)
• Cross-Modal Spherical Aggregation for Weakly Supervised Remote Sensing Shadow Removal [22.4845448174729]
  We propose a weakly supervised shadow removal network with a spherical feature space, dubbed S2-ShadowNet, to explore the best of both worlds for visible and infrared modalities. Specifically, we employ a modal translation (visible-to-infrared) model to learn the cross-domain mapping, thus generating realistic infrared samples. We contribute a large-scale weakly supervised shadow removal benchmark, including 4000 shadow images with corresponding shadow masks.
  arXiv  Detail & Related papers  (2024-06-25T11:14:09Z)
• Progressive Recurrent Network for Shadow Removal [99.1928825224358]
  Single-image shadow removal is a significant task that is still unresolved. Most existing deep learning-based approaches attempt to remove the shadow directly, which can not deal with the shadow well. We propose a simple but effective Progressive Recurrent Network (PRNet) to remove the shadow progressively.
  arXiv  Detail & Related papers  (2023-11-01T11:42:45Z)
• SILT: Shadow-aware Iterative Label Tuning for Learning to Detect Shadows from Noisy Labels [53.30604926018168]
  We propose SILT, the Shadow-aware Iterative Label Tuning framework, which explicitly considers noise in shadow labels and trains the deep model in a self-training manner. We also devise a simple yet effective label tuning strategy with global-local fusion and shadow-aware filtering to encourage the network to make significant refinements on the noisy labels. Our results show that even a simple U-Net trained with SILT can outperform all state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2023-08-23T11:16:36Z)
• Detect Any Shadow: Segment Anything for Video Shadow Detection [105.19693622157462]
  We propose ShadowSAM, a framework for fine-tuning segment anything model (SAM) to detect shadows. By combining it with long short-term attention mechanism, we extend its capability for efficient video shadow detection. Our method exhibits accelerated inference speed compared to previous video shadow detection approaches.
  arXiv  Detail & Related papers  (2023-05-26T07:39:10Z)
• Learning Restoration is Not Enough: Transfering Identical Mapping for Single-Image Shadow Removal [19.391619888009064]
  State-of-the-art shadow removal methods train deep neural networks on collected shadow & shadow-free image pairs. We find that two tasks exhibit poor compatibility, and using shared weights for these two tasks could lead to the model being optimized towards only one task. We propose to handle these two tasks separately and leverage the identical mapping results to guide the shadow restoration in an iterative manner.
  arXiv  Detail & Related papers  (2023-05-18T01:36:23Z)
• Video Instance Shadow Detection Under the Sun and Sky [81.95848151121739]
  ViShadow is a semi-supervised video instance shadow detection framework. It identifies shadow and object instances through contrastive learning for cross-frame pairing. A retrieval mechanism is introduced to manage temporary disappearances.
  arXiv  Detail & Related papers  (2022-11-23T10:20:19Z)
• R2D: Learning Shadow Removal to Enhance Fine-Context Shadow Detection [64.10636296274168]
  Current shadow detection methods perform poorly when detecting shadow regions that are small, unclear or have blurry edges. We propose a new method called Restore to Detect (R2D), where a deep neural network is trained for restoration (shadow removal) We show that our proposed method R2D improves the shadow detection performance while being able to detect fine context better compared to the other recent methods.
  arXiv  Detail & Related papers  (2021-09-20T15:09:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.