Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priors

• URL: http://arxiv.org/abs/2103.11298v1
• Date: Sun, 21 Mar 2021 03:30:30 GMT
• Title: Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priors
• Authors: Kaihao Zhang, Rongqing Li, Yanjiang Yu, Wenhan Luo, Changsheng Li, Hongdong Li
• Abstract summary: We propose a Deep Dense Multi-Scale Network (textbfDDMSNet) for snow removal by exploiting semantic and geometric priors. We incorporate the semantic and geometric maps as input and learn the semantic-aware and geometry-aware representation to remove snow.
• Score: 78.61844008368587
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Images captured in snowy days suffer from noticeable degradation of scene visibility, which degenerates the performance of current vision-based intelligent systems. Removing snow from images thus is an important topic in computer vision. In this paper, we propose a Deep Dense Multi-Scale Network (\textbf{DDMSNet}) for snow removal by exploiting semantic and geometric priors. As images captured in outdoor often share similar scenes and their visibility varies with depth from camera, such semantic and geometric information provides a strong prior for snowy image restoration. We incorporate the semantic and geometric maps as input and learn the semantic-aware and geometry-aware representation to remove snow. In particular, we first create a coarse network to remove snow from the input images. Then, the coarsely desnowed images are fed into another network to obtain the semantic and geometric labels. Finally, we design a DDMSNet to learn semantic-aware and geometry-aware representation via a self-attention mechanism to produce the final clean images. Experiments evaluated on public synthetic and real-world snowy images verify the superiority of the proposed method, offering better results both quantitatively and qualitatively.

Related papers

• SCANet: Self-Paced Semi-Curricular Attention Network for Non-Homogeneous Image Dehazing [56.900964135228435]
  Existing homogeneous dehazing methods struggle to handle the non-uniform distribution of haze in a robust manner. We propose a novel self-paced semi-curricular attention network, called SCANet, for non-homogeneous image dehazing. Our approach consists of an attention generator network and a scene reconstruction network.
  arXiv  Detail & Related papers  (2023-04-17T17:05:29Z)
• Star-Net: Improving Single Image Desnowing Model With More Efficient Connection and Diverse Feature Interaction [0.8602553195689513]
  We propose a novel single image desnowing network called Star-Net. First, we design a Star type Skip Connection (SSC) to establish information channels for all different scale features. Second, we present a Multi-Stage Interactive Transformer (MIT) as the base module of Star-Net. Third, we propose a Degenerate Filter Module (DFM) to filter the snow particle and snow fog residual in the SSC.
  arXiv  Detail & Related papers  (2023-03-17T14:03:49Z)
• Shap-CAM: Visual Explanations for Convolutional Neural Networks based on Shapley Value [86.69600830581912]
  We develop a novel visual explanation method called Shap-CAM based on class activation mapping. We demonstrate that Shap-CAM achieves better visual performance and fairness for interpreting the decision making process.
  arXiv  Detail & Related papers  (2022-08-07T00:59:23Z)
• Towards Real-time High-Definition Image Snow Removal: Efficient Pyramid Network with Asymmetrical Encoder-decoder Architecture [6.682410871522934]
  We develop a novel Efficient Pyramid Network with asymmetrical encoder-decoder architecture for real-time HD image desnowing. Our approach achieves a better complexity-performance trade-off and effectively handles the processing difficulties of HD and Ultra-HD images.
  arXiv  Detail & Related papers  (2022-07-12T15:18:41Z)
• Snow Mask Guided Adaptive Residual Network for Image Snow Removal [21.228758052455273]
  Snow is an extremely common atmospheric phenomenon that will seriously affect the performance of high-level computer vision tasks. We propose a Snow Mask Guided Adaptive Residual Network (SMGARN) It consists of three parts, Mask-Net, Guidance-Fusion Network (GF-Net), and Reconstruct-Net. Our SMGARN numerically outperforms all existing snow removal methods, and the reconstructed images are clearer in visual contrast.
  arXiv  Detail & Related papers  (2022-07-11T10:30:46Z)
• Monocular Human Digitization via Implicit Re-projection Networks [5.545779293487839]
  We present an approach to generating 3D human models from images. The key to our framework is that we predict double-sided orthographic depth maps and color images from a single perspective projected image.
  arXiv  Detail & Related papers  (2022-05-13T06:53:05Z)
• Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Prior [103.49307603952144]
  Most existing de-rain algorithms use only one single input image and aim to recover a clean image. We present a Paired Rain Removal Network (PRRNet), which exploits both stereo images and semantic information. Experiments on both monocular and the newly proposed stereo rainy datasets demonstrate that the proposed method achieves the state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-05-09T04:15:10Z)
• Non-Homogeneous Haze Removal via Artificial Scene Prior and Bidimensional Graph Reasoning [52.07698484363237]
  We propose a Non-Homogeneous Haze Removal Network (NHRN) via artificial scene prior and bidimensional graph reasoning. Our method achieves superior performance over many state-of-the-art algorithms for both the single image dehazing and hazy image understanding tasks.
  arXiv  Detail & Related papers  (2021-04-05T13:04:44Z)
• Exploiting Semantics for Face Image Deblurring [121.44928934662063]
  We propose an effective and efficient face deblurring algorithm by exploiting semantic cues via deep convolutional neural networks. We incorporate face semantic labels as input priors and propose an adaptive structural loss to regularize facial local structures. The proposed method restores sharp images with more accurate facial features and details.
  arXiv  Detail & Related papers  (2020-01-19T13:06:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.