Feature Denoising For Low-Light Instance Segmentation Using Weighted
Non-Local Blocks
- URL: http://arxiv.org/abs/2402.18307v1
- Date: Wed, 28 Feb 2024 13:07:16 GMT
- Title: Feature Denoising For Low-Light Instance Segmentation Using Weighted
Non-Local Blocks
- Authors: Joanne Lin, Nantheera Anantrasirichai, David Bull
- Abstract summary: We propose an end-to-end solution for instance segmentation for low-light imagery.
Based on Mask R-CNN, our proposed method implements weighted non-local (NL) blocks in the feature extractor.
We introduce additional learnable weights at each layer in order to enhance the network's adaptability to real-world noise characteristics.
- Score: 2.9695823613761316
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Instance segmentation for low-light imagery remains largely unexplored due to
the challenges imposed by such conditions, for example shot noise due to low
photon count, color distortions and reduced contrast. In this paper, we propose
an end-to-end solution to address this challenging task. Based on Mask R-CNN,
our proposed method implements weighted non-local (NL) blocks in the feature
extractor. This integration enables an inherent denoising process at the
feature level. As a result, our method eliminates the need for aligned ground
truth images during training, thus supporting training on real-world low-light
datasets. We introduce additional learnable weights at each layer in order to
enhance the network's adaptability to real-world noise characteristics, which
affect different feature scales in different ways.
Experimental results show that the proposed method outperforms the pretrained
Mask R-CNN with an Average Precision (AP) improvement of +10.0, with the
introduction of weighted NL Blocks further enhancing AP by +1.0.
Related papers
- Pan-denoising: Guided Hyperspectral Image Denoising via Weighted Represent Coefficient Total Variation [20.240211073097758]
This paper introduces a novel paradigm for hyperspectral image (HSI) denoising, which is termed textitpan-denoising.
Panchromatic (PAN) images capture similar structures and textures to HSIs but with less noise. Consequently, pan-denoising has the potential to uncover underlying structures and details beyond the internal information modeling of traditional HSI denoising methods.
Experiments on synthetic and real-world datasets demonstrate that PWRCTV outperforms several state-of-the-art methods in terms of metrics and visual quality.
arXiv Detail & Related papers (2024-07-08T16:05:56Z) - NIR-Assisted Image Denoising: A Selective Fusion Approach and A Real-World Benchmark Dataset [53.79524776100983]
Leveraging near-infrared (NIR) images to assist visible RGB image denoising shows the potential to address this issue.
Existing works still struggle with taking advantage of NIR information effectively for real-world image denoising.
We propose an efficient Selective Fusion Module (SFM), which can be plug-and-played into the advanced denoising networks.
arXiv Detail & Related papers (2024-04-12T14:54:26Z) - DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image
Enhancement [77.0360085530701]
Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments.
Previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features.
Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space.
arXiv Detail & Related papers (2023-12-12T06:07:21Z) - Self-Reference Deep Adaptive Curve Estimation for Low-Light Image
Enhancement [7.253235412867934]
We propose a 2-stage low-light image enhancement method called Self-Reference Deep Adaptive Curve Estimation (Self-DACE)
In the first stage, we present an intuitive, lightweight, fast, and unsupervised luminance enhancement algorithm.
We also propose a new loss function with a simplified physical model designed to preserve natural images' color, structure, and fidelity.
arXiv Detail & Related papers (2023-08-16T07:57:35Z) - Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast.
These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios.
We first propose a method for estimating the noise level in low light images in a quick and accurate way.
We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
arXiv Detail & Related papers (2023-05-17T13:56:48Z) - Instance Segmentation in the Dark [43.85818645776587]
We take a deep look at instance segmentation in the dark and introduce several techniques that substantially boost the low-light inference accuracy.
We propose a novel learning method that relies on an adaptive weighted downsampling layer, a smooth-oriented convolutional block, and disturbance suppression learning.
We capture a real-world low-light instance segmentation dataset comprising over two thousand paired low/normal-light images with instance-level pixel-wise annotations.
arXiv Detail & Related papers (2023-04-27T16:02:29Z) - Seeing Through The Noisy Dark: Toward Real-world Low-Light Image
Enhancement and Denoising [125.56062454927755]
Real-world low-light environment usually suffer from lower visibility and heavier noise, due to insufficient light or hardware limitation.
We propose a novel end-to-end method termed Real-world Low-light Enhancement & Denoising Network (RLED-Net)
arXiv Detail & Related papers (2022-10-02T14:57:23Z) - Multi-stage image denoising with the wavelet transform [125.2251438120701]
Deep convolutional neural networks (CNNs) are used for image denoising via automatically mining accurate structure information.
We propose a multi-stage image denoising CNN with the wavelet transform (MWDCNN) via three stages, i.e., a dynamic convolutional block (DCB), two cascaded wavelet transform and enhancement blocks (WEBs) and residual block (RB)
arXiv Detail & Related papers (2022-09-26T03:28:23Z) - Adaptive Unfolding Total Variation Network for Low-Light Image
Enhancement [6.531546527140475]
Most existing enhancing algorithms in sRGB space only focus on the low visibility problem or suppress the noise under a hypothetical noise level.
We propose an adaptive unfolding total variation network (UTVNet) to approximate the noise level from the real sRGB low-light image.
Experiments on real-world low-light images clearly demonstrate the superior performance of UTVNet over state-of-the-art methods.
arXiv Detail & Related papers (2021-10-03T11:22:17Z) - Simultaneous Denoising and Dereverberation Using Deep Embedding Features [64.58693911070228]
We propose a joint training method for simultaneous speech denoising and dereverberation using deep embedding features.
At the denoising stage, the DC network is leveraged to extract noise-free deep embedding features.
At the dereverberation stage, instead of using the unsupervised K-means clustering algorithm, another neural network is utilized to estimate the anechoic speech.
arXiv Detail & Related papers (2020-04-06T06:34:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.