Learning with Nested Scene Modeling and Cooperative Architecture Search for Low-Light Vision

• URL: http://arxiv.org/abs/2112.04719v1
• Date: Thu, 9 Dec 2021 06:08:31 GMT
• Title: Learning with Nested Scene Modeling and Cooperative Architecture Search for Low-Light Vision
• Authors: Risheng Liu and Long Ma and Tengyu Ma and Xin Fan and Zhongxuan Luo
• Abstract summary: Images captured from low-light scenes often suffer from severe degradations. Deep learning methods have been proposed to enhance the visual quality of low-light images. It is still challenging to extend these enhancement techniques to handle other Low-Light Vision applications.
• Score: 95.45256938467237
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Images captured from low-light scenes often suffer from severe degradations, including low visibility, color cast and intensive noises, etc. These factors not only affect image qualities, but also degrade the performance of downstream Low-Light Vision (LLV) applications. A variety of deep learning methods have been proposed to enhance the visual quality of low-light images. However, these approaches mostly rely on significant architecture engineering to obtain proper low-light models and often suffer from high computational burden. Furthermore, it is still challenging to extend these enhancement techniques to handle other LLVs. To partially address above issues, we establish Retinex-inspired Unrolling with Architecture Search (RUAS), a general learning framework, which not only can address low-light enhancement task, but also has the flexibility to handle other more challenging downstream vision applications. Specifically, we first establish a nested optimization formulation, together with an unrolling strategy, to explore underlying principles of a series of LLV tasks. Furthermore, we construct a differentiable strategy to cooperatively search specific scene and task architectures for RUAS. Last but not least, we demonstrate how to apply RUAS for both low- and high-level LLV applications (e.g., enhancement, detection and segmentation). Extensive experiments verify the flexibility, effectiveness, and efficiency of RUAS.

Related papers

• Learning a Single Convolutional Layer Model for Low Light Image Enhancement [43.411846299085575]
  Low-light image enhancement (LLIE) aims to improve the illuminance of images due to insufficient light exposure. A single convolutional layer model (SCLM) is proposed that provides global low-light enhancement as the coarsely enhanced results. Experimental results demonstrate that the proposed method performs favorably against the state-of-the-art LLIE methods in both objective metrics and subjective visual effects.
  arXiv  Detail & Related papers  (2023-05-23T13:12:00Z)
• Self-Aligned Concave Curve: Illumination Enhancement for Unsupervised Adaptation [36.050270650417325]
  We propose a learnable illumination enhancement model for high-level vision. Inspired by real camera response functions, we assume that the illumination enhancement function should be a concave curve. Our model architecture and training designs mutually benefit each other, forming a powerful unsupervised normal-to-low light adaptation framework.
  arXiv  Detail & Related papers  (2022-10-07T19:32:55Z)
• Toward Fast, Flexible, and Robust Low-Light Image Enhancement [87.27326390675155]
  We develop a new Self-Calibrated Illumination (SCI) learning framework for fast, flexible, and robust brightening images in real-world low-light scenarios. Considering the computational burden of the cascaded pattern, we construct the self-calibrated module which realizes the convergence between results of each stage. We make comprehensive explorations to SCI's inherent properties including operation-insensitive adaptability and model-irrelevant generality.
  arXiv  Detail & Related papers  (2022-04-21T14:40:32Z)
• Low-light Image Enhancement by Retinex Based Algorithm Unrolling and Adjustment [50.13230641857892]
  We propose a new deep learning framework for the low-light image enhancement (LIE) problem. The proposed framework contains a decomposition network inspired by algorithm unrolling, and adjustment networks considering both global brightness and local brightness sensitivity. Experiments on a series of typical LIE datasets demonstrated the effectiveness of the proposed method, both quantitatively and visually, as compared with existing methods.
  arXiv  Detail & Related papers  (2022-02-12T03:59:38Z)
• A Practical Contrastive Learning Framework for Single-Image Super-Resolution [51.422185656787285]
  We investigate contrastive learning-based single image super-resolution from two perspectives. We propose a practical contrastive learning framework for SISR, named PCL-SR. Compared with existing benchmark methods, we re-train them by our proposed PCL-SR framework and achieve superior performance.
  arXiv  Detail & Related papers  (2021-11-27T15:42:12Z)
• Improving Aerial Instance Segmentation in the Dark with Self-Supervised Low Light Enhancement [6.500738558466833]
  Low light conditions in aerial images adversely affect the performance of vision based applications. We propose a new method that is capable of enhancing the low light image in a self-supervised fashion. We also propose the generation of a new low light aerial dataset using GANs.
  arXiv  Detail & Related papers  (2021-02-10T12:24:40Z)
• Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement [58.72667941107544]
  We propose Retinex-inspired Unrolling with Architecture Search (RUAS) to construct lightweight yet effective enhancement network for low-light images. RUAS is able to obtain a top-performing image enhancement network, which is with fast speed and requires few computational resources.
  arXiv  Detail & Related papers  (2020-12-10T11:51:23Z)
• Unsupervised Low-light Image Enhancement with Decoupled Networks [103.74355338972123]
  We learn a two-stage GAN-based framework to enhance the real-world low-light images in a fully unsupervised fashion. Our proposed method outperforms the state-of-the-art unsupervised image enhancement methods in terms of both illumination enhancement and noise reduction.
  arXiv  Detail & Related papers  (2020-05-06T13:37:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.