Optimizing 4D Lookup Table for Low-light Video Enhancement via Wavelet Priori

• URL: http://arxiv.org/abs/2409.08585v1
• Date: Fri, 13 Sep 2024 07:04:05 GMT
• Title: Optimizing 4D Lookup Table for Low-light Video Enhancement via Wavelet Priori
• Authors: Jinhong He, Minglong Xue, Wenhai Wang, Mingliang Zhou,
• Abstract summary: Low-light video enhancement is highly demanding in maintaining color consistency. We propose Wavelet-priori for 4D Fourier Table (WaveLUT), which effectively enhances the color between video frames and the accuracy of color mapping.
• Score: 28.049668999586583
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Low-light video enhancement is highly demanding in maintaining spatiotemporal color consistency. Therefore, improving the accuracy of color mapping and keeping the latency low is challenging. Based on this, we propose incorporating Wavelet-priori for 4D Lookup Table (WaveLUT), which effectively enhances the color coherence between video frames and the accuracy of color mapping while maintaining low latency. Specifically, we use the wavelet low-frequency domain to construct an optimized lookup prior and achieve an adaptive enhancement effect through a designed Wavelet-prior 4D lookup table. To effectively compensate the a priori loss in the low light region, we further explore a dynamic fusion strategy that adaptively determines the spatial weights based on the correlation between the wavelet lighting prior and the target intensity structure. In addition, during the training phase, we devise a text-driven appearance reconstruction method that dynamically balances brightness and content through multimodal semantics-driven Fourier spectra. Extensive experiments on a wide range of benchmark datasets show that this method effectively enhances the previous method's ability to perceive the color space and achieves metric-favorable and perceptually oriented real-time enhancement while maintaining high efficiency.

Related papers

• Wavelet-based Decoupling Framework for low-light Stereo Image Enhancement [4.645709745803925]
  This paper proposes a wavelet-based low-light stereo image enhancement method with feature space decoupling.<n>By using wavelet transform the feature space is decomposed into a low-frequency branch for illumination adjustment and multiple high-frequency branches for texture enhancement.<n>To enhance the high-frequency information, a detail and texture enhancement module (DTEM) is proposed based on cross-attention mechanism.
  arXiv  Detail & Related papers  (2025-07-16T12:42:27Z)
• Latent Wavelet Diffusion: Enabling 4K Image Synthesis for Free [31.515710473565925]
  Latent Wavelet Diffusion (LWD) is a lightweight framework that enables any latent diffusion model to scale to ultra-high-resolution image generation (2K to 4K) for free.<n>LWD requires no architectural modifications and incurs no additional computational overhead.<n>It consistently improves perceptual quality and reduces FID in ultra-high-resolution image synthesis, outperforming strong baseline models.
  arXiv  Detail & Related papers  (2025-05-31T07:28:32Z)
• SG-Splatting: Accelerating 3D Gaussian Splatting with Spherical Gaussians [21.00454010373162]
  3D Gaussian Splatting is emerging as a state-of-the-art technique in novel view synthesis. However, reliance on third-degree spherical harmonics for color representation introduces significant storage demands and computational overhead. We introduce SG-Splatting with Spherical Gaussians based color representation, a novel approach to enhance rendering speed and quality.
  arXiv  Detail & Related papers  (2024-12-31T08:31:52Z)
• Flash Cache: Reducing Bias in Radiance Cache Based Inverse Rendering [62.92985004295714]
  We present a method that avoids approximations that introduce bias into the renderings and, more importantly, the gradients used for optimization. We show that by removing these biases our approach improves the generality of radiance cache based inverse rendering, as well as increasing quality in the presence of challenging light transport effects such as specular reflections.
  arXiv  Detail & Related papers  (2024-09-09T17:59:57Z)
• Unrolled Decomposed Unpaired Learning for Controllable Low-Light Video Enhancement [48.76608212565327]
  This paper makes endeavors in the direction of learning for low-light video enhancement without using paired ground truth. Compared to low-light image enhancement, enhancing low-light videos is more difficult due to the intertwined effects of noise, exposure, and contrast in the spatial domain, jointly with the need for temporal coherence. We propose the Unrolled Decomposed Unpaired Network (UDU-Net) for enhancing low-light videos by unrolling the optimization functions into a deep network to decompose the signal into spatial and temporal-related factors, which are updated iteratively.
  arXiv  Detail & Related papers  (2024-08-22T11:45:11Z)
• CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputs [65.80187860906115]
  We propose a novel approach to improve NeRF's performance with sparse inputs. We first adopt a voxel-based ray sampling strategy to ensure that the sampled rays intersect with a certain voxel in 3D space. We then randomly sample additional points within the voxel and apply a Transformer to infer the properties of other points on each ray, which are then incorporated into the volume rendering.
  arXiv  Detail & Related papers  (2024-03-25T15:56:17Z)
• DITTO: Diffusion Inference-Time T-Optimization for Music Generation [49.90109850026932]
  Diffusion Inference-Time T-Optimization (DITTO) is a frame-work for controlling pre-trained text-to-music diffusion models at inference-time. We demonstrate a surprisingly wide-range of applications for music generation including inpainting, outpainting, and looping as well as intensity, melody, and musical structure control.
  arXiv  Detail & Related papers  (2024-01-22T18:10:10Z)
• Joint Correcting and Refinement for Balanced Low-Light Image Enhancement [26.399356992450763]
  A novel structure is proposed which can balance brightness, color, and illumination more effectively. Joint Correcting and Refinement Network (JCRNet) mainly consists of three stages to balance brightness, color, and illumination of enhancement.
  arXiv  Detail & Related papers  (2023-09-28T03:16:45Z)
• A comparison between black-, grey- and white-box modeling for the bidirectional Raman amplifier optimization [0.8098985611919018]
  offline optimization of optical amplifiers relies on models ranging from white-box models deeply rooted in physics to black-box data-driven and physics-agnostic models. We show that any of the studied methods can achieve similar frequency and distance flatness of between 1 and 3.6 dB over the C-band in an 80-km span.
  arXiv  Detail & Related papers  (2023-09-11T08:39:57Z)
• Dynamic Frame Interpolation in Wavelet Domain [57.25341639095404]
  Video frame is an important low-level computation vision task, which can increase frame rate for more fluent visual experience. Existing methods have achieved great success by employing advanced motion models and synthesis networks. WaveletVFI can reduce computation up to 40% while maintaining similar accuracy, making it perform more efficiently against other state-of-the-arts.
  arXiv  Detail & Related papers  (2023-09-07T06:41:15Z)
• Low-Light Image Enhancement with Wavelet-based Diffusion Models [50.632343822790006]
  Diffusion models have achieved promising results in image restoration tasks, yet suffer from time-consuming, excessive computational resource consumption, and unstable restoration. We propose a robust and efficient Diffusion-based Low-Light image enhancement approach, dubbed DiffLL.
  arXiv  Detail & Related papers  (2023-06-01T03:08:28Z)
• Wavelet Transform-assisted Adaptive Generative Modeling for Colorization [15.814591440291652]
  This study presents a novel scheme that exploiting the score-based generative model in wavelet domain to address the issue. By taking advantage of the multi-scale and multi-channel representation via wavelet transform, the proposed model learns the priors from stacked wavelet coefficient components. Experiments demonstrated remarkable improvements of the proposed model on colorization quality, particularly on colorization robustness and diversity.
  arXiv  Detail & Related papers  (2021-07-09T07:12:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.