SLCFormer: Spectral-Local Context Transformer with Physics-Grounded Flare Synthesis for Nighttime Flare Removal

• URL: http://arxiv.org/abs/2512.15221v1
• Date: Wed, 17 Dec 2025 09:16:59 GMT
• Title: SLCFormer: Spectral-Local Context Transformer with Physics-Grounded Flare Synthesis for Nighttime Flare Removal
• Authors: Xiyu Zhu, Wei Wang, Xin Yuan, Xiao Wang,
• Abstract summary: Lens flare is a common nighttime artifact caused by strong light sources scattering within camera lenses.<n>We propose SLCFormer, a novel spectral-local context transformer framework for effective nighttime lens flare removal.<n>Our method achieves state-of-the-art performance, outperforming existing approaches in both quantitative metrics and perceptual visual quality.
• Score: 12.135723445465551
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Lens flare is a common nighttime artifact caused by strong light sources scattering within camera lenses, leading to hazy streaks, halos, and glare that degrade visual quality. However, existing methods usually fail to effectively address nonuniform scattered flares, which severely reduces their applicability to complex real-world scenarios with diverse lighting conditions. To address this issue, we propose SLCFormer, a novel spectral-local context transformer framework for effective nighttime lens flare removal. SLCFormer integrates two key modules: the Frequency Fourier and Excitation Module (FFEM), which captures efficient global contextual representations in the frequency domain to model flare characteristics, and the Directionally-Enhanced Spatial Module (DESM) for local structural enhancement and directional features in the spatial domain for precise flare removal. Furthermore, we introduce a ZernikeVAE-based scatter flare generation pipeline to synthesize physically realistic scatter flares with spatially varying PSFs, bridging optical physics and data-driven training. Extensive experiments on the Flare7K++ dataset demonstrate that our method achieves state-of-the-art performance, outperforming existing approaches in both quantitative metrics and perceptual visual quality, and generalizing robustly to real nighttime scenes with complex flare artifacts.

Related papers

• Continuous Exposure-Time Modeling for Realistic Atmospheric Turbulence Synthesis [65.19146708498346]
  Atmospheric turbulence significantly degrades long-range imaging by introducing geometric warping and exposure-timedependent blur.<n>Existing methods for turbulence effects often oversimplify the relationship between blur and exposure-time.<n>We construct ET-Turb, a large-scale synthetic turbulence dataset that explicitly incorporates continuous exposure-time modeling.
  arXiv  Detail & Related papers  (2026-03-02T02:58:44Z)
• Physics-Informed Video Flare Synthesis and Removal Leveraging Motion Independence between Flare and Scene [17.04814273488001]
  Video flare removal pose significantly greater challenges than in image synthesis, owing to the complex and mutually independent motion flare of light sources, and scene content.<n>We propose physics-informed dynamic flare pipeline, which simulates light motion source using optical flow and models the temporal behaviors of both scattering and flares.<n>Our method consistently outperforms existing video-based restoration and image-based flare removal methods on both real and synthetic videos.
  arXiv  Detail & Related papers  (2025-12-12T07:01:44Z)
• S2ML: Spatio-Spectral Mutual Learning for Depth Completion [56.26679539288063]
  Raw depth images captured by RGB-D cameras often suffer from incomplete depth values due to weak reflections, boundary shadows, and artifacts.<n>Existing methods address this problem through depth completion in the image domain, but they overlook the physical characteristics of raw depth images.<n>We propose a Spatio-Spectral Mutual Learning framework (S2ML) to harmonize the advantages of both spatial and frequency domains for depth completion.
  arXiv  Detail & Related papers  (2025-11-08T15:01:55Z)
• DeflareMamba: Hierarchical Vision Mamba for Contextually Consistent Lens Flare Removal [14.87987455441087]
  We present DeflareMamba, a sequence model for lens flare removal.<n>We show that our method effectively removes various types of flare artifacts, including scattering and reflective flares.<n>Further downstream applications demonstrate the capacity of our method to improve visual object recognition and cross-modal semantic understanding.
  arXiv  Detail & Related papers  (2025-08-04T06:49:48Z)
• Towards Generalized Range-View LiDAR Segmentation in Adverse Weather [65.22588361803942]
  We identify and analyze the unique challenges that affect the generalization of range-view LiDAR segmentation in severe weather.<n>We propose a modular and lightweight framework that enhances robustness without altering the core architecture of existing models.<n>Our approach significantly improves generalization to adverse weather with minimal inference overhead.
  arXiv  Detail & Related papers  (2025-06-10T16:48:27Z)
• FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systems [51.15230303652732]
  FLEX (F Low EXpert) is a backbone architecture for generative modeling of-temporal physical systems.<n>It reduces the variance of the velocity field in the diffusion model, which helps stabilize training.<n>It achieves accurate predictions for super-resolution and forecasting tasks using as few features as two reverse diffusion steps.
  arXiv  Detail & Related papers  (2025-05-23T00:07:59Z)
• Harmonizing Light and Darkness: A Symphony of Prior-guided Data Synthesis and Adaptive Focus for Nighttime Flare Removal [44.35766203309201]
  Intense light sources often produce flares in captured images at night, which deteriorates the visual quality and negatively affects downstream applications. In order to train an effective flare removal network, a reliable dataset is essential. We synthesize a prior-guided dataset named Flare7K*, which contains multi-flare images where the brightness of flares adheres to the laws of illumination. We propose a plug-and-play Adaptive Focus Module (AFM) that can adaptively mask the clean background areas and assist models in focusing on the regions severely affected by flares.
  arXiv  Detail & Related papers  (2024-03-30T10:37:56Z)
• Improving Lens Flare Removal with General Purpose Pipeline and Multiple Light Sources Recovery [69.71080926778413]
  flare artifacts can affect image visual quality and downstream computer vision tasks. Current methods do not consider automatic exposure and tone mapping in image signal processing pipeline. We propose a solution to improve the performance of lens flare removal by revisiting the ISP and design a more reliable light sources recovery strategy.
  arXiv  Detail & Related papers  (2023-08-31T04:58:17Z)
• Neural Free-Viewpoint Relighting for Glossy Indirect Illumination [44.32630651762033]
  We show a hybrid neural-wavelet PRT solution to high-frequency indirect illumination, including glossy reflection, for relighting with changing view. We demonstrate real-time rendering of challenging scenes involving view-dependent reflections and even caustics.
  arXiv  Detail & Related papers  (2023-07-12T17:56:09Z)
• Toward Real Flare Removal: A Comprehensive Pipeline and A New Benchmark [12.1632995709273]
  We propose a well-developed methodology for generating data-pairs with flare deterioration. The similarity of scattered flares and symmetric effect of reflected ghosts are realized. We also construct a real-shot pipeline that respectively processes the effects of scattering and reflective flares.
  arXiv  Detail & Related papers  (2023-06-28T02:57:25Z)
• Crowdsampling the Plenoptic Function [56.10020793913216]
  We present a new approach to novel view synthesis under time-varying illumination from such data. We introduce a new DeepMPI representation, motivated by observations on the sparsity structure of the plenoptic function. Our method can synthesize the same compelling parallax and view-dependent effects as previous MPI methods, while simultaneously interpolating along changes in reflectance and illumination with time.
  arXiv  Detail & Related papers  (2020-07-30T02:52:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.