Learning to See Through Flare

• URL: http://arxiv.org/abs/2508.13907v1
• Date: Tue, 19 Aug 2025 15:06:59 GMT
• Title: Learning to See Through Flare
• Abstract summary: We introduce NeuSee, the first computational imaging framework for high-fidelity sensor protection across the full visible spectrum.<n>NeuSee is adversarially trained end-to-end on 100K unique images to suppress the peak laser irradiance.<n>It outperforms other learned DOEs, achieving full-spectrum imaging and laser suppression for the first time.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Machine vision systems are susceptible to laser flare, where unwanted intense laser illumination blinds and distorts its perception of the environment through oversaturation or permanent damage to sensor pixels. We introduce NeuSee, the first computational imaging framework for high-fidelity sensor protection across the full visible spectrum. It jointly learns a neural representation of a diffractive optical element (DOE) and a frequency-space Mamba-GAN network for image restoration. NeuSee system is adversarially trained end-to-end on 100K unique images to suppress the peak laser irradiance as high as $10^6$ times the sensor saturation threshold $I_{\textrm{sat}}$, the point at which camera sensors may experience damage without the DOE. Our system leverages heterogeneous data and model parallelism for distributed computing, integrating hyperspectral information and multiple neural networks for realistic simulation and image restoration. NeuSee takes into account open-world scenes with dynamically varying laser wavelengths, intensities, and positions, as well as lens flare effects, unknown ambient lighting conditions, and sensor noises. It outperforms other learned DOEs, achieving full-spectrum imaging and laser suppression for the first time, with a 10.1\% improvement in restored image quality.

Related papers

• Quanta Perception as Probabilistic Events [10.195740497918049]
  Quanta sensors detect individual photons, but their streams exceed real-time compute and latency budgets by orders of magnitude.<n>Here we introduce $textitprobabilistic events$, a computational primitive for real-time quanta perception from individual photon detections.<n>By replacing frame reconstruction with direct probabilistic inference over photon streams, this work bridges photon-counting quanta sensing with robotic vision.
  arXiv  Detail & Related papers  (2026-08-27T18:10:04Z)
• Limited-View Photoacoustic Imaging Reconstruction Via High-quality Self-supervised Neural Representation [4.274771298029378]
  We introduce a self-supervised network termed HIgh-quality Self-supervised neural representation (HIS) HIS tackles the inverse problem of photoacoustic imaging to reconstruct high-quality photoacoustic images from sensor data acquired under limited viewpoints. Results indicate that the proposed HIS model offers superior image reconstruction quality compared to three commonly used methods for photoacoustic image reconstruction.
  arXiv  Detail & Related papers  (2024-07-04T06:07:54Z)
• NeRF-Casting: Improved View-Dependent Appearance with Consistent Reflections [57.63028964831785]
  Recent works have improved NeRF's ability to render detailed specular appearance of distant environment illumination, but are unable to synthesize consistent reflections of closer content. We address these issues with an approach based on ray tracing. Instead of querying an expensive neural network for the outgoing view-dependent radiance at points along each camera ray, our model casts rays from these points and traces them through the NeRF representation to render feature vectors.
  arXiv  Detail & Related papers  (2024-05-23T17:59:57Z)
• NiteDR: Nighttime Image De-Raining with Cross-View Sensor Cooperative Learning for Dynamic Driving Scenes [49.92839157944134]
  In nighttime driving scenes, insufficient and uneven lighting shrouds the scenes in darkness, resulting degradation of image quality and visibility. We develop an image de-raining framework tailored for rainy nighttime driving scenes. It aims to remove rain artifacts, enrich scene representation, and restore useful information.
  arXiv  Detail & Related papers  (2024-02-28T09:02:33Z)
• Learning to See Through Dazzle [0.0]
  Machine vision is susceptible to laser dazzle, where intense laser light can blind and distort its perception of the environment through oversaturation or permanent damage to sensor pixels. Here we employ a wavefront-coded phase mask to diffuse the energy of laser light and introduce a sandwich generative adversarial network (SGAN) to restore images from complex image degradations.
  arXiv  Detail & Related papers  (2024-02-24T22:22:02Z)
• Improving Lens Flare Removal with General Purpose Pipeline and Multiple Light Sources Recovery [69.71080926778413]
  flare artifacts can affect image visual quality and downstream computer vision tasks. Current methods do not consider automatic exposure and tone mapping in image signal processing pipeline. We propose a solution to improve the performance of lens flare removal by revisiting the ISP and design a more reliable light sources recovery strategy.
  arXiv  Detail & Related papers  (2023-08-31T04:58:17Z)
• Classification robustness to common optical aberrations [64.08840063305313]
  This paper proposes OpticsBench, a benchmark for investigating robustness to realistic, practically relevant optical blur effects. Experiments on ImageNet show that for a variety of different pre-trained DNNs, the performance varies strongly compared to disk-shaped kernels. We show on ImageNet-100 with OpticsAugment that can be increased by using optical kernels as data augmentation.
  arXiv  Detail & Related papers  (2023-08-29T08:36:00Z)
• 1000x Faster Camera and Machine Vision with Ordinary Devices [76.46540270145698]
  We present vidar, a bit sequence array where each bit represents whether the accumulation of photons has reached a threshold. We have developed a vidar camera that is 1,000x faster than conventional cameras. We have also developed a spiking neural network-based machine vision system that combines the speed of the machine and the mechanism of biological vision.
  arXiv  Detail & Related papers  (2022-01-23T16:10:11Z)
• Learning Neural Transmittance for Efficient Rendering of Reflectance Fields [43.24427791156121]
  We propose a novel method based on precomputed Neural Transmittance Functions to accelerate rendering of neural reflectance fields. Results on real and synthetic scenes demonstrate almost two order of magnitude speedup for renderings under environment maps with minimal accuracy loss.
  arXiv  Detail & Related papers  (2021-10-25T21:12:25Z)
• Event Guided Depth Sensing [50.997474285910734]
  We present an efficient bio-inspired event-camera-driven depth estimation algorithm. In our approach, we illuminate areas of interest densely, depending on the scene activity detected by the event camera. We show the feasibility of our approach in a simulated autonomous driving sequences and real indoor environments.
  arXiv  Detail & Related papers  (2021-10-20T11:41:11Z)
• Thermal Image Processing via Physics-Inspired Deep Networks [21.094006629684376]
  DeepIR combines physically accurate sensor modeling with deep network-based image representation. DeepIR requires neither training data nor periodic ground-truth calibration with a known black body target. Simulated and real data experiments demonstrate that DeepIR can perform high-quality non-uniformity correction with as few as three images.
  arXiv  Detail & Related papers  (2021-08-18T04:57:48Z)
• Classification of optics-free images with deep neural networks [1.52292571922932]
  We train deep neural networks to perform multi-class detection and binary classification on optics-free images. Inferencing from optics-free images has the potential for enhanced privacy and power efficiency.
  arXiv  Detail & Related papers  (2020-11-10T15:02:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.