DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data

• URL: http://arxiv.org/abs/2606.27576v1
• Date: Thu, 25 Jun 2026 22:03:43 GMT
• Title: DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data
• Abstract summary: Conventional RGB cameras suffer from lighting artifacts such as flare, glare, flicker, and overexposure, leading to irrecoverable information loss.<n>We propose a novel cross-modal restoration paradigm and present DeLux, a modular proof-of-concept pipeline.
• Score: 0.5326498612379144
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Conventional RGB cameras suffer from lighting artifacts such as flare, glare, flicker, and overexposure, leading to irrecoverable information loss that necessitates computational restoration. However, existing approaches treat these problems in isolation, failing to recover structural details completely obscured by complex spatially discrete image degradations. In this paper, we propose a novel cross-modal restoration paradigm and present DeLux, a modular proof-of-concept pipeline that leverages neuromorphic event streams as a structural prior to guide the targeted detection and inpainting of lighting artifacts in RGB video. Validation on synthetic benchmarks and real-world automotive footage demonstrates that DeLux effectively suppresses local artifacts and restores affected regions. The proposed approach outperforms existing RGB-only baselines and event-guided HDR models, achieving an average MS-SSIM of over 0.99 across all artifact types and demonstrating up to an 88% reduction in artifact severity in real-world automotive footage. The synthetic artifact generation tools and curated real-world evaluation datasets are made publicly available to foster future research on cross-modal restoration.

Related papers

• ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models [13.182092898781292]
  ArtifactWorld is a framework that resolves 3DGS artifact repair through systematic expansion and a homogeneous dual-model paradigm.<n>We show that ArtifactWorld achieves state-of-the-art performance in sparse novel view synthesis and robust 3D reconstruction.
  arXiv  Detail & Related papers  (2026-04-14T03:55:44Z)
• HaineiFRDM: Explore Diffusion to Restore Defects in Fast-Movement Films [2.3374825727995328]
  Existing open-source film restoration methods show limited performance compared to commercial methods.<n>We propose HaineiFRDM, a film restoration framework, to explore diffusion model's powerful content-understanding ability.
  arXiv  Detail & Related papers  (2025-12-31T16:18:07Z)
• UnReflectAnything: RGB-Only Highlight Removal by Rendering Synthetic Specular Supervision [51.72020507506023]
  We present UnReflectAnything, an RGB-only framework that removes highlights from a single image.<n>It predicts a highlight map together with a reflection-free diffuse reconstruction.<n>It generalizes across natural and surgical domains where non-Lambertian surfaces and non-uniform lighting create severe highlights.
  arXiv  Detail & Related papers  (2025-12-10T12:22:37Z)
• Single-Step Latent Diffusion for Underwater Image Restoration [25.229678050715496]
  Underwater image restoration algorithms seek to restore the color, contrast, and appearance of a scene that is imaged underwater.<n>They are a critical tool in applications ranging from marine ecology and aquaculture to underwater construction and archaeology.<n>Slurpp is over 200X faster than existing diffusion-based methods while offering 3 dB improvement in PSNR on synthetic benchmarks.
  arXiv  Detail & Related papers  (2025-07-10T16:02:07Z)
• BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videos [63.03271511550633]
  BrokenVideos is a benchmark dataset of 3,254 AI-generated videos with meticulously annotated, pixel-level masks highlighting regions of visual corruption.<n>Our experiments show that training state of the art artifact detection models and multi modal large language models (MLLMs) on BrokenVideos significantly improves their ability to localize corrupted regions.
  arXiv  Detail & Related papers  (2025-06-25T03:30:04Z)
• Unsupervised Image Super-Resolution Reconstruction Based on Real-World Degradation Patterns [4.977925450373957]
  We propose a novel TripleGAN framework for training super-resolution reconstruction models.<n>The framework learns real-world degradation patterns from LR observations and synthesizes datasets with corresponding degradation characteristics.<n>Our method exhibits clear advantages in quantitative metrics while maintaining sharp reconstructions without over-smoothing artifacts.
  arXiv  Detail & Related papers  (2025-06-20T14:24:48Z)
• RealRAG: Retrieval-augmented Realistic Image Generation via Self-reflective Contrastive Learning [54.07026389388881]
  We present the first real-object-based retrieval-augmented generation framework (RealRAG)<n>RealRAG augments fine-grained and unseen novel object generation by learning and retrieving real-world images to overcome the knowledge gaps of generative models.<n>Our framework integrates fine-grained visual knowledge for the generative models, tackling the distortion problem and improving the realism for fine-grained object generation.
  arXiv  Detail & Related papers  (2025-02-02T16:41:54Z)
• Towards Degradation-Robust Reconstruction in Generalizable NeRF [58.33351079982745]
  Generalizable Radiance Field (GNeRF) across scenes has been proven to be an effective way to avoid per-scene optimization. There has been limited research on the robustness of GNeRFs to different types of degradation present in the source images.
  arXiv  Detail & Related papers  (2024-11-18T16:13:47Z)
• Towards Realistic Data Generation for Real-World Super-Resolution [58.99206459754721]
  RealDGen is an unsupervised learning data generation framework designed for real-world super-resolution.<n>We develop content and degradation extraction strategies, which are integrated into a novel content-degradation decoupled diffusion model.<n>Experiments demonstrate that RealDGen excels in generating large-scale, high-quality paired data that mirrors real-world degradations.
  arXiv  Detail & Related papers  (2024-06-11T13:34:57Z)
• ReconFusion: 3D Reconstruction with Diffusion Priors [104.73604630145847]
  We present ReconFusion to reconstruct real-world scenes using only a few photos. Our approach leverages a diffusion prior for novel view synthesis, trained on synthetic and multiview datasets. Our method synthesizes realistic geometry and texture in underconstrained regions while preserving the appearance of observed regions.
  arXiv  Detail & Related papers  (2023-12-05T18:59:58Z)
• Simulating analogue film damage to analyse and improve artefact restoration on high-resolution scans [10.871587311621974]
  Digital scans of analogue photographic film typically contain artefacts such as dust and scratches. Deep learning models have shown impressive results in general image inpainting and denoising, but film artefact removal is an understudied problem. There are no publicly available high-quality datasets of real-world analogue film damage for training and evaluation. We collect a dataset of 4K damaged analogue film scans paired with manually-restored versions produced by a human expert. We construct a larger synthetic dataset of damaged images with paired clean versions using a statistical model of artefact shape and occurrence learnt from real, heavily-damaged images.
  arXiv  Detail & Related papers  (2023-02-20T14:24:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.