High-Speed Full-Color HDR Imaging via Unwrapping Modulo-Encoded Spike Streams

• URL: http://arxiv.org/abs/2604.14632v1
• Date: Thu, 16 Apr 2026 05:20:38 GMT
• Title: High-Speed Full-Color HDR Imaging via Unwrapping Modulo-Encoded Spike Streams
• Abstract summary: We present a complete modulo-based HDR imaging system that enables high-speed, full-color HDR acquisition.<n>At the core of our approach is an exposure-decoupled formulation of modulo imaging that allows multiple measurements to be interleaved in time.<n>To validate the practical viability of our system, we demonstrate a proof-of-concept hardware implementation based on modulo-encoded spike streams.
• Score: 83.83721273785281
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Conventional RGB-based high dynamic range (HDR) imaging faces a fundamental trade-off between motion artifacts in multi-exposure captures and irreversible information loss in single-shot techniques. Modulo sensors offer a promising alternative by encoding theoretically unbounded dynamic range into wrapped measurements. However, existing modulo solutions remain bottlenecked by iterative unwrapping overhead and hardware constraints limiting them to low-speed, grayscale capture. In this work, we present a complete modulo-based HDR imaging system that enables high-speed, full-color HDR acquisition by synergistically advancing both the sensing formulation and the unwrapping algorithm. At the core of our approach is an exposure-decoupled formulation of modulo imaging that allows multiple measurements to be interleaved in time, preserving a clean, observation-wise measurement model. Building upon this, we introduce an iteration-free unwrapping algorithm that integrates diffusion-based generative priors with the physical least absolute remainder property of modulo images, supporting highly efficient, physics-consistent HDR reconstruction. Finally, to validate the practical viability of our system, we demonstrate a proof-of-concept hardware implementation based on modulo-encoded spike streams. This setup preserves the native high temporal resolution of spike cameras, achieving 1000 FPS full-color imaging while reducing output data bandwidth from approximately 20 Gbps to 6 Gbps. Extensive evaluations indicate that our coordinated approach successfully overcomes key systemic bottlenecks, demonstrating the feasibility of deploying modulo imaging in dynamic scenarios.

Related papers

• Wavelet-Domain Masked Image Modeling for Color-Consistent HDR Video Reconstruction [69.35623794013152]
  High Dynamic Range (LDR) video reconstruction aims to recover fine brightness, color, and details from LDR videos.<n>Existing methods often suffer from color inaccuracies and temporal inconsistencies.<n>We propose WMNet, a novel HDR video reconstruction network that leverages Wavelet domain Masked Image Modeling.
  arXiv  Detail & Related papers  (2026-02-07T06:19:23Z)
• Deep Lightweight Unrolled Network for High Dynamic Range Modulo Imaging [19.49437461280304]
  Modulo-Imaging (MI) offers a promising alternative for expanding the dynamic dynamic range images by resetting the signal intensity when it reaches the intensity level.<n>We introduce the Scaling Equi term that facilitates self-tuning, thereby enabling the model to adapt to new images outside the original distribution.
  arXiv  Detail & Related papers  (2026-01-18T18:22:38Z)
• Autoregressive High-Order Finite Difference Modulo Imaging: High-Dynamic Range for Computer Vision Applications [3.4956406636452626]
  High dynamic range (gressive) imaging is vital for capturing the full range of light tones in scenes, essential for computer vision tasks such as autonomous driving.<n>Standard commercial imaging systems face limitations in capacity for well depth, and quantization precision, hindering their HDR capabilities.<n>We develop a modulo analog-to-digital approach that resets signals upon saturation, enabling estimation of pixel resets through neighboring pixel intensities.
  arXiv  Detail & Related papers  (2025-04-05T16:41:15Z)
• Generating Content for HDR Deghosting from Frequency View [56.103761824603644]
  Recent Diffusion Models (DMs) have been introduced in HDR imaging field. DMs require extensive iterations with large models to estimate entire images. We propose the Low-Frequency aware Diffusion (LF-Diff) model for ghost-free HDR imaging.
  arXiv  Detail & Related papers  (2024-04-01T01:32:11Z)
• Event-based Asynchronous HDR Imaging by Temporal Incident Light Modulation [54.64335350932855]
  We propose a Pixel-Asynchronous HDR imaging system, based on key insights into the challenges in HDR imaging. Our proposed Asyn system integrates the Dynamic Vision Sensors (DVS) with a set of LCD panels. The LCD panels modulate the irradiance incident upon the DVS by altering their transparency, thereby triggering the pixel-independent event streams.
  arXiv  Detail & Related papers  (2024-03-14T13:45:09Z)
• LAN-HDR: Luminance-based Alignment Network for High Dynamic Range Video Reconstruction [20.911738532410766]
  We propose an end-to-end HDR video composition framework, which aligns LDR frames in feature space and then merges aligned features into an HDR frame. In training, we adopt a temporal loss, in addition to frame reconstruction losses, to enhance temporal consistency and thus reduce flickering.
  arXiv  Detail & Related papers  (2023-08-22T01:43:00Z)
• SMAE: Few-shot Learning for HDR Deghosting with Saturation-Aware Masked Autoencoders [97.64072440883392]
  We propose a novel semi-supervised approach to realize few-shot HDR imaging via two stages of training, called SSHDR. Unlikely previous methods, directly recovering content and removing ghosts simultaneously, which is hard to achieve optimum. Experiments demonstrate that SSHDR outperforms state-of-the-art methods quantitatively and qualitatively within and across different datasets.
  arXiv  Detail & Related papers  (2023-04-14T03:42:51Z)
• HDR Reconstruction from Bracketed Exposures and Events [12.565039752529797]
  Reconstruction of high-quality HDR images is at the core of modern computational photography. We present a multi-modal end-to-end learning-based HDR imaging system that fuses bracketed images and event in the feature domain. Our framework exploits the higher temporal resolution of events by sub-sampling the input event streams using a sliding window.
  arXiv  Detail & Related papers  (2022-03-28T15:04:41Z)
• MantissaCam: Learning Snapshot High-dynamic-range Imaging with Perceptually-based In-pixel Irradiance Encoding [39.78877654934457]
  High-dynamic-range ( HDR) images are crucial in many computer vision applications. Here, we design a neural network-based algorithm that outperforms previous irradiance unwrapping methods. We show preliminary results of a prototype MantissaCam implemented with a programmable sensor.
  arXiv  Detail & Related papers  (2021-12-09T21:32:10Z)
• Wavelet-Based Network For High Dynamic Range Imaging [64.66969585951207]
  Existing methods, such as optical flow based and end-to-end deep learning based solutions, are error-prone either in detail restoration or ghosting artifacts removal. In this work, we propose a novel frequency-guided end-to-end deep neural network (FNet) to conduct HDR fusion in the frequency domain, and Wavelet Transform (DWT) is used to decompose inputs into different frequency bands. The low-frequency signals are used to avoid specific ghosting artifacts, while the high-frequency signals are used for preserving details.
  arXiv  Detail & Related papers  (2021-08-03T12:26:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.