High-speed Imaging through Turbulence with Event-based Light Fields

• URL: http://arxiv.org/abs/2603.14023v1
• Date: Sat, 14 Mar 2026 16:54:35 GMT
• Title: High-speed Imaging through Turbulence with Event-based Light Fields
• Abstract summary: This work introduces and demonstrates the first system capable of imaging fast-moving extended non-rigid objects through strong atmospheric turbulence at high frame rate.<n>Event cameras are a novel sensing architecture capable of estimating high-speed imagery at thousands of frames per second.
• Score: 17.255199056108182
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This work introduces and demonstrates the first system capable of imaging fast-moving extended non-rigid objects through strong atmospheric turbulence at high frame rate. Event cameras are a novel sensing architecture capable of estimating high-speed imagery at thousands of frames per second. However, on their own event cameras are unable to disambiguate scene motion from turbulence. In this work, we overcome this limitation using event-based light field cameras: By simultaneously capturing multiple views of a scene, event-based light field cameras and machine learning-based reconstruction algorithms are able to disambiguate motion-induced dynamics, which produce events that are strongly correlated across views, from turbulence-induced dynamics, which produce events that are weakly correlated across view. Tabletop experiments demonstrate event-based light field can overcome strong turbulence while imaging high-speed objects traveling at up to 16,000 pixels per second.

Related papers

• High-Quality and Efficient Turbulence Mitigation with Events [36.16150258581428]
  Turbulence mitigation (TM) is ill-posed due to the nature of atmospheric turbulence.<n>Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios.<n>We present EHETM, a high-quality and efficient TM method inspired by the superiority of events to model motions in continuous sequences.
  arXiv  Detail & Related papers  (2026-03-21T08:10:20Z)
• Event fields: Capturing light fields at high speed, resolution, and dynamic range [9.2152453085337]
  "Event Fields" is a new approach that utilizes innovative optical designs for event cameras to capture light fields at high speed.<n>We develop the underlying mathematical framework for Event Fields and introduce two foundational frameworks to capture them practically.<n>This novel light-sensing paradigm opens doors to new applications in photography, robotics, and AR/VR, and presents fresh challenges in rendering and machine learning.
  arXiv  Detail & Related papers  (2024-12-09T04:02:49Z)
• Structured light with a million light planes per second [17.590896196214914]
  We introduce a structured light system that enables full-frame 3D scanning at speeds of $1000text$, four times faster than the previous fastest systems.<n>Key innovation is the use of a custom acousto-optic light scanning device capable of projecting two million light planes per second.
  arXiv  Detail & Related papers  (2024-11-27T18:44:23Z)
• Deblur e-NeRF: NeRF from Motion-Blurred Events under High-speed or Low-light Conditions [56.84882059011291]
  We propose Deblur e-NeRF, a novel method to reconstruct blur-minimal NeRFs from motion-red events. We also introduce a novel threshold-normalized total variation loss to improve the regularization of large textureless patches.
  arXiv  Detail & Related papers  (2024-09-26T15:57:20Z)
• TimeRewind: Rewinding Time with Image-and-Events Video Diffusion [10.687722181495065]
  This paper addresses the novel challenge of rewinding'' time from a single captured image to recover the fleeting moments missed just before the shutter button is pressed. We overcome this challenge by leveraging the emerging technology of neuromorphic event cameras, which capture motion information with high temporal resolution. Our proposed framework introduces an event motion adaptor conditioned on event camera data, guiding the diffusion model to generate videos that are visually coherent and physically grounded in the captured events.
  arXiv  Detail & Related papers  (2024-03-20T17:57:02Z)
• EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Dataset [55.12137324648253]
  Event cameras are emerging imaging technology that offers advantages over conventional frame-based imaging sensors in dynamic range and sensing speed. This paper focuses on five event-aided image and video enhancement tasks.
  arXiv  Detail & Related papers  (2023-12-13T15:42:04Z)
• Robust e-NeRF: NeRF from Sparse & Noisy Events under Non-Uniform Motion [67.15935067326662]
  Event cameras offer low power, low latency, high temporal resolution and high dynamic range. NeRF is seen as the leading candidate for efficient and effective scene representation. We propose Robust e-NeRF, a novel method to directly and robustly reconstruct NeRFs from moving event cameras.
  arXiv  Detail & Related papers  (2023-09-15T17:52:08Z)
• Panoramas from Photons [22.437940699523082]
  We present a method capable of estimating extreme scene motion under challenging conditions, such as low light or high dynamic range. Our method relies on grouping and aggregating frames after-the-fact, in a stratified manner. We demonstrate the creation of high-quality panoramas under fast motion and extremely low light, and super-resolution results using a custom single-photon camera prototype.
  arXiv  Detail & Related papers  (2023-09-07T16:07:31Z)
• E-NeRF: Neural Radiance Fields from a Moving Event Camera [83.91656576631031]
  Estimating neural radiance fields (NeRFs) from ideal images has been extensively studied in the computer vision community. We present E-NeRF, the first method which estimates a volumetric scene representation in the form of a NeRF from a fast-moving event camera.
  arXiv  Detail & Related papers  (2022-08-24T04:53:32Z)
• MEFNet: Multi-scale Event Fusion Network for Motion Deblurring [62.60878284671317]
  Traditional frame-based cameras inevitably suffer from motion blur due to long exposure times. As a kind of bio-inspired camera, the event camera records the intensity changes in an asynchronous way with high temporal resolution. In this paper, we rethink the event-based image deblurring problem and unfold it into an end-to-end two-stage image restoration network.
  arXiv  Detail & Related papers  (2021-11-30T23:18:35Z)
• ESL: Event-based Structured Light [62.77144631509817]
  Event cameras are bio-inspired sensors providing significant advantages over standard cameras. We propose a novel structured-light system using an event camera to tackle the problem of accurate and high-speed depth sensing.
  arXiv  Detail & Related papers  (2021-11-30T15:47:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.