SGE: Structured Light System Based on Gray Code with an Event Camera

• URL: http://arxiv.org/abs/2403.07326v1
• Date: Tue, 12 Mar 2024 05:20:44 GMT
• Title: SGE: Structured Light System Based on Gray Code with an Event Camera
• Authors: Xingyu Lu, Lei Sun, Diyang Gu, Zhijie Xu, Kaiwei Wang
• Abstract summary: We introduce Gray code into event-based structured light systems for the first time. We show that our approach achieves accuracy comparable to state-of-the-art scanning methods. Our proposed approach offers a highly promising solution for ultra-fast, real-time, and high-precision dense depth estimation.
• Score: 9.701291540219026
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fast and accurate depth sensing has long been a significant research challenge. Event camera, as a device that quickly responds to intensity changes, provides a new solution for structured light (SL) systems. In this paper, we introduce Gray code into event-based SL systems for the first time. Our setup includes an event camera and Digital Light Processing (DLP) projector, enabling depth estimation through high-speed projection and decoding of Gray code patterns. By employing spatio-temporal encoding for point matching, our method is immune to timestamp noise, realizing high-speed depth estimation without loss of accuracy. The binary nature of events and Gray code minimizes data redundancy, enabling us to fully utilize sensor bandwidth at 100%. Experimental results show that our approach achieves accuracy comparable to state-of-the-art scanning methods while surpassing them in data acquisition speed (up to 41 times improvement) without sacrificing accuracy. Our proposed approach offers a highly promising solution for ultra-fast, real-time, and high-precision dense depth estimation. Code and dataset will be publicly available.

Related papers

• Characterization of point-source transient events with a rolling-shutter compressed sensing system [0.0]
  Point-source transient events (PSTEs) pose several challenges to an imaging system. Traditional imaging systems that meet these requirements are costly in terms of price, size, weight, power consumption, and data bandwidth. We develop a novel compressed sensing algorithm adapted to the rolling shutter readout of an imaging system.
  arXiv  Detail & Related papers  (2024-08-29T19:22:37Z)
• Multi-Modal Neural Radiance Field for Monocular Dense SLAM with a Light-Weight ToF Sensor [58.305341034419136]
  We present the first dense SLAM system with a monocular camera and a light-weight ToF sensor. We propose a multi-modal implicit scene representation that supports rendering both the signals from the RGB camera and light-weight ToF sensor. Experiments demonstrate that our system well exploits the signals of light-weight ToF sensors and achieves competitive results.
  arXiv  Detail & Related papers  (2023-08-28T07:56:13Z)
• Gated2Gated: Self-Supervised Depth Estimation from Gated Images [22.415893281441928]
  Gated cameras hold promise as an alternative to scanning LiDAR sensors with high-resolution 3D depth. We propose an entirely self-supervised depth estimation method that uses gated intensity profiles and temporal consistency as a training signal.
  arXiv  Detail & Related papers  (2021-12-04T19:47:38Z)
• ESL: Event-based Structured Light [62.77144631509817]
  Event cameras are bio-inspired sensors providing significant advantages over standard cameras. We propose a novel structured-light system using an event camera to tackle the problem of accurate and high-speed depth sensing.
  arXiv  Detail & Related papers  (2021-11-30T15:47:39Z)
• Event Guided Depth Sensing [50.997474285910734]
  We present an efficient bio-inspired event-camera-driven depth estimation algorithm. In our approach, we illuminate areas of interest densely, depending on the scene activity detected by the event camera. We show the feasibility of our approach in a simulated autonomous driving sequences and real indoor environments.
  arXiv  Detail & Related papers  (2021-10-20T11:41:11Z)
• 10-mega pixel snapshot compressive imaging with a hybrid coded aperture [48.95666098332693]
  High resolution images are widely used in our daily life, whereas high-speed video capture is challenging due to the low frame rate of cameras working at the high resolution mode. snapshot imaging (SCI) was proposed as a solution to the low throughput of existing imaging systems.
  arXiv  Detail & Related papers  (2021-06-30T01:09:24Z)
• CodeVIO: Visual-Inertial Odometry with Learned Optimizable Dense Depth [83.77839773394106]
  We present a lightweight, tightly-coupled deep depth network and visual-inertial odometry system. We provide the network with previously marginalized sparse features from VIO to increase the accuracy of initial depth prediction. We show that it can run in real-time with single-thread execution while utilizing GPU acceleration only for the network and code Jacobian.
  arXiv  Detail & Related papers  (2020-12-18T09:42:54Z)
• Learning Monocular Dense Depth from Events [53.078665310545745]
  Event cameras produce brightness changes in the form of a stream of asynchronous events instead of intensity frames. Recent learning-based approaches have been applied to event-based data, such as monocular depth prediction. We propose a recurrent architecture to solve this task and show significant improvement over standard feed-forward methods.
  arXiv  Detail & Related papers  (2020-10-16T12:36:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.