BuFF: Burst Feature Finder for Light-Constrained 3D Reconstruction
- URL: http://arxiv.org/abs/2209.09470v1
- Date: Tue, 20 Sep 2022 05:06:33 GMT
- Title: BuFF: Burst Feature Finder for Light-Constrained 3D Reconstruction
- Authors: Ahalya Ravendran, Mitch Bryson, Donald G. Dansereau
- Abstract summary: We develop a novel feature detector that operates directly on image bursts that enhances vision-based reconstruction under extremely low-light conditions.
Our approach finds keypoints with well-defined scale and apparent motion within each burst by jointly searching in a multi-scale and multi-motion space.
- Score: 2.298932494750101
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Robots operating at night using conventional vision cameras face significant
challenges in reconstruction due to noise-limited images. Previous work has
demonstrated that burst-imaging techniques can be used to partially overcome
this issue. In this paper, we develop a novel feature detector that operates
directly on image bursts that enhances vision-based reconstruction under
extremely low-light conditions. Our approach finds keypoints with well-defined
scale and apparent motion within each burst by jointly searching in a
multi-scale and multi-motion space. Because we describe these features at a
stage where the images have higher signal-to-noise ratio, the detected features
are more accurate than the state-of-the-art on conventional noisy images and
burst-merged images and exhibit high precision, recall, and matching
performance. We show improved feature performance and camera pose estimates and
demonstrate improved structure-from-motion performance using our feature
detector in challenging light-constrained scenes. Our feature finder provides a
significant step towards robots operating in low-light scenarios and
applications including night-time operations.
Related papers
- Rethinking High-speed Image Reconstruction Framework with Spike Camera [48.627095354244204]
Spike cameras generate continuous spike streams to capture high-speed scenes with lower bandwidth and higher dynamic range than traditional RGB cameras.
We introduce a novel spike-to-image reconstruction framework SpikeCLIP that goes beyond traditional training paradigms.
Our experiments on real-world low-light datasets demonstrate that SpikeCLIP significantly enhances texture details and the luminance balance of recovered images.
arXiv Detail & Related papers (2025-01-08T13:00:17Z) - SweepEvGS: Event-Based 3D Gaussian Splatting for Macro and Micro Radiance Field Rendering from a Single Sweep [48.34647667445792]
SweepEvGS is a novel hardware-integrated method that leverages event cameras for robust and accurate novel view synthesis from a single sweep.
We validate the robustness and efficiency of SweepEvGS through experiments in three different imaging settings.
Our results demonstrate that SweepEvGS surpasses existing methods in visual rendering quality, rendering speed, and computational efficiency.
arXiv Detail & Related papers (2024-12-16T09:09:42Z) - LBurst: Learning-Based Robotic Burst Feature Extraction for 3D Reconstruction in Low Light [2.048226951354646]
We present a learning architecture for improving 3D reconstructions in low-light conditions by finding features in a burst.
Our approach enhances visual reconstruction by detecting and describing high quality true features and less spurious features in low signal-to-noise ratio images.
arXiv Detail & Related papers (2024-10-31T00:08:36Z) - Towards Real-world Event-guided Low-light Video Enhancement and Deblurring [39.942568142125126]
Event cameras have emerged as a promising solution for improving image quality in low-light environments.
We introduce an end-to-end framework to effectively handle these tasks.
Our framework incorporates a module to efficiently leverage temporal information from events and frames.
arXiv Detail & Related papers (2024-08-27T09:44:54Z) - High Dynamic Range and Super-Resolution from Raw Image Bursts [52.341483902624006]
This paper introduces the first approach to reconstruct high-resolution, high-dynamic range color images from raw photographic bursts captured by a handheld camera with exposure bracketing.
The proposed algorithm is fast, with low memory requirements compared to state-of-the-art learning-based approaches to image restoration.
Experiments demonstrate its excellent performance with super-resolution factors of up to $times 4$ on real photographs taken in the wild with hand-held cameras.
arXiv Detail & Related papers (2022-07-29T13:31:28Z) - Are High-Resolution Event Cameras Really Needed? [62.70541164894224]
In low-illumination conditions and at high speeds, low-resolution cameras can outperform high-resolution ones, while requiring a significantly lower bandwidth.
We provide both empirical and theoretical evidence for this claim, which indicates that high-resolution event cameras exhibit higher per-pixel event rates.
In most cases, high-resolution event cameras show a lower task performance, compared to lower resolution sensors in these conditions.
arXiv Detail & Related papers (2022-03-28T12:06:20Z) - ESL: Event-based Structured Light [62.77144631509817]
Event cameras are bio-inspired sensors providing significant advantages over standard cameras.
We propose a novel structured-light system using an event camera to tackle the problem of accurate and high-speed depth sensing.
arXiv Detail & Related papers (2021-11-30T15:47:39Z) - Burst Imaging for Light-Constrained Structure-From-Motion [4.125187280299246]
We develop an image processing technique for aiding 3D reconstruction from images acquired in low light conditions.
Our technique, based on burst photography, uses direct methods for image registration within bursts of short exposure time images.
Our method is a significant step towards allowing robots to operate in low light conditions, with potential applications to robots operating in environments such as underground mines and night time operation.
arXiv Detail & Related papers (2021-08-23T02:12:40Z) - Deep Bilateral Retinex for Low-Light Image Enhancement [96.15991198417552]
Low-light images suffer from poor visibility caused by low contrast, color distortion and measurement noise.
This paper proposes a deep learning method for low-light image enhancement with a particular focus on handling the measurement noise.
The proposed method is very competitive to the state-of-the-art methods, and has significant advantage over others when processing images captured in extremely low lighting conditions.
arXiv Detail & Related papers (2020-07-04T06:26:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.