Feedback control of event cameras

• URL: http://arxiv.org/abs/2105.00409v1
• Date: Sun, 2 May 2021 07:41:39 GMT
• Title: Feedback control of event cameras
• Authors: Tobi Delbruck, Rui Graca, Marcin Paluch
• Abstract summary: Dynamic vision sensor event cameras produce a variable data rate stream of brightness change events. Event production at the pixel level is controlled by threshold, bandwidth, and refractory period bias current parameter settings. This paper proposes fixed-step feedback controllers that use measurements of event rate and noise.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Dynamic vision sensor event cameras produce a variable data rate stream of brightness change events. Event production at the pixel level is controlled by threshold, bandwidth, and refractory period bias current parameter settings. Biases must be adjusted to match application requirements and the optimal settings depend on many factors. As a first step towards automatic control of biases, this paper proposes fixed-step feedback controllers that use measurements of event rate and noise. The controllers regulate the event rate within an acceptable range using threshold and refractory period control, and regulate noise using bandwidth control. Experiments demonstrate model validity and feedback control.

Related papers

• Deblur e-NeRF: NeRF from Motion-Blurred Events under High-speed or Low-light Conditions [56.84882059011291]
  We propose Deblur e-NeRF, a novel method to reconstruct blur-minimal NeRFs from motion-red events. We also introduce a novel threshold-normalized total variation loss to improve the regularization of large textureless patches.
  arXiv  Detail & Related papers  (2024-09-26T15:57:20Z)
• Optimal OnTheFly Feedback Control of Event Sensors [0.14999444543328289]
  Event-based vision sensors produce an asynchronous stream of events which are triggered when pixel intensity variation exceeds a threshold. We propose an approach for dynamic feedback control of activation thresholds, in which a controller network analyzes the past emitted events. We demonstrate that our approach outperforms both fixed and randomly-varying threshold schemes by 6-12% in terms of LPIPS perceptual image dissimilarity metric.
  arXiv  Detail & Related papers  (2024-08-23T10:49:16Z)
• Enhancing Visual Place Recognition via Fast and Slow Adaptive Biasing in Event Cameras [18.348497200655746]
  Event cameras are increasingly popular in robotics due to beneficial features such as low latency, energy efficiency, and high dynamic range. These parameters regulate the necessary change in light intensity to trigger an event, which in turn depends on factors such as the environment lighting and camera motion. This paper introduces feedback control algorithms that automatically tune the bias parameters through two interacting methods.
  arXiv  Detail & Related papers  (2024-03-25T05:10:34Z)
• Fine-grained Controllable Video Generation via Object Appearance and Context [74.23066823064575]
  We propose fine-grained controllable video generation (FACTOR) to achieve detailed control. FACTOR aims to control objects' appearances and context, including their location and category. Our method achieves controllability of object appearances without finetuning, which reduces the per-subject optimization efforts for the users.
  arXiv  Detail & Related papers  (2023-12-05T17:47:33Z)
• Implicit Event-RGBD Neural SLAM [54.74363487009845]
  Implicit neural SLAM has achieved remarkable progress recently. Existing methods face significant challenges in non-ideal scenarios. We propose EN-SLAM, the first event-RGBD implicit neural SLAM framework.
  arXiv  Detail & Related papers  (2023-11-18T08:48:58Z)
• E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Cameras [18.54225086007182]
  We present E-Calib, a novel, fast, robust, and accurate calibration toolbox for event cameras. The proposed method is tested in a variety of rigorous experiments for different event camera models.
  arXiv  Detail & Related papers  (2023-06-15T12:16:38Z)
• Anticipatory Music Transformer [60.15347393822849]
  We introduce anticipation: a method for constructing a controllable generative model of a temporal point process. We focus on infilling control tasks, whereby the controls are a subset of the events themselves. We train anticipatory infilling models using the large and diverse Lakh MIDI music dataset.
  arXiv  Detail & Related papers  (2023-06-14T16:27:53Z)
• Fast-moving object counting with an event camera [0.0]
  This paper proposes the use of an event camera as a component of a vision system that enables counting of fast-moving objects. The proposed counting algorithm processes events in real time. The validity of using an event camera to count small, fast-moving objects and the associated wide range of potential industrial applications can be confirmed.
  arXiv  Detail & Related papers  (2022-12-16T10:16:42Z)
• Control and Evaluation of Event Cameras Output Sharpness via Bias [1.854931308524932]
  Event cameras also known as neuromorphic sensors are relatively a new technology with some privilege over the RGB cameras. Five different bias settings are explained and the effect of their change in the event output is surveyed and analyzed.
  arXiv  Detail & Related papers  (2022-10-25T11:31:37Z)
• On Controller Tuning with Time-Varying Bayesian Optimization [74.57758188038375]
  We will use time-varying optimization (TVBO) to tune controllers online in changing environments using appropriate prior knowledge on the control objective and its changes. We propose a novel TVBO strategy using Uncertainty-Injection (UI), which incorporates the assumption of incremental and lasting changes. Our model outperforms the state-of-the-art method in TVBO, exhibiting reduced regret and fewer unstable parameter configurations.
  arXiv  Detail & Related papers  (2022-07-22T14:54:13Z)
• How to Calibrate Your Event Camera [58.80418612800161]
  We propose a generic event camera calibration framework using image reconstruction. We show that neural-network-based image reconstruction is well suited for the task of intrinsic and extrinsic calibration of event cameras.
  arXiv  Detail & Related papers  (2021-05-26T07:06:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.