EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors
- URL: http://arxiv.org/abs/2604.02331v1
- Date: Thu, 02 Apr 2026 17:59:59 GMT
- Title: EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors
- Abstract summary: We propose EventHub, a novel framework for training deep-event stereo networks without ground truth annotations from costly active sensors.<n>We derive either proxy annotations and proxy events through state-of-the-art novel view synthesis techniques, or simply proxy annotations when images are already paired with event data.<n>Experiments on widely used event stereo datasets support the effectiveness of EventHub and show how the same data distillation mechanism can improve the accuracy of RGB stereo foundation models.
- Score: 63.131545315457544
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose EventHub, a novel framework for training deep-event stereo networks without ground truth annotations from costly active sensors, relying instead on standard color images. From these images, we derive either proxy annotations and proxy events through state-of-the-art novel view synthesis techniques, or simply proxy annotations when images are already paired with event data. Using the training set generated by our data factory, we repurpose state-of-the-art stereo models from RGB literature to process event data, obtaining new event stereo models with unprecedented generalization capabilities. Experiments on widely used event stereo datasets support the effectiveness of EventHub and show how the same data distillation mechanism can improve the accuracy of RGB stereo foundation models in challenging conditions such as nighttime scenes.
Related papers
- Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model [3.1333320740278623]
Saliency prediction has been extensively studied in RGB images and videos as a computational model of human visual attention.<n>We introduce SEST (Swin Event-based Saliency Transformer), a transformer-based model for saliency prediction from event data.<n>We introduce two new benchmark datasets, N-DHF1K and N-UCF Sports, generated from large-scale RGB saliency benchmarks.
arXiv Detail & Related papers (2026-05-22T15:52:01Z) - EventGait: Towards Robust Gait Recognition with Event Streams [50.890621860023]
Event cameras offer microsecond temporal resolution and high dynamic range, naturally capturing robust dynamic cues and suppressing static noise.<n>We propose textbfEventGait, an end-to-end dual-stream framework that separately models motion and shape while preserving the advantages of events.<n>Our approach sets a new state of the art on both synthesized and real-world event-based gait benchmarks, highlighting the robustness and potential of event-driven gait analysis.
arXiv Detail & Related papers (2026-05-21T08:12:04Z) - eNavi: Event-based Imitation Policies for Low-Light Indoor Mobile Robot Navigation [22.299468922396894]
We introduce a real-world indoor person-following dataset collected using a TurtleBot 2 robot.<n>We build a multimodal data preprocessing pipeline that temporally aligns event and RGB observations.<n>We propose a late-fusion RGB-Event navigation policy that combines dual MobileNet encoders with a transformer-based fusion module trained via behavioral cloning.
arXiv Detail & Related papers (2026-03-15T14:25:40Z) - EventGeM: Global-to-Local Feature Matching for Event-Based Visual Place Recognition [13.821242174757392]
We present EventGeM, a state-of-the-art global to local feature fusion pipeline for event-based Visual Place Recognition.<n>We demonstrate the capability of EventGeM in a real-world deployment on a robotic platform for online localization using event streams directly from an event camera.
arXiv Detail & Related papers (2026-03-06T01:40:12Z) - Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking [51.31378940976401]
Existing RGB-Event tracking approaches fail to fully exploit the unique advantages of event cameras.<n>We propose a novel tracking framework that performs early fusion in the frequency domain, enabling effective aggregation of high-frequency information from the event modality.<n>Experiments on three widely used RGB-Event tracking benchmark datasets, including FE108, FELT, and COESOT, demonstrate the high performance and efficiency of our method.
arXiv Detail & Related papers (2026-01-03T01:10:17Z) - ControlEvents: Controllable Synthesis of Event Camera Datawith Foundational Prior from Image Diffusion Models [61.17744115607788]
We present a diffusion-based generative model designed to synthesize high-quality event data guided by diverse control signals.<n>We demonstrate the effectiveness of our approach by synthesizing event data for visual recognition, 2D skeleton estimation, and 3D body pose estimation.
arXiv Detail & Related papers (2025-09-26T19:22:07Z) - When Person Re-Identification Meets Event Camera: A Benchmark Dataset and An Attribute-guided Re-Identification Framework [48.16640931718528]
This paper introduces a large-scale RGB-event based person ReID dataset, called EvReID.<n>The dataset contains 118,988 image pairs and covers 1200 pedestrian identities, with data collected across multiple seasons, scenes, and lighting conditions.<n>We also evaluate 15 state-of-the-art person ReID algorithms, laying a solid foundation for future research in terms of both data and benchmarking.
arXiv Detail & Related papers (2025-07-18T05:04:59Z) - EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fields [80.94515892378053]
EvDNeRF is a pipeline for generating event data and training an event-based dynamic NeRF.
NeRFs offer geometric-based learnable rendering, but prior work with events has only considered reconstruction of static scenes.
We show that by training on varied batch sizes of events, we can improve test-time predictions of events at fine time resolutions.
arXiv Detail & Related papers (2023-10-03T21:08:41Z) - Chasing Day and Night: Towards Robust and Efficient All-Day Object Detection Guided by an Event Camera [8.673063170884591]
EOLO is a novel object detection framework that achieves robust and efficient all-day detection by fusing both RGB and event modalities.
Our EOLO framework is built based on a lightweight spiking neural network (SNN) to efficiently leverage the asynchronous property of events.
arXiv Detail & Related papers (2023-09-17T15:14:01Z) - EventNeRF: Neural Radiance Fields from a Single Colour Event Camera [81.19234142730326]
This paper proposes the first approach for 3D-consistent, dense and novel view synthesis using just a single colour event stream as input.
At its core is a neural radiance field trained entirely in a self-supervised manner from events while preserving the original resolution of the colour event channels.
We evaluate our method qualitatively and numerically on several challenging synthetic and real scenes and show that it produces significantly denser and more visually appealing renderings.
arXiv Detail & Related papers (2022-06-23T17:59:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.