Event-RGB Adaptive Tracking for Nighttime Highway Perception

• URL: http://arxiv.org/abs/2607.11646v1
• Date: Mon, 13 Jul 2026 14:59:46 GMT
• Title: Event-RGB Adaptive Tracking for Nighttime Highway Perception
• Abstract summary: Intelligent Transportation Systems predominantly rely on conventional RGB cameras for traffic perception and vehicle tracking.<n>Nighttime scenarios suffer from motion blur, insufficient exposure, and poor signal-to-noise ratios, which catastrophically impair the reliability of RGB-based sensing systems.<n>We propose a novel Joint Event-RGB Adaptive Tracking (JEAT) framework to address these limitations.
• Score: 7.388485566907394
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Intelligent Transportation Systems deployed on highways predominantly rely on conventional RGB cameras for traffic perception and vehicle tracking. However, highway environments present unique challenges: the absence of artificial lighting infrastructure, combined with high vehicle velocities, results in severely degraded perception performance under low-light conditions. Specifically, nighttime scenarios suffer from motion blur, insufficient exposure, and poor signal-to-noise ratios, which catastrophically impair the reliability of RGB-based sensing systems. To address these limitations, we propose a novel Joint Event-RGB Adaptive Tracking (JEAT) framework. Unlike existing multi-sensor trackers constrained by rigid, hard-coded prioritization, JEAT merges asynchronous event streams and RGB frames into a unified joint data association optimization. By employing an Adaptive Extended Kalman Filter to continuously estimate measurement noise via NIS statistics, the framework dynamically weights and fuses both modalities, optimally harnessing event streams during dark or high-speed motion while leveraging RGB frames under bright or static conditions. Furthermore, given the absence of publicly available datasets tailored for event-based highway perception with diverse environmental conditions, we present SEHN, a large-scale synthetic dataset generated using the CARLA simulator. Our dataset encompasses diverse environmental conditions (daytime, nighttime, nighttime with out artificial lighting) and varying traffic densities, providing synchronized RGB imagery and event streams to facilitate multi-modal fusion research. Our code and datasets will be available at https://github.com/haidongwang96/SEHN.

Related papers

• Cyclops: LiDAR as a Camera That Dreams in Color [32.25721672776894]
  We propose a framework that translates sparse Non-Repetitive Scanning LiDAR (NRS-LiDAR) intensity into RGB video, enabling camera-free inference for all-day perception tasks.<n>Our approach first converts sparse LiDAR intensity projections into dense representations via a frozen pre-trained densification module.<n>The dense intensity latent is then transported toward the target RGB distribution through Latent Bridge Matching.
  arXiv  Detail & Related papers  (2026-08-17T08:37:09Z)
• Descriptor: LYNRED Mobility Dataset Multimodal Detection Subset (LYNRED-MDS) [21.053811864320302]
  We introduce the LYNRED-MDS: Multimodal Detection Subset, comprised of 4000 RGB-infrared image pairs captured in Grenoble, France.<n>Our dataset supports the development of more reliable and deployable vision systems for advanced driver-assistance systems.
  arXiv  Detail & Related papers  (2026-07-02T08:26:39Z)
• Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking [58.338848435042536]
  RGB-Event tracking improves localization by fusing RGB appearance textures and dense temporal motion cues from event sensors.<n>Real-world scenes suffer diverse structured signal degradations that hinder traditional multi-modal fusion.<n>We present a hierarchical perturbation and retrieval framework tailored for RGB-Event tracking with robustness against partial target missing and modal degradation.
  arXiv  Detail & Related papers  (2026-06-24T23:34:06Z)
• FEMOT: Multi-Object Tracking using Frame and Event Cameras [57.75021868843091]
  Bio-inspired event cameras offer high temporal resolution and high dynamic range, providing complementary cues under extreme scenarios.<n>FEMOT is a large-scale RGB-event multi-object tracking dataset that covers diverse real-world scenarios and 14 challenging attributes.<n>FEMOTR is a multimodal tracking framework that decouples RGB and event features and fuses them in the frequency domain.
  arXiv  Detail & Related papers  (2026-06-12T04:17:41Z)
• Design of a Real-time Asynchronous Monocular Odometry for Planetary Exploration [0.0]
  A real-time asynchronous event-based monocular odometry for planetary exploration.<n>Camera state is updated with every tracked position output generated by RATE, a real-time asynchronous feature tracker.
  arXiv  Detail & Related papers  (2026-05-26T20:25:33Z)
• Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking [51.31378940976401]
  Existing RGB-Event tracking approaches fail to fully exploit the unique advantages of event cameras.<n>We propose a novel tracking framework that performs early fusion in the frequency domain, enabling effective aggregation of high-frequency information from the event modality.<n>Experiments on three widely used RGB-Event tracking benchmark datasets, including FE108, FELT, and COESOT, demonstrate the high performance and efficiency of our method.
  arXiv  Detail & Related papers  (2026-01-03T01:10:17Z)
• SEVD: Synthetic Event-based Vision Dataset for Ego and Fixed Traffic Perception [22.114089372056238]
  We present SEVD, a first-of-its-kind multi-view ego, and fixed perception synthetic event-based dataset. SEVD spans urban, suburban, rural, and highway scenes featuring various classes of objects. We evaluate the dataset using state-of-the-art event-based (RED, RVT) and frame-based (YOLOv8) methods for traffic participant detection tasks.
  arXiv  Detail & Related papers  (2024-04-12T20:40:12Z)
• Implicit Event-RGBD Neural SLAM [54.74363487009845]
  Implicit neural SLAM has achieved remarkable progress recently. Existing methods face significant challenges in non-ideal scenarios. We propose EN-SLAM, the first event-RGBD implicit neural SLAM framework.
  arXiv  Detail & Related papers  (2023-11-18T08:48:58Z)
• Chasing Day and Night: Towards Robust and Efficient All-Day Object Detection Guided by an Event Camera [8.673063170884591]
  EOLO is a novel object detection framework that achieves robust and efficient all-day detection by fusing both RGB and event modalities. Our EOLO framework is built based on a lightweight spiking neural network (SNN) to efficiently leverage the asynchronous property of events.
  arXiv  Detail & Related papers  (2023-09-17T15:14:01Z)
• Revisiting Event-based Video Frame Interpolation [49.27404719898305]
  Dynamic vision sensors or event cameras provide rich complementary information for video frame. estimating optical flow from events is arguably more difficult than from RGB information. We propose a divide-and-conquer strategy in which event-based intermediate frame synthesis happens incrementally in multiple simplified stages.
  arXiv  Detail & Related papers  (2023-07-24T06:51:07Z)
• Asynchronous Blob Tracker for Event Cameras [5.64242497932732]
  Event-based cameras are popular for tracking fast-moving objects due to their high temporal resolution, low latency and high range. We propose a novel algorithm for tracking blobs using raw events asynchronously in real time. Our algorithm achieves highly accurate blob tracking, velocity estimation, and shape estimation even under challenging lighting conditions.
  arXiv  Detail & Related papers  (2023-07-20T05:15:03Z)
• Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learning [59.19469551774703]
  Drone-based vehicle detection aims at finding the vehicle locations and categories in an aerial image. We construct a large-scale drone-based RGB-Infrared vehicle detection dataset, termed DroneVehicle. Our DroneVehicle collects 28, 439 RGB-Infrared image pairs, covering urban roads, residential areas, parking lots, and other scenarios from day to night.
  arXiv  Detail & Related papers  (2020-03-05T05:29:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.