Driving in Spikes: An Entropy-Guided Object Detector for Spike Cameras

• URL: http://arxiv.org/abs/2511.15459v1
• Date: Wed, 19 Nov 2025 14:16:17 GMT
• Title: Driving in Spikes: An Entropy-Guided Object Detector for Spike Cameras
• Authors: Ziyan Liu, Qi Su, Lulu Tang, Zhaofei Yu, Tiejun Huang,
• Abstract summary: Spike cameras offer microsecond latency and ultra high dynamic range for object detection.<n>Their sparse, discrete output cannot be processed by standard image-based detectors.<n>We propose EASD, an end to end spike camera detector with a dual branch design.<n>We introduce DSEC Spike, the first driving oriented simulated spike detection benchmark.
• Score: 62.94986160782233
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Object detection in autonomous driving suffers from motion blur and saturation under fast motion and extreme lighting. Spike cameras, offer microsecond latency and ultra high dynamic range for object detection by using per pixel asynchronous integrate and fire. However, their sparse, discrete output cannot be processed by standard image-based detectors, posing a critical challenge for end to end spike stream detection. We propose EASD, an end to end spike camera detector with a dual branch design: a Temporal Based Texture plus Feature Fusion branch for global cross slice semantics, and an Entropy Selective Attention branch for object centric details. To close the data gap, we introduce DSEC Spike, the first driving oriented simulated spike detection benchmark.

Related papers

• IrisNet: Infrared Image Status Awareness Meta Decoder for Infrared Small Targets Detection [92.56025546608699]
  IrisNet is a novel meta-learned framework that adapts detection strategies to the input infrared image status.<n>Our approach establishes a dynamic mapping between infrared image features and entire decoder parameters.<n> Experiments on NUDT-SIRST, NUAA-SIRST, and IRSTD-1K datasets demonstrate the superiority of our IrisNet.
  arXiv  Detail & Related papers  (2025-11-25T13:53:54Z)
• DoppDrive: Doppler-Driven Temporal Aggregation for Improved Radar Object Detection [6.0158981171030685]
  Existing methods increase point density through temporal aggregation with ego-motion compensation, but this approach introduces scatter from dynamic objects, degrading detection performance.<n>We propose DoppDrive, a novel Doppler-Driven temporal aggregation method that enhances radar point cloud density while minimizing scatter.<n>DoppDrive is a point cloud density enhancement step applied before detection, compatible with any detector, and we demonstrate that it significantly improves object detection performance across various detectors and datasets.
  arXiv  Detail & Related papers  (2025-08-17T11:24:46Z)
• SpikeStereoNet: A Brain-Inspired Framework for Stereo Depth Estimation from Spike Streams [70.9610707466343]
  Bio-inspired spike cameras emit asynchronous events at microsecond-level resolution, providing an alternative sensing modality.<n>Existing methods lack specialized stereo algorithms and benchmarks tailored to the spike data.<n>We propose SpikeStereoNet, a brain-inspired framework and the first to estimate stereo depth directly from raw spike streams.
  arXiv  Detail & Related papers  (2025-05-26T04:14:34Z)
• POD: Predictive Object Detection with Single-Frame FMCW LiDAR Point Cloud [14.873096346810723]
  This paper explores the unique advantage of Frequency Modulated Continuous Wave (FMCW) LiDAR in autonomous perception.<n>Given a single frame FMCW point cloud with radial velocity measurements, we expect that our object detector can detect the short-term future locations of objects.<n>We propose a novel POD framework, the core idea of which is to generate a virtual future point using a ray casting mechanism.
  arXiv  Detail & Related papers  (2025-04-08T03:53:28Z)
• RobuRCDet: Enhancing Robustness of Radar-Camera Fusion in Bird's Eye View for 3D Object Detection [68.99784784185019]
  Poor lighting or adverse weather conditions degrade camera performance.<n>Radar suffers from noise and positional ambiguity.<n>We propose RobuRCDet, a robust object detection model in BEV.
  arXiv  Detail & Related papers  (2025-02-18T17:17:38Z)
• SpecDETR: A Transformer-based Hyperspectral Point Object Detection Network [32.7318504162588]
  Hyperspectral target detection (HTD) aims to identify specific materials based on spectral information in hyperspectral imagery.<n>Existing HTD methods are developed based on per-pixel binary classification, neglecting the three-dimensional cube structure of hyperspectral images.<n>We introduce SpecDETR, the first specialized network for hyperspectral multi-class point object detection.
  arXiv  Detail & Related papers  (2024-05-16T14:45:06Z)
• SpikeMOT: Event-based Multi-Object Tracking with Sparse Motion Features [52.213656737672935]
  SpikeMOT is an event-based multi-object tracker. SpikeMOT uses spiking neural networks to extract sparsetemporal features from event streams associated with objects.
  arXiv  Detail & Related papers  (2023-09-29T05:13:43Z)
• SODFormer: Streaming Object Detection with Transformer Using Events and Frames [31.293847706713052]
  DA camera, streaming two complementary sensing modalities of asynchronous events and frames, has gradually been used to address major object detection challenges. We propose a novel streaming object detector with SODFormer, which first integrates events and frames to continuously detect objects in an asynchronous manner.
  arXiv  Detail & Related papers  (2023-08-08T04:53:52Z)
• Multi-Task Cross-Modality Attention-Fusion for 2D Object Detection [6.388430091498446]
  We propose two new radar preprocessing techniques to better align radar and camera data. We also introduce a Multi-Task Cross-Modality Attention-Fusion Network (MCAF-Net) for object detection. Our approach outperforms current state-of-the-art radar-camera fusion-based object detectors in the nuScenes dataset.
  arXiv  Detail & Related papers  (2023-07-17T09:26:13Z)
• DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Clouds [55.755450273390004]
  Existing offboard 3D detectors always follow a modular pipeline design to take advantage of unlimited sequential point clouds. We have found that the full potential of offboard 3D detectors is not explored mainly due to two reasons: (1) the onboard multi-object tracker cannot generate sufficient complete object trajectories, and (2) the motion state of objects poses an inevitable challenge for the object-centric refining stage. To tackle these problems, we propose a novel paradigm of offboard 3D object detection, named DetZero.
  arXiv  Detail & Related papers  (2023-06-09T16:42:00Z)
• Bridging the View Disparity of Radar and Camera Features for Multi-modal Fusion 3D Object Detection [6.959556180268547]
  This paper focuses on how to utilize millimeter-wave (MMW) radar and camera sensor fusion for 3D object detection. A novel method which realizes the feature-level fusion under bird-eye view (BEV) for a better feature representation is proposed.
  arXiv  Detail & Related papers  (2022-08-25T13:21:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.