NightSight: Passive Computation for Navigation in Dark Using Events

• URL: http://arxiv.org/abs/2605.26330v1
• Date: Mon, 25 May 2026 21:07:44 GMT
• Title: NightSight: Passive Computation for Navigation in Dark Using Events
• Abstract summary: Small aerial robots are well-suited for search and rescue in confined and hazardous environments.<n>We present a lightweight perception approach that combines a monocular event camera, a coded aperture lens, and an infrared dot projector.<n>Our system operates in real time at 20 Hz on a NVIDIA Jetson Orin Nano, demonstrating suitability for resource-constrained platforms.
• Score: 3.7376797687484005
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Small aerial robots are particularly well-suited for search and rescue in confined and hazardous environments due to their agility, low cost, and ability to traverse through cluttered spaces that are inaccessible to larger platforms. However, enabling autonomous navigation in complete darkness remains a significant challenge, because small aerial robots cannot easily accommodate perception systems that demand substantial payload, power, or computation. In this work, we present a lightweight perception approach that combines a monocular event camera, a coded aperture lens, and an infrared dot projector to enable navigation in such conditions. The projected pattern, when imaged through the coded aperture, produces depth dependent blur signatures that implicitly encode scene geometry. We train a convolutional neural network to decode these signatures into dense depth maps using only synthetic data generated from a simple planar wall setup. Despite this minimal training regime, the model generalizes zero-shot to complex real-world scenes. Our system operates in real time at 20 Hz on a NVIDIA Jetson Orin Nano, demonstrating suitability for resource-constrained platforms. We further analyze the impact of different coded aperture designs on depth estimation performance. Our approach gives high accuracy (l1 error 7.0cm) upto 2.5m range (2.80% error). These results highlight the potential of combining structured illumination, coded optics, and event-based sensing for enabling robust perception and navigation in complete darkness.

Related papers

• LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation [52.91080323083409]
  Embodied navigation requires agents to translate heterogeneous goals and visual observations into actions across tasks, environments, and robot embodiments.<n>Here we present LightNav-0, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads.
  arXiv  Detail & Related papers  (2026-08-31T15:08:53Z)
• MinNav: Minimalist Navigation Using Optical Flow For Active Tiny Aerial Robots [9.826647298407849]
  We introduce MinNav, a navigation stack based on optical flow and its uncertainty to fly through a scene with static and dynamic obstacles.<n>We improve success rate by using the activeness of the robot to move around in an exploratory way to find obstacles and navigate.
  arXiv  Detail & Related papers  (2026-06-05T19:45:02Z)
• AsterNav: Autonomous Aerial Robot Navigation In Darkness Using Passive Computation [7.194266824918107]
  We present an autonomous aerial robot for navigation in the dark by combining an Infra-Red (IR) monocular camera with a large-aperture coded lens and structured light without external infrastructure like GPS or motion-capture.<n>AsterNet runs onboard the robot at 20 Hz on an NVIDIA Jetson Orin$textTM$ Nano.
  arXiv  Detail & Related papers  (2026-01-24T18:41:40Z)
• Real-Time Glass Detection and Reprojection using Sensor Fusion Onboard Aerial Robots [9.34137124377529]
  transparent obstacles present significant challenges to reliable navigation and mapping.<n>We propose a novel and computationally efficient framework for detecting and mapping transparent obstacles onboard a sub-300g quadrotor.<n>Our method fuses data from a Time-of-Flight (ToF) camera and an ultrasonic sensor with a custom, lightweight 2D convolution model.<n>The entire pipeline operates in real-time, utilizing only a small fraction of a CPU core on an embedded processor.
  arXiv  Detail & Related papers  (2025-10-07T23:31:45Z)
• Skyshield: Event-Driven Submillimetre Thin Obstacle Detection for Drone Flight Safety [22.778033892271555]
  This paper introduces SkyShield, an event-driven, end-to-end framework designed for the perception of submillimeter scale obstacles.<n>Our method employs a lightweight U-Net architecture and an innovative Dice-Contour Regularization Loss to ensure precise detection.
  arXiv  Detail & Related papers  (2025-08-13T00:26:35Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• Neural Implicit Dense Semantic SLAM [83.04331351572277]
  We propose a novel RGBD vSLAM algorithm that learns a memory-efficient, dense 3D geometry, and semantic segmentation of an indoor scene in an online manner. Our pipeline combines classical 3D vision-based tracking and loop closing with neural fields-based mapping. Our proposed algorithm can greatly enhance scene perception and assist with a range of robot control problems.
  arXiv  Detail & Related papers  (2023-04-27T23:03:52Z)
• EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks [107.62975594230687]
  We demonstrate an application where event cameras excel: accurately estimating the impact location of fast-moving objects. We introduce a lightweight event representation called Binary Event History Image (BEHI) to encode event data at low latency. We show that the system is capable of achieving a success rate of 81% in catching balls targeted at different locations, with a velocity of up to 13 m/s even on compute-constrained embedded platforms.
  arXiv  Detail & Related papers  (2023-04-14T15:23:28Z)
• Deep Learning for Real Time Satellite Pose Estimation on Low Power Edge TPU [58.720142291102135]
  In this paper we propose a pose estimation software exploiting neural network architectures. We show how low power machine learning accelerators could enable Artificial Intelligence exploitation in space.
  arXiv  Detail & Related papers  (2022-04-07T08:53:18Z)
• Event Guided Depth Sensing [50.997474285910734]
  We present an efficient bio-inspired event-camera-driven depth estimation algorithm. In our approach, we illuminate areas of interest densely, depending on the scene activity detected by the event camera. We show the feasibility of our approach in a simulated autonomous driving sequences and real indoor environments.
  arXiv  Detail & Related papers  (2021-10-20T11:41:11Z)
• StereoSpike: Depth Learning with a Spiking Neural Network [0.0]
  We present an end-to-end neuromorphic approach to depth estimation. We use a Spiking Neural Network (SNN) with a slightly modified U-Net-like encoder-decoder architecture, that we named StereoSpike. We demonstrate that this architecture generalizes very well, even better than its non-spiking counterparts.
  arXiv  Detail & Related papers  (2021-09-28T14:11:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.