Adapting Depth Anything to Adverse Imaging Conditions with Events

• URL: http://arxiv.org/abs/2601.02020v1
• Date: Mon, 05 Jan 2026 11:29:49 GMT
• Title: Adapting Depth Anything to Adverse Imaging Conditions with Events
• Authors: Shihan Peng, Yuyang Xiong, Hanyu Zhou, Zhiwei Shi, Haoyue Liu, Gang Chen, Luxin Yan, Yi Chang,
• Abstract summary: We propose ADAE, an event-guidedtemporal fusion framework for Depth Anything in degraded scenes.<n>We adaptively merge frame-based and event-based features using an information entropy strategy.<n>We resort to the event-based motion cue to recalibrate ambiguous features in blurred regions.
• Score: 36.04942562030614
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robust depth estimation under dynamic and adverse lighting conditions is essential for robotic systems. Currently, depth foundation models, such as Depth Anything, achieve great success in ideal scenes but remain challenging under adverse imaging conditions such as extreme illumination and motion blur. These degradations corrupt the visual signals of frame cameras, weakening the discriminative features of frame-based depths across the spatial and temporal dimensions. Typically, existing approaches incorporate event cameras to leverage their high dynamic range and temporal resolution, aiming to compensate for corrupted frame features. However, such specialized fusion models are predominantly trained from scratch on domain-specific datasets, thereby failing to inherit the open-world knowledge and robust generalization inherent to foundation models. In this work, we propose ADAE, an event-guided spatiotemporal fusion framework for Depth Anything in degraded scenes. Our design is guided by two key insights: 1) Entropy-Aware Spatial Fusion. We adaptively merge frame-based and event-based features using an information entropy strategy to indicate illumination-induced degradation. 2) Motion-Guided Temporal Correction. We resort to the event-based motion cue to recalibrate ambiguous features in blurred regions. Under our unified framework, the two components are complementary to each other and jointly enhance Depth Anything under adverse imaging conditions. Extensive experiments have been performed to verify the superiority of the proposed method. Our code will be released upon acceptance.

Related papers

• UDPNet: Unleashing Depth-based Priors for Robust Image Dehazing [77.10640210751981]
  UDPNet is a general framework that leverages depth-based priors from a large-scale pretrained depth estimation model DepthAnything V2.<n>Our proposed solution establishes a new benchmark for depth-aware dehazing across various scenarios.
  arXiv  Detail & Related papers  (2026-01-11T13:29:02Z)
• Does FLUX Already Know How to Perform Physically Plausible Image Composition? [26.848563827256914]
  SHINE is a training-free framework for Seamless, High-fidelity Insertion with Neutralized Errors.<n>We introduce ComplexCompo, featuring diverse resolutions and challenging conditions such as low lighting, strong illumination, intricate shadows, and reflective surfaces.
  arXiv  Detail & Related papers  (2025-09-25T15:01:49Z)
• Bidirectional Image-Event Guided Fusion Framework for Low-Light Image Enhancement [24.5584423318892]
  Under extreme low-light conditions, frame-based cameras suffer from severe detail loss due to limited dynamic range.<n>Recent studies have introduced event cameras for event-guided low-light image enhancement.<n>We propose BiLIE, a Bidirectional image-event guided fusion framework for Low-Light Image Enhancement.
  arXiv  Detail & Related papers  (2025-06-06T14:28:17Z)
• Event-Driven Dynamic Scene Depth Completion [50.01494043834177]
  EventDC is the first event-driven depth completion framework.<n>It consists of two key components: Event-Modulated Alignment (EMA) and Local Depth Filtering (LDF)
  arXiv  Detail & Related papers  (2025-05-19T16:02:37Z)
• Temporally Consistent Online Depth Estimation Using Point-Based Fusion [6.5514240555359455]
  We aim to estimate temporally consistent depth maps of video streams in an online setting. This is a difficult problem as future frames are not available and the method must choose between enforcing consistency and correcting errors from previous estimations. We propose to address these challenges by using a global point cloud that is dynamically updated each frame, along with a learned fusion approach in image space.
  arXiv  Detail & Related papers  (2023-04-15T00:04:18Z)
• Parallax-Tolerant Unsupervised Deep Image Stitching [57.76737888499145]
  We propose UDIS++, a parallax-tolerant unsupervised deep image stitching technique. First, we propose a robust and flexible warp to model the image registration from global homography to local thin-plate spline motion. To further eliminate the parallax artifacts, we propose to composite the stitched image seamlessly by unsupervised learning for seam-driven composition masks.
  arXiv  Detail & Related papers  (2023-02-16T10:40:55Z)
• Shakes on a Plane: Unsupervised Depth Estimation from Unstabilized Photography [54.36608424943729]
  We show that in a ''long-burst'', forty-two 12-megapixel RAW frames captured in a two-second sequence, there is enough parallax information from natural hand tremor alone to recover high-quality scene depth. We devise a test-time optimization approach that fits a neural RGB-D representation to long-burst data and simultaneously estimates scene depth and camera motion.
  arXiv  Detail & Related papers  (2022-12-22T18:54:34Z)
• DEVO: Depth-Event Camera Visual Odometry in Challenging Conditions [30.892930944644853]
  We present a novel real-time visual odometry framework for a stereo setup of a depth and high-resolution event camera. Our framework balances accuracy and robustness against computational efficiency towards strong performance in challenging scenarios.
  arXiv  Detail & Related papers  (2022-02-05T13:46:47Z)
• DeFMO: Deblurring and Shape Recovery of Fast Moving Objects [139.67524021201103]
  generative model embeds an image of the blurred object into a latent space representation, disentangles the background, and renders the sharp appearance. DeFMO outperforms the state of the art and generates high-quality temporal super-resolution frames.
  arXiv  Detail & Related papers  (2020-12-01T16:02:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.