DaDiff: Domain-aware Diffusion Model for Nighttime UAV Tracking

• URL: http://arxiv.org/abs/2410.12270v1
• Date: Wed, 16 Oct 2024 06:14:15 GMT
• Title: DaDiff: Domain-aware Diffusion Model for Nighttime UAV Tracking
• Abstract summary: This work proposes a novel progressive alignment paradigm, named domain-aware diffusion model (DaDiff) DaDiff aligning nighttime LR object features to the daytime by virtue of progressive and stable generations. An elaborate nighttime UAV tracking benchmark is constructed for LR objects, consisting of 100 annotated sequences.
• Score: 21.255323355862057
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Domain adaptation is an inspiring solution to the misalignment issue of day/night image features for nighttime UAV tracking. However, the one-step adaptation paradigm is inadequate in addressing the prevalent difficulties posed by low-resolution (LR) objects when viewed from the UAVs at night, owing to the blurry edge contour and limited detail information. Moreover, these approaches struggle to perceive LR objects disturbed by nighttime noise. To address these challenges, this work proposes a novel progressive alignment paradigm, named domain-aware diffusion model (DaDiff), aligning nighttime LR object features to the daytime by virtue of progressive and stable generations. The proposed DaDiff includes an alignment encoder to enhance the detail information of nighttime LR objects, a tracking-oriented layer designed to achieve close collaboration with tracking tasks, and a successive distribution discriminator presented to distinguish different feature distributions at each diffusion timestep successively. Furthermore, an elaborate nighttime UAV tracking benchmark is constructed for LR objects, namely NUT-LR, consisting of 100 annotated sequences. Exhaustive experiments have demonstrated the robustness and feature alignment ability of the proposed DaDiff. The source code and video demo are available at https://github.com/vision4robotics/DaDiff.

Related papers

• IPDiff: Diffusion-driven ORSI Salient Object Detection with Information Reconstruction and Multi-Prior Guidance [82.31495007058976]
  IPDiff is a Diffusion-driven ORSI-SOD method with Information Reconstruction and Multi-Prior Guidance.<n>We build IPDiff based on a unique dynamic optimization strategy, which endows IPDiff with the ability to iteratively optimize saliency maps with a dynamic parameter.<n>Our proposed IPDiff achieves the best performance compared to 46 state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-07-04T04:03:33Z)
• REAL-OW: Rehearsal-free Open World Object Detection with Low-Rank Adaptation and Dual-Stage Objectness Modeling [56.888597798431704]
  Open-World Object Detection (OWOD) requires detectors to identify previously unseen objects as unknown and incrementally incorporate them into the set of known categories.<n>Existing frameworks rely heavily on exemplar replay to mitigate catastrophic forgetting, but in some real applications, storing raw data conflicts with data access restrictions and leads to data exposure risks.<n>We propose REAL-OW, a novel rehearsal-free framework that decouples incremental knowledge through a collaborative adapter architecture.
  arXiv  Detail & Related papers  (2026-07-03T06:38:54Z)
• TAE: Target-aware enhancer for nighttime UAV tracking [13.707795153228732]
  We propose TAE, a target-aware low-light enhancement framework tailored for nighttime object tracking.<n> Guided explicitly by weak supervisory signals from tracking bounding boxes, TAE performs region-aware enhancement to ensure operations focus on the target area.<n>We also contribute DarkSOT, a new benchmark for nighttime UAV tracking, comprising 268 sequences across 9 target categories.
  arXiv  Detail & Related papers  (2026-05-28T08:11:21Z)
• Contrastive-SDXL: Annotation-Preserving Night-Time Augmentation for Pedestrian Detection [2.833077175010763]
  We present Contrastive-SDXL, a day-to-night augmentation framework for night-time pedestrian detection.<n>To preserve semantic correspondence between daytime inputs and translated night-time images, we introduce a patch-wise semantic contrastive loss.<n> Detectors trained with our synthetic images obtain a 6-7% reduction in miss rate compared with a daytime-only baseline.
  arXiv  Detail & Related papers  (2026-05-13T10:41:55Z)
• NDLPNet: A Location-Aware Nighttime Deraining Network and a Real-World Benchmark Dataset [8.582528726118023]
  Rain streak artifacts hamper the performance of nighttime surveillance and autonomous navigation.<n>We propose a novel Nighttime Deraining Location-enhanced Perceptual Network (NDLPNet)<n>NDLPNet captures the spatial positional information and density distribution of rain streaks in low-light environments.
  arXiv  Detail & Related papers  (2025-09-17T07:24:47Z)
• DARTer: Dynamic Adaptive Representation Tracker for Nighttime UAV Tracking [1.515687944002438]
  Nighttime UAV tracking presents significant challenges due to extreme illumination variations and viewpoint changes.<n>textbfDARTer (textbfDynamic textbfAdaptive textbfRepresentation textbfTracker) is an end-to-end tracking framework designed for nighttime UAV scenarios.
  arXiv  Detail & Related papers  (2025-05-01T05:24:14Z)
• CRTrack: Low-Light Semi-Supervised Multi-object Tracking Based on Consistency Regularization [9.878424965835883]
  We propose a semi-supervised multi-object tracking method based on consistency regularization named CRTrack. First, we calibrate a consistent adaptive sampling assignment to replace the static IoU-based strategy. Then, we design a adaptive semi-supervised network update method, which effectively leverages unannotated data to enhance model performance.
  arXiv  Detail & Related papers  (2025-02-24T03:35:38Z)
• DINTR: Tracking via Diffusion-based Interpolation [12.130669304428565]
  This work proposes a novel diffusion-based methodology to formulate the tracking task. Our INterpolation TrackeR (DINTR) presents a promising new paradigm and achieves a superior multiplicity on seven benchmarks across five indicator representations.
  arXiv  Detail & Related papers  (2024-10-14T00:41:58Z)
• Prompt-Driven Temporal Domain Adaptation for Nighttime UAV Tracking [21.09039345888337]
  Nighttime UAV tracking under low-illuminated scenarios has achieved great progress by domain adaptation (DA) Previous DA training-based works are deficient in narrowing the discrepancy of temporal contexts for UAV trackers. This work proposes a prompt-driven temporal domain adaptation training framework to fully utilize temporal contexts for challenging nighttime UAV tracking.
  arXiv  Detail & Related papers  (2024-09-27T08:12:28Z)
• Enhancing Nighttime UAV Tracking with Light Distribution Suppression [6.950880335490385]
  This work proposes a novel enhancer, i.e., LDEnhancer, enhancing nighttime UAV tracking with light distribution suppression. Specifically, a novel image content refinement module is developed to decompose the light distribution information and image content information. A challenging nighttime UAV tracking dataset with uneven light distribution, namely NAT2024-2, is constructed to provide a comprehensive evaluation.
  arXiv  Detail & Related papers  (2024-09-25T05:19:35Z)
• STCMOT: Spatio-Temporal Cohesion Learning for UAV-Based Multiple Object Tracking [13.269416985959404]
  Multiple object tracking (MOT) in Unmanned Aerial Vehicle (UAV) videos is important for diverse applications in computer vision. We propose a novel Spatio-Temporal Cohesion Multiple Object Tracking framework (STCMOT) We use historical embedding features to model the representation of ReID and detection features in a sequential order. Our framework sets a new state-of-the-art performance in MOTA and IDF1 metrics.
  arXiv  Detail & Related papers  (2024-09-17T14:34:18Z)
• Exploring Reliable Matching with Phase Enhancement for Night-time Semantic Segmentation [58.180226179087086]
  We propose a novel end-to-end optimized approach, named NightFormer, tailored for night-time semantic segmentation. Specifically, we design a pixel-level texture enhancement module to acquire texture-aware features hierarchically with phase enhancement and amplified attention. Our proposed method performs favorably against state-of-the-art night-time semantic segmentation methods.
  arXiv  Detail & Related papers  (2024-08-25T13:59:31Z)
• LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry [52.131996528655094]
  We present the Long-term Effective Any Point Tracking (LEAP) module. LEAP innovatively combines visual, inter-track, and temporal cues with mindfully selected anchors for dynamic track estimation. Based on these traits, we develop LEAP-VO, a robust visual odometry system adept at handling occlusions and dynamic scenes.
  arXiv  Detail & Related papers  (2024-01-03T18:57:27Z)
• Towards High-quality HDR Deghosting with Conditional Diffusion Models [88.83729417524823]
  High Dynamic Range (LDR) images can be recovered from several Low Dynamic Range (LDR) images by existing Deep Neural Networks (DNNs) techniques. DNNs still generate ghosting artifacts when LDR images have saturation and large motion. We formulate the HDR deghosting problem as an image generation that leverages LDR features as the diffusion model's condition.
  arXiv  Detail & Related papers  (2023-11-02T01:53:55Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• Adaptive Rotated Convolution for Rotated Object Detection [96.94590550217718]
  We present Adaptive Rotated Convolution (ARC) module to handle rotated object detection problem. In our ARC module, the convolution kernels rotate adaptively to extract object features with varying orientations in different images. The proposed approach achieves state-of-the-art performance on the DOTA dataset with 81.77% mAP.
  arXiv  Detail & Related papers  (2023-03-14T11:53:12Z)
• Unsupervised Domain Adaptation for Nighttime Aerial Tracking [27.595253191781904]
  This work develops a novel unsupervised domain adaptation framework for nighttime aerial tracking. A unique object discovery approach is provided to generate training patches from raw nighttime tracking videos. With a Transformer day/night feature discriminator, the daytime tracking model is adversarially trained to track at night.
  arXiv  Detail & Related papers  (2022-03-20T12:35:09Z)
• Asynchronous Tracking-by-Detection on Adaptive Time Surfaces for Event-based Object Tracking [87.0297771292994]
  We propose an Event-based Tracking-by-Detection (ETD) method for generic bounding box-based object tracking. To achieve this goal, we present an Adaptive Time-Surface with Linear Time Decay (ATSLTD) event-to-frame conversion algorithm. We compare the proposed ETD method with seven popular object tracking methods, that are based on conventional cameras or event cameras, and two variants of ETD.
  arXiv  Detail & Related papers  (2020-02-13T15:58:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.