SkyEV: RGB-Event UAV detection and tracking dataset and baseline
- URL: http://arxiv.org/abs/2607.18747v1
- Date: Tue, 21 Jul 2026 06:12:06 GMT
- Title: SkyEV: RGB-Event UAV detection and tracking dataset and baseline
- Abstract summary: We introduce SkyEV, an open-source dataset featuring highly synchronized RGB and event-based data.<n>SkyEV distinguishes itself by capturing complex real-world conditions, including camera motion and varied optical setups.<n>We provide a unified data loader and establish an experimental baseline, demonstrating the dataset's efficacy in detecting challenging, small-scale targets.
- Score: 7.035143064175411
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Detecting UAVs in air spaces has become increasingly important due to UAVs widespread availability and easy usage. However, due to their small size, they are typically difficult to detect at a sufficient range. For the training of optimized detection algorithms, datasets have been published, covering optical sensing methods ranging from infrared to regular RGB to event-sensor-based. However, these datasets often fail to reflect realistic counter-UAV scenarios, lacking critical factors such as camera ego-motion, extremely small target scales, and diverse lens configurations, and introduce compression artefacts on the frame images. To address this gap, we introduce SkyEV, an open-source dataset featuring highly synchronized uncompressed RGB and event-based data. SkyEV distinguishes itself by capturing complex real-world conditions, including significant camera motion and varied optical setups, which are essential for testing the fundamental trade-off between Field of View and detection range. Furthermore, we provide a unified data loader and establish an experimental baseline using a multi-modal architecture, demonstrating the dataset's efficacy in detecting challenging, small-scale targets.
Related papers
- FEMOT: Multi-Object Tracking using Frame and Event Cameras [57.75021868843091]
Bio-inspired event cameras offer high temporal resolution and high dynamic range, providing complementary cues under extreme scenarios.<n>FEMOT is a large-scale RGB-event multi-object tracking dataset that covers diverse real-world scenarios and 14 challenging attributes.<n>FEMOTR is a multimodal tracking framework that decouples RGB and event features and fuses them in the frequency domain.
arXiv Detail & Related papers (2026-06-12T04:17:41Z) - A Multimodal RGB and Events Dataset for Hand Detection in First-Person View [2.5043709580004787]
Existing hand detection algorithms work on images and the detection rate is restricted by the frame rate of the camera.<n>Recent work has shown that using a stereo setup of an event-based and a frame-based camera improves detection accuracy and the bandwidth-latency tradeoff.<n>We propose a methodology and an exemplary synthetic event-based hand dataset from an egocentric, first-person view perspective.
arXiv Detail & Related papers (2026-06-09T12:40:47Z) - Towards UAV Detection in the Real World: A New Multispectral Dataset UAVNet-MS and a New Method [80.50361258830928]
UAVNet-MS is the first multispectral dataset for fine-grained small-UAV detection.<n>We propose MFDNet, a dual-stream baseline addressing array-induced parallax and spatial-spectral fusion.<n>This work provides foundational dataset, strong baseline, and benchmark for multispectral UAV monitoring research.
arXiv Detail & Related papers (2026-05-20T09:49:04Z) - RAWild: Sensor-Agnostic RAW Object Detection via Physics-Guided Curve and Grid Modeling [69.96407948879015]
textbfRAWild is a physics-guided global-local tone mapping framework for sensor-agnostic RAW object detection.<n>We construct a physics-based RAW simulation pipeline that synthesizes realistic sensor outputs spanning diverse spectral sensitivities, illuminants, and sensor non-idealities.
arXiv Detail & Related papers (2026-05-07T09:51:47Z) - UAV-CB: A Complex-Background RGB-T Dataset and Local Frequency Bridge Network for UAV Detection [23.481887931930004]
In real-world scenarios, UAVs are frequently visually blended with surrounding structures such as buildings, vegetation, and power lines.<n>Existing UAV detection datasets, though diverse, are not specifically designed to capture these camouflage and complex-background challenges.<n>We construct UAV-CB, a new RGB-T UAV detection dataset deliberately curated to emphasize low-altitude backgrounds and camouflage characteristics.<n>We also propose the Local Frequency Bridge Network (LFBNet), which features in localized frequency space to bridge the frequency-spatial fusion gap and the cross-modality discrepancy gap in RGB-T fusion.
arXiv Detail & Related papers (2026-03-18T08:55:35Z) - SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systems [1.891522135443594]
Domain-adaptive thermal object detection plays a key role in facilitating visible (RGB)-to-thermal (IR) adaptation.<n>In inherent limitations of IR images, such as the lack of color and texture cues, pose challenges for RGB-trained models.<n>We propose Semantic-Aware Gray color Augmentation (SAGA), a novel strategy for mitigating color bias and bridging the domain gap.
arXiv Detail & Related papers (2025-04-22T09:22:11Z) - Multi-Domain Biometric Recognition using Body Embeddings [51.36007967653781]
We show that body embeddings perform better than face embeddings in medium-wave infrared (MWIR) and long-wave infrared (LWIR) domains.<n>We leverage a vision transformer architecture to establish benchmark results on the IJB-MDF dataset.<n>We also show that finetuning a body model, pretrained exclusively on VIS data, with a simple combination of cross-entropy and triplet losses achieves state-of-the-art mAP scores.
arXiv Detail & Related papers (2025-03-13T22:38:18Z) - IndraEye: Infrared Electro-Optical UAV-based Perception Dataset for Robust Downstream Tasks [1.629670808239867]
In this paper, we introduce the IndraEye dataset, a multi-sensor (EO-IR) dataset designed for various tasks.
It includes 5,612 images with 145,666 instances, encompassing multiple viewing angles, altitudes, seven backgrounds, and different times of the day across the Indian subcontinent.
The dataset opens up several research opportunities, such as multimodal learning, domain adaptation for object detection and segmentation, and exploration of sensor-specific strengths and weaknesses.
arXiv Detail & Related papers (2024-10-28T12:12:28Z) - SARDet-100K: Towards Open-Source Benchmark and ToolKit for Large-Scale SAR Object Detection [79.23689506129733]
We establish a new benchmark dataset and an open-source method for large-scale SAR object detection.<n>Our dataset, SARDet-100K, is a result of intense surveying, collecting, and standardizing 10 existing SAR detection datasets.<n>To the best of our knowledge, SARDet-100K is the first COCO-level large-scale multi-class SAR object detection dataset ever created.
arXiv Detail & Related papers (2024-03-11T09:20:40Z) - Drone-based RGB-Infrared Cross-Modality Vehicle Detection via
Uncertainty-Aware Learning [59.19469551774703]
Drone-based vehicle detection aims at finding the vehicle locations and categories in an aerial image.
We construct a large-scale drone-based RGB-Infrared vehicle detection dataset, termed DroneVehicle.
Our DroneVehicle collects 28, 439 RGB-Infrared image pairs, covering urban roads, residential areas, parking lots, and other scenarios from day to night.
arXiv Detail & Related papers (2020-03-05T05:29:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.