Investigation of UAV Detection in Images with Complex Backgrounds and Rainy Artifacts

• URL: http://arxiv.org/abs/2305.16450v2
• Date: Tue, 5 Dec 2023 18:35:18 GMT
• Title: Investigation of UAV Detection in Images with Complex Backgrounds and Rainy Artifacts
• Authors: Adnan Munir, Abdul Jabbar Siddiqui, Saeed Anwar
• Abstract summary: Vision-based object detection methods have been developed for UAV detection. UAV detection in images with complex backgrounds and weather artifacts like rain has yet to be reasonably studied. This work also focuses on benchmarking state-of-the-art object detection models.
• Score: 20.20609511526255
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: To detect unmanned aerial vehicles (UAVs) in real-time, computer vision and deep learning approaches are evolving research areas. Interest in this problem has grown due to concerns regarding the possible hazards and misuse of employing UAVs in many applications. These include potential privacy violations. To address the concerns, vision-based object detection methods have been developed for UAV detection. However, UAV detection in images with complex backgrounds and weather artifacts like rain has yet to be reasonably studied. Hence, for this purpose, we prepared two training datasets. The first dataset has the sky as its background and is called the Sky Background Dataset (SBD). The second training dataset has more complex scenes (with diverse backgrounds) and is named the Complex Background Dataset (CBD). Additionally, two test sets were prepared: one containing clear images and the other with images with three rain artifacts, named the Rainy Test Set (RTS). This work also focuses on benchmarking state-of-the-art object detection models, and to the best of our knowledge, it is the first to investigate the performance of recent and popular vision-based object detection methods for UAV detection under challenging conditions such as complex backgrounds, varying UAV sizes, and low-to-heavy rainy conditions. The findings presented in the paper shall help provide insights concerning the performance of the selected models for UAV detection under challenging conditions and pave the way to develop more robust UAV detection methods. The codes and datasets are available at: https://github.com/AdnanMunir294/UAVD-CBRA.

Related papers

• UAV-Rain1k: A Benchmark for Raindrop Removal from UAV Aerial Imagery [18.97379943624394]
  Raindrops adhering to the lens of UAVs can obstruct visibility of the background scene and degrade image quality. We first construct a new benchmark dataset for removing raindrops from UAV images, called UAV-Rain1k.
  arXiv  Detail & Related papers  (2024-02-08T16:00:25Z)
• Multiview Aerial Visual Recognition (MAVREC): Can Multi-view Improve Aerial Visual Perception? [57.77643186237265]
  We present Multiview Aerial Visual RECognition or MAVREC, a video dataset where we record synchronized scenes from different perspectives. MAVREC consists of around 2.5 hours of industry-standard 2.7K resolution video sequences, more than 0.5 million frames, and 1.1 million annotated bounding boxes. This makes MAVREC the largest ground and aerial-view dataset, and the fourth largest among all drone-based datasets.
  arXiv  Detail & Related papers  (2023-12-07T18:59:14Z)
• Evidential Detection and Tracking Collaboration: New Problem, Benchmark and Algorithm for Robust Anti-UAV System [56.51247807483176]
  Unmanned Aerial Vehicles (UAVs) have been widely used in many areas, including transportation, surveillance, and military. Previous works have simplified such an anti-UAV task as a tracking problem, where prior information of UAVs is always provided. In this paper, we first formulate a new and practical anti-UAV problem featuring the UAVs perception in complex scenes without prior UAVs information.
  arXiv  Detail & Related papers  (2023-06-27T19:30:23Z)
• UAVStereo: A Multiple Resolution Dataset for Stereo Matching in UAV Scenarios [0.6524460254566905]
  This paper constructs a multi-resolution UAV scenario dataset, called UAVStereo, with over 34k stereo image pairs covering 3 typical scenes. In this paper, we evaluate traditional and state-of-the-art deep learning methods, highlighting their limitations in addressing challenges in UAV scenarios.
  arXiv  Detail & Related papers  (2023-02-20T16:45:27Z)
• A Multi-purpose Real Haze Benchmark with Quantifiable Haze Levels and Ground Truth [61.90504318229845]
  This paper introduces the first paired real image benchmark dataset with hazy and haze-free images, and in-situ haze density measurements. This dataset was produced in a controlled environment with professional smoke generating machines that covered the entire scene. A subset of this dataset has been used for the Object Detection in Haze Track of CVPR UG2 2022 challenge.
  arXiv  Detail & Related papers  (2022-06-13T19:14:06Z)
• Vision-based Anti-UAV Detection and Tracking [18.307952561941942]
  Unmanned aerial vehicles (UAV) have been widely used in various fields, and their invasion of security and privacy has aroused social concern. We propose a visible light mode dataset called Dalian University of Technology Anti-UAV dataset, DUT Anti-UAV. It contains a detection dataset with a total of 10,000 images and a tracking dataset with 20 videos that include short-term and long-term sequences.
  arXiv  Detail & Related papers  (2022-05-22T15:21:45Z)
• HIT-UAV: A high-altitude infrared thermal dataset for Unmanned Aerial Vehicle-based object detection [12.412261347328792]
  We present the HIT-UAV dataset, a high-altitude infrared thermal dataset for object detection applications on Unmanned Aerial Vehicles (UAVs) The dataset comprises 2,898 infrared thermal images extracted from 43,470 frames in hundreds of videos captured by UAVs. We have trained and evaluated well-established object detection algorithms on the HIT-UAV.
  arXiv  Detail & Related papers  (2022-04-07T06:23:02Z)
• Deep Learning for UAV-based Object Detection and Tracking: A Survey [25.34399619170044]
  Unmanned aerial vehicle (UAV) has recently become a hotspot across the fields of computer vision (CV) and remote sensing (RS) Inspired by recent success of deep learning (DL), many advanced object detection and tracking approaches have been widely applied to various UAV-related tasks. This paper provides a comprehensive survey on the research progress and prospects of DL-based UAV object detection and tracking methods.
  arXiv  Detail & Related papers  (2021-10-25T04:43:24Z)
• Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges [124.48654341780431]
  We present a large-scale dataset of Object deTection in Aerial images (DOTA) and comprehensive baselines for ODAI. The proposed DOTA dataset contains 1,793,658 object instances of 18 categories of oriented-bounding-box annotations collected from 11,268 aerial images. We build baselines covering 10 state-of-the-art algorithms with over 70 configurations, where the speed and accuracy performances of each model have been evaluated.
  arXiv  Detail & Related papers  (2021-02-24T11:20:55Z)
• Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking [59.06167734555191]
  Unmanned Aerial Vehicle (UAV) offers lots of applications in both commerce and recreation. We consider the task of tracking UAVs, providing rich information such as location and trajectory. We propose a dataset, Anti-UAV, with more than 300 video pairs containing over 580k manually annotated bounding boxes.
  arXiv  Detail & Related papers  (2021-01-21T07:00:15Z)
• Perceiving Traffic from Aerial Images [86.994032967469]
  We propose an object detection method called Butterfly Detector that is tailored to detect objects in aerial images. We evaluate our Butterfly Detector on two publicly available UAV datasets (UAVDT and VisDrone 2019) and show that it outperforms previous state-of-the-art methods while remaining real-time.
  arXiv  Detail & Related papers  (2020-09-16T11:37:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.