Scarce Data Driven Deep Learning of Drones via Generalized Data Distribution Space

• URL: http://arxiv.org/abs/2108.08244v1
• Date: Wed, 18 Aug 2021 17:07:32 GMT
• Title: Scarce Data Driven Deep Learning of Drones via Generalized Data Distribution Space
• Authors: Chen Li, Schyler C. Sun, Zhuangkun Wei, Antonios Tsourdos, Weisi Guo
• Abstract summary: We show how understanding the general distribution of the drone data via a Generative Adversarial Network (GAN) can allow us to acquire missing data to achieve rapid and more accurate learning. We demonstrate our results on a drone image dataset, which contains both real drone images as well as simulated images from computer-aided design.
• Score: 12.377024173799631
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Increased drone proliferation in civilian and professional settings has created new threat vectors for airports and national infrastructures. The economic damage for a single major airport from drone incursions is estimated to be millions per day. Due to the lack of diverse drone training data, accurate training of deep learning detection algorithms under scarce data is an open challenge. Existing methods largely rely on collecting diverse and comprehensive experimental drone footage data, artificially induced data augmentation, transfer and meta-learning, as well as physics-informed learning. However, these methods cannot guarantee capturing diverse drone designs and fully understanding the deep feature space of drones. Here, we show how understanding the general distribution of the drone data via a Generative Adversarial Network (GAN) and explaining the missing features using Topological Data Analysis (TDA) - can allow us to acquire missing data to achieve rapid and more accurate learning. We demonstrate our results on a drone image dataset, which contains both real drone images as well as simulated images from computer-aided design. When compared to random data collection (usual practice - discriminator accuracy of 94.67\% after 200 epochs), our proposed GAN-TDA informed data collection method offers a significant 4\% improvement (99.42\% after 200 epochs). We believe that this approach of exploiting general data distribution knowledge form neural networks can be applied to a wide range of scarce data open challenges.

Related papers

• Drone-type-Set: Drone types detection benchmark for drone detection and tracking [0.6294091730968154]
  In this paper, we provide a dataset of various drones as well as a comparison of recognized object detection models. The experimental results of different models are provided along with a description of each method.
  arXiv  Detail & Related papers  (2024-05-16T18:56:46Z)
• Sound-based drone fault classification using multitask learning [7.726132010393797]
  This paper proposes a sound-based deep neural network (DNN) fault classifier and drone sound dataset. The dataset was constructed by collecting the operating sounds of drones from microphones mounted on three different drones in an anechoic chamber. Using the acquired dataset, we train a classifier, 1DCNN-ResNet, that classifies the types of mechanical faults and their locations from short-time input waveforms.
  arXiv  Detail & Related papers  (2023-04-23T17:55:40Z)
• Collaborative Learning with a Drone Orchestrator [79.75113006257872]
  A swarm of intelligent wireless devices train a shared neural network model with the help of a drone. The proposed framework achieves a significant speedup in training, leading to an average 24% and 87% saving in the drone hovering time.
  arXiv  Detail & Related papers  (2023-03-03T23:46:25Z)
• TransVisDrone: Spatio-Temporal Transformer for Vision-based Drone-to-Drone Detection in Aerial Videos [57.92385818430939]
  Drone-to-drone detection using visual feed has crucial applications, such as detecting drone collisions, detecting drone attacks, or coordinating flight with other drones. Existing methods are computationally costly, follow non-end-to-end optimization, and have complex multi-stage pipelines, making them less suitable for real-time deployment on edge devices. We propose a simple yet effective framework, itTransVisDrone, that provides an end-to-end solution with higher computational efficiency.
  arXiv  Detail & Related papers  (2022-10-16T03:05:13Z)
• DronePose: The identification, segmentation, and orientation detection of drones via neural networks [3.161871054978445]
  We present a CNN using a decision tree and ensemble structure to fully characterise drones in flight. Our system determines the drone type, orientation (in terms of pitch, roll, and yaw), and performs segmentation to classify different body parts. We also provide a computer model for the rapid generation of large quantities of accurately labelled photo-realistic training data.
  arXiv  Detail & Related papers  (2021-12-10T12:34:53Z)
• Rethinking Drone-Based Search and Rescue with Aerial Person Detection [79.76669658740902]
  The visual inspection of aerial drone footage is an integral part of land search and rescue (SAR) operations today. We propose a novel deep learning algorithm to automate this aerial person detection (APD) task. We present the novel Aerial Inspection RetinaNet (AIR) algorithm as the combination of these contributions.
  arXiv  Detail & Related papers  (2021-11-17T21:48:31Z)
• A dataset for multi-sensor drone detection [67.75999072448555]
  The use of small and remotely controlled unmanned aerial vehicles (UAVs) has increased in recent years. Most studies on drone detection fail to specify the type of acquisition device, the drone type, the detection range, or the dataset. We contribute with an annotated multi-sensor database for drone detection that includes infrared and visible videos and audio files.
  arXiv  Detail & Related papers  (2021-11-02T20:52:03Z)
• Dogfight: Detecting Drones from Drones Videos [58.158988162743825]
  This paper attempts to address the problem of drones detection from other flying drones variations. The erratic movement of the source and target drones, small size, arbitrary shape, large intensity, and occlusion make this problem quite challenging. To handle this, instead of using region-proposal based methods, we propose to use a two-stage segmentation-based approach.
  arXiv  Detail & Related papers  (2021-03-31T17:43:31Z)
• On-board Deep-learning-based Unmanned Aerial Vehicle Fault Cause Detection and Identification [6.585891825257162]
  We propose novel architectures to detect and classify drone mis-operations based on sensor data. We validate the proposed deep-learning architectures via simulations and experiments on a real drone. Our solution is able to detect with over 90% accuracy and classify various types of drone mis-operations.
  arXiv  Detail & Related papers  (2020-04-03T22:46:34Z)
• Detection and Tracking Meet Drones Challenge [131.31749447313197]
  This paper presents a review of object detection and tracking datasets and benchmarks, and discusses the challenges of collecting large-scale drone-based object detection and tracking datasets with manual annotations. We describe our VisDrone dataset, which is captured over various urban/suburban areas of 14 different cities across China from North to South. We provide a detailed analysis of the current state of the field of large-scale object detection and tracking on drones, and conclude the challenge as well as propose future directions.
  arXiv  Detail & Related papers  (2020-01-16T00:11:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.