UAV-AdNet: Unsupervised Anomaly Detection using Deep Neural Networks for
Aerial Surveillance
- URL: http://arxiv.org/abs/2011.02853v1
- Date: Thu, 5 Nov 2020 14:26:29 GMT
- Title: UAV-AdNet: Unsupervised Anomaly Detection using Deep Neural Networks for
Aerial Surveillance
- Authors: Ilker Bozcan and Erdal Kayacan
- Abstract summary: We propose a holistic anomaly detection system using deep neural networks for surveillance of critical infrastructures.
First, we present a method for the explicit representation of spatial layouts of objects in bird-view images.
Then, we propose a deep neural network architecture for unsupervised anomaly detection (UAV-AdNet)
Unlike studies in the literature, we combine GPS and image data to predict abnormal observations.
- Score: 20.318367304051176
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Anomaly detection is a key goal of autonomous surveillance systems that
should be able to alert unusual observations. In this paper, we propose a
holistic anomaly detection system using deep neural networks for surveillance
of critical infrastructures (e.g., airports, harbors, warehouses) using an
unmanned aerial vehicle (UAV). First, we present a heuristic method for the
explicit representation of spatial layouts of objects in bird-view images.
Then, we propose a deep neural network architecture for unsupervised anomaly
detection (UAV-AdNet), which is trained on environment representations and GPS
labels of bird-view images jointly. Unlike studies in the literature, we
combine GPS and image data to predict abnormal observations. We evaluate our
model against several baselines on our aerial surveillance dataset and show
that it performs better in scene reconstruction and several anomaly detection
tasks. The codes, trained models, dataset, and video will be available at
https://bozcani.github.io/uavadnet.
Related papers
- UAVs and Neural Networks for search and rescue missions [0.0]
We present a method for detecting objects of interest, including cars, humans, and fire, in aerial images captured by unmanned aerial vehicles (UAVs)
To achieve this, we use artificial neural networks and create a dataset for supervised learning.
arXiv Detail & Related papers (2023-10-09T08:27:35Z) - Self-Supervised Masked Convolutional Transformer Block for Anomaly
Detection [122.4894940892536]
We present a novel self-supervised masked convolutional transformer block (SSMCTB) that comprises the reconstruction-based functionality at a core architectural level.
In this work, we extend our previous self-supervised predictive convolutional attentive block (SSPCAB) with a 3D masked convolutional layer, a transformer for channel-wise attention, as well as a novel self-supervised objective based on Huber loss.
arXiv Detail & Related papers (2022-09-25T04:56:10Z) - Vision-based Anti-UAV Detection and Tracking [18.307952561941942]
Unmanned aerial vehicles (UAV) have been widely used in various fields, and their invasion of security and privacy has aroused social concern.
We propose a visible light mode dataset called Dalian University of Technology Anti-UAV dataset, DUT Anti-UAV.
It contains a detection dataset with a total of 10,000 images and a tracking dataset with 20 videos that include short-term and long-term sequences.
arXiv Detail & Related papers (2022-05-22T15:21:45Z) - Contextual Information Based Anomaly Detection for a Multi-Scene UAV
Aerial Videos [0.0]
Development of computer aided systems for the analysis of UAV based surveillance videos is crucial.
New UAV based multi-scene anomaly detection dataset is developed with frame-level annotations.
New inference strategy is proposed that utilizes few anomalous samples along with normal samples to identify better decision boundaries.
arXiv Detail & Related papers (2022-03-29T11:07:49Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - DAAIN: Detection of Anomalous and Adversarial Input using Normalizing
Flows [52.31831255787147]
We introduce a novel technique, DAAIN, to detect out-of-distribution (OOD) inputs and adversarial attacks (AA)
Our approach monitors the inner workings of a neural network and learns a density estimator of the activation distribution.
Our model can be trained on a single GPU making it compute efficient and deployable without requiring specialized accelerators.
arXiv Detail & Related papers (2021-05-30T22:07:13Z) - Context-Dependent Anomaly Detection for Low Altitude Traffic
Surveillance [15.406931859536622]
We introduce a deep neural network-based method (CADNet) to find point anomalies and contextual anomalies in an environment using a UAV.
The method is based on a variational autoencoder (VAE) with a context sub-network.
To the best of our knowledge, our method is the first contextual anomaly detection method for UAV-assisted aerial surveillance.
arXiv Detail & Related papers (2021-04-14T11:12:04Z) - An Analysis of Deep Object Detectors For Diver Detection [19.14344722263869]
We produce a dataset of approximately 105,000 annotated images of divers sourced from videos.
We train a variety of state-of-the-art deep neural networks for object detection, including SSD with Mobilenet, Faster R-CNN, and YOLO.
Based on our results, we recommend Tiny-YOLOv4 for real-time applications on robots.
arXiv Detail & Related papers (2020-11-25T01:50:32Z) - Robust Unsupervised Video Anomaly Detection by Multi-Path Frame
Prediction [61.17654438176999]
We propose a novel and robust unsupervised video anomaly detection method by frame prediction with proper design.
Our proposed method obtains the frame-level AUROC score of 88.3% on the CUHK Avenue dataset.
arXiv Detail & Related papers (2020-11-05T11:34:12Z) - Perceiving Traffic from Aerial Images [86.994032967469]
We propose an object detection method called Butterfly Detector that is tailored to detect objects in aerial images.
We evaluate our Butterfly Detector on two publicly available UAV datasets (UAVDT and VisDrone 2019) and show that it outperforms previous state-of-the-art methods while remaining real-time.
arXiv Detail & Related papers (2020-09-16T11:37:43Z) - Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for
Online Collision Avoidance [95.86944752753564]
We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties.
Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates.
The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
arXiv Detail & Related papers (2020-07-28T07:34:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.