Nordic Vehicle Dataset (NVD): Performance of vehicle detectors using newly captured NVD from UAV in different snowy weather conditions

• URL: http://arxiv.org/abs/2304.14466v1
• Date: Thu, 27 Apr 2023 18:55:43 GMT
• Title: Nordic Vehicle Dataset (NVD): Performance of vehicle detectors using newly captured NVD from UAV in different snowy weather conditions
• Authors: Hamam Mokayed and Amirhossein Nayebiastaneh and Kanjar De and Stergios Sozos and Olle Hagner and Bjorn Backe
• Abstract summary: Vehicle detection and recognition in drone images is a complex problem that has been used for different safety purposes. Various techniques have been employed to detect and track vehicles in different weather conditions. detecting vehicles in heavy snow is still in the early stages because of a lack of available data. This study aims to address this gap by providing data on vehicles captured by UAVs in different settings and under various snow cover conditions in the Nordic region.
• Score: 1.7452931180966467
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Vehicle detection and recognition in drone images is a complex problem that has been used for different safety purposes. The main challenge of these images is captured at oblique angles and poses several challenges like non-uniform illumination effect, degradations, blur, occlusion, loss of visibility, etc. Additionally, weather conditions play a crucial role in causing safety concerns and add another high level of challenge to the collected data. Over the past few decades, various techniques have been employed to detect and track vehicles in different weather conditions. However, detecting vehicles in heavy snow is still in the early stages because of a lack of available data. Furthermore, there has been no research on detecting vehicles in snowy weather using real images captured by unmanned aerial vehicles (UAVs). This study aims to address this gap by providing the scientific community with data on vehicles captured by UAVs in different settings and under various snow cover conditions in the Nordic region. The data covers different adverse weather conditions like overcast with snowfall, low light and low contrast conditions with patchy snow cover, high brightness, sunlight, fresh snow, and the temperature reaching far below -0 degrees Celsius. The study also evaluates the performance of commonly used object detection methods such as Yolo v8, Yolo v5, and fast RCNN. Additionally, data augmentation techniques are explored, and those that enhance the detectors' performance in such scenarios are proposed. The code and the dataset will be available at https://nvd.ltu-ai.dev

Related papers

• Vehicle Detection Performance in Nordic Region [9.914220157314551]
  This paper addresses the critical challenge of vehicle detection in the harsh winter conditions in the Nordic regions. Traditional vehicle detection methods have struggled in these adverse conditions. This study uses the Nordic Vehicle dataset to evaluate the performance of state-of-the-art vehicle detection algorithms.
  arXiv  Detail & Related papers  (2024-03-22T08:03:10Z)
• EVD4UAV: An Altitude-Sensitive Benchmark to Evade Vehicle Detection in UAV [19.07281015014683]
  Vehicle detection in Unmanned Aerial Vehicle (UAV) captured images has wide applications in aerial photography and remote sensing. Recent studies show that adding an adversarial patch on objects can fool the well-trained deep neural networks based object detectors. We propose a new dataset named EVD4UAV as an altitude-sensitive benchmark to evade vehicle detection in UAV.
  arXiv  Detail & Related papers  (2024-03-08T16:19:39Z)
• Energy-based Detection of Adverse Weather Effects in LiDAR Data [7.924836086640871]
  We propose a novel approach for detecting adverse weather effects in LiDAR data. Our method learns to associate low energy scores with inlier points and high energy scores with outliers. To help expand the research field of LiDAR perception in adverse weather, we release the SemanticSpray dataset.
  arXiv  Detail & Related papers  (2023-05-25T15:03:36Z)
• WEDGE: A multi-weather autonomous driving dataset built from generative vision-language models [51.61662672912017]
  We introduce WEDGE: a synthetic dataset generated with a vision-language generative model via prompting. WEDGE consists of 3360 images in 16 extreme weather conditions manually annotated with 16513 bounding boxes. We establish baseline performance for classification and detection with 53.87% test accuracy and 45.41 mAP.
  arXiv  Detail & Related papers  (2023-05-12T14:42:47Z)
• ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Rendering [83.75284107397003]
  We introduce ScatterNeRF, a neural rendering method which renders scenes and decomposes the fog-free background. We propose a disentangled representation for the scattering volume and the scene objects, and learn the scene reconstruction with physics-inspired losses. We validate our method by capturing multi-view In-the-Wild data and controlled captures in a large-scale fog chamber.
  arXiv  Detail & Related papers  (2023-05-03T13:24:06Z)
• AVisT: A Benchmark for Visual Object Tracking in Adverse Visibility [125.77396380698639]
  AVisT is a benchmark for visual tracking in diverse scenarios with adverse visibility. AVisT comprises 120 challenging sequences with 80k annotated frames, spanning 18 diverse scenarios. We benchmark 17 popular and recent trackers on AVisT with detailed analysis of their tracking performance across attributes.
  arXiv  Detail & Related papers  (2022-08-14T17:49:37Z)
• Ithaca365: Dataset and Driving Perception under Repeated and Challenging Weather Conditions [0.0]
  We present a new dataset to enable robust autonomous driving via a novel data collection process. The dataset includes images and point clouds from cameras and LiDAR sensors, along with high-precision GPS/INS. We demonstrate the uniqueness of this dataset by analyzing the performance of baselines in amodal segmentation of road and objects.
  arXiv  Detail & Related papers  (2022-08-01T22:55:32Z)
• LiDAR Snowfall Simulation for Robust 3D Object Detection [116.10039516404743]
  We propose a physically based method to simulate the effect of snowfall on real clear-weather LiDAR point clouds. Our method samples snow particles in 2D space for each LiDAR line and uses the induced geometry to modify the measurement for each LiDAR beam. We use our simulation to generate partially synthetic snowy LiDAR data and leverage these data for training 3D object detection models that are robust to snowfall.
  arXiv  Detail & Related papers  (2022-03-28T21:48:26Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• DAWN: Vehicle Detection in Adverse Weather Nature Dataset [4.09920839425892]
  We present a new dataset consisting of real-world images collected under various adverse weather conditions called DAWN. The dataset comprises a collection of 1000 images from real-traffic environments, which are divided into four sets of weather conditions: fog, snow, rain and sandstorms. This data helps interpreting effects caused by the adverse weather conditions on the performance of vehicle detection systems.
  arXiv  Detail & Related papers  (2020-08-12T15:48:49Z)
• Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learning [59.19469551774703]
  Drone-based vehicle detection aims at finding the vehicle locations and categories in an aerial image. We construct a large-scale drone-based RGB-Infrared vehicle detection dataset, termed DroneVehicle. Our DroneVehicle collects 28, 439 RGB-Infrared image pairs, covering urban roads, residential areas, parking lots, and other scenarios from day to night.
  arXiv  Detail & Related papers  (2020-03-05T05:29:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.