A Dataset for Provident Vehicle Detection at Night

• URL: http://arxiv.org/abs/2105.13236v1
• Date: Thu, 27 May 2021 15:31:33 GMT
• Title: A Dataset for Provident Vehicle Detection at Night
• Authors: Sascha Saralajew and Lars Ohnemus and Lukas Ewecker and Ebubekir Asan and Simon Isele and Stefan Roos
• Abstract summary: We study the problem of how to map this intuitive human behavior to computer vision algorithms to detect oncoming vehicles at night. We present an extensive open-source dataset containing 59746 annotated grayscale images out of 346 different scenes in a rural environment at night. We discuss the characteristics of the dataset and the challenges in objectively describing visual cues such as light reflections.
• Score: 3.1969855247377827
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In current object detection, algorithms require the object to be directly visible in order to be detected. As humans, however, we intuitively use visual cues caused by the respective object to already make assumptions about its appearance. In the context of driving, such cues can be shadows during the day and often light reflections at night. In this paper, we study the problem of how to map this intuitive human behavior to computer vision algorithms to detect oncoming vehicles at night just from the light reflections they cause by their headlights. For that, we present an extensive open-source dataset containing 59746 annotated grayscale images out of 346 different scenes in a rural environment at night. In these images, all oncoming vehicles, their corresponding light objects (e.g., headlamps), and their respective light reflections (e.g., light reflections on guardrails) are labeled. In this context, we discuss the characteristics of the dataset and the challenges in objectively describing visual cues such as light reflections. We provide different metrics for different ways to approach the task and report the results we achieved using state-of-the-art and custom object detection models as a first benchmark. With that, we want to bring attention to a new and so far neglected field in computer vision research, encourage more researchers to tackle the problem, and thereby further close the gap between human performance and computer vision systems.

Related papers

• Visual Context-Aware Person Fall Detection [52.49277799455569]
  We present a segmentation pipeline to semi-automatically separate individuals and objects in images. Background objects such as beds, chairs, or wheelchairs can challenge fall detection systems, leading to false positive alarms. We demonstrate that object-specific contextual transformations during training effectively mitigate this challenge.
  arXiv  Detail & Related papers  (2024-04-11T19:06:36Z)
• OOSTraj: Out-of-Sight Trajectory Prediction With Vision-Positioning Denoising [49.86409475232849]
  Trajectory prediction is fundamental in computer vision and autonomous driving. Existing approaches in this field often assume precise and complete observational data. We present a novel method for out-of-sight trajectory prediction that leverages a vision-positioning technique.
  arXiv  Detail & Related papers  (2024-04-02T18:30:29Z)
• Patterns of Vehicle Lights: Addressing Complexities in Curation and Annotation of Camera-Based Vehicle Light Datasets and Metrics [0.0]
  This paper explores the representation of vehicle lights in computer vision and its implications for various tasks in the field of autonomous driving. Three important tasks in autonomous driving that can benefit from vehicle light detection are identified. The challenges of collecting and annotating large datasets for training data-driven models are also addressed.
  arXiv  Detail & Related papers  (2023-07-26T21:48:14Z)
• SalienDet: A Saliency-based Feature Enhancement Algorithm for Object Detection for Autonomous Driving [160.57870373052577]
  We propose a saliency-based OD algorithm (SalienDet) to detect unknown objects. Our SalienDet utilizes a saliency-based algorithm to enhance image features for object proposal generation. We design a dataset relabeling approach to differentiate the unknown objects from all objects in training sample set to achieve Open-World Detection.
  arXiv  Detail & Related papers  (2023-05-11T16:19:44Z)
• Combining Visual Saliency Methods and Sparse Keypoint Annotations to Providently Detect Vehicles at Night [2.0299248281970956]
  We explore the potential saliency-based approaches to create different object representations based on the visual saliency and sparse keypoint annotations. We show that this approach allows for an automated derivation of different object representations. We provide further powerful tools and methods to study the problem of detecting vehicles at night before they are actually visible.
  arXiv  Detail & Related papers  (2022-04-25T09:56:34Z)
• NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset [25.29013780731876]
  Low light proves more difficult for machine cognition than previously thought. We present a large-scale dataset showing dynamic scenes captured on the streets at night. We propose to incorporate an image enhancement module into the object detection framework and two novel data augmentation techniques.
  arXiv  Detail & Related papers  (2021-10-20T03:44:04Z)
• Provident Vehicle Detection at Night for Advanced Driver Assistance Systems [3.7468898363447654]
  We present a complete system capable of providingntly detect oncoming vehicles at nighttime based on their caused light artifacts. We quantify the time benefit that the provident vehicle detection system provides compared to an in-production computer vision system.
  arXiv  Detail & Related papers  (2021-07-23T15:27:17Z)
• A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection [56.82077636126353]
  We take advantage of object-centric images to improve object detection in scene-centric images. We present a simple yet surprisingly effective framework to do so. Our approach can improve the object detection (and instance segmentation) accuracy of rare objects by 50% (and 33%) relatively.
  arXiv  Detail & Related papers  (2021-02-17T17:27:21Z)
• Provident Vehicle Detection at Night: The PVDN Dataset [2.8730465903425877]
  We present a novel dataset containing 59746 grayscale annotated images out of 346 different scenes in a rural environment at night. In these images, all oncoming vehicles, their corresponding light objects (e.g., headlamps), and their respective light reflections (e.g., light reflections on guardrails) are labeled. With that, we are providing the first open-source dataset with comprehensive ground truth data to enable research into new methods of detecting oncoming vehicles.
  arXiv  Detail & Related papers  (2020-12-31T00:06:26Z)
• Detecting Invisible People [58.49425715635312]
  We re-purpose tracking benchmarks and propose new metrics for the task of detecting invisible objects. We demonstrate that current detection and tracking systems perform dramatically worse on this task. Second, we build dynamic models that explicitly reason in 3D, making use of observations produced by state-of-the-art monocular depth estimation networks.
  arXiv  Detail & Related papers  (2020-12-15T16:54:45Z)
• SoDA: Multi-Object Tracking with Soft Data Association [75.39833486073597]
  Multi-object tracking (MOT) is a prerequisite for a safe deployment of self-driving cars. We propose a novel approach to MOT that uses attention to compute track embeddings that encode dependencies between observed objects.
  arXiv  Detail & Related papers  (2020-08-18T03:40:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.