Cooperative Saliency-based Obstacle Detection and AR Rendering for Increased Situational Awareness

• URL: http://arxiv.org/abs/2302.00916v1
• Date: Thu, 2 Feb 2023 07:32:13 GMT
• Title: Cooperative Saliency-based Obstacle Detection and AR Rendering for Increased Situational Awareness
• Authors: Gerasimos Arvanitis, Nikolaos Stagakis, Evangelia I. Zacharaki, Konstantinos Moustakas
• Abstract summary: We propose a saliency-based distributed, cooperative obstacle detection and rendering scheme. The proposed method provides favorable results and features compared to other recent and relevant approaches.
• Score: 3.010893618491329
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous vehicles are expected to operate safely in real-life road conditions in the next years. Nevertheless, unanticipated events such as the existence of unexpected objects in the range of the road, can put safety at risk. The advancement of sensing and communication technologies and Internet of Things may facilitate the recognition of hazardous situations and information exchange in a cooperative driving scheme, providing new opportunities for the increase of collaborative situational awareness. Safe and unobtrusive visualization of the obtained information may nowadays be enabled through the adoption of novel Augmented Reality (AR) interfaces in the form of windshields. Motivated by these technological opportunities, we propose in this work a saliency-based distributed, cooperative obstacle detection and rendering scheme for increasing the driver's situational awareness through (i) automated obstacle detection, (ii) AR visualization and (iii) information sharing (upcoming potential dangers) with other connected vehicles or road infrastructure. An extensive evaluation study using a variety of real datasets for pothole detection showed that the proposed method provides favorable results and features compared to other recent and relevant approaches.

Related papers

• SmartRSD: An Intelligent Multimodal Approach to Real-Time Road Surface Detection for Safe Driving [4.22695582100076]
  We introduce a multimodal approach for the automated detection of road surface conditions by integrating audio and images. Our findings highlight the potential of integrating auditory and visual cues for enhancing road safety and minimizing accident risks.
  arXiv  Detail & Related papers  (2024-06-14T15:38:21Z)
• Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey [0.707675463650964]
  Traffic incidents involving vulnerable road users (VRUs) constitute a significant proportion of global road accidents. Advances in traffic communication ecosystems, coupled with sophisticated signal processing and machine learning techniques, have facilitated the utilization of data from diverse sensors. This paper provides a comprehensive survey of state-of-the-art technologies and methodologies to enhance the safety of VRUs.
  arXiv  Detail & Related papers  (2024-05-29T15:42:10Z)
• Edge-Assisted ML-Aided Uncertainty-Aware Vehicle Collision Avoidance at Urban Intersections [12.812518632907771]
  We present a novel framework that detects preemptively collisions at urban crossroads. We exploit the Multi-access Edge Computing platform of 5G networks.
  arXiv  Detail & Related papers  (2024-04-22T18:45:40Z)
• Big Data and Deep Learning in Smart Cities: A Comprehensive Dataset for AI-Driven Traffic Accident Detection and Computer Vision Systems [0.0]
  This study delves into the application of cutting-edge technological methods in smart cities. We present a novel comprehensive dataset for traffic accident detection. This dataset is expected to advance academic research and also enhance real-time accident detection applications.
  arXiv  Detail & Related papers  (2024-01-07T21:50:24Z)
• Safeguarded Progress in Reinforcement Learning: Safe Bayesian Exploration for Control Policy Synthesis [63.532413807686524]
  This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL) We propose a new architecture that handles the trade-off between efficient progress and safety during exploration.
  arXiv  Detail & Related papers  (2023-12-18T16:09:43Z)
• MSight: An Edge-Cloud Infrastructure-based Perception System for Connected Automated Vehicles [58.461077944514564]
  This paper presents MSight, a cutting-edge roadside perception system specifically designed for automated vehicles. MSight offers real-time vehicle detection, localization, tracking, and short-term trajectory prediction. Evaluations underscore the system's capability to uphold lane-level accuracy with minimal latency.
  arXiv  Detail & Related papers  (2023-10-08T21:32:30Z)
• A Counterfactual Safety Margin Perspective on the Scoring of Autonomous Vehicles' Riskiness [52.27309191283943]
  This paper presents a data-driven framework for assessing the risk of different AVs' behaviors. We propose the notion of counterfactual safety margin, which represents the minimum deviation from nominal behavior that could cause a collision.
  arXiv  Detail & Related papers  (2023-08-02T09:48:08Z)
• Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embedding [51.8579160500354]
  We propose an unsupervised way to predict self-driving attention by uncertainty modeling and driving knowledge integration. Results show equivalent or even more impressive performance compared to fully-supervised state-of-the-art approaches.
  arXiv  Detail & Related papers  (2023-03-17T00:28:33Z)
• Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts, Datasets and Metrics [77.34726150561087]
  This work aims to carry out a study on the current scenario of camera and radar-based perception for ADAS and autonomous vehicles. Concepts and characteristics related to both sensors, as well as to their fusion, are presented. We give an overview of the Deep Learning-based detection and segmentation tasks, and the main datasets, metrics, challenges, and open questions in vehicle perception.
  arXiv  Detail & Related papers  (2023-03-08T00:48:32Z)
• Using UAVs for vehicle tracking and collision risk assessment at intersections [2.090380922731455]
  This research demonstrates the application of UAVs and V2X connectivity to track the movement of road users and assess potential collisions at intersections. The proposed method combines deep-learning based tracking algorithms and time-to-collision tasks.
  arXiv  Detail & Related papers  (2021-10-11T19:38:24Z)
• Transferable Deep Reinforcement Learning Framework for Autonomous Vehicles with Joint Radar-Data Communications [69.24726496448713]
  We propose an intelligent optimization framework based on the Markov Decision Process (MDP) to help the AV make optimal decisions. We then develop an effective learning algorithm leveraging recent advances of deep reinforcement learning techniques to find the optimal policy for the AV. We show that the proposed transferable deep reinforcement learning framework reduces the obstacle miss detection probability by the AV up to 67% compared to other conventional deep reinforcement learning approaches.
  arXiv  Detail & Related papers  (2021-05-28T08:45:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.