Leveraging Road Area Semantic Segmentation with Auxiliary Steering Task

• URL: http://arxiv.org/abs/2212.09438v1
• Date: Mon, 19 Dec 2022 13:25:09 GMT
• Title: Leveraging Road Area Semantic Segmentation with Auxiliary Steering Task
• Authors: Jyri Maanp\"a\"a, Iaroslav Melekhov, Josef Taher, Petri Manninen and Juha Hyypp\"a
• Abstract summary: We propose a CNN-based method that can leverage the steering wheel angle information to improve the road area semantic segmentation. We demonstrate the effectiveness of the proposed approach on two challenging data sets for autonomous driving.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robustness of different pattern recognition methods is one of the key challenges in autonomous driving, especially when driving in the high variety of road environments and weather conditions, such as gravel roads and snowfall. Although one can collect data from these adverse conditions using cars equipped with sensors, it is quite tedious to annotate the data for training. In this work, we address this limitation and propose a CNN-based method that can leverage the steering wheel angle information to improve the road area semantic segmentation. As the steering wheel angle data can be easily acquired with the associated images, one could improve the accuracy of road area semantic segmentation by collecting data in new road environments without manual data annotation. We demonstrate the effectiveness of the proposed approach on two challenging data sets for autonomous driving and show that when the steering task is used in our segmentation model training, it leads to a 0.1-2.9% gain in the road area mIoU (mean Intersection over Union) compared to the corresponding reference transfer learning model.

Related papers

• Neural Semantic Map-Learning for Autonomous Vehicles [85.8425492858912]
  We present a mapping system that fuses local submaps gathered from a fleet of vehicles at a central instance to produce a coherent map of the road environment. Our method jointly aligns and merges the noisy and incomplete local submaps using a scene-specific Neural Signed Distance Field. We leverage memory-efficient sparse feature-grids to scale to large areas and introduce a confidence score to model uncertainty in scene reconstruction.
  arXiv  Detail & Related papers  (2024-10-10T10:10:03Z)
• Homography Guided Temporal Fusion for Road Line and Marking Segmentation [73.47092021519245]
  Road lines and markings are frequently occluded in the presence of moving vehicles, shadow, and glare. We propose a Homography Guided Fusion (HomoFusion) module to exploit temporally-adjacent video frames for complementary cues. We show that exploiting available camera intrinsic data and ground plane assumption for cross-frame correspondence can lead to a light-weight network with significantly improved performances in speed and accuracy.
  arXiv  Detail & Related papers  (2024-04-11T10:26:40Z)
• A Deeply Supervised Semantic Segmentation Method Based on GAN [9.441379867578332]
  The proposed model integrates a generative adversarial network (GAN) framework into the traditional semantic segmentation model. The effectiveness of our approach is demonstrated by a significant boost in performance on the road crack dataset.
  arXiv  Detail & Related papers  (2023-10-06T08:22:24Z)
• R2S100K: Road-Region Segmentation Dataset For Semi-Supervised Autonomous Driving in the Wild [11.149480965148015]
  Road Region dataset (R2S100K) is a large-scale dataset and benchmark for training and evaluation of road segmentation. R2S100K comprises 100K images extracted from a large and diverse set of video sequences covering more than 1000 KM of roadways. We present an Efficient Data Sampling method (EDS) based self-training framework to improve learning by leveraging unlabeled data.
  arXiv  Detail & Related papers  (2023-08-11T21:31:37Z)
• Automatic Extraction of Relevant Road Infrastructure using Connected vehicle data and Deep Learning Model [4.235459779667272]
  We propose a novel approach that leverages connected vehicle data and cutting-edge deep learning techniques. By employing geohashing to segment vehicle trajectories and then generating image representations of road segments, we utilize the YOLOv5 algorithm for accurate classification of both straight road segments and intersections. Experimental results demonstrate an impressive overall classification accuracy of 95%, with straight roads achieving a remarkable 97% F1 score and intersections reaching a 90% F1 score.
  arXiv  Detail & Related papers  (2023-08-10T15:57:47Z)
• Unsupervised Driving Event Discovery Based on Vehicle CAN-data [62.997667081978825]
  This work presents a simultaneous clustering and segmentation approach for vehicle CAN-data that identifies common driving events in an unsupervised manner. We evaluate our approach with a dataset of real Tesla Model 3 vehicle CAN-data and a two-hour driving session that we annotated with different driving events.
  arXiv  Detail & Related papers  (2023-01-12T13:10:47Z)
• Learning Interactive Driving Policies via Data-driven Simulation [125.97811179463542]
  Data-driven simulators promise high data-efficiency for driving policy learning. Small underlying datasets often lack interesting and challenging edge cases for learning interactive driving. We propose a simulation method that uses in-painted ado vehicles for learning robust driving policies.
  arXiv  Detail & Related papers  (2021-11-23T20:14:02Z)
• Interaction Detection Between Vehicles and Vulnerable Road Users: A Deep Generative Approach with Attention [9.442285577226606]
  We propose a conditional generative model for interaction detection at intersections. It aims to automatically analyze massive video data about the continuity of road users' behavior. The model's efficacy was validated by testing on real-world datasets.
  arXiv  Detail & Related papers  (2021-05-09T10:03:55Z)
• End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learning [63.56464608571663]
  Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. In this work, we focus on the implementation of a system able to navigate through intersections where only traffic signs are provided. We propose a multi-agent system using a continuous, model-free Deep Reinforcement Learning algorithm used to train a neural network for predicting both the acceleration and the steering angle at each time step.
  arXiv  Detail & Related papers  (2021-04-28T07:54:40Z)
• Detecting 32 Pedestrian Attributes for Autonomous Vehicles [103.87351701138554]
  In this paper, we address the problem of jointly detecting pedestrians and recognizing 32 pedestrian attributes. We introduce a Multi-Task Learning (MTL) model relying on a composite field framework, which achieves both goals in an efficient way. We show competitive detection and attribute recognition results, as well as a more stable MTL training.
  arXiv  Detail & Related papers  (2020-12-04T15:10:12Z)
• Self-Supervised Drivable Area and Road Anomaly Segmentation using RGB-D Data for Robotic Wheelchairs [26.110522390201094]
  We develop a pipeline that can automatically generate segmentation labels for drivable areas and road anomalies. Our proposed automatic labeling pipeline achieves an impressive speed-up compared to manual labeling. Our proposed self-supervised approach exhibits more robust and accurate results than the state-of-the-art traditional algorithms.
  arXiv  Detail & Related papers  (2020-07-12T10:12:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.