iCurb: Imitation Learning-based Detection of Road Curbs using Aerial Images for Autonomous Driving

• URL: http://arxiv.org/abs/2103.17118v1
• Date: Wed, 31 Mar 2021 14:40:31 GMT
• Title: iCurb: Imitation Learning-based Detection of Road Curbs using Aerial Images for Autonomous Driving
• Authors: Zhenhua Xu, Yuxiang Sun, Ming Liu
• Abstract summary: Road curbs are an essential capability for autonomous driving. Usually, road curbs are detected on-line using vehicle-mounted sensors, such as video cameras and 3-D Lidars. We propose a novel solution to detect road curbs off-line using aerial images.
• Score: 11.576868193291997
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Detection of road curbs is an essential capability for autonomous driving. It can be used for autonomous vehicles to determine drivable areas on roads. Usually, road curbs are detected on-line using vehicle-mounted sensors, such as video cameras and 3-D Lidars. However, on-line detection using video cameras may suffer from challenging illumination conditions, and Lidar-based approaches may be difficult to detect far-away road curbs due to the sparsity issue of point clouds. In recent years, aerial images are becoming more and more worldwide available. We find that the visual appearances between road areas and off-road areas are usually different in aerial images, so we propose a novel solution to detect road curbs off-line using aerial images. The input to our method is an aerial image, and the output is directly a graph (i.e., vertices and edges) representing road curbs. To this end, we formulate the problem as an imitation learning problem, and design a novel network and an innovative training strategy to train an agent to iteratively find the road-curb graph. The experimental results on a public dataset confirm the effectiveness and superiority of our method. This work is accompanied with a demonstration video and a supplementary document at https://tonyxuqaq.github.io/iCurb/.

Related papers

• Prior Based Online Lane Graph Extraction from Single Onboard Camera Image [133.68032636906133]
  We tackle online estimation of the lane graph from a single onboard camera image. The prior is extracted from the dataset through a transformer based Wasserstein Autoencoder. The autoencoder is then used to enhance the initial lane graph estimates.
  arXiv  Detail & Related papers  (2023-07-25T08:58:26Z)
• FlowMap: Path Generation for Automated Vehicles in Open Space Using Traffic Flow [32.8563901381583]
  FlowMap is a path generation framework for automated vehicles based on traffic flows. A path generation algorithm on traffic flow fields (TFFs) is proposed to generate human-like paths.
  arXiv  Detail & Related papers  (2023-05-02T17:27:37Z)
• Online Lane Graph Extraction from Onboard Video [133.68032636906133]
  We use the video stream from an onboard camera for online extraction of the surrounding's lane graph. Using video, instead of a single image, as input poses both benefits and challenges in terms of combining the information from different timesteps. A single model of this proposed simple, yet effective, method can process any number of images, including one, to produce accurate lane graphs.
  arXiv  Detail & Related papers  (2023-04-03T12:36:39Z)
• Road Detection in Snowy Forest Environment using RGB Camera [0.0]
  This paper introduces detection of snowy road in forest environment using RGB camera. The method combines noise filtering technique with morphological operation to classify the image component. The performance of algorithm is evaluated by two error value: False Negative Rate and False Positive Rate.
  arXiv  Detail & Related papers  (2022-12-16T14:49:27Z)
• RNGDet: Road Network Graph Detection by Transformer in Aerial Images [19.141279413414082]
  Road network graphs provide critical information for autonomous vehicle applications. manually annotating road network graphs is inefficient and labor-intensive. We propose a novel approach based on transformer and imitation learning named RNGDet.
  arXiv  Detail & Related papers  (2022-02-16T01:59:41Z)
• Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Images [128.881857704338]
  We study the problem of extracting a directed graph representing the local road network in BEV coordinates, from a single onboard camera image. We show that the method can be extended to detect dynamic objects on the BEV plane. We validate our approach against powerful baselines and show that our network achieves superior performance.
  arXiv  Detail & Related papers  (2021-10-05T12:40:33Z)
• CP-loss: Connectivity-preserving Loss for Road Curb Detection in Autonomous Driving with Aerial Images [10.300623192980753]
  Road curb detection is important for autonomous driving. Most of the current methods detect road curbs online using vehicle-mounted sensors, such as cameras or 3-D Lidars. In this paper, we detect road curbs offline using high-resolution aerial images.
  arXiv  Detail & Related papers  (2021-07-26T01:36:58Z)
• Topo-boundary: A Benchmark Dataset on Topological Road-boundary Detection Using Aerial Images for Autonomous Driving [11.576868193291997]
  We propose a new benchmark dataset, named textitTopo-boundary, for off-line topological road-boundary detection. The dataset contains 21,556 $1000times1000$-sized 4-channel aerial images. We implement and evaluate 3 segmentation-based baselines and 5 graph-based baselines using the dataset.
  arXiv  Detail & Related papers  (2021-03-31T14:42:00Z)
• Self-Supervised Steering Angle Prediction for Vehicle Control Using Visual Odometry [55.11913183006984]
  We show how a model can be trained to control a vehicle's trajectory using camera poses estimated through visual odometry methods. We propose a scalable framework that leverages trajectory information from several different runs using a camera setup placed at the front of a car.
  arXiv  Detail & Related papers  (2021-03-20T16:29:01Z)
• Detecting Road Obstacles by Erasing Them [101.45116269051692]
  We select image patches and inpaint them with the surrounding road texture, which tends to remove obstacles from those patches. We then use a network trained to recognize discrepancies between the original patch and the inpainted one, which signals an erased obstacle.
  arXiv  Detail & Related papers  (2020-12-25T21:56:36Z)
• Road Curb Detection and Localization with Monocular Forward-view Vehicle Camera [74.45649274085447]
  We propose a robust method for estimating road curb 3D parameters using a calibrated monocular camera equipped with a fisheye lens. Our approach is able to estimate the vehicle to curb distance in real time with mean accuracy of more than 90%.
  arXiv  Detail & Related papers  (2020-02-28T00:24:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.