ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environments

• URL: http://arxiv.org/abs/2209.06522v1
• Date: Wed, 14 Sep 2022 09:52:26 GMT
• Title: ScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environments
• Authors: Junwon Seo, Taekyung Kim, Kiho Kwak, Jihong Min, Inwook Shim
• Abstract summary: In this work, we introduce a scalable framework for learning self-supervised traversability. We train a neural network that predicts the proprioceptive experience that a vehicle would undergo from 3D point clouds. With driving data of various vehicles gathered from simulation and the real world, we show that our framework is capable of learning the self-supervised traversability of various vehicles.
• Score: 7.226357394861987
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: For the safe and successful navigation of autonomous vehicles in unstructured environments, the traversability of terrain should vary based on the driving capabilities of the vehicles. Actual driving experience can be utilized in a self-supervised fashion to learn vehicle-specific traversability. However, existing methods for learning self-supervised traversability are not highly scalable for learning the traversability of various vehicles. In this work, we introduce a scalable framework for learning self-supervised traversability, which can learn the traversability directly from vehicle-terrain interaction without any human supervision. We train a neural network that predicts the proprioceptive experience that a vehicle would undergo from 3D point clouds. Using a novel PU learning method, the network simultaneously identifies non-traversable regions where estimations can be overconfident. With driving data of various vehicles gathered from simulation and the real world, we show that our framework is capable of learning the self-supervised traversability of various vehicles. By integrating our framework with a model predictive controller, we demonstrate that estimated traversability results in effective navigation that enables distinct maneuvers based on the driving characteristics of the vehicles. In addition, experimental results validate the ability of our method to identify and avoid non-traversable regions.

Related papers

• Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perception [5.46262127926284]
  Uncertainty in control and perception poses challenges for autonomous vehicle navigation in unstructured environments. This paper introduces a framework that minimizes control and perception uncertainty to ensure safe and reliable navigation.
  arXiv  Detail & Related papers  (2023-06-26T11:24:03Z)
• Learning Off-Road Terrain Traversability with Self-Supervisions Only [2.4316550366482357]
  Estimating the traversability of terrain should be reliable and accurate in diverse conditions for autonomous driving in off-road environments. We introduce a method for learning traversability from images that utilizes only self-supervision and no manual labels.
  arXiv  Detail & Related papers  (2023-05-30T09:51:27Z)
• Unsupervised Driving Event Discovery Based on Vehicle CAN-data [62.997667081978825]
  This work presents a simultaneous clustering and segmentation approach for vehicle CAN-data that identifies common driving events in an unsupervised manner. We evaluate our approach with a dataset of real Tesla Model 3 vehicle CAN-data and a two-hour driving session that we annotated with different driving events.
  arXiv  Detail & Related papers  (2023-01-12T13:10:47Z)
• RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learning [14.798955901284847]
  Under shared autonomy, wheelchair users expect vehicles to provide safe and comfortable rides while following users high-level navigation plans. We propose to model ride comfort explicitly in traversability analysis using proprioceptive sensing. We show our navigation system provides human-preferred ride comfort through robot experiments together with a human evaluation study.
  arXiv  Detail & Related papers  (2022-07-29T03:38:41Z)
• Tackling Real-World Autonomous Driving using Deep Reinforcement Learning [63.3756530844707]
  In this work, we propose a model-free Deep Reinforcement Learning Planner training a neural network that predicts acceleration and steering angle. In order to deploy the system on board the real self-driving car, we also develop a module represented by a tiny neural network.
  arXiv  Detail & Related papers  (2022-07-05T16:33:20Z)
• COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles [54.61668577827041]
  We introduce COOPERNAUT, an end-to-end learning model that uses cross-vehicle perception for vision-based cooperative driving. Our experiments on AutoCastSim suggest that our cooperative perception driving models lead to a 40% improvement in average success rate.
  arXiv  Detail & Related papers  (2022-05-04T17:55:12Z)
• Differentiable Control Barrier Functions for Vision-based End-to-End Autonomous Driving [100.57791628642624]
  We introduce a safety guaranteed learning framework for vision-based end-to-end autonomous driving. We design a learning system equipped with differentiable control barrier functions (dCBFs) that is trained end-to-end by gradient descent.
  arXiv  Detail & Related papers  (2022-03-04T16:14:33Z)
• End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learning [63.56464608571663]
  Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. In this work, we focus on the implementation of a system able to navigate through intersections where only traffic signs are provided. We propose a multi-agent system using a continuous, model-free Deep Reinforcement Learning algorithm used to train a neural network for predicting both the acceleration and the steering angle at each time step.
  arXiv  Detail & Related papers  (2021-04-28T07:54:40Z)
• Improving Robustness of Learning-based Autonomous Steering Using Adversarial Images [58.287120077778205]
  We introduce a framework for analyzing robustness of the learning algorithm w.r.t varying quality in the image input for autonomous driving. Using the results of sensitivity analysis, we propose an algorithm to improve the overall performance of the task of "learning to steer"
  arXiv  Detail & Related papers  (2021-02-26T02:08:07Z)
• PLOP: Probabilistic poLynomial Objects trajectory Planning for autonomous driving [8.105493956485583]
  We use a conditional imitation learning algorithm to predict trajectories for ego vehicle and its neighbors. Our approach is computationally efficient and relies only on on-board sensors. We evaluate our method offline on the publicly available dataset nuScenes.
  arXiv  Detail & Related papers  (2020-03-09T16:55:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.