FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusion

• URL: http://arxiv.org/abs/2308.06931v3
• Date: Mon, 18 Dec 2023 12:08:18 GMT
• Title: FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusion
• Authors: Siyu Teng, Luxi Li, Yuchen Li, Xuemin Hu, Lingxi Li, Yunfeng Ai, Long Chen
• Abstract summary: A comprehensive paradigm for unmanned transportation in open-pit mines is proposed in this research. We propose a multi-task motion planning algorithm, called FusionPlanner, for autonomous mining trucks by the multi-sensor fusion method. A novel benchmark called MiningNav offers three validation approaches to evaluate the trustworthiness and robustness of well-trained algorithms in transportation roads of open-pit mines.
• Score: 16.015095148145214
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In recent years, significant achievements have been made in motion planning for intelligent vehicles. However, as a typical unstructured environment, open-pit mining attracts limited attention due to its complex operational conditions and adverse environmental factors. A comprehensive paradigm for unmanned transportation in open-pit mines is proposed in this research. Firstly, we propose a multi-task motion planning algorithm, called FusionPlanner, for autonomous mining trucks by the multi-sensor fusion method to adapt both lateral and longitudinal control tasks for unmanned transportation. Then, we develop a novel benchmark called MiningNav, which offers three validation approaches to evaluate the trustworthiness and robustness of well-trained algorithms in transportation roads of open-pit mines. Finally, we introduce the Parallel Mining Simulator (PMS), a new high-fidelity simulator specifically designed for open-pit mining scenarios. PMS enables the users to manage and control open-pit mine transportation from both the single-truck control and multi-truck scheduling perspectives. The performance of FusionPlanner is tested by MiningNav in PMS, and the empirical results demonstrate a significant reduction in the number of collisions and takeovers of our planner. We anticipate our unmanned transportation paradigm will bring mining trucks one step closer to trustworthiness and robustness in continuous round-the-clock unmanned transportation.

Related papers

• General-Purpose Aerial Intelligent Agents Empowered by Large Language Models [9.603293922137965]
  This paper presents the first aerial intelligent agent capable of open-world task execution. Our hardware-software co-designed system addresses two fundamental limitations. The system demonstrates reliable task planning and scene understanding in communication-constrained environments.
  arXiv  Detail & Related papers  (2025-03-11T11:13:58Z)
• Multimodal Trajectory Prediction for Autonomous Driving on Unstructured Roads using Deep Convolutional Network [15.950227451262919]
  The application of autonomous driving in open-pit mining has garnered increasing attention for achieving safe and efficient transportation. A method is proposed to predict multiple possible trajectories and their probabilities of the target vehicle. The method underwent offline testing on a dataset specifically designed for autonomous driving scenarios in open-pit mining.
  arXiv  Detail & Related papers  (2024-09-27T02:29:02Z)
• Hybrid Imitation-Learning Motion Planner for Urban Driving [0.0]
  We propose a novel hybrid motion planner that integrates both learning-based and optimization-based techniques. Our model effectively balances safety and human-likeness, mitigating the trade-off inherent in these objectives. We validate our approach through simulation experiments and further demonstrate its efficacy by deploying it in real-world self-driving vehicles.
  arXiv  Detail & Related papers  (2024-09-04T16:54:31Z)
• M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving [11.36165122994834]
  We propose a Multi-Modal fusion transformer incorporating Driver Attention (M2DA) for autonomous driving. By incorporating driver attention, we empower the human-like scene understanding ability to autonomous vehicles to identify crucial areas precisely and ensure safety.
  arXiv  Detail & Related papers  (2024-03-19T08:54:52Z)
• Scenarios Engineering driven Autonomous Transportation in Open-Pit Mines [21.359823385387937]
  A novel scenarios engineering (SE) methodology for the autonomous mining truck is proposed for open-pit mines. This research addresses the unique challenges of autonomous transportation in open-pit mining, promoting productivity, safety, and performance in mining operations.
  arXiv  Detail & Related papers  (2024-03-15T02:26:55Z)
• Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport [83.06265788137443]
  We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel Long-HOT environment focused on deep exploration and long-horizon planning. We propose a modular hierarchical transport policy (HTP) that builds a topological graph of the scene to perform exploration with the help of weighted frontiers.
  arXiv  Detail & Related papers  (2022-10-28T05:30:49Z)
• Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline [96.31941517446859]
  Current end-to-end autonomous driving methods either run a controller based on a planned trajectory or perform control prediction directly. Our integrated approach has two branches for trajectory planning and direct control, respectively. Results are evaluated in the closed-loop urban driving setting with challenging scenarios using the CARLA simulator.
  arXiv  Detail & Related papers  (2022-06-16T12:42:44Z)
• COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles [54.61668577827041]
  We introduce COOPERNAUT, an end-to-end learning model that uses cross-vehicle perception for vision-based cooperative driving. Our experiments on AutoCastSim suggest that our cooperative perception driving models lead to a 40% improvement in average success rate.
  arXiv  Detail & Related papers  (2022-05-04T17:55:12Z)
• An Intelligent Self-driving Truck System For Highway Transportation [81.12838700312308]
  In this paper, we introduce an intelligent self-driving truck system. Our presented system consists of three main components, 1) a realistic traffic simulation module for generating realistic traffic flow in testing scenarios, 2) a high-fidelity truck model which is designed and evaluated for mimicking real truck response in real-world deployment. We also deploy our proposed system on a real truck and conduct real world experiments which shows our system's capacity of mitigating sim-to-real gap.
  arXiv  Detail & Related papers  (2021-12-31T04:54:13Z)
• A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments [68.31522961125589]
  We propose a framework for a team of UAVs to cooperatively explore and find a target in complex GPS-denied environments with obstacles. The team of UAVs autonomously navigates, explores, detects, and finds the target in a cluttered environment with a known map. Results indicate that the proposed multi-UAV system has improvements in terms of time-cost, the proportion of search area surveyed, as well as successful rates for search and rescue missions.
  arXiv  Detail & Related papers  (2021-07-19T12:54:04Z)
• BoMb-OT: On Batch of Mini-batches Optimal Transport [23.602237930502948]
  Mini-batch optimal transport (m-OT) has been successfully used in practical applications that involve probability measures with intractable density. We propose a novel mini-batching scheme for optimal transport, named Batch of Mini-batches Optimal Transport (BoMb-OT) We show that the new mini-batching scheme can estimate a better transportation plan between two original measures than m-OT.
  arXiv  Detail & Related papers  (2021-02-11T09:56:25Z)
• Deep Structured Reactive Planning [94.92994828905984]
  We propose a novel data-driven, reactive planning objective for self-driving vehicles. We show that our model outperforms a non-reactive variant in successfully completing highly complex maneuvers.
  arXiv  Detail & Related papers  (2021-01-18T01:43:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.