Towards Deep Learning Assisted Autonomous UAVs for Manipulation Tasks in GPS-Denied Environments

• URL: http://arxiv.org/abs/2101.06414v1
• Date: Sat, 16 Jan 2021 09:20:46 GMT
• Title: Towards Deep Learning Assisted Autonomous UAVs for Manipulation Tasks in GPS-Denied Environments
• Authors: Ashish Kumar, Mohit Vohra, Ravi Prakash, L. Behera
• Abstract summary: This paper is primarily focused on the task of assembling large 3D structures in outdoors and GPS-denied environments. Our framework is deployed on the specified UAV in order to report the performance analysis of the individual modules.
• Score: 10.02675366919811
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: In this work, we present a pragmatic approach to enable unmanned aerial vehicle (UAVs) to autonomously perform highly complicated tasks of object pick and place. This paper is largely inspired by challenge-2 of MBZIRC 2020 and is primarily focused on the task of assembling large 3D structures in outdoors and GPS-denied environments. Primary contributions of this system are: (i) a novel computationally efficient deep learning based unified multi-task visual perception system for target localization, part segmentation, and tracking, (ii) a novel deep learning based grasp state estimation, (iii) a retracting electromagnetic gripper design, (iv) a remote computing approach which exploits state-of-the-art MIMO based high speed (5000Mb/s) wireless links to allow the UAVs to execute compute intensive tasks on remote high end compute servers, and (v) system integration in which several system components are weaved together in order to develop an optimized software stack. We use DJI Matrice-600 Pro, a hex-rotor UAV and interface it with the custom designed gripper. Our framework is deployed on the specified UAV in order to report the performance analysis of the individual modules. Apart from the manipulation system, we also highlight several hidden challenges associated with the UAVs in this context.

Related papers

• UAV-enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning [79.16150966434299]
  We formulate a UAV-enabled collaborative beamforming multi-objective optimization problem (UCBMOP) to maximize the transmission rate of the UVAA and minimize the energy consumption of all UAVs. We use the heterogeneous-agent trust region policy optimization (HATRPO) as the basic framework, and then propose an improved HATRPO algorithm, namely HATRPO-UCB.
  arXiv  Detail & Related papers  (2024-04-11T03:19:22Z)
• A$^2$-UAV: Application-Aware Content and Network Optimization of Edge-Assisted UAV Systems [12.847650904294033]
  We propose a novel A$2$-UAV framework to optimize the number of correctly executed tasks at the edge. A$2$-TPP takes into account the relationship between deep neural network (DNN) accuracy and image compression. We extensively evaluate A$2$-TPP through real-world experiments with a testbed composed by four DJI Mavic Air 2 UAVs.
  arXiv  Detail & Related papers  (2023-01-16T11:17:32Z)
• Deep Learning Computer Vision Algorithms for Real-time UAVs On-board Camera Image Processing [77.34726150561087]
  This paper describes how advanced deep learning based computer vision algorithms are applied to enable real-time on-board sensor processing for small UAVs. All algorithms have been developed using state-of-the-art image processing methods based on deep neural networks.
  arXiv  Detail & Related papers  (2022-11-02T11:10:42Z)
• Deep Reinforcement Learning for Task Offloading in UAV-Aided Smart Farm Networks [3.6118662460334527]
  We introduce a Deep Q-Learning (DQL) approach to solve this multi-objective problem. We show that our proposed DQL-based method achieves comparable results when it comes to the UAVs' remaining battery levels and percentage of deadline violations.
  arXiv  Detail & Related papers  (2022-09-15T15:29:57Z)
• Advanced Algorithms of Collision Free Navigation and Flocking for Autonomous UAVs [0.0]
  This report contributes towards the state-of-the-art in UAV control for safe autonomous navigation and motion coordination of multi-UAV systems. The first part of this report deals with single-UAV systems. The complex problem of three-dimensional (3D) collision-free navigation in unknown/dynamic environments is addressed. The second part of this report addresses safe navigation for multi-UAV systems. Distributed motion coordination methods of multi-UAV systems for flocking and 3D area coverage are developed.
  arXiv  Detail & Related papers  (2021-10-30T03:51:40Z)
• Trajectory Design for UAV-Based Internet-of-Things Data Collection: A Deep Reinforcement Learning Approach [93.67588414950656]
  In this paper, we investigate an unmanned aerial vehicle (UAV)-assisted Internet-of-Things (IoT) system in a 3D environment. We present a TD3-based trajectory design for completion time minimization (TD3-TDCTM) algorithm. Our simulation results show the superiority of the proposed TD3-TDCTM algorithm over three conventional non-learning based baseline methods.
  arXiv  Detail & Related papers  (2021-07-23T03:33:29Z)
• A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments [68.31522961125589]
  We propose a framework for a team of UAVs to cooperatively explore and find a target in complex GPS-denied environments with obstacles. The team of UAVs autonomously navigates, explores, detects, and finds the target in a cluttered environment with a known map. Results indicate that the proposed multi-UAV system has improvements in terms of time-cost, the proportion of search area surveyed, as well as successful rates for search and rescue missions.
  arXiv  Detail & Related papers  (2021-07-19T12:54:04Z)
• 3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning [75.78929539923749]
  Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enhancing the network performance and coverage in wireless communication. It is challenging to obtain an optimal resource allocation scheme for the UAV-assisted Internet of Things (IoT) In this paper, we design a new UAV-assisted IoT systems relying on the shortest flight path of the UAVs while maximising the amount of data collected from IoT devices.
  arXiv  Detail & Related papers  (2021-06-06T14:08:41Z)
• Multi-Agent Deep Reinforcement Learning Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing [99.27205900403578]
  An unmanned aerial vehicle (UAV)-aided mobile edge computing (MEC) framework is proposed. We aim to jointly optimize the geographical fairness among all the user equipments (UEs) and the fairness of each UAV's UE-load. We show that our proposed solution has considerable performance over other traditional algorithms.
  arXiv  Detail & Related papers  (2020-09-23T17:44:07Z)
• UAV Autonomous Localization using Macro-Features Matching with a CAD Model [0.0]
  This paper presents a novel offline, portable, real-time in-door UAV localization technique that relies on macro-feature detection and matching. The main contribution of this work is the real-time creation of a macro-feature description vector from the UAV captured images which are simultaneously matched with an offline pre-existing vector from a Computer-Aided Design (CAD) model. The effectiveness and accuracy of the proposed system were evaluated through simulations and experimental prototype implementation.
  arXiv  Detail & Related papers  (2020-01-30T23:49:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.