Collaborative Recognition of Feasible region with Aerial and Ground
Robots through DPCN
- URL: http://arxiv.org/abs/2103.00947v1
- Date: Mon, 1 Mar 2021 12:22:11 GMT
- Title: Collaborative Recognition of Feasible region with Aerial and Ground
Robots through DPCN
- Authors: Yunshuang Li, Zheyuan Huang, Zexi chen, Yue Wang and Rong Xiong
- Abstract summary: Ground robots always get collision in that only if they get close to the obstacles, can they sense the danger and take actions, which is usually too late to avoid the crash.
We present collaboration of aerial and ground robots in recognition of feasible region.
- Score: 9.10669609583837
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Ground robots always get collision in that only if they get close to the
obstacles, can they sense the danger and take actions, which is usually too
late to avoid the crash, causing severe damage to the robots. To address this
issue, we present collaboration of aerial and ground robots in recognition of
feasible region. Taking the aerial robots' advantages of having large scale
variance of view points of the same route which the ground robots is on, the
collaboration work provides global information of road segmentation for the
ground robot, thus enabling it to obtain feasible region and adjust its pose
ahead of time. Under normal circumstance, the transformation between these two
devices can be obtained by GPS yet with much error, directly causing inferior
influence on recognition of feasible region. Thereby, we utilize the
state-of-the-art research achievements in matching heterogeneous sensor
measurements called deep phase correlation network(DPCN), which has excellent
performance on heterogeneous mapping, to refine the transformation. The network
is light-weighted and promising for better generalization. We use Aero-Ground
dataset which consists of heterogeneous sensor images and aerial road
segmentation images. The results show that our collaborative system has great
accuracy, speed and stability.
Related papers
- Social-Pose: Enhancing Trajectory Prediction with Human Body Pose [70.59399670794171]
We study the benefits of predicting human trajectories using human body poses instead of solely their Cartesian space locations in time.<n>We propose Social-pose', an attention-based pose encoder that effectively captures the poses of all humans in a scene and their social relations.
arXiv Detail & Related papers (2025-07-30T14:58:48Z) - HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments [8.974071308749007]
We study the problem of robot navigation in dense and interactive crowds with environmental constraints such as corridors and furniture.
Previous methods fail to consider all types of interactions among agents and obstacles, leading to unsafe and inefficient robot paths.
We propose a structured framework to learn robot navigation policies with reinforcement learning.
arXiv Detail & Related papers (2024-11-19T00:56:35Z) - SPACE: 3D Spatial Co-operation and Exploration Framework for Robust Mapping and Coverage with Multi-Robot Systems [0.0]
Multi-robot visual (RGB-D) mapping and exploration holds immense potential for application in domains such as domestic service and logistics.
There are two primary challenges: (1) the "ghosting trail" effect, which occurs due to overlapping views of robots, and (2) the oversight of visual reconstructions in selecting the most effective frontiers for exploration.
We propose a new semi-distributed framework (SPACE) for spatial cooperation in indoor environments that enables enhanced coverage and 3D mapping.
arXiv Detail & Related papers (2024-11-04T19:04:09Z) - Hearing the shape of an arena with spectral swarm robotics [0.0]
We introduce spectral swarm robotics where robots diffuse information to their neighbors to emulate the Laplacian operator.
We validate experimentally spectral swarm robotics under challenging conditions with the one-shot classification of arena shapes.
Spectral methods may extend beyond robotics to analyze and coordinate swarms of agents of various natures, such as traffic or crowds.
arXiv Detail & Related papers (2024-03-25T19:50:07Z) - Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances [76.34037366117234]
We introduce a new dataset called Robot Control Gestures (RoCoG-v2)
The dataset is composed of both real and synthetic videos from seven gesture classes.
We present results using state-of-the-art action recognition and domain adaptation algorithms.
arXiv Detail & Related papers (2023-03-17T23:23:55Z) - Neural Scene Representation for Locomotion on Structured Terrain [56.48607865960868]
We propose a learning-based method to reconstruct the local terrain for a mobile robot traversing urban environments.
Using a stream of depth measurements from the onboard cameras and the robot's trajectory, the estimates the topography in the robot's vicinity.
We propose a 3D reconstruction model that faithfully reconstructs the scene, despite the noisy measurements and large amounts of missing data coming from the blind spots of the camera arrangement.
arXiv Detail & Related papers (2022-06-16T10:45:17Z) - 6N-DoF Pose Tracking for Tensegrity Robots [5.398092221687385]
Tensegrity robots are composed of rigid compressive elements (rods) and flexible tensile elements (e.g., cables)
This work aims to address the pose tracking of tensegrity robots through a markerless, vision-based method.
An iterative optimization process is proposed to estimate the 6-DoF poses of each rigid element of a tensegrity robot from an RGB-D video.
arXiv Detail & Related papers (2022-05-29T20:55:29Z) - Autonomous Aerial Robot for High-Speed Search and Intercept Applications [86.72321289033562]
A fully-autonomous aerial robot for high-speed object grasping has been proposed.
As an additional sub-task, our system is able to autonomously pierce balloons located in poles close to the surface.
Our approach has been validated in a challenging international competition and has shown outstanding results.
arXiv Detail & Related papers (2021-12-10T11:49:51Z) - SABER: Data-Driven Motion Planner for Autonomously Navigating
Heterogeneous Robots [112.2491765424719]
We present an end-to-end online motion planning framework that uses a data-driven approach to navigate a heterogeneous robot team towards a global goal.
We use model predictive control (SMPC) to calculate control inputs that satisfy robot dynamics, and consider uncertainty during obstacle avoidance with chance constraints.
recurrent neural networks are used to provide a quick estimate of future state uncertainty considered in the SMPC finite-time horizon solution.
A Deep Q-learning agent is employed to serve as a high-level path planner, providing the SMPC with target positions that move the robots towards a desired global goal.
arXiv Detail & Related papers (2021-08-03T02:56:21Z) - Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for
Multi-Robot Systems [92.26462290867963]
Kimera-Multi is the first multi-robot system that is robust and capable of identifying and rejecting incorrect inter and intra-robot loop closures.
We demonstrate Kimera-Multi in photo-realistic simulations, SLAM benchmarking datasets, and challenging outdoor datasets collected using ground robots.
arXiv Detail & Related papers (2021-06-28T03:56:40Z) - DARE-SLAM: Degeneracy-Aware and Resilient Loop Closing in
Perceptually-Degraded Environments [4.34118539186713]
A key requirement in autonomous exploration is building accurate and consistent maps of the unknown environment.
We present a degeneracy-aware and drift-resilient loop closing method to improve place recognition and resolve 3D location ambiguities.
arXiv Detail & Related papers (2021-02-09T20:37:17Z) - Task-relevant Representation Learning for Networked Robotic Perception [74.0215744125845]
This paper presents an algorithm to learn task-relevant representations of sensory data that are co-designed with a pre-trained robotic perception model's ultimate objective.
Our algorithm aggressively compresses robotic sensory data by up to 11x more than competing methods.
arXiv Detail & Related papers (2020-11-06T07:39:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.