Collaborative Recognition of Feasible region with Aerial and Ground Robots through DPCN

• URL: http://arxiv.org/abs/2103.00947v1
• Date: Mon, 1 Mar 2021 12:22:11 GMT
• Title: Collaborative Recognition of Feasible region with Aerial and Ground Robots through DPCN
• Abstract summary: Ground robots always get collision in that only if they get close to the obstacles, can they sense the danger and take actions, which is usually too late to avoid the crash. We present collaboration of aerial and ground robots in recognition of feasible region.
• Score: 9.10669609583837
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Ground robots always get collision in that only if they get close to the obstacles, can they sense the danger and take actions, which is usually too late to avoid the crash, causing severe damage to the robots. To address this issue, we present collaboration of aerial and ground robots in recognition of feasible region. Taking the aerial robots' advantages of having large scale variance of view points of the same route which the ground robots is on, the collaboration work provides global information of road segmentation for the ground robot, thus enabling it to obtain feasible region and adjust its pose ahead of time. Under normal circumstance, the transformation between these two devices can be obtained by GPS yet with much error, directly causing inferior influence on recognition of feasible region. Thereby, we utilize the state-of-the-art research achievements in matching heterogeneous sensor measurements called deep phase correlation network(DPCN), which has excellent performance on heterogeneous mapping, to refine the transformation. The network is light-weighted and promising for better generalization. We use Aero-Ground dataset which consists of heterogeneous sensor images and aerial road segmentation images. The results show that our collaborative system has great accuracy, speed and stability.

Related papers

• RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction [51.76737991200891]
  Human-to-robot (H2R) object handover is a fundamental capability for human-robot collaboration, yet progress is hindered by the scarcity of large-scale, human-centric datasets.<n>We introduce Hand2Bot, an RGB-D video dataset that provides rich contextual information such as body posture and facial expressions.<n>We propose PassGen, a generative pipeline that synthesizes realistic handover sequences while ensuring hand-object consistency.
  arXiv  Detail & Related papers  (2026-08-13T09:55:59Z)
• EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal [63.906929035961134]
  We open-source a reconstruction pipeline capturing 55 scene-aligned 4D human motion sequences in diverse, complex environments.<n>The resulting dataset comprises over 150k frames, which we evaluate against motion-capture ground truth.<n>Our pipeline enables community-driven dataset extensions and factors the problem to help researchers build context-aware robots.
  arXiv  Detail & Related papers  (2026-07-15T06:02:41Z)
• Meridian: Metric-Semantic Primitive Matching for Cross-View Geo-Localization Beyond Urban Environments [47.53030013880309]
  Successful robot automation requires accurate global localization to support repeatability, task planning, goal specification, and safe operation.<n>We present Meridian, a method for matching high-level metric-semantic primitives across aerial images and ground robot RGB-D camera data.<n>We demonstrate that our algorithm can localize a ground robot across a wide variety of environments, including an autonomous driving dataset, a park and campus area, and a wilderness camp.
  arXiv  Detail & Related papers  (2026-06-04T15:52:40Z)
• CHORAL: Traversal-Aware Planning for Safe and Efficient Heterogeneous Multi-Robot Routing [4.3992789649203194]
  Monitoring large, unknown, and complex environments with autonomous robots poses significant navigation challenges.<n>We propose an integrated semantic-aware framework for coordinating heterogeneous robots.<n> Experiments in simulation and in a real inspection mission with three robotic platforms demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2026-01-15T12:34:22Z)
• SLEI3D: Simultaneous Exploration and Inspection via Heterogeneous Fleets under Limited Communication [10.496161804810473]
  This work proposes a novel planning and coordination framework (SLEI3D) that integrates the online strategies for collaborative 3D exploration, adaptive inspection and timely communication.<n>The proposed framework is validated extensively via high-fidelity simulations of numerous large-scale missions with up to 48 robots and 384 thousand cubic meters.
  arXiv  Detail & Related papers  (2026-01-01T02:06:35Z)
• Social-Pose: Enhancing Trajectory Prediction with Human Body Pose [70.59399670794171]
  We study the benefits of predicting human trajectories using human body poses instead of solely their Cartesian space locations in time.<n>We propose Social-pose', an attention-based pose encoder that effectively captures the poses of all humans in a scene and their social relations.
  arXiv  Detail & Related papers  (2025-07-30T14:58:48Z)
• HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments [8.974071308749007]
  We study the problem of robot navigation in dense and interactive crowds with environmental constraints such as corridors and furniture. Previous methods fail to consider all types of interactions among agents and obstacles, leading to unsafe and inefficient robot paths. We propose a structured framework to learn robot navigation policies with reinforcement learning.
  arXiv  Detail & Related papers  (2024-11-19T00:56:35Z)
• SPACE: 3D Spatial Co-operation and Exploration Framework for Robust Mapping and Coverage with Multi-Robot Systems [0.0]
  Multi-robot visual (RGB-D) mapping and exploration holds immense potential for application in domains such as domestic service and logistics. There are two primary challenges: (1) the "ghosting trail" effect, which occurs due to overlapping views of robots, and (2) the oversight of visual reconstructions in selecting the most effective frontiers for exploration. We propose a new semi-distributed framework (SPACE) for spatial cooperation in indoor environments that enables enhanced coverage and 3D mapping.
  arXiv  Detail & Related papers  (2024-11-04T19:04:09Z)
• Hearing the shape of an arena with spectral swarm robotics [0.0]
  We introduce spectral swarm robotics where robots diffuse information to their neighbors to emulate the Laplacian operator. We validate experimentally spectral swarm robotics under challenging conditions with the one-shot classification of arena shapes. Spectral methods may extend beyond robotics to analyze and coordinate swarms of agents of various natures, such as traffic or crowds.
  arXiv  Detail & Related papers  (2024-03-25T19:50:07Z)
• Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances [76.34037366117234]
  We introduce a new dataset called Robot Control Gestures (RoCoG-v2) The dataset is composed of both real and synthetic videos from seven gesture classes. We present results using state-of-the-art action recognition and domain adaptation algorithms.
  arXiv  Detail & Related papers  (2023-03-17T23:23:55Z)
• Neural Scene Representation for Locomotion on Structured Terrain [56.48607865960868]
  We propose a learning-based method to reconstruct the local terrain for a mobile robot traversing urban environments. Using a stream of depth measurements from the onboard cameras and the robot's trajectory, the estimates the topography in the robot's vicinity. We propose a 3D reconstruction model that faithfully reconstructs the scene, despite the noisy measurements and large amounts of missing data coming from the blind spots of the camera arrangement.
  arXiv  Detail & Related papers  (2022-06-16T10:45:17Z)
• 6N-DoF Pose Tracking for Tensegrity Robots [5.398092221687385]
  Tensegrity robots are composed of rigid compressive elements (rods) and flexible tensile elements (e.g., cables) This work aims to address the pose tracking of tensegrity robots through a markerless, vision-based method. An iterative optimization process is proposed to estimate the 6-DoF poses of each rigid element of a tensegrity robot from an RGB-D video.
  arXiv  Detail & Related papers  (2022-05-29T20:55:29Z)
• Autonomous Aerial Robot for High-Speed Search and Intercept Applications [86.72321289033562]
  A fully-autonomous aerial robot for high-speed object grasping has been proposed. As an additional sub-task, our system is able to autonomously pierce balloons located in poles close to the surface. Our approach has been validated in a challenging international competition and has shown outstanding results.
  arXiv  Detail & Related papers  (2021-12-10T11:49:51Z)
• SABER: Data-Driven Motion Planner for Autonomously Navigating Heterogeneous Robots [112.2491765424719]
  We present an end-to-end online motion planning framework that uses a data-driven approach to navigate a heterogeneous robot team towards a global goal. We use model predictive control (SMPC) to calculate control inputs that satisfy robot dynamics, and consider uncertainty during obstacle avoidance with chance constraints. recurrent neural networks are used to provide a quick estimate of future state uncertainty considered in the SMPC finite-time horizon solution. A Deep Q-learning agent is employed to serve as a high-level path planner, providing the SMPC with target positions that move the robots towards a desired global goal.
  arXiv  Detail & Related papers  (2021-08-03T02:56:21Z)
• Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systems [92.26462290867963]
  Kimera-Multi is the first multi-robot system that is robust and capable of identifying and rejecting incorrect inter and intra-robot loop closures. We demonstrate Kimera-Multi in photo-realistic simulations, SLAM benchmarking datasets, and challenging outdoor datasets collected using ground robots.
  arXiv  Detail & Related papers  (2021-06-28T03:56:40Z)
• DARE-SLAM: Degeneracy-Aware and Resilient Loop Closing in Perceptually-Degraded Environments [4.34118539186713]
  A key requirement in autonomous exploration is building accurate and consistent maps of the unknown environment. We present a degeneracy-aware and drift-resilient loop closing method to improve place recognition and resolve 3D location ambiguities.
  arXiv  Detail & Related papers  (2021-02-09T20:37:17Z)
• Task-relevant Representation Learning for Networked Robotic Perception [74.0215744125845]
  This paper presents an algorithm to learn task-relevant representations of sensory data that are co-designed with a pre-trained robotic perception model's ultimate objective. Our algorithm aggressively compresses robotic sensory data by up to 11x more than competing methods.
  arXiv  Detail & Related papers  (2020-11-06T07:39:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.