Visibility-Aware Mobile Grasping in Dynamic Environments

• URL: http://arxiv.org/abs/2605.02487v3
• Date: Sun, 10 May 2026 07:20:32 GMT
• Title: Visibility-Aware Mobile Grasping in Dynamic Environments
• Abstract summary: This paper addresses the problem of mobile grasping in dynamic, unknown environments.<n>We propose a unified mobile grasping system comprising two core components.<n>Results show that our system achieves a success rate of 68.8% and 58.0% in unknown static and dynamic environments.
• Score: 17.682256810079455
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper addresses the problem of mobile grasping in dynamic, unknown environments where a robot must operate under a limited field-of-view. The fundamental challenge is the inherent trade-off between ``seeing'' around to reduce environmental uncertainty and ``moving'' the body to achieve task progress in a high-dimensional configuration space, subject to visibility constraints. Previous approaches often assume known or static environments and decouple these objectives, failing to guarantee safety when unobserved dynamic obstacles intersect the robot's path during manipulation. In this paper, we propose a unified mobile grasping system comprising two core components: (1) an iterative low-level whole-body planner coupled with velocity-aware active perception to navigate dynamic environments safely; and (2) a hierarchical high-level planner based on behavior trees that adaptively generates subgoals to guide the robot through exploration and runtime failures. We provide experimental results across 400 randomized simulation scenarios and real-world deployment on a Fetch mobile manipulator. Results show that our system achieves a success rate of 68.8\% and 58.0\% in unknown static and dynamic environments, respectively, significantly boosting success rates by 22.8\% and 18.0\% over the \nam approach in both unknown static and dynamic environments, with improved collision safety.

Related papers

• Spatiotemporal Agility: Time-Constrained Reinforcement Learning for Vision-Guided Dynamic Quadrupedal Interception [3.372164928871513]
  Legged robots require robust agility to perceive and interact with complex and dynamic environments.<n>Most existing quadruped locomotion works rely on velocity-tracking policy, which struggle to reach precise targets within strict temporal constraints.<n>This paper proposes an integrated framework that combines a vision module for landing point and time prediction with a direct position and time conditioned RL locomotion policy.
  arXiv  Detail & Related papers  (2026-08-07T07:42:19Z)
• Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking [78.30338456206984]
  We introduce a novel framework for training general-purpose 3D foothold-tracking policies.<n>By dynamically providing footstep support through a goal sampler, this method enables the learned policy to be agnostic to specific terrains.<n>Our new target representation effectively mitigates challenges arising in the real world, such as noisy and inaccurate pose estimation and foot contact estimation.
  arXiv  Detail & Related papers  (2026-06-06T16:44:56Z)
• Learn Weightlessness: Imitate Non-Self-Stabilizing Motions on Humanoid Robot [56.377161933570335]
  Humans naturally exploit a "weightless" state during non-self-stabilizing (NSS) motions.<n>Inspired by this biological mechanism, we propose a weightlessness-state auto-labeling strategy for dataset annotation.<n>Our work bridges the gap between precise trajectory tracking and adaptive environmental interaction, offering a biologically-inspired solution for contact-rich humanoid control.
  arXiv  Detail & Related papers  (2026-04-23T07:10:05Z)
• Robust Cross-Domain WiFi Fall Detection via Physics-Driven Attention-Enhanced Transformers [64.35403680946182]
  Device-free fall detection utilizing WiFi Channel State Information (CSI) has emerged as a promising solution for elderly health monitoring.<n>Existing deep learning approaches suffer from severe performance degradation when deployed in unseen environments.<n>We propose a robust, domain-general framework featuring a novel Attention-Enhanced CNN-Transformer hybrid architecture.
  arXiv  Detail & Related papers  (2026-04-23T03:28:12Z)
• Learning Smooth and Robust Space Robotic Manipulation of Dynamic Target via Inter-frame Correlation [12.529803316934176]
  In microgravity environments, objects are typically free-floating, lacking the support and frictional constraints found on Earth.<n>This letter proposes a data-driven space robotic manipulation approach that integrates historical temporal information and inter-frame correlation mechanisms.
  arXiv  Detail & Related papers  (2026-03-29T06:27:30Z)
• HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Model [56.4392302336014]
  We present HAIC, a framework for robust interaction across diverse object dynamics without external state estimation.<n>Our key contribution is a dynamics predictor that estimates high-order object states (velocity, acceleration) solely from proprioceptive history.<n> Experiments on a humanoid robot show HAIC achieves high success rates in agile tasks.
  arXiv  Detail & Related papers  (2026-02-12T09:34:35Z)
• Safe mobility support system using crowd mapping and avoidance route planning using VLM [0.0]
  This paper proposes a novel framework that integrates Vision-Language Models (VLM) and Gaussian Process Regression (GPR) to generate dynamic crowd-density maps.<n> Experimental results from real-world trials on a university campus demonstrated that robots successfully generated routes avoiding both static obstacles and dynamic crowds.
  arXiv  Detail & Related papers  (2026-02-11T14:47:51Z)
• SPOT: Spatio-Temporal Obstacle-free Trajectory Planning for UAVs in an Unknown Dynamic Environment [1.9181913148426697]
  We develop a 4-dimensional planner, integrated with vision-based Safe Flight Corridor (SFC) generation.<n>We validate our method extensively in both simulation and real-world hardware experiments and benchmark it against state-of-the-art approaches.
  arXiv  Detail & Related papers  (2026-02-01T12:24:12Z)
• A General Purpose Method for Robotic Interception of Non-Cooperative Dynamic Targets [0.0]
  This paper presents a general purpose framework for autonomous, vision-based interception of dynamic, non-cooperative targets.<n>The approach relies solely on a monocular camera with fiducials for target tracking and operates entirely in the local observer frame.<n>Results from simulated and physical experiments demonstrate robust performance with low interception errors.
  arXiv  Detail & Related papers  (2025-12-23T21:14:03Z)
• IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigation [56.43007596544299]
  IndustryNav is the first dynamic industrial navigation benchmark for active spatial reasoning.<n>A study of nine state-of-the-art Visual Large Language Models reveals that closed-source models maintain a consistent advantage.
  arXiv  Detail & Related papers  (2025-11-21T16:48:49Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• Situationally-Aware Dynamics Learning [57.698553219660376]
  We propose a novel framework for online learning of hidden state representations.<n>Our approach explicitly models the influence of unobserved parameters on both transition dynamics and reward structures.<n>Experiments in both simulation and real world reveal significant improvements in data efficiency, policy performance, and the emergence of safer, adaptive navigation strategies.
  arXiv  Detail & Related papers  (2025-05-26T06:40:11Z)
• DPMPC-Planner: A real-time UAV trajectory planning framework for complex static environments with dynamic obstacles [0.9462808515258462]
  Safe UAV navigation is challenging due to the complex environment structures, dynamic obstacles, and uncertainties from measurement noises and unpredictable moving obstacle behaviors. This paper proposes a trajectory planning framework to achieve safe navigation considering complex static environments with dynamic obstacles.
  arXiv  Detail & Related papers  (2021-09-14T23:51:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.