GAPG: Geometry Aware Push-Grasping Synergy for Goal-Oriented Manipulation in Clutter

• URL: http://arxiv.org/abs/2603.21195v1
• Date: Sun, 22 Mar 2026 12:30:44 GMT
• Title: GAPG: Geometry Aware Push-Grasping Synergy for Goal-Oriented Manipulation in Clutter
• Abstract summary: In cluttered environments, a single-step grasp is often insufficient.<n>Previous work has introduced pushing as an auxiliary action to create graspable space.<n>We propose a geometry-aware push-grasp synergy framework to integrate grasp and push evaluation.
• Score: 27.71481975135778
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Grasping target objects is a fundamental skill for robotic manipulation, but in cluttered environments with stacked or occluded objects, a single-step grasp is often insufficient. To address this, previous work has introduced pushing as an auxiliary action to create graspable space. However, these methods often struggle with both stability and efficiency because they neglect the scene's geometric information, which is essential for evaluating grasp robustness and ensuring that pushing actions are safe and effective. To this end, we propose a geometry-aware push-grasp synergy framework that leverages point cloud data to integrate grasp and push evaluation. Specifically, the grasp evaluation module analyzes the geometric relationship between the gripper's point cloud and the points enclosed within its closing region to determine grasp feasibility and stability. Guided by this, the push evaluation module predicts how pushing actions influence future graspable space, enabling the robot to select actions that reliably transform non-graspable states into graspable ones. By jointly reasoning about geometry in both grasping and pushing, our framework achieves safer, more efficient, and more reliable manipulation in cluttered settings. Our method is extensively tested in simulation and real-world environments in various scenarios. Experimental results demonstrate that our model generalizes well to real-world scenes and unseen objects.

Related papers

• PartialBiGrasp: Inferring Hidden Local Geometry for Bimanual Grasping from Partial Views [6.708853928904307]
  We propose a dual-arm grasp generation framework that operates directly on partial point cloud observations.<n>Our model learns geometric features implicitly through convolutional occupancy networks.<n>We leverage this understanding to generate force-closure compliant grasp pairs.
  arXiv  Detail & Related papers  (2026-08-19T17:56:11Z)
• Grasp-Oriented Non-Prehensile Manipulation via Learning a Graspability Field [53.59810543538279]
  Non-prehensile manipulation is often used as a preparatory step for robotic grasping.<n>In practice, objects admit multiple graspable configurations and the desired pose is not known in advance.<n>We reformulate non-prehensile manipulation for grasping as optimizing an object centric graspability objective.
  arXiv  Detail & Related papers  (2026-06-29T15:33:27Z)
• SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning [99.49739831030388]
  We study how the design of this interface shapes the agent's capacity for open-ended spatial reasoning.<n>We propose SpatialClaw, a training-free framework for spatial reasoning that adopts code as the action interface.
  arXiv  Detail & Related papers  (2026-06-11T17:59:36Z)
• HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Model [56.4392302336014]
  We present HAIC, a framework for robust interaction across diverse object dynamics without external state estimation.<n>Our key contribution is a dynamics predictor that estimates high-order object states (velocity, acceleration) solely from proprioceptive history.<n> Experiments on a humanoid robot show HAIC achieves high success rates in agile tasks.
  arXiv  Detail & Related papers  (2026-02-12T09:34:35Z)
• Delving into Dynamic Scene Cue-Consistency for Robust 3D Multi-Object Tracking [16.366398265001422]
  3D multi-object tracking is a critical and challenging task in the field of autonomous driving.<n>We introduce the Dynamic Scene Cue-Consistency Tracker (DSC-Track) to implement this principle.
  arXiv  Detail & Related papers  (2025-08-15T08:48:13Z)
• Corner-Grasp: Multi-Action Grasp Detection and Active Gripper Adaptation for Grasping in Cluttered Environments [0.3565151496245486]
  We propose a method for effectively grasping in cluttered bin-picking environments.<n>We utilize a multi-functional gripper that combines both suction and finger grasping.<n>We also present an active gripper adaptation strategy to minimize collisions between the gripper hardware and the surrounding environment.
  arXiv  Detail & Related papers  (2025-04-02T16:12:28Z)
• Articulated Object Manipulation using Online Axis Estimation with SAM2-Based Tracking [57.942404069484134]
  Articulated object manipulation requires precise object interaction, where the object's axis must be carefully considered.<n>Previous research employed interactive perception for manipulating articulated objects, but typically, open-loop approaches often suffer from overlooking the interaction dynamics.<n>We present a closed-loop pipeline integrating interactive perception with online axis estimation from segmented 3D point clouds.
  arXiv  Detail & Related papers  (2024-09-24T17:59:56Z)
• Learning Extrinsic Dexterity with Parameterized Manipulation Primitives [8.7221770019454]
  We learn a sequence of actions that utilize the environment to change the object's pose. Our approach can control the object's state through exploiting interactions between the object, the gripper, and the environment. We evaluate our approach on picking box-shaped objects of various weight, shape, and friction properties from a constrained table-top workspace.
  arXiv  Detail & Related papers  (2023-10-26T21:28:23Z)
• DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via Physics Simulation [81.11585774044848]
  We present DeepSimHO, a novel deep-learning pipeline that combines forward physics simulation and backward gradient approximation with a neural network. Our method noticeably improves the stability of the estimation and achieves superior efficiency over test-time optimization.
  arXiv  Detail & Related papers  (2023-10-11T05:34:36Z)
• Nonprehensile Riemannian Motion Predictive Control [57.295751294224765]
  We introduce a novel Real-to-Sim reward analysis technique to reliably imagine and predict the outcome of taking possible actions for a real robotic platform. We produce a closed-loop controller to reactively push objects in a continuous action space. We observe that RMPC is robust in cluttered as well as occluded environments and outperforms the baselines.
  arXiv  Detail & Related papers  (2021-11-15T18:50:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.