TransGraspNet: Physically and Geometrically Consistent Manipulation of Transparent Labware

• URL: http://arxiv.org/abs/2607.29567v1
• Date: Fri, 31 Jul 2026 15:55:45 GMT
• Title: TransGraspNet: Physically and Geometrically Consistent Manipulation of Transparent Labware
• Abstract summary: We propose TransGraspNet, a geometry physics consistent framework that enforces consistency from perception to execution.<n>We evaluate TransGraspNet on public benchmarks, a dedicated transparent glassware dataset, and a real robotic platform.<n>The proposed system achieves reliable real-world operation, including high grasp success rates in clutter and zero spillage during high speed liquid transport.
• Score: 8.131557036284407
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Manipulating transparent laboratory glassware that contains liquid is inherently safety-critical: even small geometric errors can cause unstable grasps and hazardous spillage. Although recent progress has been made in transparent object perception and robotic grasping, most existing systems optimize detection, depth reconstruction, and grasp planning independently, which leads to cross-stage inconsistency imperfect boundaries induce depth bleeding, distorted surfaces corrupt normal estimation, and task agnostic grasp scoring yields tilted or off-center grasps that fail under dynamic motion. In this paper, we propose TransGraspNet, a geometry physics consistent framework that explicitly enforces consistency from perception to execution through three coupled principles: boundary consistency to produce structurally reliable object contours as downstream priors, surface consistency to preserve geometric fidelity and surface normal accuracy during depth reconstruction, and physics consistency to refine grasp selection with centroid alignment and wrench-space stability for upright and dynamically robust manipulation. We evaluate TransGraspNet on public benchmarks, a dedicated transparent glassware dataset, and a real robotic platform. The results show improved boundary quality and surface normal fidelity, and demonstrate strong task-level performance in cluttered transparent scenes. Most importantly, the proposed system achieves reliable real-world operation, including high grasp success rates in clutter and zero spillage during high speed liquid transport, highlighting the effectiveness of our method.

Related papers

• Surfsvr: 2D Surface Priors as 3D Geometric Regularizers for Sparse Voxel Reconstruction [56.51413081953813]
  SurfSVR is a novel sparse voxel reconstruction paradigm that treats 2D surface priors as explicit 3D geometric regularizers.<n>It consistently improves sparse voxel reconstruction across scenes with substantially different visibility and geometry characteristics.
  arXiv  Detail & Related papers  (2026-08-12T11:25:31Z)
• AISPO: Enhancing Depth Reliability for Robotic Manipulation of Non-Lambertian Objects via Affine-Invariant Shape Prior [27.63005010032789]
  We propose AISPO, a depth completion framework that improves depth reliability for manipulation in challenging sensing conditions.<n>Unlike methods that focus primarily on average depth accuracy, our approach emphasizes physical plausibility and structural integrity of the predicted depth maps.
  arXiv  Detail & Related papers  (2026-06-24T07:37:11Z)
• Admittance-Based Surface Alignment for Human-in-the-Loop Robotic Visual Inspection [7.354545339891874]
  This paper presents a novel real-time, closed-loop robotic orientation control pipeline for precision visual inspection.<n>We design the end-effector as a virtual sphere moving through a medium, such that the resulting physically interpretable mass--damper system generates synchronized, compliant motion.<n>We validate the framework on a 6-DOF manipulator demonstrating stable normal-tracking and a final mean orientation error of 0.4.
  arXiv  Detail & Related papers  (2026-06-17T02:01:51Z)
• Reliability-Guided Depth Fusion for Glare-Resilient Navigation Costmaps [0.0]
  Specular glare on reflective floors, glass boundaries, and glossy indoor surfaces frequently corrupts active-stereo RGB-D depth measurements.<n>This paper presents a glare-resilient costmap construction method based on explicit depth-reliability modeling.
  arXiv  Detail & Related papers  (2026-06-02T10:06:15Z)
• Trans2Occ: Voxel Occupancy Estimation and Grasp for Transparent Objects from Simulation to Reality [125.76063573012853]
  We present a framework for transparent object perception and manipulation based on single-view RGB input.<n>Our approach predicts voxel-space occupancy directly from a single image, providing a geometry-aware representation that supports downstream robotic grasping.
  arXiv  Detail & Related papers  (2026-06-01T06:59:13Z)
• PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
  PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
  arXiv  Detail & Related papers  (2026-03-11T14:11:42Z)
• DiffTrans: Differentiable Geometry-Materials Decomposition for Reconstructing Transparent Objects [53.83670041249326]
  Reconstructing transparent objects from a set of multi-view images is a challenging task due to the complicated nature and indeterminate behavior of light propagation.<n>We propose a differentiable rendering framework for transparent objects, dubbed DiffTrans, which allows for efficient decomposition and reconstruction of the geometry and materials of transparent objects.
  arXiv  Detail & Related papers  (2026-02-28T02:21:31Z)
• Fix False Transparency by Noise Guided Splatting [4.778060896816705]
  Opaque objects reconstructed by 3DGS often exhibit a falsely transparent surface.<n>This issue stems from the ill-posed optimization in 3DGS.<n>We propose a strategy to encourage surface Gaussians to adopt higher opacity.
  arXiv  Detail & Related papers  (2025-10-17T15:28:24Z)
• TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priors [39.60777069381983]
  We introduce Transparent Surface Gaussian Splatting (TSGS), a new framework that separates geometry learning from appearance refinement.<n>In the geometry learning stage, TSGS focuses on geometry by using specular-suppressed inputs to accurately represent surfaces.<n>To enhance depth inference, TSGS employs a first-surface depth extraction method.
  arXiv  Detail & Related papers  (2025-04-17T10:00:09Z)
• RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface Normal Estimation and Manipulation [50.10282876199739]
  This paper introduces RFTrans, an RGB-D-based method for surface normal estimation and manipulation of transparent objects. It integrates the RFNet, which predicts refractive flow, object mask, and boundaries, followed by the F2Net, which estimates surface normal from the refractive flow. A real-world robot grasping task witnesses an 83% success rate, proving that refractive flow can help enable direct sim-to-real transfer.
  arXiv  Detail & Related papers  (2023-11-21T07:19:47Z)
• DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via Physics Simulation [81.11585774044848]
  We present DeepSimHO, a novel deep-learning pipeline that combines forward physics simulation and backward gradient approximation with a neural network. Our method noticeably improves the stability of the estimation and achieves superior efficiency over test-time optimization.
  arXiv  Detail & Related papers  (2023-10-11T05:34:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.