Robotic Desk Organization: A Multi-Primitive Approach to Manipulating Heterogeneous Objects via Environmental Constraints

• URL: http://arxiv.org/abs/2605.02135v1
• Date: Mon, 04 May 2026 01:31:06 GMT
• Title: Robotic Desk Organization: A Multi-Primitive Approach to Manipulating Heterogeneous Objects via Environmental Constraints
• Abstract summary: A task-oriented framework is presented for organizing planar rigid and deformable objects on desks.<n>A perception pipeline was developed that augments existing datasets with uncommon desktop items.<n> primitives are used, including contact-based grasping for small objects, edge-based push-grasping for planar rigid objects, and levering-based grasping for planar deformable objects.
• Score: 2.2007839840134538
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Desktop organization remains challenging for service robots because of heterogeneous objects and diverse manipulation objectives, such as collection and stacking. In this article, a task-oriented framework is presented for organizing planar rigid and deformable objects on desks. A perception pipeline was developed that augments existing datasets with uncommon desktop items and makes geometry-based pose and keypoint estimation possible, along with the detection of environmental constraints, such as table edges. To handle diverse manipulation requirements, environment-assisted primitives are used, including contact-based grasping for small objects, edge-based push-grasping for planar rigid objects, and levering-based grasping for planar deformable objects. These primitives leverage environmental and interobject constraints to improve robustness. A task planner was designed to integrate these primitives into multiobject organization. Sufficient real-world experiments demonstrate the effectiveness and robustness of the proposed framework. This research provides practical manipulation primitives for planar rigid and deformable objects, highlighting the role of environmental and interobject constraints in complex multiobject manipulation tasks. Code and video are available online.

Related papers

• Task Editing for Generalizable 3D Visuomotor Policy Learning [50.590696755853365]
  3D visuomotor policies offer a promising direction for complex robotic manipulation, as depth maps and point clouds provide rich geometric information for spatial reasoning.<n>Existing methods commonly use demonstration generation strategies to improve data efficiency by applying object-centric transformations to human-collected demonstrations.<n>We propose Task-Edit, a novel demonstration generation framework that generates diverse trajectories from a task-centric editing perspective.
  arXiv  Detail & Related papers  (2026-06-05T07:54:49Z)
• Making Infeasible Tasks Feasible: Planning to Reconfigure Disconnected 3D Environments with Movable Objects [7.628322510394639]
  Planning for collision-free robot paths from an initial to a goal configuration often fails when environments are disconnected.<n>We develop BRiDGE, a sampling-based planner that incrementally builds trees over robot and object configurations to compute feasible plans.<n>We show that our method is probabilistically complete and we provide extensive numerical and hardware experiments validating its effectiveness.
  arXiv  Detail & Related papers  (2026-01-06T01:36:09Z)
• Geometrically-Aware One-Shot Skill Transfer of Category-Level Objects [18.978751760636563]
  We propose a new skill transfer framework, which enables a robot to transfer complex object manipulation skills and constraints from a single human demonstration.<n>Our approach addresses the challenge of skill acquisition and task execution by deriving geometric representations from demonstrations focusing on object-centric interactions.<n>We validate the effectiveness and adaptability of our approach through extensive experiments, demonstrating successful skill transfer and task execution in diverse real-world environments without requiring additional training.
  arXiv  Detail & Related papers  (2025-03-19T16:10:17Z)
• Hierarchical and Modular Network on Non-prehensile Manipulation in General Environments [1.3299507495084417]
  Non-prehensile manipulation is important for robots to operate in general environments like households.<n>However, prior works on non-prehensile manipulation cannot yet generalize across environments with diverse geometries.<n>We propose a modular and reconfigurable architecture that adaptively reconfigures network modules based on task requirements.<n>We additionally release a simulation-based benchmark featuring nine digital twins of real-world scenes with 353 objects.
  arXiv  Detail & Related papers  (2025-02-28T08:42:00Z)
• Unified Task and Motion Planning using Object-centric Abstractions of Motion Constraints [56.283944756315066]
  We propose an alternative TAMP approach that unifies task and motion planning into a single search. Our approach is based on an object-centric abstraction of motion constraints that permits leveraging the computational efficiency of off-the-shelf AI search to yield physically feasible plans.
  arXiv  Detail & Related papers  (2023-12-29T14:00:20Z)
• Learning Environment-Aware Affordance for 3D Articulated Object Manipulation under Occlusions [23.913350548394405]
  We propose an environment-aware affordance framework that incorporates both object-level actionable priors and environment constraints.<n>We introduce a novel contrastive affordance learning framework capable of training on scenes containing a single occluder and generalizing to scenes with complex occluder combinations.
  arXiv  Detail & Related papers  (2023-09-14T08:24:32Z)
• MANER: Multi-Agent Neural Rearrangement Planning of Objects in Cluttered Environments [8.15681999722805]
  This paper proposes a learning-based framework for multi-agent object rearrangement planning. It addresses the challenges of task sequencing and path planning in complex environments.
  arXiv  Detail & Related papers  (2023-06-10T23:53:28Z)
• Policy Architectures for Compositional Generalization in Control [71.61675703776628]
  We introduce a framework for modeling entity-based compositional structure in tasks. Our policies are flexible and can be trained end-to-end without requiring any action primitives.
  arXiv  Detail & Related papers  (2022-03-10T06:44:24Z)
• ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations [52.226947570070784]
  We present Object, a dataset of 100 objects that addresses both challenges with two key innovations. First, Object encodes the visual, auditory, and tactile sensory data for all objects, enabling a number of multisensory object recognition tasks. Second, Object employs a uniform, object-centric simulations, and implicit representation for each object's visual textures, tactile readings, and tactile readings, making the dataset flexible to use and easy to share.
  arXiv  Detail & Related papers  (2021-09-16T14:00:59Z)
• PackIt: A Virtual Environment for Geometric Planning [68.79816936618454]
  PackIt is a virtual environment to evaluate and potentially learn the ability to do geometric planning. We construct a set of challenging packing tasks using an evolutionary algorithm.
  arXiv  Detail & Related papers  (2020-07-21T22:51:17Z)
• Efficient State Abstraction using Object-centered Predicates for Manipulation Planning [86.24148040040885]
  We propose an object-centered representation that permits characterizing a much wider set of possible changes in configuration spaces. Based on this representation, we define universal planning operators for picking and placing actions that permits generating plans with geometric and force consistency.
  arXiv  Detail & Related papers  (2020-07-16T10:52:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.