Simultaneous Contact Selection and Planning for Contact-Rich Manipulation with Cascaded Optimization

• URL: http://arxiv.org/abs/2605.27972v1
• Date: Wed, 27 May 2026 05:07:19 GMT
• Title: Simultaneous Contact Selection and Planning for Contact-Rich Manipulation with Cascaded Optimization
• Abstract summary: We propose an optimization-based framework for robust contact-rich manipulation.<n>Active contact location selection is challenging due to complementarity in contact dynamics and the sparse gradients.<n>We show that Simultaneous Contact Selection and Planning produces diverse manipulation behaviors and robust control under inaccurate dynamics and perceptual noise.
• Score: 13.62351324931659
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose an optimization-based framework for robust contact-rich manipulation. Recent contact-implicit methods enable online hybrid planning across contact modes, allowing closed-loop manipulation for a given target state and contact location sequence of the robot and object. However, most existing approaches lack the ability to autonomously reason and generate diverse contact location sequences and manipulation trajectories, i.e., active contact location selection, which limits their applicability to relatively simple tasks. Active contact location selection is challenging due to complementarity in contact dynamics and the sparse gradients, making the design of a unified framework for contact selection and planning difficult. To address these challenges, we introduce Simultaneous Contact Selection and Planning (SCSP), a cascaded optimization framework comprising Contact Selection Optimization (CSO) and Contact Planning Optimization (CPO). CSO leverages a surrogate contact model and discrete-continuous optimization to efficiently resolve the nonsmoothness and coupling in contact selection, enabling online global searching of optimal contact locations. CPO performs prior-guided contact planning by evaluating the reference contact locations produced by CSO and generating corresponding manipulation trajectories in real time for redundant manipulators. Extensive simulations and real-world experiments demonstrate that SCSP produces diverse manipulation behaviors and robust control under inaccurate dynamics and perceptual noise. We further validate the generalization of the framework on challenging manipulation tasks. Project website: \href{https://sites.google.com/view/scsp-robot}{https://sites.google.com/view/scsp-robot}.

Related papers

• Reinforcement Learning-Guided Evolutionary Policy Optimization for Preference-Adjustable Heterogeneous Agile Earth Observation Satellite Scheduling [50.176885352114674]
  Heterogeneous agile Earth observation satellite (AEOS) scheduling requires task selection, satellite assignment, and observation sequencing.<n>This paper proposes an evolutionary policy optimization framework for heterogeneous AEOS scheduling with preference-adjustable weighted objectives.
  arXiv  Detail & Related papers  (2026-08-25T12:16:28Z)
• TACTIC: Tactile and Vision Conditioned Contact-Centric Control for Whole-Arm Manipulation [3.8628620899766553]
  Whole-arm manipulation involves direct contact with the environment while the robot completes a task.<n>We propose TACTIC (Tactile and Vision Conditioned Contact-Centric Control), a receding-horizon controller for whole-arm manipulation.
  arXiv  Detail & Related papers  (2026-07-10T09:08:55Z)
• CoCo-InEKF: State Estimation with Learned Contact Covariances in Dynamic, Contact-Rich Scenarios [10.290787487255301]
  CoCo-InEKF is a differentiable invariant extended Kalman filter that utilizes continuous contact velocity covariances instead of binary contact states.<n>We employ a lightweight neural network trained end-to-end using a state-error loss to predict contact candidate points.<n> Experiments on a bipedal robot demonstrate a superior accuracy-efficiency tradeoff for linear velocity estimation.
  arXiv  Detail & Related papers  (2026-05-14T17:35:06Z)
• IMPACT: An Implicit Active-Set Augmented Lagrangian for Fast Contact-Implicit Trajectory Optimization [10.186515371403772]
  We develop an augmented-Lagrangian approach to CITO for solving MPCC-based CITO with stationarity guarantees.<n>We provide an efficient C++ implementation tailored to trajectory-optimization workloads and evaluate it on the open-source CITO and contact-implicit model predictive control (CI-MPC) benchmarks.
  arXiv  Detail & Related papers  (2026-05-09T19:19:05Z)
• Navigating the Clutter: Waypoint-Based Bi-Level Planning for Multi-Robot Systems [54.887871365121775]
  Multi-robot control in cluttered environments is a challenging problem that involves complex physical constraints.<n>We propose a hybrid multi-robot control framework that jointly optimize task and motion planning.<n>Our approach consistently improves task success over motion-agnostic and VLA-based baselines.
  arXiv  Detail & Related papers  (2026-04-22T22:58:47Z)
• Unified Complementarity-Based Contact Modeling and Planning for Soft Robots [13.597188299981312]
  This letter presents a unified complementarity-based framework for soft-robot contact modeling and planning.<n>We develop a robust Linear Complementarity Problem (LCP) model tailored to discretized soft robots.<n>We also introduce a kinematically guided warm-start strategy that enables dynamic trajectory optimization through contact.
  arXiv  Detail & Related papers  (2026-02-24T19:37:36Z)
• Where to Touch, How to Contact: Hierarchical RL-MPC Framework for Geometry-Aware Long-Horizon Dexterous Manipulation [15.309183490293721]
  A key challenge in contact-rich dexterous manipulation is the need to jointly reason over geometry, kinematic constraints, and intricate, nonsmooth contact dynamics.<n>We propose a hierarchical RL--MPC framework in which a high-level reinforcement learning (RL) policy predicts a contact intention.<n>We evaluate the framework on non-prehensile tasks, including geometry-generalized pushing and object 3D reorientation.
  arXiv  Detail & Related papers  (2026-01-16T01:20:15Z)
• Hierarchical Contact-Rich Trajectory Optimization for Multi-Modal Manipulation using Tight Convex Relaxations [12.578064173652148]
  We present a novel framework for designing trajectories of robots, objects, and contacts efficiently for contact-rich manipulation.<n>We propose a hierarchical optimization framework where Mixed-Integer Linear Program (MILP) selects optimal contacts between robot & object.<n>We present a convex relaxation of bilinear constraints using binary encoding technique such that MILP can provide tighter solutions.
  arXiv  Detail & Related papers  (2025-03-11T01:40:23Z)
• Collaborative Ground-Space Communications via Evolutionary Multi-objective Deep Reinforcement Learning [113.48727062141764]
  We propose a distributed collaborative beamforming (DCB)-based uplink communication paradigm for enabling ground-space direct communications. DCB treats the terminals that are unable to establish efficient direct connections with the low Earth orbit (LEO) satellites as distributed antennas. We propose an evolutionary multi-objective deep reinforcement learning algorithm to obtain the desirable policies.
  arXiv  Detail & Related papers  (2024-04-11T03:13:02Z)
• Simultaneous Contact-Rich Grasping and Locomotion via Distributed Optimization Enabling Free-Climbing for Multi-Limbed Robots [60.06216976204385]
  We present an efficient motion planning framework for simultaneously solving locomotion, grasping, and contact problems. We demonstrate our proposed framework in the hardware experiments, showing that the multi-limbed robot is able to realize various motions including free-climbing at a slope angle 45deg with a much shorter planning time.
  arXiv  Detail & Related papers  (2022-07-04T13:52:10Z)
• Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics [99.86385468927638]
  We propose a contact point discovery approach (CPDeform) that guides the differentiable physics solver to deform soft-body plasticines. On single-stage tasks, our method can automatically find suitable initial contact points based on transport priorities. On complex multi-stage tasks, we can iteratively switch the contact points of end-effectors based on transport priorities.
  arXiv  Detail & Related papers  (2022-05-05T17:59:41Z)
• COCOI: Contact-aware Online Context Inference for Generalizable Non-planar Pushing [87.7257446869134]
  General contact-rich manipulation problems are long-standing challenges in robotics. Deep reinforcement learning has shown great potential in solving robot manipulation tasks. We propose COCOI, a deep RL method that encodes a context embedding of dynamics properties online.
  arXiv  Detail & Related papers  (2020-11-23T08:20:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.