Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation

• URL: http://arxiv.org/abs/2606.04269v1
• Date: Tue, 02 Jun 2026 22:46:20 GMT
• Title: Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation
• Abstract summary: We introduce Instant-Fold, an in-context imitation learning framework for DOM.<n>Given a single human demonstration, our policy infers and executes diverse manipulation modes directly from the demonstration.
• Score: 15.16901531512543
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deformable object manipulation (DOM) is challenging due to high-dimensional, partially observable states that evolve through long-horizon, topology-changing interactions with multiple valid manipulation modes. We introduce Instant-Fold, an in-context imitation learning framework for DOM. Given a single human demonstration, our policy infers and executes diverse manipulation modes directly from the demonstration, including variations in spatial execution and ordering, without requiring gradient updates. Our approach first learns deformation-aware visual representations via temporal contrastive pretraining, after which a flow-matching transformer policy conditioned on the demonstration predicts actions to execute the intended manipulation mode. Trained entirely in simulation, Instant-Fold generalizes across diverse folding modes and transfers zero-shot to real-world settings without additional data collection or finetuning. Videos are available at https://instant-fold.github.io.

Related papers

• AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learning [25.331956706253614]
  Articulated object manipulation is a critical capability for robots to perform various tasks in real-world scenarios.<n>Previous datasets and simulation environments for articulated objects have primarily focused on simple manipulation mechanisms.<n>We build a novel articulated object manipulation environment and equip it with 9 categories of objects.<n>Based on the environment and objects, we propose an adaptive demonstration collection and 3D visual diffusion-based imitation learning pipeline.
  arXiv  Detail & Related papers  (2025-02-16T13:45:10Z)
• DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Control [18.737628473949048]
  Imitation learning has proven to be a powerful tool for training complex visuomotor policies. Current methods often require hundreds to thousands of expert demonstrations to handle high-dimensional visual observations. We present DynaMo, a new in-domain, self-supervised method for learning visual representations.
  arXiv  Detail & Related papers  (2024-09-18T17:59:43Z)
• Pre-trained Text-to-Image Diffusion Models Are Versatile Representation Learners for Control [73.6361029556484]
  Embodied AI agents require a fine-grained understanding of the physical world mediated through visual and language inputs. We consider pre-trained text-to-image diffusion models, which are explicitly optimized to generate images from text prompts. We show that Stable Control Representations enable learning policies that exhibit state-of-the-art performance on OVMM, a difficult open-vocabulary navigation benchmark.
  arXiv  Detail & Related papers  (2024-05-09T15:39:54Z)
• Any-point Trajectory Modeling for Policy Learning [64.23861308947852]
  We introduce Any-point Trajectory Modeling (ATM) to predict future trajectories of arbitrary points within a video frame. ATM outperforms strong video pre-training baselines by 80% on average. We show effective transfer learning of manipulation skills from human videos and videos from a different robot morphology.
  arXiv  Detail & Related papers  (2023-12-28T23:34:43Z)
• GenDOM: Generalizable One-shot Deformable Object Manipulation with Parameter-Aware Policy [22.965840244436777]
  We introduce GenDOM, a framework that allows the manipulation policy to handle different deformable objects with only a single real-world demonstration.<n>At the time of inference, given a new object, GenDOM can estimate the deformable object parameters with only a single real-world demonstration.<n> Empirical validations on both simulated and real-world object manipulation setups clearly show that our method can manipulate different objects with a single demonstration.
  arXiv  Detail & Related papers  (2023-09-16T17:18:23Z)
• Inverse Dynamics Pretraining Learns Good Representations for Multitask Imitation [66.86987509942607]
  We evaluate how such a paradigm should be done in imitation learning. We consider a setting where the pretraining corpus consists of multitask demonstrations. We argue that inverse dynamics modeling is well-suited to this setting.
  arXiv  Detail & Related papers  (2023-05-26T14:40:46Z)
• Coarse-to-Fine Imitation Learning: Robot Manipulation from a Single Demonstration [8.57914821832517]
  We introduce a simple new method for visual imitation learning, which allows a novel robot manipulation task to be learned from a single human demonstration. Our method models imitation learning as a state estimation problem, with the state defined as the end-effector's pose. At test time, the end-effector moves to the estimated state through a linear path, at which point the original demonstration's end-effector velocities are simply replayed.
  arXiv  Detail & Related papers  (2021-05-13T16:36:55Z)
• Self-Supervised Representation Learning from Flow Equivariance [97.13056332559526]
  We present a new self-supervised learning representation framework that can be directly deployed on a video stream of complex scenes. Our representations, learned from high-resolution raw video, can be readily used for downstream tasks on static images.
  arXiv  Detail & Related papers  (2021-01-16T23:44:09Z)
• Visual Imitation Made Easy [102.36509665008732]
  We present an alternate interface for imitation that simplifies the data collection process while allowing for easy transfer to robots. We use commercially available reacher-grabber assistive tools both as a data collection device and as the robot's end-effector. We experimentally evaluate on two challenging tasks: non-prehensile pushing and prehensile stacking, with 1000 diverse demonstrations for each task.
  arXiv  Detail & Related papers  (2020-08-11T17:58:50Z)
• State-Only Imitation Learning for Dexterous Manipulation [63.03621861920732]
  In this paper, we explore state-only imitation learning. We train an inverse dynamics model and use it to predict actions for state-only demonstrations. Our method performs on par with state-action approaches and considerably outperforms RL alone.
  arXiv  Detail & Related papers  (2020-04-07T17:57:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.