VLBiMan++: Expanding the Generalization Boundary of Vision-Language Anchored One-Shot Bimanual Manipulation
- URL: http://arxiv.org/abs/2609.14310v1
- Date: Sun, 13 Sep 2026 06:10:51 GMT
- Title: VLBiMan++: Expanding the Generalization Boundary of Vision-Language Anchored One-Shot Bimanual Manipulation
- Abstract summary: Generalizable bimanual robotic manipulation requires a reusable task prior that can persist across increasingly diverse tasks.<n>We present VLBiMan++, an extended framework that expands the generalization boundary of vision-language anchored one-shot bimanual manipulation.
- Score: 45.119825915419064
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Generalizable bimanual robotic manipulation requires a reusable task prior that can persist across increasingly diverse tasks, objects, scenes, embodiments, and execution conditions, thus avoiding the prohibitive cost of large-scale teleoperated demonstrations and policy retraining. In this work, we present VLBiMan++, an extended framework that expands the generalization boundary of vision-language anchored one-shot bimanual manipulation. Starting from a single human demonstration, VLBiMan++ performs task-aware decomposition to identify reusable and adaptable skill components, and employs vision-language grounded geometric adaptation to transfer these skills to novel configurations without retraining. Building on this foundation, we systematically extend generalization along five dimensions: task generalization through diverse and long-horizon skill compositions; object generalization across unseen categories, varying geometries, and more complex articulated or deformable objects; scene generalization under clutter, occlusion, and dynamic interference; embodiment generalization across heterogeneous dual-arm robotic platforms; and deployment generalization through prolonged closed-loop execution under repeated external perturbations. To support this broader scope, we further introduce object-state-aware adaptation and lightweight trajectory optimization mechanisms that accommodate changes beyond simple rigid 6-DoF pose variations while preserving reliable bimanual coordination. Extensive real-world experiments demonstrate that VLBiMan++ maintains strong task success and adaptation capability across these increasingly challenging settings. Overall, VLBiMan++ advances one-shot bimanual manipulation from demonstrating isolated transferability toward a more systematic and scalable framework for generalization across tasks, objects, scenes, embodiments, and long-term deployment conditions.
Related papers
- Dynamics-Aware Meta-Imitation for Generalization to Unseen Robotic Manipulation [17.382238044141783]
We propose a framework for learning skills from demonstrations for robots.<n>By integrating meta-learning to construct a shared skill space, DAMI equips agents for rapid adaptation to novel tasks.<n>Our approach outperforms state-of-the-art baselines regarding direct inference on seen tasks and adaptation to unseen tasks.
arXiv Detail & Related papers (2026-07-17T11:50:03Z) - Task Editing for Generalizable 3D Visuomotor Policy Learning [50.590696755853365]
3D visuomotor policies offer a promising direction for complex robotic manipulation, as depth maps and point clouds provide rich geometric information for spatial reasoning.<n>Existing methods commonly use demonstration generation strategies to improve data efficiency by applying object-centric transformations to human-collected demonstrations.<n>We propose Task-Edit, a novel demonstration generation framework that generates diverse trajectories from a task-centric editing perspective.
arXiv Detail & Related papers (2026-06-05T07:54:49Z) - OneVLA: A Unified Framework for Embodied Tasks [42.816376426057275]
navigation and manipulation are fundamental capabilities of embodied intelligence.<n>OneVLA is a unified architecture that integrates these distinct tasks into a single, cohesive framework.<n>Experiments in both simulated and real-world environments demonstrate that OneVLA achieves state-of-the-art performance.
arXiv Detail & Related papers (2026-05-31T13:43:23Z) - PrimitiveVLA: Learning Reusable Motion Primitives for Efficient and Generalizable Robotic Manipulation [50.8450025321217]
Vision-Language-Action (VLA) models offer a promising paradigm for generalist robotic policies.<n>We argue that these bottlenecks stem from the prevailing Direct Instruction-to-Control Mapping.<n>We propose PrimitiveVLA, a framework that shifts this paradigm toward a Primitive-Centric Disassemble & Assemble paradigm.
arXiv Detail & Related papers (2026-05-27T15:41:18Z) - InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions [58.329946838699044]
Humans rarely plan whole-body interactions with objects at the level of explicit whole-body movements.<n>Scaling such priors is key to enabling humanoids to compose and generalize loco-manipulation skills.<n>We introduce InterPrior, a framework that learns a unified generative controller through large-scale imitation pretraining and post-training by reinforcement learning.
arXiv Detail & Related papers (2026-02-05T18:59:27Z) - Bridge Thinking and Acting: Unleashing Physical Potential of VLM with Generalizable Action Expert [60.88976842557026]
Vision-Language Models (VLM) have demonstrated impressive planning and reasoning capabilities.<n>Recent dual-system approaches attempt to decouple "thinking" from "acting"<n>We introduce a framework centered around a generalizable action expert.
arXiv Detail & Related papers (2025-10-04T18:33:27Z) - ODYSSEY: Open-World Quadrupeds Exploration and Manipulation for Long-Horizon Tasks [46.676862567167625]
ODYSSEY is a unified mobile manipulation framework for agile quadruped robots equipped with manipulators.<n>To address the challenge of egocentric perception in language-conditioned tasks, we introduce a hierarchical planner powered by a vision-language model.<n>At the control level, our novel whole-body policy achieves robust coordination across challenging terrains.
arXiv Detail & Related papers (2025-08-11T17:54:31Z) - Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy [73.75271615101754]
We present Dita, a scalable framework that leverages Transformer architectures to directly denoise continuous action sequences.<n>Dita employs in-context conditioning -- enabling fine-grained alignment between denoised actions and raw visual tokens from historical observations.<n>Dita effectively integrates cross-embodiment datasets across diverse camera perspectives, observation scenes, tasks, and action spaces.
arXiv Detail & Related papers (2025-03-25T15:19:56Z) - Diffusion Transformer Policy [48.50988753948537]
We propose a large multi-modal diffusion transformer, dubbed as Diffusion Transformer Policy, to model continuous end-effector actions.<n>By leveraging the scaling capability of transformers, the proposed approach can effectively model continuous end-effector actions across large diverse robot datasets.
arXiv Detail & Related papers (2024-10-21T12:43:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.