Debate2Create: Robot Co-design via Large Language Model Debates

• URL: http://arxiv.org/abs/2510.25850v1
• Date: Wed, 29 Oct 2025 18:00:16 GMT
• Title: Debate2Create: Robot Co-design via Large Language Model Debates
• Authors: Kevin Qiu, Marek Cygan,
• Abstract summary: Large language model (LLM) agents engage in a structured debate to jointly optimize a robot's design and its reward function.<n>We show that D2C yields diverse and specialized morphologies despite no explicit diversity objective.
• Score: 6.3842184099869295
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automating the co-design of a robot's morphology and control is a long-standing challenge due to the vast design space and the tight coupling between body and behavior. We introduce Debate2Create (D2C), a framework in which large language model (LLM) agents engage in a structured dialectical debate to jointly optimize a robot's design and its reward function. In each round, a design agent proposes targeted morphological modifications, and a control agent devises a reward function tailored to exploit the new design. A panel of pluralistic judges then evaluates the design-control pair in simulation and provides feedback that guides the next round of debate. Through iterative debates, the agents progressively refine their proposals, producing increasingly effective robot designs. Notably, D2C yields diverse and specialized morphologies despite no explicit diversity objective. On a quadruped locomotion benchmark, D2C discovers designs that travel 73% farther than the default, demonstrating that structured LLM-based debate can serve as a powerful mechanism for emergent robot co-design. Our results suggest that multi-agent debate, when coupled with physics-grounded feedback, is a promising new paradigm for automated robot design.

Related papers

• RobotSeg: A Model and Dataset for Segmenting Robots in Image and Video [56.9581053843815]
  We introduce RobotSeg, a foundation model for robot segmentation in image and video.<n>It addresses the lack of adaptation to articulated robots, reliance on manual prompts, and the need for per-frame training mask annotations.<n>It achieves state-of-the-art performance on both images and videos.
  arXiv  Detail & Related papers  (2025-11-28T07:51:02Z)
• Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations [76.79742393097358]
  Vision-Language Action (VLAs) models promise to extend the remarkable success of vision-language models (VLMs) to robotics.<n>Existing fine-tuning methods lack specificity, adapting the same set of parameters regardless of a task's visual, linguistic, and physical characteristics.<n>Inspired by functional specificity in neuroscience, we hypothesize that it is more effective to finetune sparse model representations specific to a given task.
  arXiv  Detail & Related papers  (2025-11-27T18:50:21Z)
• RoboMoRe: LLM-based Robot Co-design via Joint Optimization of Morphology and Reward [21.110738533383277]
  RoboMoRe is a framework that integrates morphology and reward shaping for co-optimization within the robot co-design loop.<n>In the coarse optimization stage, an LLM-based diversity reflection mechanism generates both diverse and high-quality morphology-reward pairs.<n>In the fine optimization stage, top candidates are iteratively refined through alternating LLM-guided reward and morphology gradient updates.
  arXiv  Detail & Related papers  (2025-05-30T22:16:07Z)
• GR00T N1: An Open Foundation Model for Generalist Humanoid Robots [133.23509142762356]
  General-purpose robots need a versatile body and an intelligent mind.<n>Recent advancements in humanoid robots have shown great promise as a hardware platform for building generalist autonomy.<n>We introduce GR00T N1, an open foundation model for humanoid robots.
  arXiv  Detail & Related papers  (2025-03-18T21:06:21Z)
• Large Language Models as Natural Selector for Embodied Soft Robot Design [5.023206838671049]
  This paper introduces RoboCrafter-QA, a novel benchmark to evaluate whether Large Language Models can learn representations of soft robot designs.<n>Our experiments reveal that while these models exhibit promising capabilities in learning design representations, they struggle with fine-grained distinctions between designs with subtle performance differences.
  arXiv  Detail & Related papers  (2025-03-04T03:55:10Z)
• Text2Robot: Evolutionary Robot Design from Text Descriptions [3.054307340752497]
  We introduce Text2Robot, a framework that converts user text specifications and performance preferences into physical quadrupedal robots.<n>Text2Robot enables rapid prototyping and opens new opportunities for robot design with generative models.
  arXiv  Detail & Related papers  (2024-06-28T14:51:01Z)
• RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis [102.1876259853457]
  We propose a tree-structured multimodal code generation framework for generalized robotic behavior synthesis, termed RoboCodeX. RoboCodeX decomposes high-level human instructions into multiple object-centric manipulation units consisting of physical preferences such as affordance and safety constraints. To further enhance the capability to map conceptual and perceptual understanding into control commands, a specialized multimodal reasoning dataset is collected for pre-training and an iterative self-updating methodology is introduced for supervised fine-tuning.
  arXiv  Detail & Related papers  (2024-02-25T15:31:43Z)
• RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulation [77.41969287400977]
  This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation. We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language. We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
  arXiv  Detail & Related papers  (2024-02-22T15:12:00Z)
• RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control [140.48218261864153]
  We study how vision-language models trained on Internet-scale data can be incorporated directly into end-to-end robotic control. Our approach leads to performant robotic policies and enables RT-2 to obtain a range of emergent capabilities from Internet-scale training.
  arXiv  Detail & Related papers  (2023-07-28T21:18:02Z)
• SoftZoo: A Soft Robot Co-design Benchmark For Locomotion In Diverse Environments [111.91255476270526]
  We introduce SoftZoo, a soft robot co-design platform for locomotion in diverse environments. SoftZoo supports an extensive, naturally-inspired material set, including the ability to simulate environments such as flat ground, desert, wetland, clay, ice, snow, shallow water, and ocean. It provides a variety of tasks relevant for soft robotics, including fast locomotion, agile turning, and path following, as well as differentiable design representations for morphology and control.
  arXiv  Detail & Related papers  (2023-03-16T17:59:50Z)
• Diversity-based Design Assist for Large Legged Robots [4.505477982701834]
  We explore the design space of a class of large legged robots, which stand at around 2m tall and whose design and construction is not well-studied. A novel robot encoding allows for bio-inspired features such as legs scaling along the length of the body.
  arXiv  Detail & Related papers  (2020-04-17T03:59:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.