ManiTwin: Scaling Data-Generation-Ready Digital Object Dataset to 100K

• URL: http://arxiv.org/abs/2603.16866v1
• Date: Tue, 17 Mar 2026 17:59:49 GMT
• Title: ManiTwin: Scaling Data-Generation-Ready Digital Object Dataset to 100K
• Abstract summary: We present ManiTwin, a pipeline for generating data-generation-ready digital object twins.<n>We construct ManiTwin-100K, a dataset containing 100K high-quality annotated 3D assets.<n>Experiments demonstrate that ManiTwin provides an efficient asset synthesis and annotation workflow.
• Score: 83.97657657382376
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Learning in simulation provides a useful foundation for scaling robotic manipulation capabilities. However, this paradigm often suffers from a lack of data-generation-ready digital assets, in both scale and diversity. In this work, we present ManiTwin, an automated and efficient pipeline for generating data-generation-ready digital object twins. Our pipeline transforms a single image into simulation-ready and semantically annotated 3D asset, enabling large-scale robotic manipulation data generation. Using this pipeline, we construct ManiTwin-100K, a dataset containing 100K high-quality annotated 3D assets. Each asset is equipped with physical properties, language descriptions, functional annotations, and verified manipulation proposals. Experiments demonstrate that ManiTwin provides an efficient asset synthesis and annotation workflow, and that ManiTwin-100K offers high-quality and diverse assets for manipulation data generation, random scene synthesis, and VQA data generation, establishing a strong foundation for scalable simulation data synthesis and policy learning. Our webpage is available at https://manitwin.github.io/.

Related papers

• 123D: Unifying Multi-Modal Autonomous Driving Data at Scale [58.4010470217018]
  We present 123D, an open-source framework that unifies such multi-modal driving data through a single API.<n>We consolidate eight real-world driving datasets spanning 3,300 hours and 90,000 kilometers, together with a synthetic dataset with collection scripts, and provide tools for data analysis and visualization.
  arXiv  Detail & Related papers  (2026-05-08T17:59:53Z)
• A Synthetic Eye Movement Dataset for Script Reading Detection: Real Trajectory Replay on a 3D Simulator [12.307366979757065]
  We present a pipeline for generating synthetic labeled eye movement video by extracting real human iris trajectories from reference videos.<n>We release 144 sessions (72 reading, 72 conversation) totaling 12 hours of synthetic eye movement video at 25 fps.<n>A matched frame-by-frame comparison reveals that the 3D simulator exhibits bounded sensitivity at reading-scale movements.
  arXiv  Detail & Related papers  (2026-04-07T06:15:48Z)
• SynthRender and IRIS: Open-Source Framework and Dataset for Bidirectional Sim-Real Transfer in Industrial Object Perception [5.278929538141005]
  We release SynthRender, an open source framework for synthetic image generation with Guided Domain Randomization capabilities.<n>We also benchmark recent Reality-to-Simulation techniques for 3D asset creation from 2D images of real parts.<n>These synthetic assets provide low-overhead, transferable data even for parts lacking 3D files.
  arXiv  Detail & Related papers  (2026-02-24T17:42:34Z)
• URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Model [76.08429266631823]
  We propose an end-to-end automatic reconstruction framework based on a 3D multimodal large language model (MLLM)<n>URDF-Anything utilizes an autoregressive prediction framework based on point-cloud and text multimodal input to jointly optimize geometric segmentation and kinematic parameter prediction.<n> Experiments on both simulated and real-world datasets demonstrate that our method significantly outperforms existing approaches.
  arXiv  Detail & Related papers  (2025-11-02T13:45:51Z)
• RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation [52.2244588424002]
  We present RoboTwin 2.0, a scalable framework for automated, large-scale generation of diverse and realistic data.<n>At its core is RoboTwin-OD, an object library of 731 instances across 147 categories with semantic and manipulation-relevant annotations.<n>To improve sim-to-real transfer, RoboTwin 2.0 applies structured domain randomization along five axes.
  arXiv  Detail & Related papers  (2025-06-22T16:26:53Z)
• RealSyn: An Effective and Scalable Multimodal Interleaved Document Transformation Paradigm [34.02250139766494]
  Contrastive Language-Image Pre-training (CLIP) demonstrates promising performance on a variety of benchmarks.<n>A substantial volume of multimodal interleaved documents remains underutilized for contrastive vision-language representation learning.<n>We establish a Real-World Data Extraction pipeline to extract high-quality images and texts.<n>Then we design a hierarchical retrieval method to efficiently associate each image with multiple semantically relevant realistic texts.<n>We construct RealSyn, a dataset combining realistic and synthetic texts, available in three scales: 15M, 30M, and 100M.
  arXiv  Detail & Related papers  (2025-02-18T03:58:38Z)
• TRoVE: Transforming Road Scene Datasets into Photorealistic Virtual Environments [84.6017003787244]
  This work proposes a synthetic data generation pipeline to address the difficulties and domain-gaps present in simulated datasets. We show that using annotations and visual cues from existing datasets, we can facilitate automated multi-modal data generation.
  arXiv  Detail & Related papers  (2022-08-16T20:46:08Z)
• UnrealPerson: An Adaptive Pipeline towards Costless Person Re-identification [102.58619642363959]
  This paper presents UnrealPerson, a novel pipeline that makes full use of unreal image data to decrease the costs in both the training and deployment stages. With 3,000 IDs and 120,000 instances, our method achieves a 38.5% rank-1 accuracy when being directly transferred to MSMT17.
  arXiv  Detail & Related papers  (2020-12-08T08:15:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.