Synthetic Dataset Generation for Partially Observed Indoor Objects

• URL: http://arxiv.org/abs/2604.07010v1
• Date: Wed, 08 Apr 2026 12:32:26 GMT
• Title: Synthetic Dataset Generation for Partially Observed Indoor Objects
• Abstract summary: We present a virtual scanning framework implemented in Unity for generating realistic synthetic 3D scan datasets.<n>The proposed system simulates the behaviour of real-world scanners using parameters such as scan resolution, measurement range, and distance-dependent noise.<n>The resulting dataset provides valuable supervision for training and evaluating learning-based methods for scene reconstruction and object completion.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Learning-based methods for 3D scene reconstruction and object completion require large datasets containing partial scans paired with complete ground-truth geometry. However, acquiring such datasets using real-world scanning systems is costly and time-consuming, particularly when accurate ground truth for occluded regions is required. In this work, we present a virtual scanning framework implemented in Unity for generating realistic synthetic 3D scan datasets. The proposed system simulates the behaviour of real-world scanners using configurable parameters such as scan resolution, measurement range, and distance-dependent noise. Instead of directly sampling mesh surfaces, the framework performs ray-based scanning from virtual viewpoints, enabling realistic modelling of sensor visibility and occlusion effects. In addition, panoramic images captured at the scanner location are used to assign colours to the resulting point clouds. To support scalable dataset creation, the scanner is integrated with a procedural indoor scene generation pipeline that automatically produces diverse room layouts and furniture arrangements. Using this system, we introduce the \textit{V-Scan} dataset, which contains synthetic indoor scans together with object-level partial point clouds, voxel-based occlusion grids, and complete ground-truth geometry. The resulting dataset provides valuable supervision for training and evaluating learning-based methods for scene reconstruction and object completion.

Related papers

• Seen2Scene: Completing Realistic 3D Scenes with Visibility-Guided Flow [80.05357398241574]
  We present Seen2Scene, the first flow matching-based approach that trains on incomplete, real-world 3D scans for scene completion and generation.<n>By learning directly from real-world, incomplete 3D scans, Seen2Scene enables realistic 3D scene completion for complex, cluttered real environments.
  arXiv  Detail & Related papers  (2026-03-30T15:08:38Z)
• IGFuse: Interactive 3D Gaussian Scene Reconstruction via Multi-Scans Fusion [15.837932667195037]
  IGFuse is a novel framework that reconstructs interactive Gaussian scene by fusing observations from multiple scans.<n>Our method constructs segmentation aware Gaussian fields and enforces bi-directional photometric and semantic consistency across scans.<n>IGFuse enables high fidelity rendering and object level scene manipulation without dense observations or complex pipelines.
  arXiv  Detail & Related papers  (2025-08-18T17:59:47Z)
• A large-scale, physically-based synthetic dataset for satellite pose estimation [0.0]
  This paper introduces the DLVS3-HST-V1 dataset, which focuses on the Hubble Space Telescope (HST) as a complex, articulated target.<n>The dataset is generated using advanced real-time and offline rendering technologies, integrating high-fidelity 3D models, dynamic lighting, and physically accurate material properties.<n>The pipeline supports the creation of large-scale, richly annotated image sets with ground-truth 6-DoF pose and keypoint data, semantic segmentation, depth, and normal maps.
  arXiv  Detail & Related papers  (2025-06-15T09:24:32Z)
• Multi-Modal Dataset Acquisition for Photometrically Challenging Object [56.30027922063559]
  This paper addresses the limitations of current datasets for 3D vision tasks in terms of accuracy, size, realism, and suitable imaging modalities for photometrically challenging objects. We propose a novel annotation and acquisition pipeline that enhances existing 3D perception and 6D object pose datasets.
  arXiv  Detail & Related papers  (2023-08-21T10:38:32Z)
• SCoDA: Domain Adaptive Shape Completion for Real Scans [78.92028595499245]
  3D shape completion from point clouds is a challenging task, especially from scans of real-world objects. We propose a new task, SCoDA, for the domain adaptation of real scan shape completion from synthetic data. We propose a novel cross-domain feature fusion method for knowledge transfer and a novel volume-consistent self-training framework for robust learning from real data.
  arXiv  Detail & Related papers  (2023-04-20T09:38:26Z)
• Self-supervised Point Cloud Completion on Real Traffic Scenes via Scene-concerned Bottom-up Mechanism [14.255659581428333]
  Point cloud completion aims to refer the complete shapes for incomplete 3D scans of objects. Current deep learning-based approaches rely on large-scale complete shapes in the training process. We propose a self-supervised point cloud completion method (TraPCC) for vehicles in real traffic scenes without any complete data.
  arXiv  Detail & Related papers  (2022-03-20T14:42:37Z)
• Towards realistic symmetry-based completion of previously unseen point clouds [0.43496401697112697]
  We propose a novel framework that performs well on symmetric objects. Unlike learning-based approaches, the proposed framework does not require training data. We demonstrate that the proposed framework achieves state-of-the-art efficiency in point cloud completion of real-world customer scans.
  arXiv  Detail & Related papers  (2022-01-05T23:05:13Z)
• Fully Automated Photogrammetric Data Segmentation and Object Information Extraction Approach for Creating Simulation Terrain [0.0]
  This research aims to develop a fully automated photogrammetric data segmentation and object information extraction framework. Considering the use case of the data in creating realistic virtual environments for training and simulations, segmenting the data and extracting object information are essential tasks.
  arXiv  Detail & Related papers  (2020-08-09T09:32:09Z)
• OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasets [103.54691385842314]
  We propose a novel framework for creating large-scale photorealistic datasets of indoor scenes. Our goal is to make the dataset creation process widely accessible. This enables important applications in inverse rendering, scene understanding and robotics.
  arXiv  Detail & Related papers  (2020-07-25T06:48:47Z)
• Transferable Active Grasping and Real Embodied Dataset [48.887567134129306]
  We show how to search for feasible viewpoints for grasping by the use of hand-mounted RGB-D cameras. A practical 3-stage transferable active grasping pipeline is developed, that is adaptive to unseen clutter scenes. In our pipeline, we propose a novel mask-guided reward to overcome the sparse reward issue in grasping and ensure category-irrelevant behavior.
  arXiv  Detail & Related papers  (2020-04-28T08:15:35Z)
• DOPS: Learning to Detect 3D Objects and Predict their 3D Shapes [54.239416488865565]
  We propose a fast single-stage 3D object detection method for LIDAR data. The core novelty of our method is a fast, single-pass architecture that both detects objects in 3D and estimates their shapes. We find that our proposed method achieves state-of-the-art results by 5% on object detection in ScanNet scenes, and it gets top results by 3.4% in the Open dataset.
  arXiv  Detail & Related papers  (2020-04-02T17:48:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.