Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmark

• URL: http://arxiv.org/abs/2310.16044v3
• Date: Wed, 17 Jan 2024 00:18:21 GMT
• Title: Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmark
• Abstract summary: Stanford-ORB is a new real-world 3D Object inverse Rendering Benchmark. Recent advances in inverse rendering have enabled a wide range of real-world applications in 3D content generation.
• Score: 31.357709524280022
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce Stanford-ORB, a new real-world 3D Object inverse Rendering Benchmark. Recent advances in inverse rendering have enabled a wide range of real-world applications in 3D content generation, moving rapidly from research and commercial use cases to consumer devices. While the results continue to improve, there is no real-world benchmark that can quantitatively assess and compare the performance of various inverse rendering methods. Existing real-world datasets typically only consist of the shape and multi-view images of objects, which are not sufficient for evaluating the quality of material recovery and object relighting. Methods capable of recovering material and lighting often resort to synthetic data for quantitative evaluation, which on the other hand does not guarantee generalization to complex real-world environments. We introduce a new dataset of real-world objects captured under a variety of natural scenes with ground-truth 3D scans, multi-view images, and environment lighting. Using this dataset, we establish the first comprehensive real-world evaluation benchmark for object inverse rendering tasks from in-the-wild scenes, and compare the performance of various existing methods.

Related papers

• 3DReflecNet: A Large-Scale Dataset for 3D Reconstruction of Reflective, Transparent, and Low-Texture Objects [41.25903201175962]
  3DReflecNet is a large-scale hybrid dataset exceeding 22 TB.<n>This dataset spans diverse materials, complex lighting conditions, and a wide range of geometric forms.<n>We design benchmarks for five core tasks: image matching, structure-from-motion, novel view synthesis, removal, and relighting.
  arXiv  Detail & Related papers  (2026-05-11T08:51:28Z)
• OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Control [65.57356151743936]
  OLATverse is a large-scale dataset comprising around 9M images of 765 real-world objects.<n>Each object is captured using 35 DSLR cameras and 331 individually controlled light sources, enabling the simulation of diverse illumination conditions.<n>We construct an extensive evaluation set, establishing the first comprehensive real-world object-centric benchmark for inverse rendering and normal estimation.
  arXiv  Detail & Related papers  (2025-11-04T11:13:43Z)
• IDArb: Intrinsic Decomposition for Arbitrary Number of Input Views and Illuminations [64.07859467542664]
  Capturing geometric and material information from images remains a fundamental challenge in computer vision and graphics. Traditional optimization-based methods often require hours of computational time to reconstruct geometry, material properties, and environmental lighting from dense multi-view inputs. We introduce IDArb, a diffusion-based model designed to perform intrinsic decomposition on an arbitrary number of images under varying illuminations.
  arXiv  Detail & Related papers  (2024-12-16T18:52:56Z)
• Zero-Shot Multi-Object Scene Completion [59.325611678171974]
  We present a 3D scene completion method that recovers the complete geometry of multiple unseen objects in complex scenes from a single RGB-D image. Our method outperforms the current state-of-the-art on both synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2024-03-21T17:59:59Z)
• Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitives [70.32817882783608]
  We present an approach that produces a simple, compact, and actionable 3D world representation by means of 3D primitives. Unlike existing primitive decomposition methods that rely on 3D input data, our approach operates directly on images. We show that the resulting textured primitives faithfully reconstruct the input images and accurately model the visible 3D points.
  arXiv  Detail & Related papers  (2023-07-11T17:58:31Z)
• Anything-3D: Towards Single-view Anything Reconstruction in the Wild [61.090129285205805]
  We introduce Anything-3D, a methodical framework that ingeniously combines a series of visual-language models and the Segment-Anything object segmentation model. Our approach employs a BLIP model to generate textural descriptions, utilize the Segment-Anything model for the effective extraction of objects of interest, and leverages a text-to-image diffusion model to lift object into a neural radiance field.
  arXiv  Detail & Related papers  (2023-04-19T16:39:51Z)
• De-rendering 3D Objects in the Wild [21.16153549406485]
  We present a weakly supervised method that is able to decompose a single image of an object into shape. For training, the method only relies on a rough initial shape estimate of the training objects to bootstrap the learning process. In our experiments, we show that the method can successfully de-render 2D images into a 3D representation and generalizes to unseen object categories.
  arXiv  Detail & Related papers  (2022-01-06T23:50:09Z)
• Towards realistic symmetry-based completion of previously unseen point clouds [0.43496401697112697]
  We propose a novel framework that performs well on symmetric objects. Unlike learning-based approaches, the proposed framework does not require training data. We demonstrate that the proposed framework achieves state-of-the-art efficiency in point cloud completion of real-world customer scans.
  arXiv  Detail & Related papers  (2022-01-05T23:05:13Z)
• ABO: Dataset and Benchmarks for Real-World 3D Object Understanding [43.42504014918771]
  Amazon-Berkeley Objects (ABO) is a large-scale dataset of product images and 3D models corresponding to real household objects. We use ABO to measure the domain gap for single-view 3D reconstruction networks trained on synthetic objects. We also use multi-view images from ABO to measure the robustness of state-of-the-art metric learning approaches to different camera viewpoints.
  arXiv  Detail & Related papers  (2021-10-12T17:52:42Z)
• RandomRooms: Unsupervised Pre-training from Synthetic Shapes and Randomized Layouts for 3D Object Detection [138.2892824662943]
  A promising solution is to make better use of the synthetic dataset, which consists of CAD object models, to boost the learning on real datasets. Recent work on 3D pre-training exhibits failure when transfer features learned on synthetic objects to other real-world applications. In this work, we put forward a new method called RandomRooms to accomplish this objective.
  arXiv  Detail & Related papers  (2021-08-17T17:56:12Z)
• Salient Objects in Clutter [130.63976772770368]
  This paper identifies and addresses a serious design bias of existing salient object detection (SOD) datasets. This design bias has led to a saturation in performance for state-of-the-art SOD models when evaluated on existing datasets. We propose a new high-quality dataset and update the previous saliency benchmark.
  arXiv  Detail & Related papers  (2021-05-07T03:49:26Z)
• Unsupervised Learning of 3D Object Categories from Videos in the Wild [75.09720013151247]
  We focus on learning a model from multiple views of a large collection of object instances. We propose a new neural network design, called warp-conditioned ray embedding (WCR), which significantly improves reconstruction. Our evaluation demonstrates performance improvements over several deep monocular reconstruction baselines on existing benchmarks.
  arXiv  Detail & Related papers  (2021-03-30T17:57:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.