Planar Surface Reconstruction from Sparse Views

• URL: http://arxiv.org/abs/2103.14644v1
• Date: Fri, 26 Mar 2021 17:59:20 GMT
• Title: Planar Surface Reconstruction from Sparse Views
• Abstract summary: The paper studies planar surface reconstruction of indoor scenes from two views with unknown camera poses. Our experiments demonstrate that our method is able to advance the state of the art of reconstruction from sparse views.
• Score: 30.965368147506386
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The paper studies planar surface reconstruction of indoor scenes from two views with unknown camera poses. While prior approaches have successfully created object-centric reconstructions of many scenes, they fail to exploit other structures, such as planes, which are typically the dominant components of indoor scenes. In this paper, we reconstruct planar surfaces from multiple views, while jointly estimating camera pose. Our experiments demonstrate that our method is able to advance the state of the art of reconstruction from sparse views, on challenging scenes from Matterport3D. Project site: https://jinlinyi.github.io/SparsePlanes/

Related papers

• Before the Shutter: Aesthetic and Actionable Portrait Photography Planning in 3D Scenes [35.590517071520964]
  We introduce 3D aesthetic portrait planning, the task of generating human pose, camera, lighting, and exposure plans.<n>Our approach builds a Photographic Scene Graph that represents scene affordances, subject-scene relations, and portrait-relevant lighting structure.<n>Our results suggest a path from post-capture correction toward pre-capture computational portrait planning.
  arXiv  Detail & Related papers  (2026-05-28T17:55:09Z)
• Room Envelopes: A Synthetic Dataset for Indoor Layout Reconstruction from Images [21.08510903329145]
  Modern scene reconstruction methods are able to recover 3D surfaces that are visible in one or more images.<n>This leads to incomplete reconstructions, missing all occluded surfaces.<n>We argue that structural elements of a scene, like the walls, floors and ceilings, have received less attention.
  arXiv  Detail & Related papers  (2025-11-06T01:46:36Z)
• FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Views [93.6881532277553]
  We present FLARE, a feed-forward model designed to infer high-quality camera poses and 3D geometry from uncalibrated sparse-view images. Our solution features a cascaded learning paradigm with camera pose serving as the critical bridge, recognizing its essential role in mapping 3D structures onto 2D image planes.
  arXiv  Detail & Related papers  (2025-02-17T18:54:05Z)
• iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views [61.707755434165335]
  iFusion is a novel 3D object reconstruction framework that requires only two views with unknown camera poses. We harness a pre-trained novel view synthesis diffusion model, which embeds implicit knowledge about the geometry and appearance of diverse objects. Experiments demonstrate strong performance in both pose estimation and novel view synthesis.
  arXiv  Detail & Related papers  (2023-12-28T18:59:57Z)
• RIC: Rotate-Inpaint-Complete for Generalizable Scene Reconstruction [43.63574200858472]
  General scene reconstruction refers to the task of estimating the full 3D geometry and texture of a scene containing previously unseen objects. In this paper, we present a method for scene reconstruction by structurally breaking the problem into two steps: rendering novel views via inpainting and 2D to 3D scene lifting.
  arXiv  Detail & Related papers  (2023-07-21T22:39:41Z)
• Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesis [76.72505510632904]
  We present Total-Recon, the first method to reconstruct deformable scenes from long monocular RGBD videos. Our method hierarchically decomposes the scene into the background and objects, whose motion is decomposed into root-body motion and local articulations.
  arXiv  Detail & Related papers  (2023-04-24T17:59:52Z)
• Few-View Object Reconstruction with Unknown Categories and Camera Poses [80.0820650171476]
  This work explores reconstructing general real-world objects from a few images without known camera poses or object categories. The crux of our work is solving two fundamental 3D vision problems -- shape reconstruction and pose estimation. Our method FORGE predicts 3D features from each view and leverages them in conjunction with the input images to establish cross-view correspondence.
  arXiv  Detail & Related papers  (2022-12-08T18:59:02Z)
• State of the Art in Dense Monocular Non-Rigid 3D Reconstruction [100.9586977875698]
  3D reconstruction of deformable (or non-rigid) scenes from a set of monocular 2D image observations is a long-standing and actively researched area of computer vision and graphics. This survey focuses on state-of-the-art methods for dense non-rigid 3D reconstruction of various deformable objects and composite scenes from monocular videos or sets of monocular views.
  arXiv  Detail & Related papers  (2022-10-27T17:59:53Z)
• Perspective Reconstruction of Human Faces by Joint Mesh and Landmark Regression [89.8129467907451]
  We propose to simultaneously reconstruct 3D face mesh in the world space and predict 2D face landmarks on the image plane. Based on the predicted 3D and 2D landmarks, the 6DoF (6 Degrees Freedom) face pose can be easily estimated by the solver.
  arXiv  Detail & Related papers  (2022-08-15T12:32:20Z)
• Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenes [50.317223783035075]
  We present a new framework to reconstruct holistic 3D indoor scenes from single-view images. We propose an instance-aligned implicit function (InstPIFu) for detailed object reconstruction. Our code and model will be made publicly available.
  arXiv  Detail & Related papers  (2022-07-18T14:54:57Z)
• Reconstructing Small 3D Objects in front of a Textured Background [0.0]
  We present a technique for a complete 3D reconstruction of small objects moving in front of a textured background. It is a particular variation of multibody structure from motion, which specializes to two objects only. In experiments with real artifacts, we show that our approach has practical advantages when reconstructing 3D objects from all sides.
  arXiv  Detail & Related papers  (2021-05-24T15:36:33Z)
• Associative3D: Volumetric Reconstruction from Sparse Views [17.5320459412718]
  This paper studies the problem of 3D volumetric reconstruction from two views of a scene with an unknown camera. We propose a new approach that estimates reconstructions, distributions over the camera/object and camera/camera transformations. We train and test our approach on a dataset of indoor scenes, and rigorously evaluate the merits of our joint reasoning approach.
  arXiv  Detail & Related papers  (2020-07-27T17:58:53Z)
• Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Image [24.99186733297264]
  We propose an end-to-end solution to jointly reconstruct room layout, object bounding boxes and meshes from a single image. Our method builds upon a holistic scene context and proposes a coarse-to-fine hierarchy with three components. Experiments on the SUN RGB-D and Pix3D datasets demonstrate that our method consistently outperforms existing methods.
  arXiv  Detail & Related papers  (2020-02-27T16:00:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.