A Concept for Reconstructing Stucco Statues from historic Sketches using synthetic Data only

• URL: http://arxiv.org/abs/2402.05593v1
• Date: Thu, 8 Feb 2024 11:46:26 GMT
• Title: A Concept for Reconstructing Stucco Statues from historic Sketches using synthetic Data only
• Authors: Thomas P\"ollabauer, Julius K\"uhn
• Abstract summary: In medieval times, stuccoworkers used a red color, called sinopia, to first create a sketch of the to-be-made statue on the wall. Today, many of these statues are destroyed, but using the original drawings, deriving from the red color also called sinopia, we can reconstruct how the final statue might have looked.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In medieval times, stuccoworkers used a red color, called sinopia, to first create a sketch of the to-be-made statue on the wall. Today, many of these statues are destroyed, but using the original drawings, deriving from the red color also called sinopia, we can reconstruct how the final statue might have looked.We propose a fully-automated approach to reconstruct a point cloud and show preliminary results by generating a color-image, a depth-map, as well as surface normals requiring only a single sketch, and without requiring a collection of other, similar samples. Our proposed solution allows real-time reconstruction on-site, for instance, within an exhibition, or to generate a useful starting point for an expert, trying to manually reconstruct the statue, all while using only synthetic data for training.

Related papers

• EasyHOI: Unleashing the Power of Large Models for Reconstructing Hand-Object Interactions in the Wild [79.71523320368388]
  Our work aims to reconstruct hand-object interactions from a single-view image. We first design a novel pipeline to estimate the underlying hand pose and object shape. With the initial reconstruction, we employ a prior-guided optimization scheme.
  arXiv  Detail & Related papers  (2024-11-21T16:33:35Z)
• One-to-many Reconstruction of 3D Geometry of cultural Artifacts using a synthetically trained Generative Model [8.762635528934084]
  Our approach generates a variety of detailed 3D representation from a single sketch. It relies solely on synthetic data for training, making it adoptable even in cases of only small numbers of training examples.
  arXiv  Detail & Related papers  (2024-02-13T09:13:30Z)
• Coloring the Past: Neural Historical Buildings Reconstruction from Archival Photography [69.93897305312574]
  We introduce an approach to reconstruct the geometry of historical buildings, employing volumetric rendering techniques. We leverage dense point clouds as a geometric prior and introduce a color appearance embedding loss to recover the color of the building given limited available color images.
  arXiv  Detail & Related papers  (2023-11-29T16:59:45Z)
• RealFusion: 360{\deg} Reconstruction of Any Object from a Single Image [98.46318529630109]
  We consider the problem of reconstructing a full 360deg photographic model of an object from a single image. We take an off-the-self conditional image generator based on diffusion and engineer a prompt that encourages it to "dream up" novel views of the object.
  arXiv  Detail & Related papers  (2023-02-21T13:25:35Z)
• Pik-Fix: Restoring and Colorizing Old Photo [24.366910102387344]
  Restoring and inpainting the visual memories that are present, but often impaired, in old photos remains an intriguing but unsolved research topic. Deep learning presents a plausible avenue, but the lack of large-scale datasets of old photos makes addressing this restoration task very challenging. Here we present a novel reference-based end-to-end learning framework that is able to both repair and colorize old and degraded pictures.
  arXiv  Detail & Related papers  (2022-05-04T05:46:43Z)
• ROMNet: Renovate the Old Memories [25.41639794384076]
  We present a novel reference-based end-to-end learning framework that can jointly repair and colorize degraded legacy pictures. We also create, to our knowledge, the first public and real-world old photo dataset with paired ground truth for evaluating old photo restoration models.
  arXiv  Detail & Related papers  (2022-02-05T17:48:15Z)
• Neural Re-Rendering of Humans from a Single Image [80.53438609047896]
  We propose a new method for neural re-rendering of a human under a novel user-defined pose and viewpoint. Our algorithm represents body pose and shape as a parametric mesh which can be reconstructed from a single image.
  arXiv  Detail & Related papers  (2021-01-11T18:53:47Z)
• A Divide et Impera Approach for 3D Shape Reconstruction from Multiple Views [49.03830902235915]
  Estimating the 3D shape of an object from a single or multiple images has gained popularity thanks to the recent breakthroughs powered by deep learning. This paper proposes to rely on viewpoint variant reconstructions by merging the visible information from the given views. To validate the proposed method, we perform a comprehensive evaluation on the ShapeNet reference benchmark in terms of relative pose estimation and 3D shape reconstruction.
  arXiv  Detail & Related papers  (2020-11-17T09:59:32Z)
• SparseFusion: Dynamic Human Avatar Modeling from Sparse RGBD Images [49.52782544649703]
  We propose a novel approach to reconstruct 3D human body shapes based on a sparse set of RGBD frames. The main challenge is how to robustly fuse these sparse frames into a canonical 3D model. Our framework is flexible, with potential applications going beyond shape reconstruction.
  arXiv  Detail & Related papers  (2020-06-05T18:53:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.