Structure of Multiple Mirror System from Kaleidoscopic Projections of
Single 3D Point
- URL: http://arxiv.org/abs/2103.15501v1
- Date: Mon, 29 Mar 2021 11:12:15 GMT
- Title: Structure of Multiple Mirror System from Kaleidoscopic Projections of
Single 3D Point
- Authors: Kosuke Takahashi and Shohei Nobuhara
- Abstract summary: This paper proposes a novel algorithm of discovering the structure of a kaleidoscopic imaging system that consists of multiple planar mirrors and a camera.
The key contribution of this paper is to propose novel algorithms for these problems using a single 3D point of unknown geometry.
- Score: 14.345346642066511
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper proposes a novel algorithm of discovering the structure of a
kaleidoscopic imaging system that consists of multiple planar mirrors and a
camera. The kaleidoscopic imaging system can be recognized as the virtual
multi-camera system and has strong advantages in that the virtual cameras are
strictly synchronized and have the same intrinsic parameters. In this paper, we
focus on the extrinsic calibration of the virtual multi-camera system. The
problems to be solved in this paper are two-fold. The first problem is to
identify to which mirror chamber each of the 2D projections of mirrored 3D
points belongs. The second problem is to estimate all mirror parameters, i.e.,
normals, and distances of the mirrors. The key contribution of this paper is to
propose novel algorithms for these problems using a single 3D point of unknown
geometry by utilizing a kaleidoscopic projection constraint, which is an
epipolar constraint on mirror reflections. We demonstrate the performance of
the proposed algorithm of chamber assignment and estimation of mirror
parameters with qualitative and quantitative evaluations using synthesized and
real data.
Related papers
- Gaussian Splatting in Mirrors: Reflection-Aware Rendering via Virtual Camera Optimization [14.324573496923792]
3D-GS often misinterprets reflections as virtual spaces, resulting in blurred and inconsistent multi-view rendering within mirrors.
Our paper presents a novel method aimed at obtaining high-quality multi-view consistent reflection rendering by modelling reflections as physically-based virtual cameras.
arXiv Detail & Related papers (2024-10-02T14:53:24Z) - Reflecting Reality: Enabling Diffusion Models to Produce Faithful Mirror Reflections [26.02117310176884]
We tackle the problem of generating highly realistic and plausible mirror reflections using diffusion-based generative models.
To enable this, we create SynMirror, a large-scale dataset of diverse synthetic scenes with objects placed in front of mirrors.
We propose a novel depth-conditioned inpainting method called MirrorFusion, which generates high-quality geometrically consistent and photo-realistic mirror reflections.
arXiv Detail & Related papers (2024-09-23T02:59:07Z) - MirrorGaussian: Reflecting 3D Gaussians for Reconstructing Mirror Reflections [58.003014868772254]
MirrorGaussian is the first method for mirror scene reconstruction with real-time rendering based on 3D Gaussian Splatting.
We introduce an intuitive dual-rendering strategy that enables differentiableization of both the real-world 3D Gaussians and the mirrored counterpart.
Our approach significantly outperforms existing methods, achieving state-of-the-art results.
arXiv Detail & Related papers (2024-05-20T09:58:03Z) - Towards Unified 3D Object Detection via Algorithm and Data Unification [70.27631528933482]
We build the first unified multi-modal 3D object detection benchmark MM- Omni3D and extend the aforementioned monocular detector to its multi-modal version.
We name the designed monocular and multi-modal detectors as UniMODE and MM-UniMODE, respectively.
arXiv Detail & Related papers (2024-02-28T18:59:31Z) - MirrorCalib: Utilizing Human Pose Information for Mirror-based Virtual Camera Calibration [3.776930498297967]
We present the novel task of estimating the parameters of a virtual camera relative to a real camera in exercise videos with a mirror.
Prior knowledge of a human body and 2D joint locations are utilized to estimate the camera extrinsic parameters.
MirrorCalib achieves a rotation error of 1.82deg and a translation error of 69.51 mm on a collected real-world dataset.
arXiv Detail & Related papers (2023-11-05T23:25:21Z) - Mirror-Aware Neural Humans [21.0548144424571]
We develop a consumer-level 3D motion capture system that starts from off-the-shelf 2D poses by automatically calibrating the camera.
We empirically demonstrate the benefit of learning a body model and accounting for occlusion in challenging mirror scenes.
arXiv Detail & Related papers (2023-09-09T10:43:45Z) - Monocular 3D Object Detection with Depth from Motion [74.29588921594853]
We take advantage of camera ego-motion for accurate object depth estimation and detection.
Our framework, named Depth from Motion (DfM), then uses the established geometry to lift 2D image features to the 3D space and detects 3D objects thereon.
Our framework outperforms state-of-the-art methods by a large margin on the KITTI benchmark.
arXiv Detail & Related papers (2022-07-26T15:48:46Z) - Calibrated and Partially Calibrated Semi-Generalized Homographies [65.29477277713205]
We propose the first minimal solutions for estimating the semi-generalized homography given a perspective and a generalized camera.
The proposed solvers are stable and efficient as demonstrated by a number of synthetic and real-world experiments.
arXiv Detail & Related papers (2021-03-11T08:56:24Z) - Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images [59.906948203578544]
We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object.
We first estimate per-view depth maps using a deep multi-view stereo network.
These depth maps are used to coarsely align the different views.
We propose a novel multi-view reflectance estimation network architecture.
arXiv Detail & Related papers (2020-03-27T21:28:54Z) - Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset
for Spatially Varying Isotropic Materials [65.95928593628128]
We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique.
Our algorithm is suitable for perspective cameras and nearby point light sources.
arXiv Detail & Related papers (2020-01-18T12:26:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.