A Projector-Camera System Using Hybrid Pixels with Projection and Capturing Capabilities

• URL: http://arxiv.org/abs/2107.05043v1
• Date: Sun, 11 Jul 2021 13:27:25 GMT
• Title: A Projector-Camera System Using Hybrid Pixels with Projection and Capturing Capabilities
• Authors: Kenta Yamamoto, Daisuke Iwai, Kosuke Sato
• Abstract summary: We propose a novel projector-camera system (ProCams) in which each pixel has both projection and capturing capabilities. Our proposed ProCams solves the difficulty of obtaining precise pixel correspondence between the projector and the camera.
• Score: 23.217683529089005
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a novel projector-camera system (ProCams) in which each pixel has both projection and capturing capabilities. Our proposed ProCams solves the difficulty of obtaining precise pixel correspondence between the projector and the camera. We implemented a proof-of-concept ProCams prototype and demonstrated its applicability to a dynamic projection mapping.

Related papers

• nvTorchCam: An Open-source Library for Camera-Agnostic Differentiable Geometric Vision [54.047353679741086]
  We introduce nvTorchCam, an open-source library under the Apache 2.0 license designed to make deep learning algorithms camera model-independent. nvTorchCam abstracts critical camera operations such as projection and unprojection, allowing developers to implement algorithms once and apply them across diverse camera models.
  arXiv  Detail & Related papers  (2024-10-15T21:24:31Z)
• ChatCam: Empowering Camera Control through Conversational AI [67.31920821192323]
  ChatCam is a system that navigates camera movements through conversations with users. To achieve this, we propose CineGPT, a GPT-based autoregressive model for text-conditioned camera trajectory generation. We also develop an Anchor Determinator to ensure precise camera trajectory placement.
  arXiv  Detail & Related papers  (2024-09-25T20:13:41Z)
• Image Conductor: Precision Control for Interactive Video Synthesis [90.2353794019393]
  Filmmaking and animation production often require sophisticated techniques for coordinating camera transitions and object movements. Image Conductor is a method for precise control of camera transitions and object movements to generate video assets from a single image.
  arXiv  Detail & Related papers  (2024-06-21T17:55:05Z)
• Neural Projection Mapping Using Reflectance Fields [11.74757574153076]
  We introduce a projector into a neural reflectance field that allows to calibrate the projector and photo realistic light editing. Our neural field consists of three neural networks, estimating geometry, material, and transmittance. We believe that neural projection mapping opens up the door to novel and exciting downstream tasks, through the joint optimization of the scene and projection images.
  arXiv  Detail & Related papers  (2023-06-11T05:33:10Z)
• Directionally Decomposing Structured Light for Projector Calibration [22.062182997296805]
  Intrinsic projector calibration is essential in projection mapping (PM) applications. We present a practical calibration device that requires a minimal working volume directly in front of the projector lens. We demonstrate that our technique can calibrate projectors with different focusing distances and aperture sizes at the same accuracy as a conventional method.
  arXiv  Detail & Related papers  (2021-10-08T06:44:01Z)
• Procam Calibration from a Single Pose of a Planar Target [0.30458514384586405]
  A novel user friendly method is proposed for calibrating a procam system from a single pose of a planar chessboard target. A sequence of Gray Code patterns are projected onto the chessboard, which allows correspondences between the camera, projector and the chessboard to be automatically extracted. The method is experimentally validated on the procam system, which is shown to be comparable in accuracy with existing multi-pose approaches.
  arXiv  Detail & Related papers  (2021-02-22T22:53:29Z)
• Infrastructure-based Multi-Camera Calibration using Radial Projections [117.22654577367246]
  Pattern-based calibration techniques can be used to calibrate the intrinsics of the cameras individually. Infrastucture-based calibration techniques are able to estimate the extrinsics using 3D maps pre-built via SLAM or Structure-from-Motion. We propose to fully calibrate a multi-camera system from scratch using an infrastructure-based approach.
  arXiv  Detail & Related papers  (2020-07-30T09:21:04Z)
• DeProCams: Simultaneous Relighting, Compensation and Shape Reconstruction for Projector-Camera Systems [91.45207885902786]
  We propose a novel end-to-end trainable model named DeProCams to learn the photometric and geometric mappings of ProCams. DeProCams explicitly decomposes the projector-camera image mappings into three subprocesses: shading attributes estimation, rough direct light estimation and photorealistic neural rendering. In our experiments, DeProCams shows clear advantages over previous arts with promising quality and being fully differentiable.
  arXiv  Detail & Related papers  (2020-03-06T05:49:16Z)
• Redesigning SLAM for Arbitrary Multi-Camera Systems [51.81798192085111]
  Adding more cameras to SLAM systems improves robustness and accuracy but complicates the design of the visual front-end significantly. In this work, we aim at an adaptive SLAM system that works for arbitrary multi-camera setups. We adapt a state-of-the-art visual-inertial odometry with these modifications, and experimental results show that the modified pipeline can adapt to a wide range of camera setups.
  arXiv  Detail & Related papers  (2020-03-04T11:44:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.