Setup-Independent Full Projector Compensation
- URL: http://arxiv.org/abs/2604.01736v1
- Date: Thu, 02 Apr 2026 08:00:22 GMT
- Title: Setup-Independent Full Projector Compensation
- Abstract summary: Projector compensation seeks to correct geometric and photometric distortions.<n>Current methods require fine-tuning or retraining whenever the surface, lighting, or projector-camera pose changes.<n>We introduce SIComp, capable of generalizing to unseen setups without fine-tuning or retraining.
- Score: 40.922125757397666
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Projector compensation seeks to correct geometric and photometric distortions that occur when images are projected onto nonplanar or textured surfaces. However, most existing methods are highly setup-dependent, requiring fine-tuning or retraining whenever the surface, lighting, or projector-camera pose changes. Progress has been limited by two key challenges: (1) the absence of large, diverse training datasets and (2) existing geometric correction models are typically constrained by specific spatial setups; without further retraining or fine-tuning, they often fail to generalize directly to novel geometric configurations. We introduce SIComp, the first Setup-Independent framework for full projector Compensation, capable of generalizing to unseen setups without fine-tuning or retraining. To enable this, we construct a large-scale real-world dataset spanning 277 distinct projector-camera setups. SIComp adopts a co-adaptive design that decouples geometry and photometry: A carefully tailored optical flow module performs online geometric correction, while a novel photometric network handles photometric compensation. To further enhance robustness under varying illumination, we integrate intensity-varying surface priors into the network design. Extensive experiments demonstrate that SIComp consistently produces high-quality compensation across diverse unseen setups, substantially outperforming existing methods in terms of generalization ability and establishing the first generalizable solution to projector compensation. The code and dataset are available on our project page: https://hai-bo-li.github.io/SIComp/
Related papers
- Geometry Meets Light: Leveraging Geometric Priors for Universal Photometric Stereo under Limited Multi-Illumination Cues [24.171649472398514]
GeoUniPS is a universal photometric stereo network that integrates synthetic supervision with high-level geometric priors.<n>We introduce the PS-Perp dataset with realistic perspective projection to enable learning of spatially varying view directions.
arXiv Detail & Related papers (2025-11-17T06:14:38Z) - Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis [49.67420486373202]
GRGS is a generalizable and relightable 3D Gaussian framework for high-fidelity human novel view synthesis under diverse lighting conditions.<n>We introduce a Lighting-aware Geometry Refinement (LGR) module trained on synthetically relit data to predict accurate depth and surface normals.
arXiv Detail & Related papers (2025-05-27T17:59:47Z) - Towards Unified Structured Light Optimization [2.4823372746556442]
Structured light (SL) 3D reconstruction captures the precise surface shape of objects.<n>We present a unified framework for SL optimization, adaptable to diverse lighting conditions, object types, and different types of SL.<n>Key contributions include a novel global matching method for projectors, enabling precise projector-camera alignment with just one projected image.
arXiv Detail & Related papers (2025-01-24T17:29:17Z) - CompenHR: Efficient Full Compensation for High-resolution Projector [68.42060996280064]
Full projector compensation is a practical task of projector-camera systems.
It aims to find a projector input image, named compensation image, such that when projected it cancels the geometric and photometric distortions.
State-of-the-art methods use deep learning to address this problem and show promising performance for low-resolution setups.
However, directly applying deep learning to high-resolution setups is impractical due to the long training time and high memory cost.
arXiv Detail & Related papers (2023-11-22T14:13:27Z) - MS-PS: A Multi-Scale Network for Photometric Stereo With a New
Comprehensive Training Dataset [0.0]
Photometric stereo (PS) problem consists in reconstructing the 3D-surface of an object.
We propose a multi-scale architecture for PS which, combined with a new dataset, yields state-of-the-art results.
arXiv Detail & Related papers (2022-11-25T14:01:54Z) - Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian
Photometric Stereo [61.6260594326246]
We introduce an efficient fully-convolutional architecture that can leverage both spatial and photometric context simultaneously.
Using separable 4D convolutions and 2D heat-maps reduces the size and makes more efficient.
arXiv Detail & Related papers (2021-03-22T18:06:58Z) - End-to-end Full Projector Compensation [81.19324259967742]
Full projector compensation aims to modify a projector input image to compensate for both geometric and photometric disturbance of the projection surface.
In this paper, we propose the first end-to-end differentiable solution, named CompenNeSt++, to solve the two problems jointly.
arXiv Detail & Related papers (2020-07-30T18:23:52Z) - DeProCams: Simultaneous Relighting, Compensation and Shape
Reconstruction for Projector-Camera Systems [91.45207885902786]
We propose a novel end-to-end trainable model named DeProCams to learn the photometric and geometric mappings of ProCams.
DeProCams explicitly decomposes the projector-camera image mappings into three subprocesses: shading attributes estimation, rough direct light estimation and photorealistic neural rendering.
In our experiments, DeProCams shows clear advantages over previous arts with promising quality and being fully differentiable.
arXiv Detail & Related papers (2020-03-06T05:49:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.