PPISP: Physically-Plausible Compensation and Control of Photometric Variations in Radiance Field Reconstruction

• URL: http://arxiv.org/abs/2601.18336v1
• Date: Mon, 26 Jan 2026 10:23:43 GMT
• Title: PPISP: Physically-Plausible Compensation and Control of Photometric Variations in Radiance Field Reconstruction
• Abstract summary: Physically-Plausible ISP correction module disentangles camera-intrinsic and capture-dependent effects.<n>A dedicated PPISP controller, trained on the input views, predicts ISP parameters for novel viewpoints.
• Score: 10.040461884848403
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multi-view 3D reconstruction methods remain highly sensitive to photometric inconsistencies arising from camera optical characteristics and variations in image signal processing (ISP). Existing mitigation strategies such as per-frame latent variables or affine color corrections lack physical grounding and generalize poorly to novel views. We propose the Physically-Plausible ISP (PPISP) correction module, which disentangles camera-intrinsic and capture-dependent effects through physically based and interpretable transformations. A dedicated PPISP controller, trained on the input views, predicts ISP parameters for novel viewpoints, analogous to auto exposure and auto white balance in real cameras. This design enables realistic and fair evaluation on novel views without access to ground-truth images. PPISP achieves SoTA performance on standard benchmarks, while providing intuitive control and supporting the integration of metadata when available. The source code is available at: https://github.com/nv-tlabs/ppisp

Related papers

• RAWild: Sensor-Agnostic RAW Object Detection via Physics-Guided Curve and Grid Modeling [69.96407948879015]
  textbfRAWild is a physics-guided global-local tone mapping framework for sensor-agnostic RAW object detection.<n>We construct a physics-based RAW simulation pipeline that synthesizes realistic sensor outputs spanning diverse spectral sensitivities, illuminants, and sensor non-idealities.
  arXiv  Detail & Related papers  (2026-05-07T09:51:47Z)
• Image-Conditioned Adaptive Parameter Tuning for Visual Odometry Frontends [21.343239924094764]
  Resource-constrained autonomous robots rely on sparse direct and semi-direct visual-(inertial)-odometry (VO) pipelines.<n>We propose the first image-conditioned reinforcement learning framework for online tuning of VO parameters.
  arXiv  Detail & Related papers  (2026-03-23T10:26:25Z)
• A Physically-Grounded Attack and Adaptive Defense Framework for Real-World Low-Light Image Enhancement [11.903420482259257]
  Limited illumination often causes severe physical noise and detail degradation in images.<n>Existing Low-Light Image Enhancement (LLIE) methods treat the enhancement process as a blind black-box mapping.<n>We propose a novel LLIE approach, conceptually formulated as a physics-based attack and display-adaptive defense paradigm.
  arXiv  Detail & Related papers  (2026-03-15T09:44:54Z)
• Unifying Color and Lightness Correction with View-Adaptive Curve Adjustment for Robust 3D Novel View Synthesis [73.27997579020233]
  We propose Luminance-GS++, a 3DGS-based framework for robust NVS under diverse illumination conditions.<n>Our method combines a globally view-adaptive lightness adjustment with a local pixel-wise residual refinement for precise color correction.
  arXiv  Detail & Related papers  (2026-02-20T16:20:50Z)
• Beyond Calibration: Physically Informed Learning for Raw-to-Raw Mapping [45.35073576457164]
  Existing raw-to-raw conversion methods face limitations such as poor adaptability to changing illumination, high computational costs, or impractical requirements such as simultaneous camera operation and overlapping fields-of-view.<n>We introduce the Neural Physical Model (NPM), a lightweight, physically-informed approach that simulates raw images under specified illumination to estimate transformations between devices.
  arXiv  Detail & Related papers  (2025-06-10T10:02:00Z)
• Photoreal Scene Reconstruction from an Egocentric Device [5.581317382137083]
  Existing methodologies assume using frame-rate 6DoF pose estimated from the device's visual-inertial odometry system.<n>We employ visual-inertial bundle adjustment (VIBA) to calibrate the precise timestamps and movement of the rolling shutter RGB sensing camera.<n>We incorporate a physical image formation model based into Gaussian Splatting, which effectively addresses the sensor characteristics.
  arXiv  Detail & Related papers  (2025-06-04T20:53:43Z)
• DPCS: Path Tracing-Based Differentiable Projector-Camera Systems [49.69815958689441]
  Projector-camera systems (ProCams) simulation aims to model the physical project-and-capture process and associated scene parameters of a ProCams.<n>Recent advances use an end-to-end neural network to learn the project-and-capture process.<n>We introduce a novel path tracing-based differentiable projector-camera systems (DPCS), offering a differentiable ProCams simulation method.
  arXiv  Detail & Related papers  (2025-03-15T15:31:18Z)
• PIGUIQA: A Physical Imaging Guided Perceptual Framework for Underwater Image Quality Assessment [59.9103803198087]
  We propose a Physical Imaging Guided perceptual framework for Underwater Image Quality Assessment (UIQA)<n>By leveraging underwater radiative transfer theory, we integrate physics-based imaging estimations to establish quantitative metrics for these distortions.<n>The proposed model accurately predicts image quality scores and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-12-20T03:31:45Z)
• Generalizable Non-Line-of-Sight Imaging with Learnable Physical Priors [52.195637608631955]
  Non-line-of-sight (NLOS) imaging has attracted increasing attention due to its potential applications. Existing NLOS reconstruction approaches are constrained by the reliance on empirical physical priors. We introduce a novel learning-based solution, comprising two key designs: Learnable Path Compensation (LPC) and Adaptive Phasor Field (APF)
  arXiv  Detail & Related papers  (2024-09-21T04:39:45Z)
• Möbius Transform for Mitigating Perspective Distortions in Representation Learning [43.86985901138407]
  Perspective distortion (PD) causes unprecedented changes in shape, size, orientation, angles, and other spatial relationships in images. We propose mitigating perspective distortion (MPD) by employing a fine-grained parameter control on a specific family of M"obius transform. We present a dedicated perspectively distorted benchmark dataset, ImageNet-PD, to benchmark the robustness of deep learning models against this new dataset.
  arXiv  Detail & Related papers  (2024-03-07T15:39:00Z)
• Learning Degradation-Independent Representations for Camera ISP Pipelines [14.195578257521934]
  We propose a novel approach to learn degradation-independent representations (DiR) through the refinement of a self-supervised learned baseline representation. The proposed DiR learning technique has remarkable domain generalization capability and it outperforms state-of-the-art methods across various downstream tasks.
  arXiv  Detail & Related papers  (2023-07-03T05:38:28Z)
• GenISP: Neural ISP for Low-Light Machine Cognition [19.444297600977546]
  In low-light conditions, object detectors using raw image data are more robust than detectors using image data processed by an ISP pipeline. We propose a minimal neural ISP pipeline for machine cognition, named GenISP, that explicitly incorporates Color Space Transformation to a device-independent color space.
  arXiv  Detail & Related papers  (2022-05-07T17:17:24Z)
• ReconfigISP: Reconfigurable Camera Image Processing Pipeline [75.46902933531247]
  Image Signal Processor (ISP) is crucial component in digital cameras that transforms sensor signals into images for us to perceive and understand. Existing ISP designs always adopt a fixed architecture, e.g., several sequential modules connected in a rigid order. In this study, we propose a novel Reconfigurable ISP (ReconfigISP) whose architecture and parameters can be automatically tailored to specific data and tasks.
  arXiv  Detail & Related papers  (2021-09-10T09:56:43Z)
• 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop [128.07841893637337]
  Regression-based methods have recently shown promising results in reconstructing human meshes from monocular images. Minor deviation in parameters may lead to noticeable misalignment between the estimated meshes and image evidences. We propose a Pyramidal Mesh Alignment Feedback (PyMAF) loop to leverage a feature pyramid and rectify the predicted parameters.
  arXiv  Detail & Related papers  (2021-03-30T17:07:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.