FreeLit: Paired-Free Indoor Relighting via Physics-Guided Diffusion

• URL: http://arxiv.org/abs/2607.13656v1
• Date: Wed, 15 Jul 2026 10:03:22 GMT
• Title: FreeLit: Paired-Free Indoor Relighting via Physics-Guided Diffusion
• Abstract summary: FreeLit is a paired-free framework for controllable indoor relighting.<n>It explicitly manipulates light-source location, color, and intensity.<n>It achieves stable, physically consistent, and controllable relighting.
• Score: 12.521086833681077
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image-based indoor scene relighting remains challenging due to the complex interplay between cluttered geometry and local illumination, requiring precise modeling of light position, color, and intensity. Existing data-driven methods implicitly learn this relationship via paired multi-illumination datasets. Nevertheless, this data is costly and fails to scale, which is essential for accurate light-source-level control. Conversely, inverse-rendering methods reduce the data dependency by incorporating physical priors; however, they lack the robustness of intrinsic estimation in challenging conditions. In this paper, we present FreeLit, a paired-free framework for controllable indoor relighting that explicitly manipulates light-source location, color, and intensity. Instead of relying on paired supervision, we construct a physics-guided illumination prior from intrinsic scene properties, generating a structured lightmap along with a pseudo-relit image to guide diffusion-based synthesis. To address instability in intrinsic estimation, especially in low-light scenes, we introduce a relighting-guided intrinsic stabilization strategy that enforces illumination-invariant reflectance through structure-aware distillation and consistency constraints. Furthermore, we propose controllability-oriented evaluation metrics to quantify alignment with user-specified illumination color and intensity. Experimental results demonstrate that FreeLit achieves stable, physically consistent, and controllable relighting, with improved robustness in low-light indoor scenes, without requiring paired supervision.

Related papers

• Learning Structural Illumination for Unsupervised Low-light Enhancement [8.895269493077585]
  We propose aRelative Illumination Structure Estimation (RISE) framework that decouples relative illumination structure from absolute exposure.<n>For scene-adaptive exposure adjustment, we propose a Dual-Metering Exposure Reference derived from each input.<n>RISE achieves state-of-the-art performance among unsupervised LLIE methods while producing visually natural results.
  arXiv  Detail & Related papers  (2026-08-08T14:27:56Z)
• LightMover: Generative Light Movement with Color and Intensity Controls [49.259165408623915]
  LightMover is a framework for controllable light manipulation in single images.<n>Video diffusion priors produce physically plausible illumination changes without re-rendering the scene.
  arXiv  Detail & Related papers  (2026-03-28T09:51:59Z)
• Learning Latent Proxies for Controllable Single-Image Relighting [29.76860042350802]
  Single-image relighting is highly under-constrained.<n>We introduce LightCtrl that integrates physical priors at two levels.<n>We also present ScaLight, a large-scale object-level dataset.
  arXiv  Detail & Related papers  (2026-03-16T17:16:59Z)
• Light-X: Generative 4D Video Rendering with Camera and Illumination Control [52.87059646145144]
  Light-X is a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control.<n>To address the lack of paired multi-view and multi-illumination videos, we introduce Light-Syn, a degradation-based pipeline with inverse-mapping.
  arXiv  Detail & Related papers  (2025-12-04T18:59:57Z)
• GLOW: Global Illumination-Aware Inverse Rendering of Indoor Scenes Captured with Dynamic Co-Located Light & Camera [18.90141473604964]
  Inverse rendering of indoor scenes remains challenging due to the ambiguity between reflectance and lighting.<n>We present GLOW, a Global Illumination-aware Inverse Rendering framework designed to address these challenges.
  arXiv  Detail & Related papers  (2025-11-28T03:24:12Z)
• LightQANet: Quantized and Adaptive Feature Learning for Low-Light Image Enhancement [65.06462316546806]
  Low-light image enhancement aims to improve illumination while preserving high-quality color and texture.<n>Existing methods often fail to extract reliable feature representations due to severely degraded pixel-level information under low-light conditions.<n>We propose LightQANet, a novel framework that introduces quantized and adaptive feature learning for low-light enhancement.
  arXiv  Detail & Related papers  (2025-10-16T14:54:42Z)
• After the Party: Navigating the Mapping From Color to Ambient Lighting [48.01497878412971]
  We introduce CL3AN, the first large-scale, high-resolution dataset of its kind.<n>We find that leading approaches often produce artifacts, such as illumination inconsistencies, texture leakage, and color distortion.<n>We achieve such a desired decomposition through a novel learning framework.
  arXiv  Detail & Related papers  (2025-08-04T08:07:03Z)
• LightLab: Controlling Light Sources in Images with Diffusion Models [49.83835236202516]
  We present a diffusion-based method for fine-grained, parametric control over light sources in an image.<n>We leverage the linearity of light to synthesize image pairs depicting controlled light changes of either a target light source or ambient illumination.<n>We show how our method can achieve compelling light editing results, and outperforms existing methods based on user preference.
  arXiv  Detail & Related papers  (2025-05-14T17:57:27Z)
• DifFRelight: Diffusion-Based Facial Performance Relighting [12.909429637057343]
  We present a novel framework for free-viewpoint facial performance relighting using diffusion-based image-to-image translation. We train a diffusion model for precise lighting control, enabling high-fidelity relit facial images from flat-lit inputs. The model accurately reproduces complex lighting effects like eye reflections, subsurface scattering, self-shadowing, and translucency.
  arXiv  Detail & Related papers  (2024-10-10T17:56:44Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• Sparse Needlets for Lighting Estimation with Spherical Transport Loss [89.52531416604774]
  NeedleLight is a new lighting estimation model that represents illumination with needlets and allows lighting estimation in both frequency domain and spatial domain jointly. Extensive experiments show that NeedleLight achieves superior lighting estimation consistently across multiple evaluation metrics as compared with state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-06-24T15:19:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.