Consistent Feature Transport for Image Relighting

• URL: http://arxiv.org/abs/2607.17833v1
• Date: Mon, 20 Jul 2026 11:25:36 GMT
• Title: Consistent Feature Transport for Image Relighting
• Abstract summary: Relighting modifies illumination while preserving non-lighting content such as identity and geometry.<n>We reformulate relighting as an illumination feature transport problem and introduce Consistent Feature Transport (CFT)<n>CFT explicitly enforces illumination-consistent transport between source and target image distributions.
• Score: 45.982118331789884
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Image relighting modifies illumination while preserving non-lighting content such as identity and geometry. Existing diffusion-based methods often suffer from unstable illumination changes or inconsistent content preservation under complex lighting, as they lack an explicit mechanism to learn feature transformations between images. We reformulate relighting as an illumination feature transport problem and introduce Consistent Feature Transport (CFT), a training principle that explicitly enforces illumination-consistent transport between source and target image distributions. Built upon rectified flow, CFT jointly models noise-to-image generation and illumination-consistent source-to-target transport through trajectory-level supervision. This dual-transport formulation encourages isolation of illumination-specific variations while preserving content-aligned features. To support complex lighting scenarios, we construct a large-scale portrait relighting dataset with diverse relighting effects. Experiments show consistent improvements over existing state-of-the-art relighting approaches and demonstrate that CFT can generalize to other editing tasks, including style transfer. Code is available at https://github.com/Dixin-Lab/CFT.

Related papers

• TokenLight: Precise Lighting Control in Images using Attribute Tokens [36.19968483255676]
  We formulate relighting as a conditional image generation task and introduce attribute tokens to encode lighting factors.<n>The model is trained on a large-scale synthetic dataset with ground-truth lighting annotations.<n>We validate our approach across a variety of relighting tasks, including controlling in-scene lighting fixtures and editing environment illumination.
  arXiv  Detail & Related papers  (2026-04-16T17:59:50Z)
• LightMover: Generative Light Movement with Color and Intensity Controls [49.259165408623915]
  LightMover is a framework for controllable light manipulation in single images.<n>Video diffusion priors produce physically plausible illumination changes without re-rendering the scene.
  arXiv  Detail & Related papers  (2026-03-28T09:51:59Z)
• POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling [51.7495375918484]
  Face relighting aims to synthesize realistic portraits under novel illumination while preserving identity and geometry.<n>We introduce POLAR, a large-scale and physically calibrated One-Light-at-a-Time dataset containing over 200 subjects captured under 156 lighting directions, multiple views, and diverse expressions.<n>We develop a flow-based generative model POLARNet that predicts per-light OLAT responses from a single portrait, capturing fine-grained and direction-aware illumination effects while preserving facial identity.
  arXiv  Detail & Related papers  (2025-12-15T11:04:09Z)
• LightQANet: Quantized and Adaptive Feature Learning for Low-Light Image Enhancement [65.06462316546806]
  Low-light image enhancement aims to improve illumination while preserving high-quality color and texture.<n>Existing methods often fail to extract reliable feature representations due to severely degraded pixel-level information under low-light conditions.<n>We propose LightQANet, a novel framework that introduces quantized and adaptive feature learning for low-light enhancement.
  arXiv  Detail & Related papers  (2025-10-16T14:54:42Z)
• TransLight: Image-Guided Customized Lighting Control with Generative Decoupling [31.587782425861363]
  We present TransLight, a novel framework that enables high-fidelity and high-freedom transfer of light effects.<n>We first present Generative Decoupling, where two fine-tuned diffusion models are used to accurately separate image content and light effects.<n>We then employ IC-Light as the generative model and train our model with our triplets, injecting the reference lighting image as an additional conditioning signal.
  arXiv  Detail & Related papers  (2025-08-20T16:05:12Z)
• SAIGFormer: A Spatially-Adaptive Illumination-Guided Network for Low-Light Image Enhancement [58.79901582809091]
  Recent Transformer-based low-light enhancement methods have made promising progress in recovering global illumination.<n>Recent Transformer-based low-light enhancement methods have made promising progress in recovering global illumination.<n>We present a Spatially-Adaptive Illumination-Guided Transformer framework that enables accurate illumination restoration.
  arXiv  Detail & Related papers  (2025-07-21T11:38:56Z)
• DreamLight: Towards Harmonious and Consistent Image Relighting [41.90032795389507]
  We introduce a model named DreamLight for universal image relighting.<n>It can seamlessly composite subjects into a new background while maintaining aesthetic uniformity in terms of lighting and color tone.
  arXiv  Detail & Related papers  (2025-06-17T14:05:24Z)
• LightLab: Controlling Light Sources in Images with Diffusion Models [49.83835236202516]
  We present a diffusion-based method for fine-grained, parametric control over light sources in an image.<n>We leverage the linearity of light to synthesize image pairs depicting controlled light changes of either a target light source or ambient illumination.<n>We show how our method can achieve compelling light editing results, and outperforms existing methods based on user preference.
  arXiv  Detail & Related papers  (2025-05-14T17:57:27Z)
• Light-A-Video: Training-free Video Relighting via Progressive Light Fusion [52.420894727186216]
  Light-A-Video is a training-free approach to achieve temporally smooth video relighting.<n>Adapted from image relighting models, Light-A-Video introduces two key techniques to enhance lighting consistency.
  arXiv  Detail & Related papers  (2025-02-12T17:24:19Z)
• LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relighting [26.40653597095593]
  Given a source image and a target lighting image, LumiNet synthesizes a relit version of the source scene that captures the target's lighting.<n>LumiNet processes latent representations from two different images - preserving geometry and albedo from the source while transferring lighting characteristics from the target.
  arXiv  Detail & Related papers  (2024-11-29T18:59:11Z)
• Intrinsic Image Transfer for Illumination Manipulation [1.2387676601792899]
  This paper presents a novel intrinsic image transfer (IIT) algorithm for illumination manipulation. It creates a local image translation between two illumination surfaces. We illustrate that all losses can be reduced without the necessity of taking an intrinsic image decomposition.
  arXiv  Detail & Related papers  (2021-07-01T19:12:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.