Physics-Constrained Cross-Resolution Enhancement Network for Optics-Guided Thermal UAV Image Super-Resolution

• URL: http://arxiv.org/abs/2601.03526v1
• Date: Wed, 07 Jan 2026 02:30:27 GMT
• Title: Physics-Constrained Cross-Resolution Enhancement Network for Optics-Guided Thermal UAV Image Super-Resolution
• Authors: Zhicheng Zhao, Fengjiao Peng, Jinquan Yan, Wei Lu, Chenglong Li, Jin Tang,
• Abstract summary: Existing methods compress optical features to match thermal feature dimensions for cross-modal alignment and fusion.<n>We propose PCNet to achieve cross-resolution mutual enhancement between optical and thermal modalities.<n>We also propose a Physics-Driven Thermal Conduction Module (PDTM) that incorporates two-dimensional heat conduction into optical guidance.
• Score: 19.782662020080522
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Optics-guided thermal UAV image super-resolution has attracted significant research interest due to its potential in all-weather monitoring applications. However, existing methods typically compress optical features to match thermal feature dimensions for cross-modal alignment and fusion, which not only causes the loss of high-frequency information that is beneficial for thermal super-resolution, but also introduces physically inconsistent artifacts such as texture distortions and edge blurring by overlooking differences in the imaging physics between modalities. To address these challenges, we propose PCNet to achieve cross-resolution mutual enhancement between optical and thermal modalities, while physically constraining the optical guidance process via thermal conduction to enable robust thermal UAV image super-resolution. In particular, we design a Cross-Resolution Mutual Enhancement Module (CRME) to jointly optimize thermal image super-resolution and optical-to-thermal modality conversion, facilitating effective bidirectional feature interaction across resolutions while preserving high-frequency optical priors. Moreover, we propose a Physics-Driven Thermal Conduction Module (PDTM) that incorporates two-dimensional heat conduction into optical guidance, modeling spatially-varying heat conduction properties to prevent inconsistent artifacts. In addition, we introduce a temperature consistency loss that enforces regional distribution consistency and boundary gradient smoothness to ensure generated thermal images align with real-world thermal radiation principles. Extensive experiments on VGTSR2.0 and DroneVehicle datasets demonstrate that PCNet significantly outperforms state-of-the-art methods on both reconstruction quality and downstream tasks including semantic segmentation and object detection.

Related papers

• Modeling and Inverse Identification of Interfacial Heat Conduction in Finite Layer and Semi-Infinite Substrate Systems via a Physics-Guided Neural Framework [0.0]
  HeatTransFormer is a physics-guided Transformer architecture for interface-dominated diffusion problems.<n>It integrates physically informed sampling, a Laplace-based activation emulating diffusion solutions, and a mask-free attention mechanism.<n>It produces coherent temperature fields across the interface, when applied to a finite layer semi-infinite substrate configuration.
  arXiv  Detail & Related papers  (2025-12-02T10:22:57Z)
• Temperature calibration of surface emissivities with an improved thermal image enhancement network [8.19646340914779]
  Infrared thermography faces persistent challenges in temperature accuracy due to material emissivity variations.<n>This study introduces a physically guided neural framework that unifies temperature correction and image enhancement.
  arXiv  Detail & Related papers  (2025-06-20T07:40:05Z)
• Adaptive Stereo Depth Estimation with Multi-Spectral Images Across All Lighting Conditions [58.88917836512819]
  We propose a novel framework incorporating stereo depth estimation to enforce accurate geometric constraints. To mitigate the effects of poor lighting on stereo matching, we introduce Degradation Masking. Our method achieves state-of-the-art (SOTA) performance on the Multi-Spectral Stereo (MS2) dataset.
  arXiv  Detail & Related papers  (2024-11-06T03:30:46Z)
• Building Vision Models upon Heat Conduction [66.1594989193046]
  This study introduces the Heat Conduction Operator (HCO) built upon the physical heat conduction principle.<n>HCO conceptualizes image patches as heat sources and models their correlations through adaptive thermal energy diffusion.<n> vHeat achieves up to a 3x throughput, 80% less GPU memory allocation, and 35% fewer computational FLOPs compared to the Swin-Transformer.
  arXiv  Detail & Related papers  (2024-05-26T12:58:04Z)
• Physics-Inspired Degradation Models for Hyperspectral Image Fusion [61.743696362028246]
  Most fusion methods solely focus on the fusion algorithm itself and overlook the degradation models. We propose physics-inspired degradation models (PIDM) to model the degradation of LR-HSI and HR-MSI. Our proposed PIDM can boost the fusion performance of existing fusion methods in practical scenarios.
  arXiv  Detail & Related papers  (2024-02-04T09:07:28Z)
• TCI-Former: Thermal Conduction-Inspired Transformer for Infrared Small Target Detection [58.00308680221481]
  Infrared small target detection (ISTD) is critical to national security and has been extensively applied in military areas. Most ISTD networks focus on designing feature extraction blocks or feature fusion modules, but rarely describe the ISTD process from the feature map evolution perspective. We propose Thermal Conduction-Inspired Transformer (TCI-Former) based on the theoretical principles of thermal conduction.
  arXiv  Detail & Related papers  (2024-02-03T05:51:22Z)
• CoReFusion: Contrastive Regularized Fusion for Guided Thermal Super-Resolution [0.0]
  Super-Resolution approaches can replicate accurate high-resolution thermal pictures using measurements from low-cost, low-resolution thermal sensors. We present a novel data fusion framework and regularization technique for Guided Super Resolution of Thermal images.
  arXiv  Detail & Related papers  (2023-04-03T14:21:41Z)
• Does Thermal Really Always Matter for RGB-T Salient Object Detection? [153.17156598262656]
  This paper proposes a network named TNet to solve the RGB-T salient object detection (SOD) task. In this paper, we introduce a global illumination estimation module to predict the global illuminance score of the image. On the other hand, we introduce a two-stage localization and complementation module in the decoding phase to transfer object localization cue and internal integrity cue in thermal features to the RGB modality.
  arXiv  Detail & Related papers  (2022-10-09T13:50:12Z)
• Photothermal-SR-Net: A Customized Deep Unfolding Neural Network for Photothermal Super Resolution Imaging [9.160910754837756]
  Photothermal-SR-Net is proposed in this paper, which performs deconvolution by deep unfolding considering the underlying physics. Photothermal-SR-Net applies trained block-sparsity thresholding to the acquired thermal images in each convolutional layer.
  arXiv  Detail & Related papers  (2021-04-21T14:41:04Z)
• Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo [61.6260594326246]
  We introduce an efficient fully-convolutional architecture that can leverage both spatial and photometric context simultaneously. Using separable 4D convolutions and 2D heat-maps reduces the size and makes more efficient.
  arXiv  Detail & Related papers  (2021-03-22T18:06:58Z)
• Exploring Thermal Images for Object Detection in Underexposure Regions for Autonomous Driving [67.69430435482127]
  Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving. The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals. This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
  arXiv  Detail & Related papers  (2020-06-01T09:59:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.