On RGB-TIR Stereo Calibration under Extreme Resolution Asymmetry

• URL: http://arxiv.org/abs/2605.15860v1
• Date: Fri, 15 May 2026 11:21:49 GMT
• Title: On RGB-TIR Stereo Calibration under Extreme Resolution Asymmetry
• Abstract summary: This paper presents a practical stereo calibration framework for an RGB camera (2028 x 1520) paired with a TIR camera operating at only 80 x 62.<n>The system is validated using constant-depth and per-pixel depth estimation.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate geometric calibration of RGB-thermal infrared (TIR) stereo camera systems is essential for multimodal building envelope analysis, yet remains challenging when low-cost thermal sensors with very low spatial resolution are employed. This paper presents a practical stereo calibration framework for an RGB camera (2028 x 1520 px) paired with a TIR camera operating at only 80 x 62 px - a pixel-count ratio of approximately 1:625. An active OLED screen dynamically switches modality-specific patterns (checkerboard for TIR, ChArUco for RGB) on a single physical surface, providing controlled and repeatable thermal contrast. A dedicated corner detection algorithm combining perspective rectification, Hessian saddle-point analysis, and Mean Shift localisation achieves reliable checkerboard detection at 80 x 62 px without per-frame parameter tuning. A baseline-constrained bundle adjustment enforces physically consistent rig geometry under the planar-calibration-object degeneracy, yielding a stereo baseline of 32.7 mm (nominal 30 mm) with an overall reprojection error of 0.382 px. The system is validated on a thermally active building mock-up using constant-depth and per-pixel depth estimation, demonstrating consistent TIR-to-RGB projection suitable for building energy performance assessment.

Related papers

• LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection [8.90165768285529]
  Polarization imaging provides complementary physical cues, whereas existing methods assume fixed multimodal input configurations.<n>We propose a lightweight gated RGB-polarization fusion framework supporting separately optimized RGB-only and polarization-assisted configurations.<n>Under a common local reevaluation protocol, the multimodal configuration outperforms PolarNet and IPNet on all six metrics.
  arXiv  Detail & Related papers  (2026-09-11T12:57:37Z)
• Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screening [5.388667139496039]
  Unmanned aerial vehicle facade inspection can combine red, green, and blue (RGB) imagery with thermal measurements to screen surface and subsurface anomalies.<n>This article presents a sensor-level pipeline comprising per-sensor correction, RGB-to-thermal registration, common-support cropping, and signed local contrast encoding of 16-bit radiometric measurements.
  arXiv  Detail & Related papers  (2026-09-11T07:29:20Z)
• Lightweight Interpretable RGB-Guided Hyperspectral Super-Resolution under Real Cross-resolution Misalignment [6.5685272845309255]
  RGB-guided hyperspectral super-resolution transfers spatial detail from a high-resolution RGB guide to a low-resolution hyperspectral image.<n>We propose a lightweight and interpretable RGB-guided HSR framework combining cross-modal flow alignment with model-based Gram-Schmidtization fusion.
  arXiv  Detail & Related papers  (2026-09-01T10:55:11Z)
• TransTac: Visuo-Tactile Modality Transition via Ultraviolet-Encoded Transparent Elastomers [6.211452009978906]
  We present TransTac, a transparent ultraviolet (UV)-encoded binocular VBTS that integrates visual observation and marker-based tactile reconstruction.<n>The system employs a transparent elastomer embedded with UV-reflective markers and a prior-guided Delaunay stereo matching algorithm for robust sparse triangulation.<n>In semantic evaluation, TransTac achieves up to 83.3% zero-shot recognition accuracy on tactile images, exceeding opaque tactile baselines by approximately 50 percentage points.
  arXiv  Detail & Related papers  (2026-06-03T05:46:00Z)
• Con-DSO: Learning Short-Horizon Consistency Priors for RGB-D Direct Sparse Odometry [8.079139316299182]
  Con-DSO is a consistency-aware RGB-D direct sparse odometry framework.<n>It predicts dense photometric and depth-geometric consistency uncertainty from temporally adjacent RGB-D frame pairs.<n>Experiments show substantial gains over direct RGB-D VO baselines.
  arXiv  Detail & Related papers  (2026-05-27T04:46:52Z)
• Cross-Modal RGB-D Fusion Transformer for 6D Pose Estimation of Non-Cooperative Spacecraft with Stereo-Derived Depth [9.6704752180736]
  Learning-based monocular methods have seen widespread adoption in spacecraft pose estimation.<n>They suffer from an intrinsic depth ambiguity problem and tend to fail under the harsh illumination conditions encountered in orbit.<n>Active depth sensors could in principle address the geometric ambiguity, but their power and mass requirements make them poorly suited to most spacecraft platforms.<n>This work addresses these issues through a passive stereo vision framework for six-degree-of-freedom (6-DOF) pose estimation of non-cooperative spacecraft.
  arXiv  Detail & Related papers  (2026-05-09T01:16:33Z)
• High-Resolution Single-Shot Polarimetric Imaging Made Easy [76.04914313843774]
  EasyPolar is a multi-view polarimetric imaging framework.<n>Three synchronized RGB cameras capture one unpolarized view and two polarized views with distinct orientations.<n>A confidence-guided polarization reconstruction network is proposed to address the potential misalignment in multi-view fusion.
  arXiv  Detail & Related papers  (2026-04-07T08:20:58Z)
• Unifying Color and Lightness Correction with View-Adaptive Curve Adjustment for Robust 3D Novel View Synthesis [73.27997579020233]
  We propose Luminance-GS++, a 3DGS-based framework for robust NVS under diverse illumination conditions.<n>Our method combines a globally view-adaptive lightness adjustment with a local pixel-wise residual refinement for precise color correction.
  arXiv  Detail & Related papers  (2026-02-20T16:20:50Z)
• Near-Light Color Photometric Stereo for mono-Chromaticity non-lambertian surface [67.4383975650003]
  We propose a framework that leverages neural implicit representations for depth and BRDF modeling under the assumption of mono-chromaticity.<n> Experiments on both synthetic and real-world datasets demonstrate that our method achieves accurate and robust surface reconstruction.
  arXiv  Detail & Related papers  (2026-01-19T02:26:08Z)
• Hierarchical Spatial Algorithms for High-Resolution Image Quantization and Feature Extraction [0.0]
  This study introduces a modular framework for spatial image processing.<n>It integrates grayscale quantization, color and brightness enhancement, image sharpening, bidirectional transformation pipelines, and geometric feature extraction.<n> Experimental evaluation across diverse datasets demonstrates robust and deterministic performance.
  arXiv  Detail & Related papers  (2025-10-09T16:56:24Z)
• High-efficiency, high-count-rate 2D superconducting nanowire single-photon detector array [0.8887848065482818]
  Superconducting nanowire single-photon detectors (SNSPDs) are the current leading technology for the detection of single-photons in the near-infrared (NIR) and short-wave infrared (SWIR) spectral regions.<n>Here we demonstrate a practical, self-contained 64-pixel SNSPD array system which exhibits high performance of all operational parameters.
  arXiv  Detail & Related papers  (2025-01-13T14:25:17Z)
• Adaptive Stereo Depth Estimation with Multi-Spectral Images Across All Lighting Conditions [58.88917836512819]
  We propose a novel framework incorporating stereo depth estimation to enforce accurate geometric constraints. To mitigate the effects of poor lighting on stereo matching, we introduce Degradation Masking. Our method achieves state-of-the-art (SOTA) performance on the Multi-Spectral Stereo (MS2) dataset.
  arXiv  Detail & Related papers  (2024-11-06T03:30:46Z)
• The Solution for the GAIIC2024 RGB-TIR object detection Challenge [5.625794757504552]
  RGB-TIR object detection aims to utilize both RGB and TIR images for complementary information during detection. Our proposed method achieved an mAP score of 0.516 and 0.543 on A and B benchmarks respectively.
  arXiv  Detail & Related papers  (2024-07-04T12:08:36Z)
• A Combined Approach Toward Consistent Reconstructions of Indoor Spaces Based on 6D RGB-D Odometry and KinectFusion [7.503338065129185]
  We propose a 6D RGB-D odometry approach that finds the relative camera pose between consecutive RGB-D frames by keypoint extraction. We feed the estimated pose to the highly accurate KinectFusion algorithm, which fine-tune the frame-to-frame relative pose. Our algorithm outputs a ready-to-use polygon mesh (highly suitable for creating 3D virtual worlds) without any postprocessing steps.
  arXiv  Detail & Related papers  (2022-12-25T22:52:25Z)
• Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo [61.6260594326246]
  We introduce an efficient fully-convolutional architecture that can leverage both spatial and photometric context simultaneously. Using separable 4D convolutions and 2D heat-maps reduces the size and makes more efficient.
  arXiv  Detail & Related papers  (2021-03-22T18:06:58Z)
• Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materials [65.95928593628128]
  We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique. Our algorithm is suitable for perspective cameras and nearby point light sources.
  arXiv  Detail & Related papers  (2020-01-18T12:26:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.