MonoIR-RS: Infrared Remote Sensing Vision-Language Learning with CLIP and VLM Adaptation

• URL: http://arxiv.org/abs/2607.06552v1
• Date: Tue, 07 Jul 2026 17:53:58 GMT
• Title: MonoIR-RS: Infrared Remote Sensing Vision-Language Learning with CLIP and VLM Adaptation
• Abstract summary: MonoIR-RS is a large-scale infrared remote-sensing vision-language dataset.<n>It couples IR-aware data construction with CLIP-style contrastive adaptation and VLM instruction tuning.<n>We show that the synthesized infrared imagery is markedly closer to real thermal imagery than a grayscale conversion.
• Score: 12.037405766509274
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Infrared remote-sensing imagery captures intensity structure, object-background contrast, and illumination-invariant cues often invisible in RGB imagery. Yet, most remote-sensing vision-language resources and models focus on visible-band semantics, leaving infrared vision-language understanding underexplored. We introduce MonoIR-RS, a large-scale infrared remote-sensing vision-language dataset and benchmark that couples IR-aware data construction with CLIP-style contrastive adaptation and VLM instruction tuning. Built from the same source pool and split as FusionRS, MonoIR-RS retains the infrared image as the model-facing modality, yielding 600,000 synthesized infrared images and 59,032 retained IR-aware caption records. The model experiments use this retained language-supervision subset, whose captions rewrite supervision around grayscale structure and infrared-style contrast instead of RGB appearance. We show that the synthesized infrared imagery is markedly closer to real thermal imagery than a grayscale conversion on the AVIID benchmark. We fine-tune five CLIP backbones and six VLM backbones, and calibrate them against zero-shot behavior: IR-aware adaptation lifts CLIP mean recall by up to 12.8 points and drives VLM captioning IR-cue coverage to 100% while reducing residual RGB-color leakage to near zero. By isolating the infrared modality from RGB-IR dual-modal learning, MonoIR-RS offers a controlled, reproducible testbed for aligning infrared remote-sensing evidence with language.

Related papers

• RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains [0.6475189298553835]
  This work investigates whether modern generative translators can overcome this cross-modal gap to improve infrared vehicle detection on unseen UAV target domains.<n> Translators are trained on paired RGB-IR source datasets and applied to RGB training images from held-out target datasets to generate synthetic IR data.<n>The resulting synthetic IR imagery is used to train RF-DETR vehicle detectors, which are evaluated on unseen IR target test splits across five aerial datasets.
  arXiv  Detail & Related papers  (2026-09-02T13:06:58Z)
• FaithIR: Rethinking Infrared Image Super-Resolution from Perceptual Sharpness to Task Relevant Fidelity [50.75932774177958]
  FaithIR is a faithful infrared super-resolution framework for reliable machine perception.<n>Experiments on FLIR-IISR, M3FD, and FMB demonstrate strong reconstruction fidelity, cross-dataset generalization, and superior performance in object detection and semantic segmentation.
  arXiv  Detail & Related papers  (2026-08-04T04:23:30Z)
• InfraQR: Edge-Placed QR-Inspired Structured Patch Attacks on Infrared Vision-Language Models [6.982777059279356]
  We present InfraQR, a QR-inspired structured patch attack for infrared vision-language models.<n>We evaluate it on infrared classification, caption transfer, and question-answer-aware visual question answering tasks.<n>Results show that infrared vision-language models remain vulnerable to structured edge-placed perturbations.
  arXiv  Detail & Related papers  (2026-07-08T11:28:15Z)
• InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection [31.00284151416272]
  InfraNet is a quality-aware framework that regulates RGB guidance during training and supports flexible RGB--IR or IR-only deployment.<n>Our method is evaluated through extensive experiments on four benchmark datasets (LLVIP, FLIR-Aligned, M$3$FD, and DroneVehicle)
  arXiv  Detail & Related papers  (2026-07-04T09:49:53Z)
• FusionRS: A Large-Scale RGB-Infrared Remote Sensing Dataset for Dual-Modal Vision-Language Foundation Models [4.917364215480415]
  FusionRS is the first large-scale RGB-infrared-text dataset for vision-language learning in remote sensing.<n>It is constructed by translating diverse public RGB remote sensing images into infrared-style counterparts, forming aligned RGB-IR image pairs.<n>Experiments show that FusionRS improves RGB-IR alignment, infrared-to-text retrieval, and dual-modal captioning over RGB-only and non-IR-aware training settings.
  arXiv  Detail & Related papers  (2026-06-15T17:49:34Z)
• Vision-Language Models for Infrared Industrial Sensing in Additive Manufacturing Scene Description [1.7786984823452563]
  Infrared cameras provide advantages in manufacturing environments in low-light conditions or enclosed machines where vision systems struggle.<n>Recent advances in vision-language systems (VLMs) offer new in-text predictions in relation to RGB data.<n>This work introduces a zero-shot encoder that adapts VLMs to infrared data by preprocessing images captured by a FLIR Boson camera.
  arXiv  Detail & Related papers  (2025-12-11T20:20:38Z)
• IrisNet: Infrared Image Status Awareness Meta Decoder for Infrared Small Targets Detection [92.56025546608699]
  IrisNet is a novel meta-learned framework that adapts detection strategies to the input infrared image status.<n>Our approach establishes a dynamic mapping between infrared image features and entire decoder parameters.<n> Experiments on NUDT-SIRST, NUAA-SIRST, and IRSTD-1K datasets demonstrate the superiority of our IrisNet.
  arXiv  Detail & Related papers  (2025-11-25T13:53:54Z)
• DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understanding [43.85632218045282]
  We introduce DiffV2IR, a novel framework for image translation comprising two key elements: a Progressive Learning Module (PLM) and a Vision-Language Understanding Module (VLUM)<n>PLM features an adaptive diffusion model architecture that leverages multi-stage knowledge learning to infrared transition from full-range to target wavelength.<n>VLUM incorporates unified Vision-Language Understanding. We also collected a large infrared dataset, IR-500K, which includes 500,000 infrared images compiled by various scenes and objects under various environmental conditions.
  arXiv  Detail & Related papers  (2025-03-24T17:58:09Z)
• Multi-Domain Biometric Recognition using Body Embeddings [51.36007967653781]
  We show that body embeddings perform better than face embeddings in medium-wave infrared (MWIR) and long-wave infrared (LWIR) domains.<n>We leverage a vision transformer architecture to establish benchmark results on the IJB-MDF dataset.<n>We also show that finetuning a body model, pretrained exclusively on VIS data, with a simple combination of cross-entropy and triplet losses achieves state-of-the-art mAP scores.
  arXiv  Detail & Related papers  (2025-03-13T22:38:18Z)
• Bringing RGB and IR Together: Hierarchical Multi-Modal Enhancement for Robust Transmission Line Detection [67.02804741856512]
  We propose a novel Hierarchical Multi-Modal Enhancement Network (HMMEN) that integrates RGB and IR data for robust and accurate TL detection.<n>Our method introduces two key components: (1) a Mutual Multi-Modal Enhanced Block (MMEB), which fuses and enhances hierarchical RGB and IR feature maps in a coarse-to-fine manner, and (2) a Feature Alignment Block (FAB) that corrects misalignments between decoder outputs and IR feature maps by leveraging deformable convolutions.
  arXiv  Detail & Related papers  (2025-01-25T06:21:06Z)
• CapHDR2IR: Caption-Driven Transfer from Visible Light to Infrared Domain [7.007302908953179]
  Infrared (IR) imaging offers advantages in several fields due to its unique ability of capturing content in extreme light conditions. As an alternative, visible light can be used to synthesize IR images but this causes a loss of fidelity in image details and introduces inconsistencies due to lack of contextual awareness of the scene.
  arXiv  Detail & Related papers  (2024-11-25T12:23:14Z)
• Contourlet Refinement Gate Framework for Thermal Spectrum Distribution Regularized Infrared Image Super-Resolution [54.293362972473595]
  Image super-resolution (SR) aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts. Current approaches to address SR tasks are either dedicated to extracting RGB image features or assuming similar degradation patterns. We propose a Contourlet refinement gate framework to restore infrared modal-specific features while preserving spectral distribution fidelity.
  arXiv  Detail & Related papers  (2024-11-19T14:24:03Z)
• IRSAM: Advancing Segment Anything Model for Infrared Small Target Detection [55.554484379021524]
  Infrared Small Target Detection (IRSTD) task falls short in achieving satisfying performance due to a notable domain gap between natural and infrared images. We propose the IRSAM model for IRSTD, which improves SAM's encoder-decoder architecture to learn better feature representation of infrared small objects.
  arXiv  Detail & Related papers  (2024-07-10T10:17:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.