InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection

• URL: http://arxiv.org/abs/2607.03795v1
• Date: Sat, 04 Jul 2026 09:49:53 GMT
• Title: InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection
• Abstract summary: InfraNet is a quality-aware framework that regulates RGB guidance during training and supports flexible RGB--IR or IR-only deployment.<n>Our method is evaluated through extensive experiments on four benchmark datasets (LLVIP, FLIR-Aligned, M$3$FD, and DroneVehicle)
• Score: 31.00284151416272
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robust object detection under adverse visual conditions remains a long-standing challenge for multi-modal perception systems. Existing fusion-based methods typically require both RGB and infrared (IR) inputs, and treat them equally during both training and inference, which compromises their robustness when the RGB modality becomes unreliable or unavailable. In this case, we propose \textbf{InfraNet}, an IR-centric quality-aware framework that regulates RGB guidance during training and supports flexible RGB--IR or IR-only deployment. InfraNet employs an asymmetric architecture where the primary IR pathway extracts multi-scale infrared features for predictions, while the auxiliary RGB pathway provides reliability-controlled supervisory signals. The core of InfraNet is \textbf{QualGate}, a quality-aware fusion module that learns a task-oriented control signal to suppress unreliable RGB guidance and compensate IR features during cross-modal training. Built upon InfraNet, we design two architectural variants: a lightweight IR-only architecture InfraNet-IR and an RGB--IR architecture InfraNet-RGB-IR. Our method is evaluated through extensive experiments on four benchmark datasets (LLVIP, FLIR-Aligned, M$^3$FD, and DroneVehicle), showing strong or competitive accuracy in challenging low-light and adverse weather conditions. Notably, InfraNet maintains high efficiency in IR-only inference, making it both accurate and computationally efficient.

Related papers

• RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains [0.6475189298553835]
  This work investigates whether modern generative translators can overcome this cross-modal gap to improve infrared vehicle detection on unseen UAV target domains.<n> Translators are trained on paired RGB-IR source datasets and applied to RGB training images from held-out target datasets to generate synthetic IR data.<n>The resulting synthetic IR imagery is used to train RF-DETR vehicle detectors, which are evaluated on unseen IR target test splits across five aerial datasets.
  arXiv  Detail & Related papers  (2026-09-02T13:06:58Z)
• FaithIR: Rethinking Infrared Image Super-Resolution from Perceptual Sharpness to Task Relevant Fidelity [50.75932774177958]
  FaithIR is a faithful infrared super-resolution framework for reliable machine perception.<n>Experiments on FLIR-IISR, M3FD, and FMB demonstrate strong reconstruction fidelity, cross-dataset generalization, and superior performance in object detection and semantic segmentation.
  arXiv  Detail & Related papers  (2026-08-04T04:23:30Z)
• IR275K: A Benchmark for Infrared Multi-Frame Super-Resolution Toward Efficient Remote Sensing [10.081515566603645]
  We introduce IR275K, a curated benchmark containing 594 infrared video sequences and 275,196 frames.<n>It provides sequence-level train/validation/test splits and a reproducible X4 evaluation protocol.<n>We further evaluate CGMamba, a lightweight state-space model with 10.90M parameters and 112.14G FLOPs.
  arXiv  Detail & Related papers  (2026-07-24T15:06:17Z)
• IrisNet: Infrared Image Status Awareness Meta Decoder for Infrared Small Targets Detection [92.56025546608699]
  IrisNet is a novel meta-learned framework that adapts detection strategies to the input infrared image status.<n>Our approach establishes a dynamic mapping between infrared image features and entire decoder parameters.<n> Experiments on NUDT-SIRST, NUAA-SIRST, and IRSTD-1K datasets demonstrate the superiority of our IrisNet.
  arXiv  Detail & Related papers  (2025-11-25T13:53:54Z)
• SWIR-LightFusion: Multi-spectral Semantic Fusion of Synthetic SWIR with Thermal IR (LWIR/MWIR) and RGB [6.054759773528757]
  We propose a synthetically generate SWIR-like structural/contrast cues without claiming spectral reproduction.<n>We then propose a multimodal fusion framework integrating synthetic SWIR, LWIR, and RGB modalities.<n>The outcomes highlight substantial potential for real-world applications in surveillance and autonomous systems.
  arXiv  Detail & Related papers  (2025-10-15T11:00:41Z)
• WiSE-OD: Benchmarking Robustness in Infrared Object Detection [12.115815831689265]
  WiSE-OD is a weight-space ensembling method with two variants: WiSE-OD$_ZS$, which combines RGB zero-shot and IR fine-tuned weights, and WiSE-OD$_LP$, which blends zero-shot and linear probing.<n>We introduce LLVIP-C and FLIR-C, two cross-modality out-of-distribution benchmarks built by applying corruption to standard IR datasets.
  arXiv  Detail & Related papers  (2025-07-25T03:33:50Z)
• Multispectral Detection Transformer with Infrared-Centric Feature Fusion [8.762314897895175]
  Infrared-Centric Fusion (IC-Fusion) is a lightweight and modality-aware sensor fusion method.<n>IC-Fusion prioritizes infrared features while effectively integrating complementary RGB semantic context.<n> Experiments on the FLIR and LLVIP benchmarks demonstrate the superior effectiveness and efficiency of our IR-centric fusion strategy.
  arXiv  Detail & Related papers  (2025-05-21T05:44:14Z)
• Multi-Domain Biometric Recognition using Body Embeddings [51.36007967653781]
  We show that body embeddings perform better than face embeddings in medium-wave infrared (MWIR) and long-wave infrared (LWIR) domains.<n>We leverage a vision transformer architecture to establish benchmark results on the IJB-MDF dataset.<n>We also show that finetuning a body model, pretrained exclusively on VIS data, with a simple combination of cross-entropy and triplet losses achieves state-of-the-art mAP scores.
  arXiv  Detail & Related papers  (2025-03-13T22:38:18Z)
• Bringing RGB and IR Together: Hierarchical Multi-Modal Enhancement for Robust Transmission Line Detection [67.02804741856512]
  We propose a novel Hierarchical Multi-Modal Enhancement Network (HMMEN) that integrates RGB and IR data for robust and accurate TL detection.<n>Our method introduces two key components: (1) a Mutual Multi-Modal Enhanced Block (MMEB), which fuses and enhances hierarchical RGB and IR feature maps in a coarse-to-fine manner, and (2) a Feature Alignment Block (FAB) that corrects misalignments between decoder outputs and IR feature maps by leveraging deformable convolutions.
  arXiv  Detail & Related papers  (2025-01-25T06:21:06Z)
• Contourlet Refinement Gate Framework for Thermal Spectrum Distribution Regularized Infrared Image Super-Resolution [54.293362972473595]
  Image super-resolution (SR) aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts. Current approaches to address SR tasks are either dedicated to extracting RGB image features or assuming similar degradation patterns. We propose a Contourlet refinement gate framework to restore infrared modal-specific features while preserving spectral distribution fidelity.
  arXiv  Detail & Related papers  (2024-11-19T14:24:03Z)
• CIR-Net: Cross-modality Interaction and Refinement for RGB-D Salient Object Detection [144.66411561224507]
  We present a convolutional neural network (CNN) model, named CIR-Net, based on the novel cross-modality interaction and refinement. Our network outperforms the state-of-the-art saliency detectors both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2022-10-06T11:59:19Z)
• Robust Environment Perception for Automated Driving: A Unified Learning Pipeline for Visual-Infrared Object Detection [2.478658210785]
  We exploit both visual and thermal perception units for robust object detection purposes. In this paper, we exploit both visual and thermal perception units for robust object detection purposes.
  arXiv  Detail & Related papers  (2022-06-08T15:02:58Z)
• Data-Level Recombination and Lightweight Fusion Scheme for RGB-D Salient Object Detection [73.31632581915201]
  We propose a novel data-level recombination strategy to fuse RGB with D (depth) before deep feature extraction. A newly lightweight designed triple-stream network is applied over these novel formulated data to achieve an optimal channel-wise complementary fusion status between the RGB and D.
  arXiv  Detail & Related papers  (2020-08-07T10:13:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.