Towards Robust Infrared Small Target Detection: A Feature-Enhanced and Sensitivity-Tunable Framework

• URL: http://arxiv.org/abs/2407.20090v2
• Date: Tue, 22 Apr 2025 13:28:27 GMT
• Title: Towards Robust Infrared Small Target Detection: A Feature-Enhanced and Sensitivity-Tunable Framework
• Authors: Jinmiao Zhao, Zelin Shi, Chuang Yu, Yunpeng Liu, Yimian Dai,
• Abstract summary: We propose a feature-enhanced and sensitivity-tunable (FEST) framework, which is compatible with existing SIRST detection networks.<n>We show that our FEST framework can significantly enhance the performance of existing SIRST detection networks.<n> Notably, the multi-scale direction-aware network (MSDA-Net) equipped with the FEST framework won the first prize in the PRCV 2024 wide-area infrared small target detection competition.
• Score: 2.4810332733338623
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, single-frame infrared small target (SIRST) detection technology has attracted wide-spread attention. However, due to the intrinsic feature scarcity in infrared small targets, precise segmentation of small targets from complex backgrounds remains a significant challenge. Different from most existing deep learning-based methods that focus on improving network architectures, we propose a feature-enhanced and sensitivity-tunable (FEST) framework, which is compatible with existing SIRST detection networks and further enhances their detection performance. The FEST framework improves the model's robustness from two aspects: feature enhancement and target confidence regulation. For feature enhancement, on the one hand, we adopt a multi-scale fusion strategy, which can effectively improve the model's perception and adaptability to multi-scale features of multi-size targets. On the other hand, we construct an edge enhancement difficulty mining (EEDM) loss based on the analysis of the task characteristics, which helps guide the network to continuously focus on challenging target regions and edge features during training. For target confidence regulation, we design an adjustable sensitivity (AS) strategy for network post-processing. This strategy not only enhances the adaptability of the network in complex scenarios, but also significantly improves the detection rate of infrared small targets while maintaining segmentation accuracy. Extensive experimental results show that our FEST framework can significantly enhance the performance of existing SIRST detection networks. Notably, the multi-scale direction-aware network (MSDA-Net) equipped with the FEST framework won the first prize in the PRCV 2024 wide-area infrared small target detection competition.

Related papers

• 10K is Enough: An Ultra-Lightweight Binarized Network for Infrared Small-Target Detection [48.074211420276605]
  Binarized neural networks (BNNs) are distinguished by their exceptional efficiency in model compression. We propose the Binarized Infrared Small-Target Detection Network (BiisNet) BiisNet preserves the core operations of binarized convolutions while integrating full-precision features into the network's information flow.
  arXiv  Detail & Related papers  (2025-03-04T14:25:51Z)
• Auto-RT: Automatic Jailbreak Strategy Exploration for Red-Teaming Large Language Models [62.12822290276912]
  Auto-RT is a reinforcement learning framework that automatically explores and optimize complex attack strategies. By significantly improving exploration efficiency and automatically optimizing attack strategies, Auto-RT detects a boarder range of vulnerabilities, achieving a faster detection speed and 16.63% higher success rates compared to existing methods.
  arXiv  Detail & Related papers  (2025-01-03T14:30:14Z)
• YOLO-MST: Multiscale deep learning method for infrared small target detection based on super-resolution and YOLO [0.18641315013048293]
  This paper proposes a deep-learning infrared small target detection method that combines image super-resolution technology with multi-scale observation. The mAP@0.5 detection rates of this method on two public datasets, SIRST and IRIS, reached 96.4% and 99.5% respectively.
  arXiv  Detail & Related papers  (2024-12-27T18:43:56Z)
• From Easy to Hard: Progressive Active Learning Framework for Infrared Small Target Detection with Single Point Supervision [18.555485444818835]
  We construct an innovative Progressive Active Learning (PAL) framework for single point supervision. We propose a model pre-start concept, which focuses on automatically selecting a portion of easy samples. We show that existing SIRST detection networks equipped with our PAL framework have achieved state-of-the-art (SOTA) results on multiple public datasets.
  arXiv  Detail & Related papers  (2024-12-15T11:08:49Z)
• LR-Net: A Lightweight and Robust Network for Infrared Small Target Detection [2.6617665093172445]
  We propose an innovative lightweight and robust network (LR-Net) LR-Net abandons the complex structure and achieves an effective balance between detection accuracy and resource consumption. We achieve 3rd place in the "ICPR 2024 Resource-Limited Infrared Small Target Detection Challenge Track 2: Lightweight Infrared Small Target Detection"
  arXiv  Detail & Related papers  (2024-08-05T18:57:33Z)
• Refined Infrared Small Target Detection Scheme with Single-Point Supervision [2.661766509317245]
  We propose an innovative refined infrared small target detection scheme with single-point supervision. The proposed scheme achieves state-of-the-art (SOTA) performance. Notably, the proposed scheme won the third place in the "ICPR 2024 Resource-Limited Infrared Small Target Detection Challenge Track 1: Weakly Supervised Infrared Small Target Detection"
  arXiv  Detail & Related papers  (2024-08-05T18:49:58Z)
• Single-Point Supervised High-Resolution Dynamic Network for Infrared Small Target Detection [7.0456782736205685]
  We propose a single-point supervised high-resolution dynamic network (SSHD-Net) It achieves state-of-the-art (SOTA) detection performance using only single-point supervision. Experiments on the publicly available datasets NUDT-SIRST and IRSTD-1k demonstrate the effectiveness of our method.
  arXiv  Detail & Related papers  (2024-08-04T09:44:47Z)
• SIRST-5K: Exploring Massive Negatives Synthesis with Self-supervised Learning for Robust Infrared Small Target Detection [53.19618419772467]
  Single-frame infrared small target (SIRST) detection aims to recognize small targets from clutter backgrounds. With the development of Transformer, the scale of SIRST models is constantly increasing. With a rich diversity of infrared small target data, our algorithm significantly improves the model performance and convergence speed.
  arXiv  Detail & Related papers  (2024-03-08T16:14:54Z)
• SpirDet: Towards Efficient, Accurate and Lightweight Infrared Small Target Detector [60.42293239557962]
  We propose SpirDet, a novel approach for efficient detection of infrared small targets. We employ a new dual-branch sparse decoder to restore the feature map. Extensive experiments show that the proposed SpirDet significantly outperforms state-of-the-art models.
  arXiv  Detail & Related papers  (2024-02-08T05:06:14Z)
• Enhancing Infrared Small Target Detection Robustness with Bi-Level Adversarial Framework [61.34862133870934]
  We propose a bi-level adversarial framework to promote the robustness of detection in the presence of distinct corruptions. Our scheme remarkably improves 21.96% IOU across a wide array of corruptions and notably promotes 4.97% IOU on the general benchmark.
  arXiv  Detail & Related papers  (2023-09-03T06:35:07Z)
• Small Object Detection via Coarse-to-fine Proposal Generation and Imitation Learning [52.06176253457522]
  We propose a two-stage framework tailored for small object detection based on the Coarse-to-fine pipeline and Feature Imitation learning. CFINet achieves state-of-the-art performance on the large-scale small object detection benchmarks, SODA-D and SODA-A.
  arXiv  Detail & Related papers  (2023-08-18T13:13:09Z)
• EFLNet: Enhancing Feature Learning for Infrared Small Target Detection [20.546186772828555]
  Single-frame infrared small target detection is considered to be a challenging task. Due to the extreme imbalance between target and background, bounding box regression is extremely sensitive to infrared small target. We propose an enhancing feature learning network (EFLNet) to address these problems.
  arXiv  Detail & Related papers  (2023-07-27T09:23:22Z)
• A Multi-task Framework for Infrared Small Target Detection and Segmentation [9.033048310220346]
  We propose a novel end-to-end framework for infrared small target detection and segmentation. We use UNet as the backbone to maintain resolution and semantic information. We develop a multi-task framework for infrared small target detection and segmentation.
  arXiv  Detail & Related papers  (2022-06-14T15:43:34Z)
• Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection [65.30079184700755]
  This study addresses the issue of fusing infrared and visible images that appear differently for object detection. Previous approaches discover commons underlying the two modalities and fuse upon the common space either by iterative optimization or deep networks. This paper proposes a bilevel optimization formulation for the joint problem of fusion and detection, and then unrolls to a target-aware Dual Adversarial Learning (TarDAL) network for fusion and a commonly used detection network.
  arXiv  Detail & Related papers  (2022-03-30T11:44:56Z)
• Infrared Small-Dim Target Detection with Transformer under Complex Backgrounds [155.388487263872]
  We propose a new infrared small-dim target detection method with the transformer. We adopt the self-attention mechanism of the transformer to learn the interaction information of image features in a larger range. We also design a feature enhancement module to learn more features of small-dim targets.
  arXiv  Detail & Related papers  (2021-09-29T12:23:41Z)
• Uncertainty-Aware Deep Calibrated Salient Object Detection [74.58153220370527]
  Existing deep neural network based salient object detection (SOD) methods mainly focus on pursuing high network accuracy. These methods overlook the gap between network accuracy and prediction confidence, known as the confidence uncalibration problem. We introduce an uncertaintyaware deep SOD network, and propose two strategies to prevent deep SOD networks from being overconfident.
  arXiv  Detail & Related papers  (2020-12-10T23:28:36Z)
• Multiple Infrared Small Targets Detection based on Hierarchical Maximal Entropy Random Walk [12.10092482860325]
  We establish a detection method derived from maximal entropy random walk (MERW) to robustly detect multiple small targets. The proposed method is superior to the state-of-the-art methods in terms of target enhancement, background suppression and multiple small targets detection.
  arXiv  Detail & Related papers  (2020-10-02T11:11:34Z)
• Anchor-free Small-scale Multispectral Pedestrian Detection [88.7497134369344]
  We propose a method for effective and efficient multispectral fusion of the two modalities in an adapted single-stage anchor-free base architecture. We aim at learning pedestrian representations based on object center and scale rather than direct bounding box predictions. Results show our method's effectiveness in detecting small-scaled pedestrians.
  arXiv  Detail & Related papers  (2020-08-19T13:13:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.