Deep learning based infrared small object segmentation: Challenges and future directions

• URL: http://arxiv.org/abs/2502.14168v1
• Date: Thu, 20 Feb 2025 00:35:14 GMT
• Title: Deep learning based infrared small object segmentation: Challenges and future directions
• Authors: Zhengeng Yang, Hongshan Yu, Jianjun Zhang, Qiang Tang, Ajmal Mian,
• Abstract summary: Infrared sensing is a core method for supporting unmanned systems, such as autonomous vehicles and drones. Deep learning has been applied for object recognition in infrared images. This paper critically analyzes existing techniques in this domain, identifies unsolved challenges and provides future research directions.
• Score: 29.48971427905328
• License:
• Abstract: Infrared sensing is a core method for supporting unmanned systems, such as autonomous vehicles and drones. Recently, infrared sensors have been widely deployed on mobile and stationary platforms for detection and classification of objects from long distances and in wide field of views. Given its success in the vision image analysis domain, deep learning has also been applied for object recognition in infrared images. However, techniques that have proven successful in visible light perception face new challenges in the infrared domain. These challenges include extremely low signal-to-noise ratios in infrared images, very small and blurred objects of interest, and limited availability of labeled/unlabeled training data due to the specialized nature of infrared sensors. Numerous methods have been proposed in the literature for the detection and classification of small objects in infrared images achieving varied levels of success. There is a need for a survey paper that critically analyzes existing techniques in this domain, identifies unsolved challenges and provides future research directions. This paper fills the gap and offers a concise and insightful review of deep learning-based methods. It also identifies the challenges faced by existing infrared object segmentation methods and provides a structured review of existing infrared perception methods from the perspective of these challenges and highlights the motivations behind the various approaches. Finally, this review suggests promising future directions based on recent advancements within this domain.

Related papers

• Infrared and Visible Image Fusion: From Data Compatibility to Task Adaption [65.06388526722186]
  Infrared-visible image fusion is a critical task in computer vision. There is a lack of recent comprehensive surveys that address this rapidly expanding domain. We introduce a multi-dimensional framework to elucidate common learning-based IVIF methods.
  arXiv  Detail & Related papers  (2025-01-18T13:17:34Z)
• Small Aerial Target Detection for Airborne Infrared Detection Systems using LightGBM and Trajectory Constraints [10.00266996583567]
  A simple and effective small aerial target detection method for airborne infrared detection system is proposed in this article. Experiments on public datasets demonstrate that the proposed method performs better than other existing methods. To the best of our knowledge, this dataset has the largest data scale and richest scene types within this field.
  arXiv  Detail & Related papers  (2024-07-01T13:33:40Z)
• Small and Dim Target Detection in IR Imagery: A Review [9.941925002794262]
  This is the first review in the field of small and dim target detection in infrared imagery. There are two main types of approaches: methodologies using several frames for detection, and single-frame-based detection techniques. Our findings indicate that deep learning approaches perform better than traditional image processing-based approaches.
  arXiv  Detail & Related papers  (2023-11-27T22:25:46Z)
• Low-light Pedestrian Detection in Visible and Infrared Image Feeds: Issues and Challenges [2.6565101124248502]
  This study reviews recent developments in low-light pedestrian detection approaches. It systematically categorizes and analyses various algorithms from region-based to non-region-based and graph-based learning methodologies. It outlines the key benchmark datasets that can be used for research and development of advanced pedestrian detection algorithms.
  arXiv  Detail & Related papers  (2023-11-14T21:39:15Z)
• Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advances [51.70835702029498]
  This review aims to present a comprehensive review of the recent achievements in deep learning based RSOD methods. We identify five main challenges in RSOD, including multi-scale object detection, rotated object detection, weak object detection, tiny object detection, and object detection with limited supervision. We also review the widely used benchmark datasets and evaluation metrics within the field of RSOD, as well as the application scenarios for RSOD.
  arXiv  Detail & Related papers  (2023-09-13T06:48:32Z)
• Oriented Object Detection in Optical Remote Sensing Images using Deep Learning: A Survey [10.665235711722076]
  Oriented object detection is one of the most fundamental and challenging tasks in remote sensing. Recent years have witnessed remarkable progress in oriented object detection using deep learning techniques.
  arXiv  Detail & Related papers  (2023-02-21T06:31:53Z)
• Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection [65.30079184700755]
  This study addresses the issue of fusing infrared and visible images that appear differently for object detection. Previous approaches discover commons underlying the two modalities and fuse upon the common space either by iterative optimization or deep networks. This paper proposes a bilevel optimization formulation for the joint problem of fusion and detection, and then unrolls to a target-aware Dual Adversarial Learning (TarDAL) network for fusion and a commonly used detection network.
  arXiv  Detail & Related papers  (2022-03-30T11:44:56Z)
• The State of Aerial Surveillance: A Survey [62.198765910573556]
  This paper provides a comprehensive overview of human-centric aerial surveillance tasks from a computer vision and pattern recognition perspective. The main object of interest is humans, where single or multiple subjects are to be detected, identified, tracked, re-identified and have their behavior analyzed.
  arXiv  Detail & Related papers  (2022-01-09T20:13:27Z)
• Infrared Small-Dim Target Detection with Transformer under Complex Backgrounds [155.388487263872]
  We propose a new infrared small-dim target detection method with the transformer. We adopt the self-attention mechanism of the transformer to learn the interaction information of image features in a larger range. We also design a feature enhancement module to learn more features of small-dim targets.
  arXiv  Detail & Related papers  (2021-09-29T12:23:41Z)
• Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities [52.59080024266596]
  We present a survey of the state-of-the-art deep learning methods for sensor-based human activity recognition. We first introduce the multi-modality of the sensory data and provide information for public datasets. We then propose a new taxonomy to structure the deep methods by challenges.
  arXiv  Detail & Related papers  (2020-01-21T09:55:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.