Monte Carlo Linear Clustering with Single-Point Supervision is Enough
for Infrared Small Target Detection
- URL: http://arxiv.org/abs/2304.04442v1
- Date: Mon, 10 Apr 2023 08:04:05 GMT
- Title: Monte Carlo Linear Clustering with Single-Point Supervision is Enough
for Infrared Small Target Detection
- Authors: Boyang Li and Yingqian Wang and Longguang Wang and Fei Zhang and Ting
Liu and Zaiping Lin and Wei An and Yulan Guo
- Abstract summary: Single-frame infrared small target (SIRST) detection aims at separating small targets from clutter backgrounds on infrared images.
Deep learning based methods have achieved promising performance on SIRST detection, but at the cost of a large amount of training data.
We propose the first method to achieve SIRST detection with single-point supervision.
- Score: 48.707233614642796
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Single-frame infrared small target (SIRST) detection aims at separating small
targets from clutter backgrounds on infrared images. Recently, deep learning
based methods have achieved promising performance on SIRST detection, but at
the cost of a large amount of training data with expensive pixel-level
annotations. To reduce the annotation burden, we propose the first method to
achieve SIRST detection with single-point supervision. The core idea of this
work is to recover the per-pixel mask of each target from the given single
point label by using clustering approaches, which looks simple but is indeed
challenging since targets are always insalient and accompanied with background
clutters. To handle this issue, we introduce randomness to the clustering
process by adding noise to the input images, and then obtain much more reliable
pseudo masks by averaging the clustered results. Thanks to this "Monte Carlo"
clustering approach, our method can accurately recover pseudo masks and thus
turn arbitrary fully supervised SIRST detection networks into weakly supervised
ones with only single point annotation. Experiments on four datasets
demonstrate that our method can be applied to existing SIRST detection networks
to achieve comparable performance with their fully supervised counterparts,
which reveals that single-point supervision is strong enough for SIRST
detection. Our code will be available at:
https://github.com/YeRen123455/SIRST-Single-Point-Supervision.
Related papers
- Bridge the Points: Graph-based Few-shot Segment Anything Semantically [79.1519244940518]
Recent advancements in pre-training techniques have enhanced the capabilities of vision foundation models.
Recent studies extend the SAM to Few-shot Semantic segmentation (FSS)
We propose a simple yet effective approach based on graph analysis.
arXiv Detail & Related papers (2024-10-09T15:02:28Z) - Hybrid Mask Generation for Infrared Small Target Detection with Single-Point Supervision [18.168923054036682]
Single-frame infrared small target (SIRST) detection poses a significant challenge due to the requirement to discern minute targets.
We introduce a Hybrid Mask Generation approach that recovers high-quality masks for each target from only a single-point label for network training.
Experimental results across three datasets demonstrate that our method outperforms the existing methods for infrared small target detection with single-point supervision.
arXiv Detail & Related papers (2024-09-06T03:34:44Z) - One Shot is Enough for Sequential Infrared Small Target Segmentation [9.354927663020586]
Infrared small target sequences exhibit strong similarities between frames and contain rich contextual information.
We propose a one-shot and training-free method that perfectly adapts SAM's zero-shot generalization capability to sequential IRSTS.
Experiments demonstrate that our method requires only one shot to achieve comparable performance to state-of-the-art IRSTS methods.
arXiv Detail & Related papers (2024-08-09T02:36:56Z) - Refined Infrared Small Target Detection Scheme with Single-Point Supervision [2.661766509317245]
We propose an innovative refined infrared small target detection scheme with single-point supervision.
The proposed scheme achieves state-of-the-art (SOTA) performance.
Notably, the proposed scheme won the third place in the "ICPR 2024 Resource-Limited Infrared Small Target Detection Challenge Track 1: Weakly Supervised Infrared Small Target Detection"
arXiv Detail & Related papers (2024-08-05T18:49:58Z) - SIRST-5K: Exploring Massive Negatives Synthesis with Self-supervised
Learning for Robust Infrared Small Target Detection [53.19618419772467]
Single-frame infrared small target (SIRST) detection aims to recognize small targets from clutter backgrounds.
With the development of Transformer, the scale of SIRST models is constantly increasing.
With a rich diversity of infrared small target data, our algorithm significantly improves the model performance and convergence speed.
arXiv Detail & Related papers (2024-03-08T16:14:54Z) - One-Stage Cascade Refinement Networks for Infrared Small Target
Detection [21.28595135499812]
Single-frame InfraRed Small Target (SIRST) detection has been a challenging task due to a lack of inherent characteristics.
We present a new research benchmark for infrared small target detection consisting of the SIRST-V2 dataset of real-world, high-resolution single-frame targets.
arXiv Detail & Related papers (2022-12-16T13:37:23Z) - Object Detection Made Simpler by Eliminating Heuristic NMS [70.93004137521946]
We show a simple NMS-free, end-to-end object detection framework.
We attain on par or even improved detection accuracy compared with the original one-stage detector.
arXiv Detail & Related papers (2021-01-28T02:38:29Z) - Fast Single-shot Ship Instance Segmentation Based on Polar Template Mask
in Remote Sensing Images [7.45725819658858]
We propose a single-shot convolutional neural network structure, which is conceptually simple and straightforward.
Our method, termed with SSS-Net, detects targets based on the location of the object's center.
Experiments on both the Airbus Ship Detection Challenge dataset and the ISAIDships dataset show that SSS-Net has strong competitiveness in precision and speed for ship instance segmentation.
arXiv Detail & Related papers (2020-08-28T02:38:04Z) - A Self-Training Approach for Point-Supervised Object Detection and
Counting in Crowds [54.73161039445703]
We propose a novel self-training approach that enables a typical object detector trained only with point-level annotations.
During training, we utilize the available point annotations to supervise the estimation of the center points of objects.
Experimental results show that our approach significantly outperforms state-of-the-art point-supervised methods under both detection and counting tasks.
arXiv Detail & Related papers (2020-07-25T02:14:42Z) - Detection in Crowded Scenes: One Proposal, Multiple Predictions [79.28850977968833]
We propose a proposal-based object detector, aiming at detecting highly-overlapped instances in crowded scenes.
The key of our approach is to let each proposal predict a set of correlated instances rather than a single one in previous proposal-based frameworks.
Our detector can obtain 4.9% AP gains on challenging CrowdHuman dataset and 1.0% $textMR-2$ improvements on CityPersons dataset.
arXiv Detail & Related papers (2020-03-20T09:48:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.