Local Motion and Contrast Priors Driven Deep Network for Infrared Small
Target Super-Resolution
- URL: http://arxiv.org/abs/2201.01014v5
- Date: Tue, 4 Apr 2023 14:25:10 GMT
- Title: Local Motion and Contrast Priors Driven Deep Network for Infrared Small
Target Super-Resolution
- Authors: Xinyi Ying, Yingqian Wang, Longguang Wang, Weidong Sheng, Li Liu,
Zaiping Lin, Shilin Zhou
- Abstract summary: Infrared small target super-resolution (SR) aims to recover reliable and high-resolution image with high-contrast targets from its low-resolution counterparts.
We propose the first infrared small target SR method named local motion and contrast prior deep network (MoCoPnet)
MoCoPnet integrates domain knowledge of infrared small target into deep deep network, which can mitigate feature scarcity of small infrared targets.
- Score: 24.131639832686083
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Infrared small target super-resolution (SR) aims to recover reliable and
detailed high-resolution image with high-contrast targets from its
low-resolution counterparts. Since the infrared small target lacks color and
fine structure information, it is significant to exploit the supplementary
information among sequence images to enhance the target. In this paper, we
propose the first infrared small target SR method named local motion and
contrast prior driven deep network (MoCoPnet) to integrate the domain knowledge
of infrared small target into deep network, which can mitigate the intrinsic
feature scarcity of infrared small targets. Specifically, motivated by the
local motion prior in the spatio-temporal dimension, we propose a local
spatio-temporal attention module to perform implicit frame alignment and
incorporate the local spatio-temporal information to enhance the local features
(especially for small targets). Motivated by the local contrast prior in the
spatial dimension, we propose a central difference residual group to
incorporate the central difference convolution into the feature extraction
backbone, which can achieve center-oriented gradient-aware feature extraction
to further improve the target contrast. Extensive experiments have demonstrated
that our method can recover accurate spatial dependency and improve the target
contrast. Comparative results show that MoCoPnet can outperform the
state-of-the-art video SR and single image SR methods in terms of both SR
performance and target enhancement. Based on the SR results, we further
investigate the influence of SR on infrared small target detection and the
experimental results demonstrate that MoCoPnet promotes the detection
performance. The code is available at https://github.com/XinyiYing/MoCoPnet.
Related papers
- Sparse Prior Is Not All You Need: When Differential Directionality Meets Saliency Coherence for Infrared Small Target Detection [15.605122893098981]
This study introduces a Sparse Differential Directionality prior (SDD) framework.
We leverage the distinct directional characteristics of targets to differentiate them from the background.
We further enhance target detectability with a saliency coherence strategy.
A Proximal Alternating Minimization-based (PAM) algorithm efficiently solves our proposed model.
arXiv Detail & Related papers (2024-07-22T04:32:43Z) - IRSAM: Advancing Segment Anything Model for Infrared Small Target Detection [55.554484379021524]
Infrared Small Target Detection (IRSTD) task falls short in achieving satisfying performance due to a notable domain gap between natural and infrared images.
We propose the IRSAM model for IRSTD, which improves SAM's encoder-decoder architecture to learn better feature representation of infrared small objects.
arXiv Detail & Related papers (2024-07-10T10:17:57Z) - Multi-Scale Direction-Aware Network for Infrared Small Target Detection [2.661766509317245]
Infrared small target detection faces the problem that it is difficult to effectively separate the background and the target.
We propose a multi-scale direction-aware network (MSDA-Net) to integrate the high-frequency directional features of infrared small targets.
MSDA-Net achieves state-of-the-art (SOTA) results on the public NUDT-SIRST, SIRST and IRSTD-1k datasets.
arXiv Detail & Related papers (2024-06-04T07:23:09Z) - SIRST-5K: Exploring Massive Negatives Synthesis with Self-supervised
Learning for Robust Infrared Small Target Detection [53.19618419772467]
Single-frame infrared small target (SIRST) detection aims to recognize small targets from clutter backgrounds.
With the development of Transformer, the scale of SIRST models is constantly increasing.
With a rich diversity of infrared small target data, our algorithm significantly improves the model performance and convergence speed.
arXiv Detail & Related papers (2024-03-08T16:14:54Z) - SpirDet: Towards Efficient, Accurate and Lightweight Infrared Small
Target Detector [60.42293239557962]
We propose SpirDet, a novel approach for efficient detection of infrared small targets.
We employ a new dual-branch sparse decoder to restore the feature map.
Extensive experiments show that the proposed SpirDet significantly outperforms state-of-the-art models.
arXiv Detail & Related papers (2024-02-08T05:06:14Z) - Point-aware Interaction and CNN-induced Refinement Network for RGB-D
Salient Object Detection [95.84616822805664]
We introduce CNNs-assisted Transformer architecture and propose a novel RGB-D SOD network with Point-aware Interaction and CNN-induced Refinement.
In order to alleviate the block effect and detail destruction problems brought by the Transformer naturally, we design a CNN-induced refinement (CNNR) unit for content refinement and supplementation.
arXiv Detail & Related papers (2023-08-17T11:57:49Z) - EFLNet: Enhancing Feature Learning for Infrared Small Target Detection [20.546186772828555]
Single-frame infrared small target detection is considered to be a challenging task.
Due to the extreme imbalance between target and background, bounding box regression is extremely sensitive to infrared small target.
We propose an enhancing feature learning network (EFLNet) to address these problems.
arXiv Detail & Related papers (2023-07-27T09:23:22Z) - Infrared Small-Dim Target Detection with Transformer under Complex
Backgrounds [155.388487263872]
We propose a new infrared small-dim target detection method with the transformer.
We adopt the self-attention mechanism of the transformer to learn the interaction information of image features in a larger range.
We also design a feature enhancement module to learn more features of small-dim targets.
arXiv Detail & Related papers (2021-09-29T12:23:41Z) - Dense Nested Attention Network for Infrared Small Target Detection [36.654692765557726]
Single-frame infrared small target (SIRST) detection aims at separating small targets from clutter backgrounds.
Existing CNN-based methods cannot be directly applied for infrared small targets.
We propose a dense nested attention network (DNANet) in this paper.
arXiv Detail & Related papers (2021-06-01T13:45:35Z) - A Single Stream Network for Robust and Real-time RGB-D Salient Object
Detection [89.88222217065858]
We design a single stream network to use the depth map to guide early fusion and middle fusion between RGB and depth.
This model is 55.5% lighter than the current lightest model and runs at a real-time speed of 32 FPS when processing a $384 times 384$ image.
arXiv Detail & Related papers (2020-07-14T04:40:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.