RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detection
- URL: http://arxiv.org/abs/2311.00917v1
- Date: Thu, 2 Nov 2023 01:21:12 GMT
- Title: RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detection
- Authors: Fengyi Wu, Tianfang Zhang, Lei Li, Yian Huang, Zhenming Peng
- Abstract summary: This work proposes an interpretable deep network for detecting infrared dim targets, dubbed RPCANet.
Our approach formulates the ISTD task as sparse target extraction, low-rank background estimation, and image reconstruction.
By unfolding the iterative optimization updating steps into a deep-learning framework, time-consuming and complex matrix calculations are replaced by theory-guided neural networks.
- Score: 10.202639589226076
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep learning (DL) networks have achieved remarkable performance in infrared
small target detection (ISTD). However, these structures exhibit a deficiency
in interpretability and are widely regarded as black boxes, as they disregard
domain knowledge in ISTD. To alleviate this issue, this work proposes an
interpretable deep network for detecting infrared dim targets, dubbed RPCANet.
Specifically, our approach formulates the ISTD task as sparse target
extraction, low-rank background estimation, and image reconstruction in a
relaxed Robust Principle Component Analysis (RPCA) model. By unfolding the
iterative optimization updating steps into a deep-learning framework,
time-consuming and complex matrix calculations are replaced by theory-guided
neural networks. RPCANet detects targets with clear interpretability and
preserves the intrinsic image feature, instead of directly transforming the
detection task into a matrix decomposition problem. Extensive experiments
substantiate the effectiveness of our deep unfolding framework and demonstrate
its trustworthy results, surpassing baseline methods in both qualitative and
quantitative evaluations.
Related papers
- Sparse Prior Is Not All You Need: When Differential Directionality Meets Saliency Coherence for Infrared Small Target Detection [15.605122893098981]
This study introduces a Sparse Differential Directionality prior (SDD) framework.
We leverage the distinct directional characteristics of targets to differentiate them from the background.
We further enhance target detectability with a saliency coherence strategy.
A Proximal Alternating Minimization-based (PAM) algorithm efficiently solves our proposed model.
arXiv Detail & Related papers (2024-07-22T04:32:43Z) - One-Stage Cascade Refinement Networks for Infrared Small Target
Detection [21.28595135499812]
Single-frame InfraRed Small Target (SIRST) detection has been a challenging task due to a lack of inherent characteristics.
We present a new research benchmark for infrared small target detection consisting of the SIRST-V2 dataset of real-world, high-resolution single-frame targets.
arXiv Detail & Related papers (2022-12-16T13:37:23Z) - A Deep-Unfolded Spatiotemporal RPCA Network For L+S Decomposition [18.842185919365082]
We propose a novel deep unfolded RPCA (DUST-RPCA) network, which explicitly takes advantage of the spatial and temporal continuity in the low-rank component.
Our experimental results on the moving MNIST dataset indicate that DUST-RPCA gives better accuracy when compared with the existing state of the art deep unfolded RPCA networks.
arXiv Detail & Related papers (2022-11-06T17:33:30Z) - MPANet: Multi-Patch Attention For Infrared Small Target object Detection [11.437699171778544]
Infrared small target detection (ISTD) has attracted widespread attention and been applied in various fields.
Due to the small size of infrared targets and the noise interference from complex backgrounds, the performance of ISTD using convolutional neural networks (CNNs) is restricted.
A multi-patch attention network (MPANet) based on the axial-attention encoder and the multi-scale patch branch (MSPB) structure is proposed.
arXiv Detail & Related papers (2022-06-05T08:01:38Z) - Robust lEarned Shrinkage-Thresholding (REST): Robust unrolling for
sparse recover [87.28082715343896]
We consider deep neural networks for solving inverse problems that are robust to forward model mis-specifications.
We design a new robust deep neural network architecture by applying algorithm unfolding techniques to a robust version of the underlying recovery problem.
The proposed REST network is shown to outperform state-of-the-art model-based and data-driven algorithms in both compressive sensing and radar imaging problems.
arXiv Detail & Related papers (2021-10-20T06:15:45Z) - Infrared Small-Dim Target Detection with Transformer under Complex
Backgrounds [155.388487263872]
We propose a new infrared small-dim target detection method with the transformer.
We adopt the self-attention mechanism of the transformer to learn the interaction information of image features in a larger range.
We also design a feature enhancement module to learn more features of small-dim targets.
arXiv Detail & Related papers (2021-09-29T12:23:41Z) - Dense Nested Attention Network for Infrared Small Target Detection [36.654692765557726]
Single-frame infrared small target (SIRST) detection aims at separating small targets from clutter backgrounds.
Existing CNN-based methods cannot be directly applied for infrared small targets.
We propose a dense nested attention network (DNANet) in this paper.
arXiv Detail & Related papers (2021-06-01T13:45:35Z) - Anomaly Detection on Attributed Networks via Contrastive Self-Supervised
Learning [50.24174211654775]
We present a novel contrastive self-supervised learning framework for anomaly detection on attributed networks.
Our framework fully exploits the local information from network data by sampling a novel type of contrastive instance pair.
A graph neural network-based contrastive learning model is proposed to learn informative embedding from high-dimensional attributes and local structure.
arXiv Detail & Related papers (2021-02-27T03:17:20Z) - A Deep-Unfolded Reference-Based RPCA Network For Video
Foreground-Background Separation [86.35434065681925]
This paper proposes a new deep-unfolding-based network design for the problem of Robust Principal Component Analysis (RPCA)
Unlike existing designs, our approach focuses on modeling the temporal correlation between the sparse representations of consecutive video frames.
Experimentation using the moving MNIST dataset shows that the proposed network outperforms a recently proposed state-of-the-art RPCA network in the task of video foreground-background separation.
arXiv Detail & Related papers (2020-10-02T11:40:09Z) - Progressively Guided Alternate Refinement Network for RGB-D Salient
Object Detection [63.18846475183332]
We aim to develop an efficient and compact deep network for RGB-D salient object detection.
We propose a progressively guided alternate refinement network to refine it.
Our model outperforms existing state-of-the-art approaches by a large margin.
arXiv Detail & Related papers (2020-08-17T02:55:06Z) - Depthwise Non-local Module for Fast Salient Object Detection Using a
Single Thread [136.2224792151324]
We propose a new deep learning algorithm for fast salient object detection.
The proposed algorithm achieves competitive accuracy and high inference efficiency simultaneously with a single CPU thread.
arXiv Detail & Related papers (2020-01-22T15:23:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.