Dual-stream contrastive predictive network with joint handcrafted
feature view for SAR ship classification
- URL: http://arxiv.org/abs/2311.15202v2
- Date: Thu, 30 Nov 2023 10:45:11 GMT
- Title: Dual-stream contrastive predictive network with joint handcrafted
feature view for SAR ship classification
- Authors: Xianting Feng, Hao zheng, Zhigang Hu, Liu Yang, Meiguang Zheng
- Abstract summary: We propose a novel dual-stream contrastive predictive network (DCPNet)
The first task is to construct positive sample pairs, guiding the core encoder to learn more general representations.
The second task is to encourage adaptive capture of the correspondence between deep features and handcrated features, achieving knowledge transfer within the model, and effectively improving the redundancy caused by the feature fusion.
- Score: 9.251342335645765
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most existing synthetic aperture radar (SAR) ship classification technologies
heavily rely on correctly labeled data, ignoring the discriminative features of
unlabeled SAR ship images. Even though researchers try to enrich CNN-based
features by introducing traditional handcrafted features, existing methods
easily cause information redundancy and fail to capture the interaction between
them. To address these issues, we propose a novel dual-stream contrastive
predictive network (DCPNet), which consists of two asymmetric task designs and
the false negative sample elimination module. The first task is to construct
positive sample pairs, guiding the core encoder to learn more general
representations. The second task is to encourage adaptive capture of the
correspondence between deep features and handcrated features, achieving
knowledge transfer within the model, and effectively improving the redundancy
caused by the feature fusion. To increase the separability between clusters, we
also design a cluster-level tasks. The experimental results on OpenSARShip and
FUSAR-Ship datasets demonstrate the improvement in classification accuracy of
supervised models and confirm the capability of learning effective
representations of DCPNet.
Related papers
- Reversible Decoupling Network for Single Image Reflection Removal [15.763420129991255]
High-level semantic clues tend to be compressed or discarded during layer-by-layer propagation.
We propose a novel architecture called Reversible Decoupling Network (RDNet)
RDNet employs a reversible encoder to secure valuable information while flexibly decoupling transmission- and reflection-relevant features during the forward pass.
arXiv Detail & Related papers (2024-10-10T15:58:27Z) - DCNN: Dual Cross-current Neural Networks Realized Using An Interactive Deep Learning Discriminator for Fine-grained Objects [48.65846477275723]
This study proposes novel dual-current neural networks (DCNN) to improve the accuracy of fine-grained image classification.
The main novel design features for constructing a weakly supervised learning backbone model DCNN include (a) extracting heterogeneous data, (b) keeping the feature map resolution unchanged, (c) expanding the receptive field, and (d) fusing global representations and local features.
arXiv Detail & Related papers (2024-05-07T07:51:28Z) - Local Consensus Enhanced Siamese Network with Reciprocal Loss for
Two-view Correspondence Learning [35.5851523517487]
Two-view correspondence learning usually establish an end-to-end network to jointly predict correspondence reliability and relative pose.
We propose a Local Feature Consensus (LFC) plugin block to augment the features of existing models.
We extend existing models to a Siamese network with a reciprocal loss that exploits the supervision of mutual projection.
arXiv Detail & Related papers (2023-08-06T22:20:09Z) - Collaborative Reflection-Augmented Autoencoder Network for Recommender
Systems [23.480069921831344]
We develop a Collaborative Reflection-Augmented Autoencoder Network (CRANet)
CRANet is capable of exploring transferable knowledge from observed and unobserved user-item interactions.
We experimentally validate CRANet on four diverse benchmark datasets corresponding to two recommendation tasks.
arXiv Detail & Related papers (2022-01-10T04:36:15Z) - Adversarial Feature Augmentation and Normalization for Visual
Recognition [109.6834687220478]
Recent advances in computer vision take advantage of adversarial data augmentation to ameliorate the generalization ability of classification models.
Here, we present an effective and efficient alternative that advocates adversarial augmentation on intermediate feature embeddings.
We validate the proposed approach across diverse visual recognition tasks with representative backbone networks.
arXiv Detail & Related papers (2021-03-22T20:36:34Z) - AFD-Net: Adaptive Fully-Dual Network for Few-Shot Object Detection [8.39479809973967]
Few-shot object detection (FSOD) aims at learning a detector that can fast adapt to previously unseen objects with scarce examples.
Existing methods solve this problem by performing subtasks of classification and localization utilizing a shared component.
We present that a general few-shot detector should consider the explicit decomposition of two subtasks, as well as leveraging information from both of them to enhance feature representations.
arXiv Detail & Related papers (2020-11-30T10:21:32Z) - Towards Accurate Knowledge Transfer via Target-awareness Representation
Disentanglement [56.40587594647692]
We propose a novel transfer learning algorithm, introducing the idea of Target-awareness REpresentation Disentanglement (TRED)
TRED disentangles the relevant knowledge with respect to the target task from the original source model and used as a regularizer during fine-tuning the target model.
Experiments on various real world datasets show that our method stably improves the standard fine-tuning by more than 2% in average.
arXiv Detail & Related papers (2020-10-16T17:45:08Z) - Dual-constrained Deep Semi-Supervised Coupled Factorization Network with
Enriched Prior [80.5637175255349]
We propose a new enriched prior based Dual-constrained Deep Semi-Supervised Coupled Factorization Network, called DS2CF-Net.
To ex-tract hidden deep features, DS2CF-Net is modeled as a deep-structure and geometrical structure-constrained neural network.
Our network can obtain state-of-the-art performance for representation learning and clustering.
arXiv Detail & Related papers (2020-09-08T13:10:21Z) - Dual Adversarial Auto-Encoders for Clustering [152.84443014554745]
We propose Dual Adversarial Auto-encoder (Dual-AAE) for unsupervised clustering.
By performing variational inference on the objective function of Dual-AAE, we derive a new reconstruction loss which can be optimized by training a pair of Auto-encoders.
Experiments on four benchmarks show that Dual-AAE achieves superior performance over state-of-the-art clustering methods.
arXiv Detail & Related papers (2020-08-23T13:16:34Z) - BiDet: An Efficient Binarized Object Detector [96.19708396510894]
We propose a binarized neural network learning method called BiDet for efficient object detection.
Our BiDet fully utilizes the representational capacity of the binary neural networks for object detection by redundancy removal.
Our method outperforms the state-of-the-art binary neural networks by a sizable margin.
arXiv Detail & Related papers (2020-03-09T08:16:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.