Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detection

• URL: http://arxiv.org/abs/2410.03987v1
• Date: Sat, 5 Oct 2024 00:20:22 GMT
• Title: Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detection
• Authors: Dingwen Zhang, Liangbo Cheng, Yi Liu, Xinggang Wang, Junwei Han,
• Abstract summary: We propose a novel mamba capsule routing at the type level. These type-level mamba capsules are fed into the EM routing algorithm to get the high-layer mamba capsules. On top of that, to retrieve the pixel-level capsule features for further camouflaged prediction, we achieve this on the basis of the low-layer pixel-level capsules.
• Score: 98.6460229237143
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The part-whole relational property endowed by Capsule Networks (CapsNets) has been known successful for camouflaged object detection due to its segmentation integrity. However, the previous Expectation Maximization (EM) capsule routing algorithm with heavy computation and large parameters obstructs this trend. The primary attribution behind lies in the pixel-level capsule routing. Alternatively, in this paper, we propose a novel mamba capsule routing at the type level. Specifically, we first extract the implicit latent state in mamba as capsule vectors, which abstract type-level capsules from pixel-level versions. These type-level mamba capsules are fed into the EM routing algorithm to get the high-layer mamba capsules, which greatly reduce the computation and parameters caused by the pixel-level capsule routing for part-whole relationships exploration. On top of that, to retrieve the pixel-level capsule features for further camouflaged prediction, we achieve this on the basis of the low-layer pixel-level capsules with the guidance of the correlations from adjacent-layer type-level mamba capsules. Extensive experiments on three widely used COD benchmark datasets demonstrate that our method significantly outperforms state-of-the-arts. Code has been available on https://github.com/Liangbo-Cheng/mamba\_capsule.

Related papers

• Hierarchical Object-Centric Learning with Capsule Networks [0.0]
  Capsule networks (CapsNets) were introduced to address convolutional neural networks limitations. This thesis investigates the intriguing aspects of CapsNets and focuses on three key questions to unlock their full potential.
  arXiv  Detail & Related papers  (2024-05-30T09:10:33Z)
• Deep multi-prototype capsule networks [0.3823356975862005]
  Capsule networks are a type of neural network that identify image parts and form the instantiation parameters of a whole hierarchically. This paper presents a multi-prototype architecture for guiding capsule networks to represent the variations in the image parts. The experimental results on MNIST, SVHN, C-Cube, CEDAR, MCYT, and UTSig datasets reveal that the proposed model outperforms others regarding image classification accuracy.
  arXiv  Detail & Related papers  (2024-04-23T18:37:37Z)
• HP-Capsule: Unsupervised Face Part Discovery by Hierarchical Parsing Capsule Network [76.92310948325847]
  We propose a Hierarchical Parsing Capsule Network (HP-Capsule) for unsupervised face subpart-part discovery. HP-Capsule extends the application of capsule networks from digits to human faces and takes a step forward to show how the neural networks understand objects without human intervention.
  arXiv  Detail & Related papers  (2022-03-21T01:39:41Z)
• Capsule networks with non-iterative cluster routing [2.8935588665357077]
  In existing routing procedures, capsules produce predictions (termed votes) for capsules of the next layer. In the proposed cluster routing, capsules produce vote clusters instead of individual votes for next-layer capsules. The proposed capsule networks achieve the best accuracy on the Fashion-MNIST and SVHN datasets with fewer parameters.
  arXiv  Detail & Related papers  (2021-09-19T20:14:22Z)
• ASPCNet: A Deep Adaptive Spatial Pattern Capsule Network for Hyperspectral Image Classification [47.541691093680406]
  This paper proposes an adaptive spatial pattern capsule network (ASPCNet) architecture. It can rotate the sampling location of convolutional kernels on the basis of an enlarged receptive field. Experiments on three public datasets demonstrate that ASPCNet can yield competitive performance with higher accuracies than state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-04-25T07:10:55Z)
• Deformable Capsules for Object Detection [3.702343116848637]
  We introduce a new family of capsule networks, deformable capsules (textitDeformCaps), to address a very important problem in computer vision: object detection. We demonstrate that the proposed methods efficiently scale up to create the first-ever capsule network for object detection in the literature.
  arXiv  Detail & Related papers  (2021-04-11T15:36:30Z)
• Layer-adaptive sparsity for the Magnitude-based Pruning [88.37510230946478]
  We propose a novel importance score for global pruning, coined layer-adaptive magnitude-based pruning (LAMP) score. LAMP consistently outperforms popular existing schemes for layerwise sparsity selection.
  arXiv  Detail & Related papers  (2020-10-15T09:14:02Z)
• Capsule-Transformer for Neural Machine Translation [73.84254045203222]
  Transformer hugely benefits from its key design of the multi-head self-attention network (SAN) We propose the capsule-Transformer, which extends the linear transformation into a more general capsule routing algorithm. Experimental results on the widely-used machine translation datasets show our proposed capsule-Transformer outperforms strong Transformer baseline significantly.
  arXiv  Detail & Related papers  (2020-04-30T09:11:38Z)
• Subspace Capsule Network [85.69796543499021]
  SubSpace Capsule Network (SCN) exploits the idea of capsule networks to model possible variations in the appearance or implicitly defined properties of an entity. SCN can be applied to both discriminative and generative models without incurring computational overhead compared to CNN during test time.
  arXiv  Detail & Related papers  (2020-02-07T17:51:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.