Boosting Adversarial Transferability of MLP-Mixer

• URL: http://arxiv.org/abs/2204.12204v1
• Date: Tue, 26 Apr 2022 10:18:59 GMT
• Title: Boosting Adversarial Transferability of MLP-Mixer
• Authors: Haoran Lyu, Yajie Wang, Yu-an Tan, Huipeng Zhou, Yuhang Zhao and Quanxin Zhang
• Abstract summary: We propose an adversarial attack method against the Dense-Mixer called Maxwell's demon Attack (MA) Our method can be easily combined with existing methods and can improve the transferability by up to 38.0% on ResMLP. To the best of our knowledge, we are the first work to study adversarial transferability of Dense-Mixer.
• Score: 9.957957463532738
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The security of models based on new architectures such as MLP-Mixer and ViTs needs to be studied urgently. However, most of the current researches are mainly aimed at the adversarial attack against ViTs, and there is still relatively little adversarial work on MLP-mixer. We propose an adversarial attack method against MLP-Mixer called Maxwell's demon Attack (MA). MA breaks the channel-mixing and token-mixing mechanism of MLP-Mixer by controlling the part input of MLP-Mixer's each Mixer layer, and disturbs MLP-Mixer to obtain the main information of images. Our method can mask the part input of the Mixer layer, avoid overfitting of the adversarial examples to the source model, and improve the transferability of cross-architecture. Extensive experimental evaluation demonstrates the effectiveness and superior performance of the proposed MA. Our method can be easily combined with existing methods and can improve the transferability by up to 38.0% on MLP-based ResMLP. Adversarial examples produced by our method on MLP-Mixer are able to exceed the transferability of adversarial examples produced using DenseNet against CNNs. To the best of our knowledge, we are the first work to study adversarial transferability of MLP-Mixer.

Related papers

• MLP Can Be A Good Transformer Learner [73.01739251050076]
  Self-attention mechanism is the key of the Transformer but often criticized for its computation demands. This paper introduces a novel strategy that simplifies vision transformers and reduces computational load through the selective removal of non-essential attention layers.
  arXiv  Detail & Related papers  (2024-04-08T16:40:15Z)
• Understanding MLP-Mixer as a Wide and Sparse MLP [7.734726150561087]
  Multi-layer perceptron (MLP) is a fundamental component of deep learning. Recent-based architectures, especially the Mixer-Mixer, have achieved significant empirical success. We show that sparseness is a key mechanism underlying the Mixer-Mixers.
  arXiv  Detail & Related papers  (2023-06-02T11:51:24Z)
• Model-tuning Via Prompts Makes NLP Models Adversarially Robust [97.02353907677703]
  We show surprising gains in adversarial robustness enjoyed by Model-tuning Via Prompts (MVP) MVP improves performance against adversarial substitutions by an average of 8% over standard methods. We also conduct ablations to investigate the mechanism underlying these gains.
  arXiv  Detail & Related papers  (2023-03-13T17:41:57Z)
• SplitMixer: Fat Trimmed From MLP-like Models [53.12472550578278]
  We present SplitMixer, a simple and lightweight isotropic-like architecture, for visual recognition. It contains two types of interleaving convolutional operations to mix information across locations (spatial mixing) and channels (channel mixing)
  arXiv  Detail & Related papers  (2022-07-21T01:37:07Z)
• Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs [84.3235981545673]
  Token-mixing multi-layer perceptron (MLP) models have shown competitive performance in computer vision tasks. We present Mix-Shift-MLP which makes the size of the local receptive field used for mixing increase with respect to the amount of spatial shifting. MS-MLP achieves competitive performance in multiple vision benchmarks.
  arXiv  Detail & Related papers  (2022-02-14T06:53:48Z)
• PointMixer: MLP-Mixer for Point Cloud Understanding [74.694733918351]
  The concept of channel-mixings and token-mixings achieves noticeable performance in visual recognition tasks. Unlike images, point clouds are inherently sparse, unordered and irregular, which limits the direct use of universal-Mixer for point cloud understanding. We propose PointMixer, a universal point set operator that facilitates information sharing among unstructured 3D points.
  arXiv  Detail & Related papers  (2021-11-22T13:25:54Z)
• Rethinking Token-Mixing MLP for MLP-based Vision Backbone [34.47616917228978]
  We propose an improved structure as termed Circulant Channel-Specific (CCS) token-mixing benchmark, which is spatial-invariant and channel-specific. It takes fewer parameters but achieves higher classification accuracy on ImageNet1K.
  arXiv  Detail & Related papers  (2021-06-28T17:59:57Z)
• S$^2$-MLP: Spatial-Shift MLP Architecture for Vision [34.47616917228978]
  Recently, visual Transformer (ViT) and its following works abandon the convolution and exploit the self-attention operation. In this paper, we propose a novel pure architecture, spatial-shift (S$2$-MLP)
  arXiv  Detail & Related papers  (2021-06-14T15:05:11Z)
• MLP-Mixer: An all-MLP Architecture for Vision [93.16118698071993]
  We present-Mixer, an architecture based exclusively on multi-layer perceptrons (MLPs). Mixer attains competitive scores on image classification benchmarks, with pre-training and inference comparable to state-of-the-art models.
  arXiv  Detail & Related papers  (2021-05-04T16:17:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.