TrackPGD: A White-box Attack using Binary Masks against Robust Transformer Trackers

• URL: http://arxiv.org/abs/2407.03946v1
• Date: Thu, 4 Jul 2024 14:02:12 GMT
• Title: TrackPGD: A White-box Attack using Binary Masks against Robust Transformer Trackers
• Authors: Fatemeh Nourilenjan Nokabadi, Yann Batiste Pequignot, Jean-Francois Lalonde, Christian Gagné,
• Abstract summary: Object trackers with transformer backbones have achieved robust performance on visual object tracking datasets. Due to the backbone differences, the adversarial white-box attacks proposed for object tracking are not transferable to all types of trackers. We are proposing a novel white-box attack named TrackPGD, which relies on the predicted object binary mask to attack the robust transformer trackers.
• Score: 6.115755665318123
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Object trackers with transformer backbones have achieved robust performance on visual object tracking datasets. However, the adversarial robustness of these trackers has not been well studied in the literature. Due to the backbone differences, the adversarial white-box attacks proposed for object tracking are not transferable to all types of trackers. For instance, transformer trackers such as MixFormerM still function well after black-box attacks, especially in predicting the object binary masks. We are proposing a novel white-box attack named TrackPGD, which relies on the predicted object binary mask to attack the robust transformer trackers. That new attack focuses on annotation masks by adapting the well-known SegPGD segmentation attack, allowing to successfully conduct the white-box attack on trackers relying on transformer backbones. The experimental results indicate that the TrackPGD is able to effectively attack transformer-based trackers such as MixFormerM, OSTrackSTS, and TransT-SEG on several tracking datasets.

Related papers

• Adversarial Bounding Boxes Generation (ABBG) Attack against Visual Object Trackers [6.6810237114686615]
  Adversarial perturbations aim to deceive neural networks into predicting inaccurate results. For visual object trackers, adversarial attacks have been developed to generate perturbations by manipulating the outputs. We present a novel white-box approach to attack visual object trackers with transformer backbones using only one bounding box.
  arXiv  Detail & Related papers  (2024-11-26T14:30:36Z)
• Adaptively Bypassing Vision Transformer Blocks for Efficient Visual Tracking [11.361394596302334]
  ABTrack is an adaptive computation framework that adaptively bypassing transformer blocks for efficient visual tracking. We propose a Bypass Decision Module (BDM) to determine if a transformer block should be bypassed. We introduce a novel ViT pruning method to reduce the dimension of the latent representation of tokens in each transformer block.
  arXiv  Detail & Related papers  (2024-06-12T09:39:18Z)
• Reproducibility Study on Adversarial Attacks Against Robust Transformer Trackers [18.615714086028632]
  New transformer networks have been integrated into object tracking pipelines and have demonstrated strong performance on the latest benchmarks. This paper focuses on understanding how transformer trackers behave under adversarial attacks and how different attacks perform on tracking datasets as their parameters change.
  arXiv  Detail & Related papers  (2024-06-03T20:13:38Z)
• Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performance [87.19164603145056]
  We propose LoRAT, a method that unveils the power of large ViT model for tracking within laboratory-level resources. The essence of our work lies in adapting LoRA, a technique that fine-tunes a small subset of model parameters without adding inference latency. We design an anchor-free head solely based on to adapt PETR, enabling better performance with less computational overhead.
  arXiv  Detail & Related papers  (2024-03-08T11:41:48Z)
• Enhancing Tracking Robustness with Auxiliary Adversarial Defense Networks [1.7907721703063868]
  Adrial attacks in visual object tracking have significantly degraded the performance of advanced trackers. We propose an effective auxiliary pre-processing defense network, AADN, which performs defensive transformations on the input images before feeding them into the tracker.
  arXiv  Detail & Related papers  (2024-02-28T01:42:31Z)
• Strong-TransCenter: Improved Multi-Object Tracking based on Transformers with Dense Representations [0.6144680854063939]
  Transformer networks have been a focus of research in many fields in recent years, being able to surpass the state-of-the-art performance in different computer vision tasks. In the task of Multiple Object Tracking (MOT), leveraging the power of Transformers remains relatively unexplored. Among the pioneering efforts in this domain, TransCenter, a Transformer-based MOT architecture with dense object queries, demonstrated exceptional tracking capabilities while maintaining reasonable runtime. We propose a post-processing mechanism grounded in the Track-by-Detection paradigm, aiming to refine the track displacement estimation.
  arXiv  Detail & Related papers  (2022-10-24T19:47:58Z)
• Efficient Visual Tracking with Exemplar Transformers [98.62550635320514]
  We introduce the Exemplar Transformer, an efficient transformer for real-time visual object tracking. E.T.Track, our visual tracker that incorporates Exemplar Transformer layers, runs at 47 fps on a CPU. This is up to 8 times faster than other transformer-based models.
  arXiv  Detail & Related papers  (2021-12-17T18:57:54Z)
• Towards Transferable Adversarial Attacks on Vision Transformers [110.55845478440807]
  Vision transformers (ViTs) have demonstrated impressive performance on a series of computer vision tasks, yet they still suffer from adversarial examples. We introduce a dual attack framework, which contains a Pay No Attention (PNA) attack and a PatchOut attack, to improve the transferability of adversarial samples across different ViTs.
  arXiv  Detail & Related papers  (2021-09-09T11:28:25Z)
• Efficient Adversarial Attacks for Visual Object Tracking [73.43180372379594]
  We present an end-to-end network FAN (Fast Attack Network) that uses a novel drift loss combined with the embedded feature loss to attack the Siamese network based trackers. Under a single GPU, FAN is efficient in the training speed and has a strong attack performance.
  arXiv  Detail & Related papers  (2020-08-01T08:47:58Z)
• Cascaded Regression Tracking: Towards Online Hard Distractor Discrimination [202.2562153608092]
  We propose a cascaded regression tracker with two sequential stages. In the first stage, we filter out abundant easily-identified negative candidates. In the second stage, a discrete sampling based ridge regression is designed to double-check the remaining ambiguous hard samples.
  arXiv  Detail & Related papers  (2020-06-18T07:48:01Z)
• Cooling-Shrinking Attack: Blinding the Tracker with Imperceptible Noises [87.53808756910452]
  A cooling-shrinking attack method is proposed to deceive state-of-the-art SiameseRPN-based trackers. Our method has good transferability and is able to deceive other top-performance trackers such as DaSiamRPN, DaSiamRPN-UpdateNet, and DiMP.
  arXiv  Detail & Related papers  (2020-03-21T07:13:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.