Ti-Patch: Tiled Physical Adversarial Patch for no-reference video quality metrics

• URL: http://arxiv.org/abs/2404.09961v1
• Date: Mon, 15 Apr 2024 17:38:47 GMT
• Title: Ti-Patch: Tiled Physical Adversarial Patch for no-reference video quality metrics
• Authors: Victoria Leonenkova, Ekaterina Shumitskaya, Anastasia Antsiferova, Dmitriy Vatolin,
• Abstract summary: No-reference image- and video-quality metrics are crucial in many computer vision tasks. The vulnerability of quality metrics imposes restrictions on using such metrics in quality control systems. This paper proposes a new method for testing quality metrics vulnerability in the physical space.
• Score: 3.7855740990304736
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Objective no-reference image- and video-quality metrics are crucial in many computer vision tasks. However, state-of-the-art no-reference metrics have become learning-based and are vulnerable to adversarial attacks. The vulnerability of quality metrics imposes restrictions on using such metrics in quality control systems and comparing objective algorithms. Also, using vulnerable metrics as a loss for deep learning model training can mislead training to worsen visual quality. Because of that, quality metrics testing for vulnerability is a task of current interest. This paper proposes a new method for testing quality metrics vulnerability in the physical space. To our knowledge, quality metrics were not previously tested for vulnerability to this attack; they were only tested in the pixel space. We applied a physical adversarial Ti-Patch (Tiled Patch) attack to quality metrics and did experiments both in pixel and physical space. We also performed experiments on the implementation of physical adversarial wallpaper. The proposed method can be used as additional quality metrics in vulnerability evaluation, complementing traditional subjective comparison and vulnerability tests in the pixel space. We made our code and adversarial videos available on GitHub: https://github.com/leonenkova/Ti-Patch.

Related papers

• Guardians of Image Quality: Benchmarking Defenses Against Adversarial Attacks on Image Quality Metrics [35.87448891459325]
  This paper presents a comprehensive benchmarking study of various defense mechanisms in response to the rise in adversarial attacks on IQA. We evaluate 25 defense strategies, including adversarial purification, adversarial training, and certified robustness methods. We analyze the differences between defenses and their applicability to IQA tasks, considering that they should preserve IQA scores and image quality.
  arXiv  Detail & Related papers  (2024-08-02T19:02:49Z)
• IOI: Invisible One-Iteration Adversarial Attack on No-Reference Image- and Video-Quality Metrics [4.135467749401761]
  No-reference image- and video-quality metrics are widely used in video processing benchmarks. This paper introduces an Invisible One-Iteration (IOI) adversarial attack on no reference image and video quality metrics.
  arXiv  Detail & Related papers  (2024-03-09T16:33:30Z)
• Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attacks [43.85564498709518]
  This paper analyses modern metrics' robustness to different adversarial attacks. Some metrics showed high resistance to adversarial attacks, which makes their usage in benchmarks safer than vulnerable metrics.
  arXiv  Detail & Related papers  (2023-10-10T19:21:41Z)
• A Geometrical Approach to Evaluate the Adversarial Robustness of Deep Neural Networks [52.09243852066406]
  Adversarial Converging Time Score (ACTS) measures the converging time as an adversarial robustness metric. We validate the effectiveness and generalization of the proposed ACTS metric against different adversarial attacks on the large-scale ImageNet dataset.
  arXiv  Detail & Related papers  (2023-10-10T09:39:38Z)
• Fast Adversarial CNN-based Perturbation Attack on No-Reference Image- and Video-Quality Metrics [0.0]
  We propose a fast adversarial attack on no-reference quality metrics. The proposed attack can be exploited as a preprocessing step in real-time video processing and compression algorithms. This research can yield insights to further aid in designing of stable neural-network-based no-reference quality metrics.
  arXiv  Detail & Related papers  (2023-05-24T20:18:21Z)
• Improving Adversarial Robustness to Sensitivity and Invariance Attacks with Deep Metric Learning [80.21709045433096]
  A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample. We use metric learning to frame adversarial regularization as an optimal transport problem. Our preliminary results indicate that regularizing over invariant perturbations in our framework improves both invariant and sensitivity defense.
  arXiv  Detail & Related papers  (2022-11-04T13:54:02Z)
• Universal Perturbation Attack on Differentiable No-Reference Image- and Video-Quality Metrics [0.0]
  Some attacks can deceive image- and video-quality metrics. We propose a new method to attack differentiable no-reference quality metrics through universal perturbation.
  arXiv  Detail & Related papers  (2022-11-01T10:28:13Z)
• Segment and Complete: Defending Object Detectors against Adversarial Patch Attacks with Robust Patch Detection [142.24869736769432]
  Adversarial patch attacks pose a serious threat to state-of-the-art object detectors. We propose Segment and Complete defense (SAC), a framework for defending object detectors against patch attacks. We show SAC can significantly reduce the targeted attack success rate of physical patch attacks.
  arXiv  Detail & Related papers  (2021-12-08T19:18:48Z)
• Transparent Human Evaluation for Image Captioning [70.03979566548823]
  We develop a rubric-based human evaluation protocol for image captioning models. We show that human-generated captions show substantially higher quality than machine-generated ones. We hope that this work will promote a more transparent evaluation protocol for image captioning.
  arXiv  Detail & Related papers  (2021-11-17T07:09:59Z)
• Learning to Evaluate Perception Models Using Planner-Centric Metrics [104.33349410009161]
  We propose a principled metric for 3D object detection specifically for the task of self-driving. We find that our metric penalizes many of the mistakes that other metrics penalize by design. For human evaluation, we generate scenes in which standard metrics and our metric disagree and find that humans side with our metric 79% of the time.
  arXiv  Detail & Related papers  (2020-04-19T02:14:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.