Protecting Your Video Content: Disrupting Automated Video-based LLM Annotations

• URL: http://arxiv.org/abs/2503.21824v1
• Date: Wed, 26 Mar 2025 08:11:58 GMT
• Title: Protecting Your Video Content: Disrupting Automated Video-based LLM Annotations
• Authors: Haitong Liu, Kuofeng Gao, Yang Bai, Jinmin Li, Jinxiao Shan, Tao Dai, Shu-Tao Xia,
• Abstract summary: Video-based large language models (video-based LLMs) have achieved impressive performance across various video comprehension tasks.<n>This rapid advancement raises significant privacy and security concerns, particularly regarding the unauthorized use of personal video data.<n>We propose two series of protective video watermarks with imperceptible adversarial perturbations, named Ramblings and Mutes.
• Score: 48.94868867419852
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, video-based large language models (video-based LLMs) have achieved impressive performance across various video comprehension tasks. However, this rapid advancement raises significant privacy and security concerns, particularly regarding the unauthorized use of personal video data in automated annotation by video-based LLMs. These unauthorized annotated video-text pairs can then be used to improve the performance of downstream tasks, such as text-to-video generation. To safeguard personal videos from unauthorized use, we propose two series of protective video watermarks with imperceptible adversarial perturbations, named Ramblings and Mutes. Concretely, Ramblings aim to mislead video-based LLMs into generating inaccurate captions for the videos, thereby degrading the quality of video annotations through inconsistencies between video content and captions. Mutes, on the other hand, are designed to prompt video-based LLMs to produce exceptionally brief captions, lacking descriptive detail. Extensive experiments demonstrate that our video watermarking methods effectively protect video data by significantly reducing video annotation performance across various video-based LLMs, showcasing both stealthiness and robustness in protecting personal video content. Our code is available at https://github.com/ttthhl/Protecting_Your_Video_Content.

Related papers

• VideoRAG: Retrieval-Augmented Generation over Video Corpus [57.68536380621672]
  VideoRAG is a framework that dynamically retrieves videos based on their relevance with queries.<n>VideoRAG is powered by recent Large Video Language Models (LVLMs)<n>We experimentally validate the effectiveness of VideoRAG, showcasing that it is superior to relevant baselines.
  arXiv  Detail & Related papers  (2025-01-10T11:17:15Z)
• Interpolating Video-LLMs: Toward Longer-sequence LMMs in a Training-free Manner [53.671484175063995]
  Video-LLMs are pre-trained to process short videos, limiting their broader application for understanding longer video content. We introduce an alternative video token rearrangement technique that circumvents limitations imposed by the fixed video encoder and alignment projector.
  arXiv  Detail & Related papers  (2024-09-19T17:59:55Z)
• Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision [24.568643475808564]
  Video Self-Training with augmented Reasoning (Video-STaR) is the first video self-training approach. Video-STaR allows the utilization of any labeled video dataset for video instruction tuning.
  arXiv  Detail & Related papers  (2024-07-08T17:59:42Z)
• Video Watermarking: Safeguarding Your Video from (Unauthorized) Annotations by Video-based LLMs [43.83499677307886]
  Video Watermarking is a technique to protect videos from unauthorized annotations by video-based Large Language Models. Our method preserves the viewing experience while preventing misuse by video-based LLMs.
  arXiv  Detail & Related papers  (2024-07-02T16:34:14Z)
• Long Video Understanding with Learnable Retrieval in Video-Language Models [36.793956806567834]
  We introduce a learnable retrieval-based video-language model (R-VLM) for efficient long video understanding. Specifically, given a question (Query) and a long video, our model identifies and selects the most relevant K video chunks. This effectively reduces the number of video tokens, eliminates noise interference, and enhances system performance.
  arXiv  Detail & Related papers  (2023-12-08T09:48:36Z)
• VTimeLLM: Empower LLM to Grasp Video Moments [43.51980030572101]
  Large language models (LLMs) have shown remarkable text understanding capabilities. Video LLMs can only provide a coarse description of the entire video. We propose VTimeLLM, a novel Video LLM for fine-grained video moment understanding.
  arXiv  Detail & Related papers  (2023-11-30T10:49:56Z)
• HowToCaption: Prompting LLMs to Transform Video Annotations at Scale [72.69268311756082]
  We propose to leverage the capabilities of large language models (LLMs) to obtain high-quality video descriptions aligned with videos at scale. We introduce a prompting method that is able to take into account a longer text of subtitles, allowing us to capture the contextual information beyond one single sentence. We apply our method to the subtitles of the HowTo100M dataset, creating a new large-scale dataset, HowToCaption.
  arXiv  Detail & Related papers  (2023-10-07T19:32:55Z)
• VideoLLM: Modeling Video Sequence with Large Language Models [70.32832021713864]
  Existing video understanding models are often task-specific and lack a comprehensive capability of handling diverse tasks. We propose a novel framework called VideoLLM that leverages the sequence reasoning capabilities of pre-trained LLMs. VideoLLM incorporates a carefully designed Modality and Semantic Translator, which convert inputs from various modalities into a unified token sequence.
  arXiv  Detail & Related papers  (2023-05-22T17:51:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.