Video Seal: Open and Efficient Video Watermarking

• URL: http://arxiv.org/abs/2412.09492v1
• Date: Thu, 12 Dec 2024 17:41:49 GMT
• Title: Video Seal: Open and Efficient Video Watermarking
• Authors: Pierre Fernandez, Hady Elsahar, I. Zeki Yalniz, Alexandre Mourachko,
• Abstract summary: Video watermarking addresses challenges by embedding imperceptible signals into videos, allowing for identification. Video Seal is a comprehensive framework for neural video watermarking and a competitive open-sourced model. We present experimental results demonstrating the effectiveness of the approach in terms of speed, imperceptibility, and robustness.
• Score: 47.40833588157406
• License:
• Abstract: The proliferation of AI-generated content and sophisticated video editing tools has made it both important and challenging to moderate digital platforms. Video watermarking addresses these challenges by embedding imperceptible signals into videos, allowing for identification. However, the rare open tools and methods often fall short on efficiency, robustness, and flexibility. To reduce these gaps, this paper introduces Video Seal, a comprehensive framework for neural video watermarking and a competitive open-sourced model. Our approach jointly trains an embedder and an extractor, while ensuring the watermark robustness by applying transformations in-between, e.g., video codecs. This training is multistage and includes image pre-training, hybrid post-training and extractor fine-tuning. We also introduce temporal watermark propagation, a technique to convert any image watermarking model to an efficient video watermarking model without the need to watermark every high-resolution frame. We present experimental results demonstrating the effectiveness of the approach in terms of speed, imperceptibility, and robustness. Video Seal achieves higher robustness compared to strong baselines especially under challenging distortions combining geometric transformations and video compression. Additionally, we provide new insights such as the impact of video compression during training, and how to compare methods operating on different payloads. Contributions in this work - including the codebase, models, and a public demo - are open-sourced under permissive licenses to foster further research and development in the field.

Related papers

• VideoShield: Regulating Diffusion-based Video Generation Models via Watermarking [27.345134138673945]
  VideoShield is a novel watermarking framework for video generation models. It embeds watermarks directly during video generation, eliminating the need for additional training. Our method maps watermark bits to template bits, which are then used to generate watermarked noise.
  arXiv  Detail & Related papers  (2025-01-24T02:57:09Z)
• FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors [64.54220123913154]
  We introduce FramePainter as an efficient instantiation of image-to-video generation problem. It only uses a lightweight sparse control encoder to inject editing signals. It domainantly outperforms previous state-of-the-art methods with far less training data.
  arXiv  Detail & Related papers  (2025-01-14T16:09:16Z)
• LVMark: Robust Watermark for latent video diffusion models [5.310978296852323]
  We introduce a novel watermarking method called LVMark, which embeds watermarks into video diffusion models. A key component of LVMark is a selective weight modulation strategy that efficiently embeds watermark messages into the video diffusion model. Our approach is the first to highlight the potential of video-generative model watermarking as a valuable tool for enhancing the effectiveness of ownership protection in video-generative models.
  arXiv  Detail & Related papers  (2024-12-12T09:57:20Z)
• Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances [13.746887960091112]
  Large-scale text-to-image models can distort embedded watermarks during editing, posing challenges to copyright protection. We introduce W-Bench, the first comprehensive benchmark designed to evaluate the robustness of watermarking methods. We propose VINE, a watermarking method that significantly enhances robustness against various image editing techniques.
  arXiv  Detail & Related papers  (2024-10-24T14:28:32Z)
• WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models [132.77237314239025]
  Video virtual try-on aims to generate realistic sequences that maintain garment identity and adapt to a person's pose and body shape in source videos. Traditional image-based methods, relying on warping and blending, struggle with complex human movements and occlusions. We reconceptualize video try-on as a process of generating videos conditioned on garment descriptions and human motion. Our solution, WildVidFit, employs image-based controlled diffusion models for a streamlined, one-stage approach.
  arXiv  Detail & Related papers  (2024-07-15T11:21:03Z)
• VJT: A Video Transformer on Joint Tasks of Deblurring, Low-light Enhancement and Denoising [45.349350685858276]
  Video restoration task aims to recover high-quality videos from low-quality observations. Video often faces different types of degradation, such as blur, low light, and noise. We propose an efficient end-to-end video transformer approach for the joint task of video deblurring, low-light enhancement, and denoising.
  arXiv  Detail & Related papers  (2024-01-26T10:27:56Z)
• VidToMe: Video Token Merging for Zero-Shot Video Editing [100.79999871424931]
  We propose a novel approach to enhance temporal consistency in generated videos by merging self-attention tokens across frames. Our method improves temporal coherence and reduces memory consumption in self-attention computations.
  arXiv  Detail & Related papers  (2023-12-17T09:05:56Z)
• RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models [19.792535444735957]
  RAVE is a zero-shot video editing method that leverages pre-trained text-to-image diffusion models without additional training. It produces high-quality videos while preserving original motion and semantic structure. RAVE is capable of a wide range of edits, from local attribute modifications to shape transformations.
  arXiv  Detail & Related papers  (2023-12-07T18:43:45Z)
• Semi-Supervised Action Recognition with Temporal Contrastive Learning [50.08957096801457]
  We learn a two-pathway temporal contrastive model using unlabeled videos at two different speeds. We considerably outperform video extensions of sophisticated state-of-the-art semi-supervised image recognition methods.
  arXiv  Detail & Related papers  (2021-02-04T17:28:35Z)
• Non-Adversarial Video Synthesis with Learned Priors [53.26777815740381]
  We focus on the problem of generating videos from latent noise vectors, without any reference input frames. We develop a novel approach that jointly optimize the input latent space, the weights of a recurrent neural network and a generator through non-adversarial learning. Our approach generates superior quality videos compared to the existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-03-21T02:57:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.