Noise-Coded Illumination for Forensic and Photometric Video Analysis

• URL: http://arxiv.org/abs/2507.23002v1
• Date: Wed, 30 Jul 2025 18:08:34 GMT
• Title: Noise-Coded Illumination for Forensic and Photometric Video Analysis
• Authors: Peter F. Michael, Zekun Hao, Serge Belongie, Abe Davis,
• Abstract summary: We show how coding very subtle, noise-like modulations into the illumination of a scene can help combat this advantage.<n>Our approach effectively adds a temporal watermark to any video recorded under coded illumination.<n>We show that even when an adversary knows that our technique is being used, creating a plausible coded fake video amounts to solving a second, more difficult version of the original adversarial content creation problem.
• Score: 11.507609566604664
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The proliferation of advanced tools for manipulating video has led to an arms race, pitting those who wish to sow disinformation against those who want to detect and expose it. Unfortunately, time favors the ill-intentioned in this race, with fake videos growing increasingly difficult to distinguish from real ones. At the root of this trend is a fundamental advantage held by those manipulating media: equal access to a distribution of what we consider authentic (i.e., "natural") video. In this paper, we show how coding very subtle, noise-like modulations into the illumination of a scene can help combat this advantage by creating an information asymmetry that favors verification. Our approach effectively adds a temporal watermark to any video recorded under coded illumination. However, rather than encoding a specific message, this watermark encodes an image of the unmanipulated scene as it would appear lit only by the coded illumination. We show that even when an adversary knows that our technique is being used, creating a plausible coded fake video amounts to solving a second, more difficult version of the original adversarial content creation problem at an information disadvantage. This is a promising avenue for protecting high-stakes settings like public events and interviews, where the content on display is a likely target for manipulation, and while the illumination can be controlled, the cameras capturing video cannot.

Related papers

• Active Light Modulation to Counter Manipulation of Speech Visual Content [1.471374083774109]
  Spotlight is a low-overhead and unobtrusive system for protecting live speech videos from falsification.<n> Spotlight creates dynamic physical signatures at the event site and embeds them into all video recordings via imperceptible light.<n>Prototype experiments show Spotlight achieves AUCs $geq$ 0.99 and an overall true positive rate of 100% in detecting falsified videos.
  arXiv  Detail & Related papers  (2025-04-30T17:55:24Z)
• VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Models [18.427936201177122]
  VideoMark is a distortion-free robust watermarking framework for video diffusion models.<n>We employ a frame-wise watermarking strategy with pseudorandom error correction (PRC) codes, using a fixed watermark sequence.<n>For watermark extraction, we propose a Temporal Matching Module (TMM) that leverages edit distance to align decoded messages with the original watermark sequence.
  arXiv  Detail & Related papers  (2025-04-23T02:21:12Z)
• FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors [64.54220123913154]
  We introduce FramePainter as an efficient instantiation of image-to-video generation problem.<n>It only uses a lightweight sparse control encoder to inject editing signals.<n>It domainantly outperforms previous state-of-the-art methods with far less training data.
  arXiv  Detail & Related papers  (2025-01-14T16:09:16Z)
• Video Seal: Open and Efficient Video Watermarking [47.40833588157406]
  Video watermarking addresses challenges by embedding imperceptible signals into videos, allowing for identification.<n>Video Seal is a comprehensive framework for neural video watermarking and a competitive open-sourced model.<n>We present experimental results demonstrating the effectiveness of the approach in terms of speed, imperceptibility, and robustness.
  arXiv  Detail & Related papers  (2024-12-12T17:41:49Z)
• Divot: Diffusion Powers Video Tokenizer for Comprehension and Generation [54.21476271127356]
  Divot is a Diffusion-Powered Video Tokenizer.<n>We present Divot-unaVic through video-to-text autoregression and text-to-video generation.
  arXiv  Detail & Related papers  (2024-12-05T18:53:04Z)
• FateZero: Fusing Attentions for Zero-shot Text-based Video Editing [104.27329655124299]
  We propose FateZero, a zero-shot text-based editing method on real-world videos without per-prompt training or use-specific mask. Our method is the first one to show the ability of zero-shot text-driven video style and local attribute editing from the trained text-to-image model.
  arXiv  Detail & Related papers  (2023-03-16T17:51:13Z)
• Digital Image Forensics using Deep Learning [0.0]
  The aim of our project is to build an algorithm that identifies which camera was used to capture an image using traces of information left intrinsically in the image. Solving this problem would have a big impact on the verification of evidence used in criminal and civil trials and even news reporting.
  arXiv  Detail & Related papers  (2022-10-14T02:27:34Z)
• Robust Watermarking for Video Forgery Detection with Improved Imperceptibility and Robustness [30.611167333725408]
  This paper proposes a video watermarking network for tampering localization. We jointly train a 3D-UNet-based watermark embedding network and a decoder that predicts the tampering mask. Experimental results demonstrate that our method generates watermarked videos with good imperceptibility and robustly and accurately locates tampered areas.
  arXiv  Detail & Related papers  (2022-07-07T16:27:10Z)
• FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes [25.277040616599336]
  Deepfakes and manipulated media are becoming a prominent threat due to the recent advances in realistic image and video synthesis techniques. We introduce a deep learning based semi-fragile watermarking technique that allows media authentication by verifying an invisible secret message embedded in the image pixels.
  arXiv  Detail & Related papers  (2022-04-05T03:29:30Z)
• Relighting Images in the Wild with a Self-Supervised Siamese Auto-Encoder [62.580345486483886]
  We propose a self-supervised method for image relighting of single view images in the wild. The method is based on an auto-encoder which deconstructs an image into two separate encodings. We train our model on large-scale datasets such as Youtube 8M and CelebA.
  arXiv  Detail & Related papers  (2020-12-11T16:08:50Z)
• Encoding in the Dark Grand Challenge: An Overview [60.9261003831389]
  We propose a Grand Challenge on encoding low-light video sequences. VVC achieves a high performance compared to simply denoising the video source prior to encoding. The quality of the video streams can be further improved by employing a post-processing image enhancement method.
  arXiv  Detail & Related papers  (2020-05-07T08:22:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.