Detecting Temporally Localized Manipulations in Authentic Video Streams

• URL: http://arxiv.org/abs/2606.07090v1
• Date: Fri, 05 Jun 2026 09:35:51 GMT
• Title: Detecting Temporally Localized Manipulations in Authentic Video Streams
• Abstract summary: Video editing and generative artificial intelligence technologies have made realistic video manipulation increasingly accessible.<n>Existing datasets do not adequately model scenarios in which a short manipulated segment is inserted into an otherwise authentic video.<n>We create a new dataset specifically designed for authentic videos containing short and highly realistic manipulated intervals.
• Score: 1.9116784879310027
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The rapid advancement of video editing and generative artificial intelligence technologies has made realistic video manipulation increasingly accessible. Although existing datasets have significantly advanced research in deepfake detection, object removal, and video inpainting, they do not adequately model scenarios in which a short manipulated segment is inserted into an otherwise authentic video and the original video continues afterward. In this study, we review representative datasets from the literature, analyze their characteristics, and discuss their limitations with respect to temporally localized realistic manipulation detection. Based on this analysis, we motivate the need for a new dataset specifically designed for authentic videos containing short and highly realistic manipulated intervals. Finally, we evaluate two complementary approaches on our custom-curated test set to establish an initial benchmark for this challenging scenario. The first employs a linear probe on DINOv3 features, assessed under three thresholding strategies. The second leverages DINOv3 features with a consecutive frame similarity-based method to detect temporal manipulation boundaries. Together, these experiments provide an initial benchmark for partially manipulated video detection and highlight the need for content-adaptive thresholding mechanisms. The dataset, code, and supplementary materials are publicly available at https://github.com/OkanUmur/temporally-localized-video-manipulation-detection.

Related papers

• SphereVideo: Prototype-anchored Hyperspherical Boundary for Continual AI-generated Video Detection [61.05420454815012]
  AI-generated video (AIGV) detection aims to distinguish real videos from AI-generated ones.<n>In practice, detectors trained on existing data often fail to generalize to newly emerging generative models.<n>We propose SphereVideo, a novel framework for AIGV detection built on two key observations.
  arXiv  Detail & Related papers  (2026-08-02T15:54:54Z)
• Explainable Forensics of Manipulated Segments in Untrimmed Long Videos [50.190474724159465]
  We formulate the task of Temporal AI-Generated Segment localization and Explanation.<n>We introduce TASLE, a large-scale benchmark comprising 12,472 untrimmed videos with diverse manipulation patterns and rich annotation signals.<n>We propose MSLoc, a coarse-to-fine forensic baseline that combines a boundary-sensitive proposal generation module for efficient long-video scanning with an MLLM-based refinement module for precise boundary localization and interpretable reasoning.
  arXiv  Detail & Related papers  (2026-06-01T15:48:38Z)
• Preserving Forgery Artifacts: AI-Generated Video Detection at Native Scale [36.51885181895111]
  We introduce a comprehensive dataset and a novel detection framework.<n>First, we curate a large-scale dataset of over 140K videos from 15 state-of-the-art open-source and commercial generators.<n>We propose a novel detection framework built on the Qwen-VL Vision Transformer, which operates at variable spatial resolutions and temporal durations.
  arXiv  Detail & Related papers  (2026-04-06T12:36:08Z)
• ActivityForensics: A Comprehensive Benchmark for Localizing Manipulated Activity in Videos [62.94038307981723]
  We introduce ActivityForensics, the first large-scale benchmark for localizing manipulated activity in videos.<n>It contains over 6K forged video segments that are seamlessly blended into the video context.<n>Based on ActivityForensics, we introduce comprehensive evaluation protocols covering intra-domain, cross-domain, and open-world settings.
  arXiv  Detail & Related papers  (2026-04-04T18:00:05Z)
• BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videos [63.03271511550633]
  BrokenVideos is a benchmark dataset of 3,254 AI-generated videos with meticulously annotated, pixel-level masks highlighting regions of visual corruption.<n>Our experiments show that training state of the art artifact detection models and multi modal large language models (MLLMs) on BrokenVideos significantly improves their ability to localize corrupted regions.
  arXiv  Detail & Related papers  (2025-06-25T03:30:04Z)
• Real-Time Anomaly Detection in Video Streams [0.0]
  This thesis is part of a CIFRE agreement between the company Othello and the LIASD laboratory.<n>The objective is to develop an artificial intelligence system that can detect real-time dangers in a video stream.
  arXiv  Detail & Related papers  (2024-11-29T14:24:33Z)
• Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Prompts [57.01985221057047]
  This paper introduces a novel method that learnstemporal prompt embeddings for weakly supervised video anomaly detection and localization (WSVADL) based on pre-trained vision-language models (VLMs) Our method achieves state-of-theart performance on three public benchmarks for the WSVADL task.
  arXiv  Detail & Related papers  (2024-08-12T03:31:29Z)
• AVTENet: A Human-Cognition-Inspired Audio-Visual Transformer-Based Ensemble Network for Video Deepfake Detection [49.81915942821647]
  This study introduces the audio-visual transformer-based ensemble network (AVTENet) to detect deepfake videos.<n>For evaluation, we use the recently released benchmark multimodal audio-video FakeAVCeleb dataset.<n>For a detailed analysis, we evaluate AVTENet, its variants, and several existing methods on multiple test sets of the FakeAVCeleb dataset.
  arXiv  Detail & Related papers  (2023-10-19T19:01:26Z)
• Video Salient Object Detection via Contrastive Features and Attention Modules [106.33219760012048]
  We propose a network with attention modules to learn contrastive features for video salient object detection. A co-attention formulation is utilized to combine the low-level and high-level features. We show that the proposed method requires less computation, and performs favorably against the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-11-03T17:40:32Z)
• Spatio-temporal Features for Generalized Detection of Deepfake Videos [12.453288832098314]
  We propose-temporal features, modeled by 3D CNNs, to extend the capabilities to detect new sorts of deep videos. We show that our approach outperforms existing methods in terms of generalization capabilities.
  arXiv  Detail & Related papers  (2020-10-22T16:28:50Z)
• Dynamic texture analysis for detecting fake faces in video sequences [6.1356022122903235]
  This work explores the analysis of texture-temporal dynamics of the video signal. The goal is to characterizing and distinguishing real fake sequences. We propose to build multiple binary decision on the joint analysis of temporal segments.
  arXiv  Detail & Related papers  (2020-07-30T07:21:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.