VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing

• URL: http://arxiv.org/abs/2605.03276v2
• Date: Fri, 08 May 2026 23:14:34 GMT
• Title: VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing
• Abstract summary: We introduce VEBENCH, the first benchmark designed to evaluate editing knowledge understanding and operational reasoning in realistic video editing scenarios.<n> VEBENCH contains 3.9K high-quality edited videos (over 257 hours) and 3,080 human-verified QA pairs.<n>It features two complementary QA tasks: Video Editing Technique Recognition and Video Editing Operation Simulation.
• Score: 39.721584069301095
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Real-world video editing demands not only expert knowledge of cinematic techniques but also multimodal reasoning to select, align, and combine footage into coherent narratives. While recent Large Multimodal Models (LMMs) have shown remarkable progress in general video understanding, their abilities in multi-video reasoning and operational editing workflows remain largely unexplored. We introduce VEBENCH, the first comprehensive benchmark designed to evaluate both editing knowledge understanding and operational reasoning in realistic video editing scenarios. VEBENCH contains 3.9K high-quality edited videos (over 257 hours) and 3,080 human-verified QA pairs, built through a three-round human-AI collaborative annotation pipeline that ensures precise temporal labeling and semantic consistency. It features two complementary QA tasks: 1) Video Editing Technique Recognition, assessing models' ability to identify 7 editing techniques using multimodal cues; and 2) Video Editing Operation Simulation, modeling real-world editing workflows by requiring the selection and temporal localization of relevant clips from multiple candidates. Extensive experiments across proprietary (e.g., Gemini-2.5-Pro) and open-source LMMs reveal a large gap between current model performance and human-level editing cognition. These results highlight the urgent need for bridging video understanding with creative operational reasoning. We envision VEBENCH as a foundation for advancing intelligent video editing systems and driving future research on complex reasoning.

Related papers

• Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning [56.17582599802973]
  We introduce the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, which is structured around three core objectives.<n>To tackle these three unique challenges, we introduce an agentic editing framework that leverages the Large Language Models (LLMs) and Vision-Language Models (VLMs)<n>Extensive experiments demonstrate that our MMLVE-Agent outperforms existing closed-source SOTA approaches.
  arXiv  Detail & Related papers  (2026-08-27T08:48:13Z)
• VideoGAIA: A Benchmark for General AI Assistants on Agentic Video Understanding [73.10050069618302]
  VideoGAIA is an agentic video understanding benchmark for general artificial intelligence assistants.<n>VideoGAIA contains 271 model-human co-designed tasks covering diverse and complex real-world scenarios.<n>All evaluated MLLMs, including frontier models such as GPT-5.5 and Kimi-K3, achieve less than 60% accuracy on VideoGAIA.
  arXiv  Detail & Related papers  (2026-08-12T03:24:44Z)
• OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editing [53.21868575804758]
  We introduce a comprehensive and structured benchmark for instruction-based video editing (IVE)<n>Our benchmark decomposes editing tasks into multiple video-specific dimensions, including spatial, temporal, audio, and reference-based editing.<n>We propose an evaluation framework that assesses editing quality from four complementary dimensions: accuracy, preservation, realism, and consistency.
  arXiv  Detail & Related papers  (2026-08-05T16:58:48Z)
• CoVEBench: Can Video Editing Models Handle Complex Instructions? [26.871333176496126]
  CoVEBench is a compositional video editing benchmark comprising 416 curated source videos, 626 multi-point editing instructions, and 9,990 fine-grained checklist items.<n>It evaluates models via MLLM-judged instruction compliance and video fidelity, alongside automated metrics for video quality.
  arXiv  Detail & Related papers  (2026-06-07T02:29:41Z)
• A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding [69.31609753061137]
  Multimodal Large Language Models have achieved strong performance in single-video understanding, yet their ability to reason across multiple videos remains limited.<n>Existing approaches typicallyulate multiple videos into a single input and performulate direct inference, which introduces training-inference mismatch.<n>Current multi-video benchmarks primarily emphasize event-level comparison, leaving identity-level matching, fine-grained discrimination, and structured multi-step reasoning underexplored.<n>We propose SAMA, a Skill-Augmented Agentic Framework for Multi-Video Understanding, which integrates visual tools, task-specific skills, and a conflict-aware verification mechanism
  arXiv  Detail & Related papers  (2026-03-16T02:09:48Z)
• Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing [21.525921468472685]
  We present a scalable and computationally efficient model that connects pretrained multimodal large-language models (MLLMs) with video diffusion models for unified video generation and editing.<n>Our key idea is to exploit the understanding and reasoning capabilities of MLLMs to produce explicit target captions to interpret user instructions.<n>We evaluate the performance of Omni-Video 2 on the FiVE benchmark for fine-grained video editing and the VBench benchmark for text-to-video generation.
  arXiv  Detail & Related papers  (2026-02-09T15:56:05Z)
• Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding [43.785571875867]
  We propose Agentic Video Intelligence (AVI), a flexible and training-free framework that can mirror human video comprehension through system-level design and optimization.<n>AVI introduces three key innovations: (1) a human-inspired three-phase reasoning process (Retrieve-Perceive-Review), (2) a structured video knowledge base organized through entity graphs, and (3) an open-source model ensemble combining reasoning LLMs with lightweight base CV models and VLM.
  arXiv  Detail & Related papers  (2025-11-18T12:43:15Z)
• Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models [78.32948112203228]
  Video understanding represents the most challenging frontier in computer vision.<n>Recent emergence of Video-Large Multitemporal Models has demonstrated remarkable capabilities in video understanding tasks.<n>Survey aims to provide researchers and practitioners with a unified framework for advancing Video-LMM capabilities.
  arXiv  Detail & Related papers  (2025-10-06T17:10:44Z)
• VEU-Bench: Towards Comprehensive Understanding of Video Editing [4.9254235505057835]
  We introduce VEU-Bench (Video Editing Understanding Benchmark), a comprehensive benchmark that categorizes video editing components across various dimensions.<n>Unlike previous video editing understanding benchmarks that focus mainly on editing element classification, VEU-Bench encompasses 19 fine-grained tasks across three stages: recognition, reasoning, and judging.<n>We develop Oscars, a VEU expert model fine-tuned on the curated VEU-Bench dataset. It outperforms existing open-source Vid-LLMs on VEU-Bench by over 28.3% in accuracy and performance comparable to commercial models like GPT-4o.
  arXiv  Detail & Related papers  (2025-04-24T04:36:28Z)
• MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge [35.323379110573406]
  We introduce MMKE-Bench, a comprehensive MultiModal Knowledge Editing Benchmark.<n>It is designed to evaluate the ability of LMMs to edit diverse visual knowledge in real-world scenarios.<n>It incorporates three types of editing tasks: visual entity editing, visual semantic editing, and user-specific editing.<n>It consists of 2,940 pieces of knowledge and 8,363 images across 33 broad categories, with evaluation questions automatically generated and human-verified.
  arXiv  Detail & Related papers  (2025-02-27T08:21:28Z)
• Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era [50.19334853510935]
  Recent strides in instruction-based editing have enabled intuitive interaction with visual content, using natural language as a bridge between user intent and complex editing operations. We aim to democratize powerful visual editing across various industries, from entertainment to education.
  arXiv  Detail & Related papers  (2024-11-15T05:18:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.