OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editing

• URL: http://arxiv.org/abs/2512.07826v2
• Date: Tue, 16 Dec 2025 16:37:57 GMT
• Title: OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editing
• Abstract summary: OpenVE-3M is an open-source, large-scale, and high-quality dataset for instruction-based video editing.<n>To address the lack of a unified benchmark in the field, we construct OpenVE-Bench, containing 431 video-edit pairs.<n>We present OpenVE-Edit, a 5B model trained on our dataset that demonstrates remarkable efficiency and effectiveness.
• Score: 40.87442780303236
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The quality and diversity of instruction-based image editing datasets are continuously increasing, yet large-scale, high-quality datasets for instruction-based video editing remain scarce. To address this gap, we introduce OpenVE-3M, an open-source, large-scale, and high-quality dataset for instruction-based video editing. It comprises two primary categories: spatially-aligned edits (Global Style, Background Change, Local Change, Local Remove, Local Add, and Subtitles Edit) and non-spatially-aligned edits (Camera Multi-Shot Edit and Creative Edit). All edit types are generated via a meticulously designed data pipeline with rigorous quality filtering. OpenVE-3M surpasses existing open-source datasets in terms of scale, diversity of edit types, instruction length, and overall quality. Furthermore, to address the lack of a unified benchmark in the field, we construct OpenVE-Bench, containing 431 video-edit pairs that cover a diverse range of editing tasks with three key metrics highly aligned with human judgment. We present OpenVE-Edit, a 5B model trained on our dataset that demonstrates remarkable efficiency and effectiveness by setting a new state-of-the-art on OpenVE-Bench, outperforming all prior open-source models including a 14B baseline. Project page is at https://lewandofskee.github.io/projects/OpenVE.

Related papers

• RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing [66.83679558829465]
  RefVideo-6M is a large-scale reference-guided editing dataset containing 5 million video editing samples and 1 million image editing samples.<n>To ensure reliable supervision, our dataset uses a construction pipeline that treats artifact-free real videos as editing targets.<n>It provides approximately 6 million visual references, covering diverse reference types and editing scenarios.
  arXiv  Detail & Related papers  (2026-08-26T17:59:19Z)
• JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation [100.46371655184585]
  JAVEdit-100k is the first large-scale, high-quality dataset tailored for instruction-guided joint audio-visual editing.<n>This dataset is rigorously constructed via four meticulously designed generation pipelines, seamlessly paired with an agent-in-the-loop quality control mechanism.<n>To address the lack of standardized evaluation within the field, we introduce JAVEditBench, a comprehensive benchmark featuring curated source videos and human-aligned instructions.
  arXiv  Detail & Related papers  (2026-06-02T05:26:06Z)
• ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Framework [58.443783258153786]
  We propose ScaleEditor, a hierarchical multi-agent framework for end-to-end construction of large-scale, high-quality image editing datasets.<n>Our pipeline consists of three key components: source image expansion with world-knowledge infusion, adaptive multi-agent editing instruction-image synthesis, and a task-aware data quality verification mechanism.<n>Using ScaleEditor, we curate ScaleEdit-12M, the largest open-source image editing dataset to date, spanning 23 task families across diverse real and synthetic domains.
  arXiv  Detail & Related papers  (2026-03-21T04:39:19Z)
• EditVerse: Unifying Image and Video Editing and Generation with In-Context Learning [58.53074381801114]
  We introduce EditVerse, a unified framework for image and video generation and editing within a single model.<n>By representing all modalities, i.e. text, image, and video, as a unified token sequence, EditVerse leverages self-attention to achieve robust in-context learning.<n>We present EditVerseBench, the first benchmark for instruction-based video editing covering diverse tasks and resolutions.
  arXiv  Detail & Related papers  (2025-09-24T17:59:30Z)
• Generating High-Quality Datasets for Code Editing via Open-Source Language Models [49.01026966779838]
  We introduce OpenCodeEdit, an open-source pipeline that synthesizes realistic code-edit triplets.<n>The pipeline produces both concise "lazy" instructions and more detailed "descriptive" ones, and applies filtering based on diffs and topics to guarantee data quality and variety.<n>Fine-tuning three advanced base models on OCEDataFT leads to significant performance boosts on the CanItEdit benchmark, with relative pass@1 improvements ranging from 4.50% to 20.79%.
  arXiv  Detail & Related papers  (2025-09-19T03:57:39Z)
• TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMs [54.44479359918971]
  We introduce TDVE-DB, a large-scale benchmark dataset for text-driven video editing.<n> TDVE-DB consists of 3,857 edited videos generated from 12 diverse models across 8 editing categories.<n>We propose TDVE-Assessor, a novel VQA model specifically designed for text-driven video editing assessment.
  arXiv  Detail & Related papers  (2025-05-26T05:47:09Z)
• InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Construction [10.855393943204728]
  We present a high-quality Instruction-based Video Editing dataset with 1M triplets, namely InsViE-1M.<n>We generate and filter a variety of video editing triplets from high-quality images.<n>Experiments demonstrate the advantages of our InsViE-1M dataset and the trained model over state-of-the-art works.
  arXiv  Detail & Related papers  (2025-03-26T07:30:58Z)
• AnyEdit: Mastering Unified High-Quality Image Editing for Any Idea [88.79769371584491]
  We present AnyEdit, a comprehensive multi-modal instruction editing dataset.<n>We ensure the diversity and quality of the AnyEdit collection through three aspects: initial data diversity, adaptive editing process, and automated selection of editing results.<n>Experiments on three benchmark datasets show that AnyEdit consistently boosts the performance of diffusion-based editing models.
  arXiv  Detail & Related papers  (2024-11-24T07:02:56Z)
• VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editing [13.006616304789878]
  This paper introduces a dataset VIVID-10M and a baseline model VIVID.<n>VIVID-10M is the first large-scale hybrid image-video local editing dataset.<n>Our approach achieves state-of-the-art performance in video local editing, surpassing baseline methods in both automated metrics and user studies.
  arXiv  Detail & Related papers  (2024-11-22T10:04:05Z)
• EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editing [114.14164860467227]
  We propose EditRoom, a framework capable of executing a variety of layout edits through natural language commands.<n>Specifically, EditRoom leverages Large Language Models (LLMs) for command planning and generates target scenes.<n>We have developed an automatic pipeline to augment existing 3D scene datasets and introduced EditRoom-DB, a large-scale dataset with 83k editing pairs.
  arXiv  Detail & Related papers  (2024-10-03T17:42:24Z)
• UltraEdit: Instruction-based Fine-Grained Image Editing at Scale [43.222251591410455]
  This paper presents UltraEdit, a large-scale (approximately 4 million editing samples) automatically generated dataset for instruction-based image editing.<n>Our key idea is to address the drawbacks in existing image editing datasets like InstructPix2Pix and MagicBrush, and provide a systematic approach to producing massive and high-quality image editing samples.
  arXiv  Detail & Related papers  (2024-07-07T06:50:22Z)
• EffiVED:Efficient Video Editing via Text-instruction Diffusion Models [9.287394166165424]
  We introduce EffiVED, an efficient diffusion-based model that supports instruction-guided video editing. We transform vast image editing datasets and open-world videos into a high-quality dataset for training EffiVED.
  arXiv  Detail & Related papers  (2024-03-18T08:42:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.