Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Model

• URL: http://arxiv.org/abs/2512.13507v3
• Date: Tue, 23 Dec 2025 17:38:46 GMT
• Title: Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Model
• Abstract summary: Seedance 1.5 pro is a foundational model engineered specifically for native, joint audio-video generation.<n>Seedance 1.5 pro distinguishes itself through precise multilingual and dialect lip-syncing, dynamic cinematic camera control, and enhanced narrative coherence.
• Score: 163.56671779593736
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent strides in video generation have paved the way for unified audio-visual generation. In this work, we present Seedance 1.5 pro, a foundational model engineered specifically for native, joint audio-video generation. Leveraging a dual-branch Diffusion Transformer architecture, the model integrates a cross-modal joint module with a specialized multi-stage data pipeline, achieving exceptional audio-visual synchronization and superior generation quality. To ensure practical utility, we implement meticulous post-training optimizations, including Supervised Fine-Tuning (SFT) on high-quality datasets and Reinforcement Learning from Human Feedback (RLHF) with multi-dimensional reward models. Furthermore, we introduce an acceleration framework that boosts inference speed by over 10X. Seedance 1.5 pro distinguishes itself through precise multilingual and dialect lip-syncing, dynamic cinematic camera control, and enhanced narrative coherence, positioning it as a robust engine for professional-grade content creation. Seedance 1.5 pro is now accessible on Volcano Engine at https://console.volcengine.com/ark/region:ark+cn-beijing/experience/vision?type=GenVideo.

Related papers

• Seedance 2.0: Advancing Video Generation for World Complexity [156.43863352024826]
  Seedance 2.0 is a new native multi-modal audio-video generation model, officially released in China in early February 2026.<n>It adopts a unified, highly efficient, and large-scale architecture for multi-modal audio-video joint generation.<n>Seedance 2.0 supports direct generation of audio-video content with durations ranging from 4 to 15 seconds, with native output resolutions of 480p and 720p.
  arXiv  Detail & Related papers  (2026-04-15T17:59:40Z)
• ALIVE: Animate Your World with Lifelike Audio-Video Generation [50.693986608051716]
  ALIVE is a generation model that adapts a pretrained Text-to-Video (T2V) model to Sora-style audio-video generation and animation.<n>To support the audio-visual synchronization and reference animation, we augment the popular MMDiT architecture with a joint audio-video branch.<n>ALIVE demonstrates outstanding performance, consistently outperforming open-source models and matching or surpassing state-of-the-art commercial solutions.
  arXiv  Detail & Related papers  (2026-02-09T14:06:03Z)
• HunyuanVideo 1.5 Technical Report [96.9793191588414]
  HunyuanVideo 1.5 is a lightweight yet powerful open-source video generation model.<n>It achieves state-of-the-art visual quality and motion coherence with only 8.3 billion parameters.<n>All open-source assets are publicly available at https://github.com/Tencent-Hunyuan/HunyuanVideo-1.5.
  arXiv  Detail & Related papers  (2025-11-24T08:22:07Z)
• UniVerse-1: Unified Audio-Video Generation via Stitching of Experts [59.38012380516272]
  We introduce UniVerse-1, a unified, Veo-3-like model capable of simultaneously generating coordinated audio and video.<n>To enhance training efficiency, we bypass training from scratch and instead employ a stitching of experts (SoE) technique.
  arXiv  Detail & Related papers  (2025-09-07T17:55:03Z)
• Seedance 1.0: Exploring the Boundaries of Video Generation Models [71.26796999246068]
  Seedance 1.0 is a high-performance and inference-efficient video foundation generation model.<n>It integrates multi-source curation data augmented with precision and meaningful video captioning.<n>Seedance 1.0 can generate a 5-second video at 1080p resolution only with 41.4 seconds ( NVIDIA-L20)
  arXiv  Detail & Related papers  (2025-06-10T17:56:11Z)
• Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners [69.70590867769408]
  Video and audio content creation serves as the core technique for the movie industry and professional users. Existing diffusion-based methods tackle video and audio generation separately, which hinders the technique transfer from academia to industry. In this work, we aim at filling the gap, with a carefully designed optimization-based framework for cross-visual-audio and joint-visual-audio generation.
  arXiv  Detail & Related papers  (2024-02-27T17:57:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.