Wan-Animate: Unified Character Animation and Replacement with Holistic Replication

• URL: http://arxiv.org/abs/2509.14055v1
• Date: Wed, 17 Sep 2025 15:00:57 GMT
• Title: Wan-Animate: Unified Character Animation and Replacement with Holistic Replication
• Authors: Gang Cheng, Xin Gao, Li Hu, Siqi Hu, Mingyang Huang, Chaonan Ji, Ju Li, Dechao Meng, Jinwei Qi, Penchong Qiao, Zhen Shen, Yafei Song, Ke Sun, Linrui Tian, Feng Wang, Guangyuan Wang, Qi Wang, Zhongjian Wang, Jiayu Xiao, Sheng Xu, Bang Zhang, Peng Zhang, Xindi Zhang, Zhe Zhang, Jingren Zhou, Lian Zhuo,
• Abstract summary: We introduce Wan-Animate, a unified framework for character animation and replacement.<n>It can animate the character by precisely replicating the expressions and movements of the character in the video to generate high-fidelity character videos.<n>It can integrate the animated character into the reference video to replace the original character, replicating the scene's lighting and color tone.
• Score: 53.619006977292635
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce Wan-Animate, a unified framework for character animation and replacement. Given a character image and a reference video, Wan-Animate can animate the character by precisely replicating the expressions and movements of the character in the video to generate high-fidelity character videos. Alternatively, it can integrate the animated character into the reference video to replace the original character, replicating the scene's lighting and color tone to achieve seamless environmental integration. Wan-Animate is built upon the Wan model. To adapt it for character animation tasks, we employ a modified input paradigm to differentiate between reference conditions and regions for generation. This design unifies multiple tasks into a common symbolic representation. We use spatially-aligned skeleton signals to replicate body motion and implicit facial features extracted from source images to reenact expressions, enabling the generation of character videos with high controllability and expressiveness. Furthermore, to enhance environmental integration during character replacement, we develop an auxiliary Relighting LoRA. This module preserves the character's appearance consistency while applying the appropriate environmental lighting and color tone. Experimental results demonstrate that Wan-Animate achieves state-of-the-art performance. We are committed to open-sourcing the model weights and its source code.

Related papers

• Character-Centric Understanding of Animated Movies [88.83104906869106]
  We propose an audio-visual pipeline to enable automatic and robust animated character recognition.<n>Characters in animated movies exhibit extreme diversity in their appearance, motion, and deformation.<n>This pipeline enhances character-centric understanding of animated movies.
  arXiv  Detail & Related papers  (2025-09-15T17:59:51Z)
• Animate-X++: Universal Character Image Animation with Dynamic Backgrounds [32.04255747303296]
  Animate-X++ is a universal animation framework based on DiT for various character types, including anthropomorphic characters.<n>To enhance motion representation, we introduce the Pose Indicator, which captures comprehensive motion pattern from the driving video through both implicit and explicit manner.<n>For the second challenge, we introduce a multi-task training strategy that jointly trains the animation and TI2V tasks.
  arXiv  Detail & Related papers  (2025-08-13T03:11:28Z)
• DreamDance: Animating Character Art via Inpainting Stable Gaussian Worlds [64.53681498600065]
  DreamDance is an animation framework capable of producing stable, consistent character and scene motion conditioned on precise camera trajectories.<n>We train a pose-aware video inpainting model that injects the dynamic character into the scene video while enhancing background quality.
  arXiv  Detail & Related papers  (2025-05-30T15:54:34Z)
• Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordance [30.225654002561512]
  We introduce Animate Anyone 2, aiming to animate characters with environment affordance.<n>We propose a shape-agnostic mask strategy that more effectively characterizes the relationship between character and environment.<n>We also introduce a pose modulation strategy that enables the model to handle more diverse motion patterns.
  arXiv  Detail & Related papers  (2025-02-10T04:20:11Z)
• AniDoc: Animation Creation Made Easier [54.97341104616779]
  Our research focuses on reducing the labor costs in the production of 2D animation by harnessing the potential of increasingly powerful AI.<n>AniDoc emerges as a video line art colorization tool, which automatically converts sketch sequences into colored animations.<n>Our model exploits correspondence matching as an explicit guidance, yielding strong robustness to the variations between the reference character and each line art frame.
  arXiv  Detail & Related papers  (2024-12-18T18:59:59Z)
• Zero-shot High-fidelity and Pose-controllable Character Animation [89.74818983864832]
  Image-to-video (I2V) generation aims to create a video sequence from a single image. Existing approaches suffer from inconsistency of character appearances and poor preservation of fine details. We propose PoseAnimate, a novel zero-shot I2V framework for character animation.
  arXiv  Detail & Related papers  (2024-04-21T14:43:31Z)
• AnimateZoo: Zero-shot Video Generation of Cross-Species Animation via Subject Alignment [64.02822911038848]
  We present AnimateZoo, a zero-shot diffusion-based video generator to produce animal animations. Key technique used in our AnimateZoo is subject alignment, which includes two steps. Our model is capable of generating videos characterized by accurate movements, consistent appearance, and high-fidelity frames.
  arXiv  Detail & Related papers  (2024-04-07T12:57:41Z)
• Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation [27.700371215886683]
  diffusion models have become the mainstream in visual generation research, owing to their robust generative capabilities. In this paper, we propose a novel framework tailored for character animation. By expanding the training data, our approach can animate arbitrary characters, yielding superior results in character animation compared to other image-to-video methods.
  arXiv  Detail & Related papers  (2023-11-28T12:27:15Z)
• CAST: Character labeling in Animation using Self-supervision by Tracking [6.57697269659615]
  Cartoons and animation domain videos have very different characteristics compared to real-life images and videos. Current computer vision and deep-learning solutions often fail on animated content because they were trained on natural images. We present a method to refine a semantic representation suitable for specific animated content.
  arXiv  Detail & Related papers  (2022-01-19T14:21:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.