MultiAnimate: A Unified Framework for Controllable Multi-Character Animation

• URL: http://arxiv.org/abs/2607.13415v1
• Date: Wed, 15 Jul 2026 03:33:52 GMT
• Title: MultiAnimate: A Unified Framework for Controllable Multi-Character Animation
• Abstract summary: MultiAnimate is a framework that enables concurrent animation of multiple characters within a shared environment.<n>We introduce an identity-specific reference net that enables appearance extraction from multiple reference images.<n>Second, we implement an identity-aware pose encoder to address the character-pose binding challenge.<n>Third, we introduce an interaction guider module that enhances the framework's capability to handle complex inter-character interactions.
• Score: 76.56813950148235
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advances in generative models and technological innovations have significantly addressed the fundamental challenges of character image animation. However, existing approaches predominantly focus on character animation from a single reference image, substantially limiting their applicability in scenarios such as multiple character interaction animation. To fill this gap, this paper introduces MultiAnimate, a comprehensive framework that enables concurrent animation of multiple characters within a shared environment while preserving both identity consistency and spatial relationships. The framework achieves these objectives through multiple well-designed mechanisms. First, we incorporate an identity-specific reference net that enables appearance extraction from multiple reference images, distinguishing MultiAnimate from existing approaches constrained to single reference inputs. Second, we implement an identity-aware pose encoder to address the character-pose binding challenge, wherein an attention mechanism enables the network to accurately differentiate and process multiple pose sequences during generation. Third, we introduce an interaction guider module that enhances the framework's capability to handle complex inter-character interactions by leveraging character-specific mask information, serving as an optional component that refines the pose sequences. Extensive experiments and ablation analyses demonstrate our framework's superiority in multiple character animation, particularly in scenarios involving complex motion sequences.

Related papers

• GroupVideo: Multi-Identity Customized Text-to-Video Generation [53.89036635198158]
  GroupVideo is a novel framework that leverages multiple individual photographs to generate identitycustomized video.<n>GroupVideo incorporates multimodal identity alignment, while semantic alignment introduces a semantic perceiver to enhance the naturalness of motions.<n>In response to the shortage of multi-ID video datasets, we have curated a comprehensive high-quality dataset of 20,000 videos.
  arXiv  Detail & Related papers  (2026-07-23T08:09:04Z)
• AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation [55.94507360511886]
  We propose AnyCrowd, a Transformer-based video generation framework capable of scaling to an arbitrary number of characters.<n>Specifically, we first introduce an Instance-Isolated Latent Representation (IILR), which encodes character instances independently prior to DiT processing to prevent latent identity entanglement.<n>Building on this disentangled representation, we further propose Tri-Stage Decoupled Attention (TSDA) to bind identities to driving poses by decomposing self-attention into: (i) instance-aware foreground attention, (ii) background-centric interaction, and (iii) global-background coordination.
  arXiv  Detail & Related papers  (2026-03-16T15:25:04Z)
• MultiAnimate: Pose-Guided Image Animation Made Extensible [44.163219649465866]
  A Pose-guided human image animation aims to synthesize realistic videos of a reference character driven by a sequence of poses.<n>We propose a multi-character image animation framework built upon modern Diffusion Transformers for video generation.<n>We show that our framework achieves state-of-the-art performance in multi-character image animation, surpassing existing diffusion-based baselines.
  arXiv  Detail & Related papers  (2026-02-25T05:06:58Z)
• CoDance: An Unbind-Rebind Paradigm for Robust Multi-Subject Animation [95.46061771820412]
  CoDance is a novel Unbind-Rebind framework that enables the animation of arbitrary subject counts, types, and spatial configurations conditioned on a single pose sequence.<n>To ensure precise control and subject association, we then devise a Rebind module, leveraging semantic guidance from text prompts and spatial guidance from subject masks to direct the learned motion to intended characters.<n>Experiments on CoDanceBench and existing datasets show that CoDance achieves SOTA performance, exhibiting remarkable generalization across diverse subjects and spatial layouts.
  arXiv  Detail & Related papers  (2026-01-16T08:53:09Z)
• One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer [36.26551019954542]
  We present One-to-All Animation, a framework for high-fidelity character animation and image pose transfer.<n>To handle spatially misaligned reference, we reformulate training as a self-supervised outpainting task.<n>We also design a reference extractor for comprehensive identity feature extraction.
  arXiv  Detail & Related papers  (2025-11-28T07:30:10Z)
• Multi-Object Sketch Animation with Grouping and Motion Trajectory Priors [17.222592006593057]
  GroupSketch is a novel method for vector sketch animation that effectively handles multi-object interactions and complex motions.<n>Our approach significantly outperforms existing methods in generating high-quality, temporally consistent animations.
  arXiv  Detail & Related papers  (2025-08-21T13:11:28Z)
• Towards Multiple Character Image Animation Through Enhancing Implicit Decoupling [77.08568533331206]
  We propose a novel multi-condition guided framework for character image animation.<n>We employ several well-designed input modules to enhance the implicit decoupling capability of the model.<n>Our method excels in generating high-quality character animations, especially in scenarios of complex backgrounds and multiple characters.
  arXiv  Detail & Related papers  (2024-06-05T08:03:18Z)
• Zero-shot High-fidelity and Pose-controllable Character Animation [89.74818983864832]
  Image-to-video (I2V) generation aims to create a video sequence from a single image. Existing approaches suffer from inconsistency of character appearances and poor preservation of fine details. We propose PoseAnimate, a novel zero-shot I2V framework for character animation.
  arXiv  Detail & Related papers  (2024-04-21T14:43:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.