OmniLottie: Generating Vector Animations via Parameterized Lottie Tokens

• URL: http://arxiv.org/abs/2603.02138v1
• Date: Mon, 02 Mar 2026 17:59:05 GMT
• Title: OmniLottie: Generating Vector Animations via Parameterized Lottie Tokens
• Abstract summary: We introduce a well designed Lottie tokenizer that transforms files into structured sequences of commands and parameters representing shapes, animation functions and control parameters.<n>Such tokenizer enables us to build OmniLottie upon pretrained vision language models to follow multi-modal interleaved instructions and generate high quality vector animations.
• Score: 56.699545482716736
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: OmniLottie is a versatile framework that generates high quality vector animations from multi-modal instructions. For flexible motion and visual content control, we focus on Lottie, a light weight JSON formatting for both shapes and animation behaviors representation. However, the raw Lottie JSON files contain extensive invariant structural metadata and formatting tokens, posing significant challenges for learning vector animation generation. Therefore, we introduce a well designed Lottie tokenizer that transforms JSON files into structured sequences of commands and parameters representing shapes, animation functions and control parameters. Such tokenizer enables us to build OmniLottie upon pretrained vision language models to follow multi-modal interleaved instructions and generate high quality vector animations. To further advance research in vector animation generation, we curate MMLottie-2M, a large scale dataset of professionally designed vector animations paired with textual and visual annotations. With extensive experiments, we validate that OmniLottie can produce vivid and semantically aligned vector animations that adhere closely to multi modal human instructions.

Related papers

• SCAIL-2: Unifying Controlled Character Animation with End-to-end In-Context Conditioning [12.196865711049561]
  Controlled character animation requires transferring motion from a driving sequence to a reference character.<n>We present SCAIL-2, a framework that bypasses those intermediates and achieves textbfend-to-end character animation.
  arXiv  Detail & Related papers  (2026-06-09T12:49:34Z)
• Generative Animations: A Multi-Model Pipeline for Prompt-Driven Motion Synthesis [0.688204255655161]
  We introduce Generative Animations, a system that transforms natural language prompts into production-ready animations.<n>By chaining Large Language Models (LLMs) for semantic parsing with the Segment Anything Model (SAM) for visual grounding, our pipeline automatically generates motion paths.<n>We demonstrate the system through three use cases: contour-following trajectories, orbital animations with z-order awareness, and perspective-aligned motion on transformed objects.
  arXiv  Detail & Related papers  (2026-05-26T15:58:30Z)
• LottieGPT: Tokenizing Vector Animation for Autoregressive Generation [63.27046904946992]
  Vector animations offer resolution-independence, compactness, semantic structure, and parametric editable motion representations.<n>Current generative models operate exclusively in space and thus cannot synthesize them.<n>We finetune Qwen-VL to create LottieGPT, a native multimodal model capable of generating coherent, editable vector animations.
  arXiv  Detail & Related papers  (2026-04-13T17:55:40Z)
• MVAnimate: Enhancing Character Animation with Multi-View Optimization [55.4217617472079]
  We introduce MVAnimate, a novel framework that synthesizes both 2D and 3D information of dynamic figures based on multi-view prior information.<n>Our approach leverages multi-view prior information to produce temporally consistent and spatially coherent animation outputs.
  arXiv  Detail & Related papers  (2026-02-09T14:55:21Z)
• SynMotion: Semantic-Visual Adaptation for Motion Customized Video Generation [56.90807453045657]
  SynMotion is a motion-customized video generation model that jointly leverages semantic guidance and visual adaptation.<n>At the semantic level, we introduce the dual-em semantic comprehension mechanism which disentangles subject and motion representations.<n>At the visual level, we integrate efficient motion adapters into a pre-trained video generation model to enhance motion fidelity and temporal coherence.
  arXiv  Detail & Related papers  (2025-06-30T10:09:32Z)
• MotionDreamer: One-to-Many Motion Synthesis with Localized Generative Masked Transformer [36.43680216948212]
  We present MotionDreamer, a localized masked modeling paradigm designed to learn internal motion patterns from a given motion.<n> MotionDreamer constructs a robust and informative codebook for local motion patterns using a novel distribution regularization method.<n>As demonstrated through comprehensive experiments, MotionDreamer outperforms the state-of-the-art methods that are typically GAN or Diffusion-based in both faithfulness and diversity.
  arXiv  Detail & Related papers  (2025-04-11T20:27:22Z)
• PhysAnimator: Physics-Guided Generative Cartoon Animation [19.124321553546242]
  PhysAnimator is a novel approach for generating anime-stylized animation from static anime illustrations.<n>To capture the fluidity and exaggeration characteristic of anime, we perform image-space deformable body simulations on extracted mesh geometries.<n>We extract and warp sketches from the simulation sequence, generating a texture-agnostic representation, and employ a sketch-guided video diffusion model to synthesize high-quality animation frames.
  arXiv  Detail & Related papers  (2025-01-27T22:48:36Z)
• LASER: Tuning-Free LLM-Driven Attention Control for Efficient Text-conditioned Image-to-Animation [52.16008431411513]
  LASER is a tuning-free LLM-driven attention control framework.<n>We propose a Text-conditioned Image-to-Animation Benchmark to validate the effectiveness and efficacy of LASER.
  arXiv  Detail & Related papers  (2024-04-21T07:13:56Z)
• Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenization [52.63845811751936]
  Video pre-training is challenging due to the modeling of its dynamics video. In this paper, we address such limitations in video pre-training with an efficient video decomposition. Our framework is both capable of comprehending and generating image and video content, as demonstrated by its performance across 13 multimodal benchmarks.
  arXiv  Detail & Related papers  (2024-02-05T16:30:49Z)
• Real-time Animation Generation and Control on Rigged Models via Large Language Models [50.034712575541434]
  We introduce a novel method for real-time animation control and generation on rigged models using natural language input. We embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and realistic animations.
  arXiv  Detail & Related papers  (2023-10-27T01:36:35Z)
• Latent Image Animator: Learning to Animate Images via Latent Space Navigation [11.286071873122658]
  We introduce the Latent Image Animator (LIA), a self-supervised autoencoder that evades need for structure representation. LIA is streamlined to animate images by linear navigation in the latent space. Specifically, motion in generated video is constructed by linear displacement of codes in the latent space.
  arXiv  Detail & Related papers  (2022-03-17T02:45:34Z)
• The Animation Transformer: Visual Correspondence via Segment Matching [2.8387322144750726]
  Animation Transformer (AnT) uses a transformer-based architecture to learn the spatial and visual relationships between segments across a sequence of images. AnT enables practical ML-assisted colorization for professional animation and is publicly accessible as a creative tool in Cadmium.
  arXiv  Detail & Related papers  (2021-09-06T17:23:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.