AmodalSVG: Amodal Image Vectorization via Semantic Layer Peeling

• URL: http://arxiv.org/abs/2604.10940v1
• Date: Mon, 13 Apr 2026 03:20:33 GMT
• Title: AmodalSVG: Amodal Image Vectorization via Semantic Layer Peeling
• Abstract summary: AmodalSVG is a new framework for amodal image vectorization.<n>It produces semantically organized and geometrically complete SVG representations.<n>AmodalSVG significantly outperforms prior methods in visual fidelity.
• Score: 25.8181655007804
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce AmodalSVG, a new framework for amodal image vectorization that produces semantically organized and geometrically complete SVG representations from natural images. Existing vectorization methods operate under a modal paradigm: tracing only visible pixels and disregarding occlusion. Consequently, the resulting SVGs are semantically entangled and geometrically incomplete, limiting SVG's structural editability. In contrast, AmodalSVG reconstructs full object geometries, including occluded regions, into independent, editable vector layers. To achieve this, AmodalSVG reformulates image vectorization as a two-stage framework, performing semantic decoupling and completion in the raster domain to produce amodally complete semantic layers, which are then independently vectorized. In the first stage, we introduce Semantic Layer Peeling (SLP), a VLM-guided strategy that progressively decomposes an image into semantically coherent layers. By hybrid inpainting, SLP recovers complete object appearances under occlusions, enabling explicit semantic decoupling. To vectorize these layers efficiently, we propose Adaptive Layered Vectorization (ALV), which dynamically modulates the primitive budget via an error-budget-driven adjustment mechanism. Extensive experiments demonstrate that AmodalSVG significantly outperforms prior methods in visual fidelity. Moreover, the resulting amodal layers enable object-level editing directly in the vector domain, capabilities not supported by existing vectorization approaches. Code will be released upon acceptance.

Related papers

• Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedback [29.19392406217364]
  We propose a novel generation paradigm that reformulates SVG synthesis as a step-wise, visual-context-aware process.<n>By rendering intermediate code states into a cumulative canvas, the model explicitly observes the evolving visual context at each step.<n>We show that applying this visual loop naively to off-the-shelf models is suboptimal due to their inability to leverage incremental visual-code mappings.
  arXiv  Detail & Related papers  (2026-04-22T16:15:28Z)
• SemLayer: Semantic-aware Generative Segmentation and Layer Construction for Abstract Icons [53.57408001182251]
  SemLayer is a visual generation empowered pipeline that restores editable layered structures.<n>We formalize this problem as semantic layer construction for flattened vector art.<n>We demonstrate the effectiveness of SemLayer, enabling previously inapplicable to flattened vector graphics and establishing semantic layer reconstruction as a practical and valuable task.
  arXiv  Detail & Related papers  (2026-03-25T07:51:04Z)
• Vector Prism: Animating Vector Graphics by Stratifying Semantic Structure [57.89872230703339]
  We introduce a framework that recovers the semantic structure required for reliable SVG animation.<n>By reorganizing SVGs into semantic groups, our approach enables VLMs to produce animations with far greater coherence.
  arXiv  Detail & Related papers  (2025-12-16T12:03:46Z)
• OmniSVG: A Unified Scalable Vector Graphics Generation Model [69.59073636922287]
  We propose OmniSVG, a unified framework that leverages pre-trained Vision-Language Models for end-to-end multimodal SVG generation.<n>By parameterizing SVG commands and coordinates into discrete tokens, OmniSVG decouples structural logic from low-level geometry for efficient training while maintaining the synthesis of complex SVG structure.<n>We introduce MMSVG-2M, a multimodal dataset with two million annotated SVG assets, along with a standardized evaluation protocol for conditional SVG generation tasks.
  arXiv  Detail & Related papers  (2025-04-08T17:59:49Z)
• LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer [17.881925697226656]
  LayerTracer is a diffusion transformer that bridges the gap by learning designers' layered creation processes from a novel dataset of sequential design operations.<n>For image vectorization, we introduce a conditional diffusion mechanism that encodes reference images into latent tokens.<n>Experiments demonstrate LayerTracer's superior performance against optimization-based and neural baselines in both generation quality and editability.
  arXiv  Detail & Related papers  (2025-02-03T06:49:58Z)
• NeuralSVG: An Implicit Representation for Text-to-Vector Generation [54.4153300455889]
  We propose NeuralSVG, an implicit neural representation for generating vector graphics from text prompts.<n>To encourage a layered structure in the generated SVG, we introduce a dropout-based regularization technique.<n>We demonstrate that NeuralSVG outperforms existing methods in generating structured and flexible SVG.
  arXiv  Detail & Related papers  (2025-01-07T18:50:06Z)
• SVGDreamer++: Advancing Editability and Diversity in Text-Guided SVG Generation [31.76771064173087]
  We propose a novel text-guided vector graphics synthesis method to address limitations of existing methods.<n>We introduce a Hierarchical Image VEctorization (HIVE) framework that operates at the semantic object level.<n>We also present a Vectorized Particle-based Score Distillation (VPSD) approach to improve the diversity of output SVGs.
  arXiv  Detail & Related papers  (2024-11-26T19:13:38Z)
• SVGDreamer: Text Guided SVG Generation with Diffusion Model [31.76771064173087]
  We propose a novel text-guided vector graphics synthesis method called SVGDreamer.<n>SIVE process enables decomposition of synthesis into foreground objects and background.<n>VPSD approach addresses issues of shape over-smoothing, color over-saturation, limited diversity, and slow convergence.
  arXiv  Detail & Related papers  (2023-12-27T08:50:01Z)
• Towards Layer-wise Image Vectorization [57.26058135389497]
  We propose Layerwise Image Vectorization, namely LIVE, to convert images to SVGs and simultaneously maintain its image topology. Live generates compact forms with layer-wise structures that are semantically consistent with human perspective. Live initiates human editable SVGs for both designers and can be used in other applications.
  arXiv  Detail & Related papers  (2022-06-09T17:55:02Z)
• DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation [217.86315551526235]
  We propose a novel hierarchical generative network, called DeepSVG, for complex SVG icons generation and manipulation. Our architecture effectively disentangles high-level shapes from the low-level commands that encode the shape itself. We demonstrate that our network learns to accurately reconstruct diverse vector graphics, and can serve as a powerful animation tool.
  arXiv  Detail & Related papers  (2020-07-22T09:36:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.