TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencing

• URL: http://arxiv.org/abs/2503.11629v1
• Date: Fri, 14 Mar 2025 17:48:06 GMT
• Title: TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencing
• Authors: Stefan Lionar, Jiabin Liang, Gim Hee Lee,
• Abstract summary: TreeMeshGPT is an autoregressive Transformer designed to generate artistic meshes aligned with input point clouds.<n>Our approach represents each triangular face with two tokens, achieving a compression rate of approximately 22%.<n>Our method generates mesh with strong normal orientation constraints, minimizing flipped normals commonly encountered in previous methods.
• Score: 47.919057306538626
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce TreeMeshGPT, an autoregressive Transformer designed to generate high-quality artistic meshes aligned with input point clouds. Instead of the conventional next-token prediction in autoregressive Transformer, we propose a novel Autoregressive Tree Sequencing where the next input token is retrieved from a dynamically growing tree structure that is built upon the triangle adjacency of faces within the mesh. Our sequencing enables the mesh to extend locally from the last generated triangular face at each step, and therefore reduces training difficulty and improves mesh quality. Our approach represents each triangular face with two tokens, achieving a compression rate of approximately 22% compared to the naive face tokenization. This efficient tokenization enables our model to generate highly detailed artistic meshes with strong point cloud conditioning, surpassing previous methods in both capacity and fidelity. Furthermore, our method generates mesh with strong normal orientation constraints, minimizing flipped normals commonly encountered in previous methods. Our experiments show that TreeMeshGPT enhances the mesh generation quality with refined details and normal orientation consistency.

Related papers

• MeshCraft: Exploring Efficient and Controllable Mesh Generation with Flow-based DiTs [79.45006864728893]
  MeshCraft is a framework for efficient and controllable mesh generation. It uses continuous spatial diffusion to generate discrete triangle faces. It can generate an 800-face mesh in just 3.2 seconds.
  arXiv  Detail & Related papers  (2025-03-29T09:21:50Z)
• MeshPad: Interactive Sketch Conditioned Artistic-designed Mesh Generation and Editing [64.84885028248395]
  MeshPad is a generative approach that creates 3D meshes from sketch inputs.<n>We focus on enabling consistent edits by decomposing editing into 'deletion' of regions of a mesh, followed by 'addition' of new mesh geometry.<n>Our approach is based on a triangle sequence-based mesh representation, exploiting a large Transformer model for mesh triangle addition and deletion.
  arXiv  Detail & Related papers  (2025-03-03T11:27:44Z)
• Nautilus: Locality-aware Autoencoder for Scalable Mesh Generation [46.08876528701562]
  We propose Nautilus, a locality-aware autoencoder for artist-like mesh generation.<n>Our approach introduces a novel tokenization algorithm that preserves face proximity relationships.<n>We also develop a Dual-stream Point Conditioner that provides multi-scale guidance.
  arXiv  Detail & Related papers  (2025-01-24T08:22:02Z)
• EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generation [36.69567056569989]
  We propose an Auto-regressive Auto-encoder (ArAE) model capable of generating high-quality 3D meshes with up to 4,000 faces at a spatial resolution of $5123$. We introduce a novel mesh tokenization algorithm that efficiently compresses triangular meshes into 1D token sequences, significantly enhancing training efficiency. Our model compresses variable-length triangular meshes into a fixed-length latent space, enabling training latent diffusion models for better generalization.
  arXiv  Detail & Related papers  (2024-09-26T17:55:02Z)
• MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenization [65.15226276553891]
  MeshAnything V2 is an advanced mesh generation model designed to create Artist-Created Meshes.<n>A key innovation behind MeshAnything V2 is our novel Adjacent Mesh Tokenization (AMT) method.
  arXiv  Detail & Related papers  (2024-08-05T15:33:45Z)
• PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidance [66.40153183581894]
  We introduce a generic and scalable mesh generation framework PivotMesh. PivotMesh makes an initial attempt to extend the native mesh generation to large-scale datasets. We show that PivotMesh can generate compact and sharp 3D meshes across various categories.
  arXiv  Detail & Related papers  (2024-05-27T07:13:13Z)
• HVOFusion: Incremental Mesh Reconstruction Using Hybrid Voxel Octree [12.180935725861723]
  We propose a novel hybrid voxel-octree approach to fuse octree with voxel structures. Such sparse structure preserves triangular faces in the leaf nodes and produces partial meshes sequentially for incremental reconstruction. Experimental results on several datasets show that our proposed approach is capable of quickly and accurately reconstructing a scene with realistic colors.
  arXiv  Detail & Related papers  (2024-04-27T18:24:53Z)
• MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers [32.169007676811404]
  MeshGPT is a new approach for generating triangle meshes that reflects the compactness typical of artist-created meshes. Inspired by recent advances in powerful large language models, we adopt a sequence-based approach to autoregressively generate triangle meshes as triangles.
  arXiv  Detail & Related papers  (2023-11-27T01:20:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.