TSegAgent: Zero-Shot Tooth Segmentation via Geometry-Aware Vision-Language Agents

• URL: http://arxiv.org/abs/2603.19684v1
• Date: Fri, 20 Mar 2026 06:32:16 GMT
• Title: TSegAgent: Zero-Shot Tooth Segmentation via Geometry-Aware Vision-Language Agents
• Abstract summary: tooth segmentation and identification from intra-oral scanned 3D models are fundamental problems in digital dentistry.<n>Most existing approaches rely on task-specific 3D neural networks trained with densely annotated datasets.<n>We propose TSegAgent, which addresses these challenges by reformulating dental analysis as a zero-shot geometric reasoning problem.
• Score: 18.53790376035867
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Automatic tooth segmentation and identification from intra-oral scanned 3D models are fundamental problems in digital dentistry, yet most existing approaches rely on task-specific 3D neural networks trained with densely annotated datasets, resulting in high annotation cost and limited generalization to scans from unseen sources. Thus, we propose TSegAgent, which addresses these challenges by reformulating dental analysis as a zero-shot geometric reasoning problem rather than a purely data-driven recognition task. The key idea is to combine the representational capacity of general-purpose foundation models with explicit geometric inductive biases derived from dental anatomy. Instead of learning dental-specific features, the proposed framework leverages multi-view visual abstraction and geometry-grounded reasoning to infer tooth instances and identities without task-specific training. By explicitly encoding structural constraints such as dental arch organization and volumetric relationships, the method reduces uncertainty in ambiguous cases and mitigates overfitting to particular shape distributions. Experimental results demonstrate that this reasoning-oriented formulation enables accurate and reliable tooth segmentation and identification with low computational and annotation cost, while exhibiting strong generalization across diverse and previously unseen dental scans.

Related papers

• OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis [53.581112172626234]
  We present OralAgent, the first dental-specialized AI agent that unifies multimodal reasoning, tool-based decision-making, and knowledge-grounded retrieval.<n>It integrates 22 visual analysis tools and 368 widely-used classical dental textbooks, enabling autonomous reasoning, planning, tool use, knowledge retrieval, and multi-step workflow execution.
  arXiv  Detail & Related papers  (2026-04-09T06:37:11Z)
• TCATSeg: A Tooth Center-Wise Attention Network for 3D Dental Model Semantic Segmentation [32.91531490589717]
  We propose TCATSeg, a novel framework that combines local geometric features with global semantic context.<n>We present a new dataset of 400 dental models, including pre-orthodontic samples, to evaluate the generalization of our method.
  arXiv  Detail & Related papers  (2026-03-17T14:57:43Z)
• ArchMap: Arch-Flattening and Knowledge-Guided Vision Language Model for Tooth Counting and Structured Dental Understanding [19.228631155023432]
  ArchMap is a training-free and knowledge-guided framework for robust structured dental understanding.<n>It standardizes raw 3D meshes into spatially aligned, continuity-preserving multi-view projections.<n>It achieves higher accuracy, reduced semantic drift, and superior stability under sparse or artifact-prone conditions.
  arXiv  Detail & Related papers  (2025-11-18T10:46:06Z)
• GeoT: Geometry-guided Instance-dependent Transition Matrix for Semi-supervised Tooth Point Cloud Segmentation [48.64133802117796]
  GeoT is a framework that employs instance-dependent transition matrix (IDTM) to explicitly model noise in pseudo labels for semi-supervised dental segmentation.<n>Specifically, to handle the extensive solution space of IDTM arising from tens of thousands of dental points, we introduce tooth geometric priors.<n>Our method can make full utilization of unlabeled data to facilitate segmentation, achieving performance comparable to fully supervised methods with only $20%$ of the labeled data.
  arXiv  Detail & Related papers  (2025-03-21T09:43:57Z)
• Sparse Anatomical Prompt Semi-Supervised Learning with Masked Image Modeling for CBCT Tooth Segmentation [9.373643627609336]
  tooth identification and segmentation in Cone Beam Computed Tomography (CBCT) dental images can significantly enhance the efficiency and precision of manual diagnoses performed by dentists.<n>Existing segmentation methods are mainly developed based on large data volumes training, on which their annotations are extremely time-consuming.<n>This study proposes a tasked-oriented Masked Auto-Encoder paradigm to effectively utilize large amounts of unlabeled data to achieve accurate tooth segmentation with limited labeled data.
  arXiv  Detail & Related papers  (2024-02-07T05:05:21Z)
• Automatic Tooth Arrangement with Joint Features of Point and Mesh Representations via Diffusion Probabilistic Models [33.75061391364549]
  Tooth arrangement is a crucial step in orthodontics treatment, in which aligning teeth could improve overall well-being, enhance facial aesthetics, and boost self-confidence. To improve the efficiency of tooth arrangement and minimize errors associated with unreasonable designs by inexperienced practitioners, some deep learning-based tooth arrangement methods have been proposed.
  arXiv  Detail & Related papers  (2023-12-23T02:27:15Z)
• Geometric Deep Learning for Structure-Based Drug Design: A Survey [83.87489798671155]
  Structure-based drug design (SBDD) leverages the three-dimensional geometry of proteins to identify potential drug candidates. Recent advancements in geometric deep learning, which effectively integrate and process 3D geometric data, have significantly propelled the field forward.
  arXiv  Detail & Related papers  (2023-06-20T14:21:58Z)
• TFormer: 3D Tooth Segmentation in Mesh Scans with Geometry Guided Transformer [37.47317212620463]
  Optical Intra-oral Scanners (IOS) are widely used in digital dentistry, providing 3-Dimensional (3D) and high-resolution geometrical information of dental crowns and the gingiva. Previous methods are error-prone in complicated tooth-tooth or tooth-gingiva boundaries, and usually exhibit unsatisfactory results across various patients. We propose a novel method based on 3D transformer architectures that is evaluated with large-scale and high-resolution 3D IOS datasets.
  arXiv  Detail & Related papers  (2022-10-29T15:20:54Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
  We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes. We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
  arXiv  Detail & Related papers  (2020-12-26T08:02:56Z)
• Generalized Iris Presentation Attack Detection Algorithm under Cross-Database Settings [63.90855798947425]
  Presentation attacks pose major challenges to most of the biometric modalities. We propose a generalized deep learning-based presentation attack detection network, MVANet. It is inspired by the simplicity and success of hybrid algorithm or fusion of multiple detection networks.
  arXiv  Detail & Related papers  (2020-10-25T22:42:27Z)
• 3D Dense Geometry-Guided Facial Expression Synthesis by Adversarial Learning [54.24887282693925]
  We propose a novel framework to exploit 3D dense (depth and surface normals) information for expression manipulation. We use an off-the-shelf state-of-the-art 3D reconstruction model to estimate the depth and create a large-scale RGB-Depth dataset. Our experiments demonstrate that the proposed method outperforms the competitive baseline and existing arts by a large margin.
  arXiv  Detail & Related papers  (2020-09-30T17:12:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.