OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis

• URL: http://arxiv.org/abs/2605.27378v1
• Date: Thu, 09 Apr 2026 06:37:11 GMT
• Title: OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis
• Abstract summary: We present OralAgent, the first dental-specialized AI agent that unifies multimodal reasoning, tool-based decision-making, and knowledge-grounded retrieval.<n>It integrates 22 visual analysis tools and 368 widely-used classical dental textbooks, enabling autonomous reasoning, planning, tool use, knowledge retrieval, and multi-step workflow execution.
• Score: 53.581112172626234
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Dental image analysis plays a pivotal role in supporting accurate diagnosis and treatment planning in oral healthcare. Although recent advances have produced dental AI models for specific tasks and individual imaging modalities, their isolated designs limit practical use in real-world clinical workflows. In this paper, we present OralAgent, the first dental-specialized AI agent that unifies multimodal reasoning, tool-based decision-making, and knowledge-grounded retrieval within an end-to-end automated framework. It integrates 22 visual analysis tools and 368 widely-used classical dental textbooks, enabling autonomous reasoning, planning, tool use, knowledge retrieval, and multi-step workflow execution. Furthermore, we introduce OralCorpus, a large-scale, high-quality bilingual textual resource containing 134.8M tokens curated for dental retrieval-augmented generation (RAG). To evaluate models' multidisciplinary dental knowledge, we construct OralQA-ZH, a Chinese multiple-choice question benchmark consisting of 798 items across eleven oral subspecialties. Extensive experiments demonstrate that OralAgent achieves state-of-the-art performance on the MMOral-Uni, MMOral-OPG, and OralQA-ZH benchmarks, highlighting its effectiveness, interpretability, and adaptability in real-world clinical settings. The code and models are publicly available at https://github.com/isjinghao/OralAgent.

Related papers

• Volumetric Radiology AI in the Era of Multimodal Large Language Models [62.95443321443533]
  Volumetric radiology presents a fundamental representational mismatch.<n>Current large language models (MLLMs) are conditioned on selected two-dimensional (2D) images, compressed visual representations, or report-derived text.<n>Reliable radiology AI requires representations that preserve task-relevant 3D information and systems that can access, verify, and integrate this information.
  arXiv  Detail & Related papers  (2026-08-20T20:23:41Z)
• DentAgent: Evidence-Centric Multi-Agent Coordination for Multimodal Dental Reasoning [32.53481435542718]
  We introduce DentAgent, an evidence-centric multi-agent framework for dental AI.<n>Each specialist utilizes domain tools to convert observations into structured evidence records.<n>The Evidence Blackboard manages these records as a shared evidence state, tracking coverage, gaps, and conflicts before response generation.
  arXiv  Detail & Related papers  (2026-08-19T12:58:03Z)
• Towards Autonomous and Auditable Medical Imaging Model Development [53.326510777116766]
  We introduce AMID, an autonomous multi-agent framework for medical imaging model development.<n>AMID first proposes Data-Conditioned Method Planning, which refines coarse task-level search spaces into executable, parallelizable method lanes.<n>It then develops Verification-Guided Two-Stage Optimization, moving from broad early exploration of diverse method lanes to selective exploitation of promising candidates.
  arXiv  Detail & Related papers  (2026-07-12T00:54:06Z)
• Large AI Models in Dental Healthcare: From General-Purpose Systems to Domain-Specific Foundation Models [0.30650083373343306]
  Oral diseases affect nearly 3.5 billion people worldwide, yet the comparative clinical potential of large-scale AI models in dentistry remains poorly understood.<n>Three distinct model categories have emerged: language-generative models, discriminative vision foundation models, and dental-specific models.<n>General-purpose and dental-specific models play complementary roles; the most effective systems combine both within structured pipelines.
  arXiv  Detail & Related papers  (2026-06-01T21:39:27Z)
• DentalGPT: Incentivizing Multimodal Complex Reasoning in Dentistry [28.389946455559713]
  Current multimodal large language models (MLLMs) struggle to capture fine-grained dental visual details.<n>We present DentalGPT, a specialized dental MLLM developed through high-quality domain knowledge injection and reinforcement learning.
  arXiv  Detail & Related papers  (2025-12-12T13:42:57Z)
• OralGPT-Omni: A Versatile Dental Multimodal Large Language Model [44.919874082284686]
  We present OralGPT- Omni, the first dental-specialized MLLM for comprehensive analysis across diverse dental imaging modalities and clinical tasks.<n>To explicitly capture dentists' diagnostic reasoning, we construct TRACE-CoT, a clinically grounded chain-of-thought dataset.<n>In parallel, we introduce MMOral-Uni, the first unified multimodal benchmark for dental image analysis.
  arXiv  Detail & Related papers  (2025-11-27T03:21:20Z)
• Towards Generalist Intelligence in Dentistry: Vision Foundation Models for Oral and Maxillofacial Radiology [22.124686092997717]
  DentVFM is the first family of vision foundation models (VFMs) designed for dentistry.<n>It generates task-agnostic visual representations for a wide range of dental applications.<n>It shows impressive generalist intelligence, demonstrating robust generalization to diverse dental tasks.
  arXiv  Detail & Related papers  (2025-10-16T10:24:23Z)
• DentVLM: A Multimodal Vision-Language Model for Comprehensive Dental Diagnosis and Enhanced Clinical Practice [71.62725911420627]
  We introduce DentVLM, a vision-language model engineered for expert-level oral disease diagnosis.<n>The model is capable of interpreting seven 2D oral imaging modalities across 36 diagnostic tasks.<n>It surpassed the diagnostic performance of 13 junior dentists on 21 of 36 tasks and exceeded that of 12 senior dentists on 12 of 36 tasks.
  arXiv  Detail & Related papers  (2025-09-27T14:47:37Z)
• Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios [46.729092855387165]
  We study the choice of the backbone LLM for medical AI agents, which is the foundation for the agent's overall reasoning and action generation.<n>Our findings demonstrate o1's ability to enhance diagnostic accuracy and consistency, paving the way for smarter, more responsive AI tools.
  arXiv  Detail & Related papers  (2024-11-16T18:19:53Z)
• STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyond [68.47402386668846]
  We introduce Structured Reasoning In Critical Text Assessment (STRICTA) to model text assessment as an explicit, step-wise reasoning process.<n>STRICTA breaks down the assessment into a graph of interconnected reasoning steps drawing on causality theory.<n>We apply STRICTA to a dataset of over 4000 reasoning steps from roughly 40 biomedical experts on more than 20 papers.
  arXiv  Detail & Related papers  (2024-09-09T06:55:37Z)
• CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark [51.38557174322772]
  We present the first Chinese Biomedical Language Understanding Evaluation benchmark. It is a collection of natural language understanding tasks including named entity recognition, information extraction, clinical diagnosis normalization, single-sentence/sentence-pair classification. We report empirical results with the current 11 pre-trained Chinese models, and experimental results show that state-of-the-art neural models perform by far worse than the human ceiling.
  arXiv  Detail & Related papers  (2021-06-15T12:25:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.