TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilots

• URL: http://arxiv.org/abs/2511.17652v1
• Date: Thu, 20 Nov 2025 13:29:35 GMT
• Title: TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilots
• Abstract summary: We introduce TeamPath, an AI system powered by reinforcement learning and router-enhanced solutions based on large-scale histopathology datasets.<n>TeamPath works as a virtual assistant for expert-level disease diagnosis, patch-level information summarization, and cross-modality generation.<n>We collaborate with pathologists from Yale School of Medicine to demonstrate that TeamPath can assist them in working more efficiently.
• Score: 32.22233464805693
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Advances in AI have introduced several strong models in computational pathology to usher it into the era of multi-modal diagnosis, analysis, and interpretation. However, the current pathology-specific visual language models still lack capacities in making diagnosis with rigorous reasoning paths as well as handling divergent tasks, and thus challenges of building AI Copilots for real scenarios still exist. Here we introduce TeamPath, an AI system powered by reinforcement learning and router-enhanced solutions based on large-scale histopathology multimodal datasets, to work as a virtual assistant for expert-level disease diagnosis, patch-level information summarization, and cross-modality generation to integrate transcriptomic information for the clinical usage. We also collaborate with pathologists from Yale School of Medicine to demonstrate that TeamPath can assist them in working more efficiently by identifying and correcting expert conclusions and reasoning paths. Overall, TeamPath can flexibly choose the best settings according to the needs, and serve as an innovative and reliable system for information communication across different modalities and experts.

Related papers

• Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathology [54.42160154368719]
  Whole-slide images (WSI) have enabled the digital transformation of pathology.<n> multimodal models that jointly analyze histopathology images and pathology reports have shown promising potential for automated pathology report generation and AI-assisted diagnosis.<n>Here, we introduce TUM-Uteria, a uterine pathology dataset comprising WSIs paired with diagnostic pathology reports at both the case and slide levels.
  arXiv  Detail & Related papers  (2026-07-04T20:34:59Z)
• A Multi-modal Agentic Co-pilot for Evidence Grounded Computational Pathology [27.958607954013036]
  We present PathPocket, a multimodal AI agentic co-pilot designed specifically for evidence grounded pathology.<n>We construct the most comprehensive pathology evidence corpus to date, encompassing approximately 110,472 public and authorized documents structured across a rigorous hierarchy of evidence from clinical guideline to expert opinion.<n>This hypergraph provides traceable evidence for a collaborative multi-agent reasoning framework integrating input understanding, evidence retrieval, filtering, and diagnosis generation.<n>We rigorously evaluate the system on a multidimensional benchmark of over 200,000 real-world cases, where it significantly outperforms existing state-of-the-arts.
  arXiv  Detail & Related papers  (2026-06-06T10:36:30Z)
• MedRoute: RL-Based Dynamic Specialist Routing in Multi-Agent Medical Diagnosis [49.78267008828593]
  In clinical practice, diagnosis is performed by multiple specialists, each contributing domain-specific expertise.<n>Current approaches in this emerging area, typically relying on static or predefined selection of various specialists, cannot be adapted to the changing practical scenario.<n>We propose MedRoute, a flexible and dynamic multi-agent framework that comprises of a collaborative system of specialist LMM agents.
  arXiv  Detail & Related papers  (2026-02-05T19:50:04Z)
• OnSight Pathology: A real-time platform-agnostic computational pathology companion for histopathology [0.1866854739883167]
  We introduce OnSight Pathology, a platform-agnostic computer vision software that uses continuous custom screen captures.<n>OnSight Pathology operates locally on consumer-grade personal computers without complex software integration.<n>We show how OnSight Pathology can deliver real-time AI inferences across a broad range of pathology pipelines.
  arXiv  Detail & Related papers  (2025-12-03T19:02:08Z)
• Automated Construction of Medical Indicator Knowledge Graphs Using Retrieval Augmented Large Language Models [8.095858876360577]
  We propose an automated framework that combines retrieval-augmented generation (RAG) with large language models (LLMs) to construct medical indicator knowledge graphs.<n>The resulting knowledge graphs can be integrated into intelligent diagnosis and question-answering systems.
  arXiv  Detail & Related papers  (2025-11-17T16:00:42Z)
• A co-evolving agentic AI system for medical imaging analysis [14.925000849408683]
  "TissueLab" is a co-evolving agentic AI system that allows researchers to ask direct questions, automatically plan and generate explainable results, and conduct real-time analyses.<n>By standardizing inputs, outputs, and capabilities of diverse tools, the system determines when and how to invoke them to address research and clinical questions.<n>TissueLab achieves state-of-the-art performance compared with end-to-end vision-language models (VLMs) and other agentic AI systems such as GPT-5.
  arXiv  Detail & Related papers  (2025-09-24T16:15:28Z)
• RAD: Towards Trustworthy Retrieval-Augmented Multi-modal Clinical Diagnosis [56.373297358647655]
  Retrieval-Augmented Diagnosis (RAD) is a novel framework that injects external knowledge into multimodal models directly on downstream tasks.<n>RAD operates through three key mechanisms: retrieval and refinement of disease-centered knowledge from multiple medical sources, a guideline-enhanced contrastive loss transformer, and a dual decoder.
  arXiv  Detail & Related papers  (2025-09-24T10:36:14Z)
• A Knowledge-driven Adaptive Collaboration of LLMs for Enhancing Medical Decision-making [49.048767633316764]
  KAMAC is a knowledge-driven Adaptive Multi-Agent Collaboration framework.<n>It enables agents to dynamically form and expand expert teams based on the evolving diagnostic context.<n> Experiments on two real-world medical benchmarks demonstrate that KAMAC significantly outperforms both single-agent and advanced multi-agent methods.
  arXiv  Detail & Related papers  (2025-09-18T14:33:36Z)
• End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoning [52.12425911708585]
  Deep-DxSearch is an agentic RAG system trained end-to-end with reinforcement learning (RL)<n>In Deep-DxSearch, we first construct a large-scale medical retrieval corpus comprising patient records and reliable medical knowledge sources.<n> Experiments demonstrate that our end-to-end RL training framework consistently outperforms prompt-engineering and training-free RAG approaches.
  arXiv  Detail & Related papers  (2025-08-21T17:42:47Z)
• Advancing AI Research Assistants with Expert-Involved Learning [84.30323604785646]
  Large language models (LLMs) and large multimodal models (LMMs) promise to accelerate biomedical discovery, yet their reliability remains unclear.<n>We introduce ARIEL (AI Research Assistant for Expert-in-the-Loop Learning), an open-source evaluation and optimization framework.<n>We find that state-of-the-art models generate fluent but incomplete summaries, whereas LMMs struggle with detailed visual reasoning.
  arXiv  Detail & Related papers  (2025-05-03T14:21:48Z)
• PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathology [11.366456922386263]
  Diagnosing diseases through whole slide images is fundamental in modern pathology.<n>Traditional AI approaches fail short of such a holistic, iterative, multi-scale diagnostic procedure.<n>We introduce PathFinder, a multi-modal, multi-agent framework that emulates the decision-making process of expert pathologists.
  arXiv  Detail & Related papers  (2025-02-13T03:08:02Z)
• Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios [46.729092855387165]
  We study the choice of the backbone LLM for medical AI agents, which is the foundation for the agent's overall reasoning and action generation.<n>Our findings demonstrate o1's ability to enhance diagnostic accuracy and consistency, paving the way for smarter, more responsive AI tools.
  arXiv  Detail & Related papers  (2024-11-16T18:19:53Z)
• PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathology [15.419350834457136]
  We present PathAsst, a multimodal generative foundation AI assistant to revolutionize diagnostic and predictive analytics in pathology. The development of PathAsst involves three pivotal steps: data acquisition, CLIP model adaptation, and the training of PathAsst's multimodal generative capabilities. The experimental results of PathAsst show the potential of harnessing AI-powered generative foundation model to improve pathology diagnosis and treatment processes.
  arXiv  Detail & Related papers  (2023-05-24T11:55:50Z)
• Computational Pathology: A Survey Review and The Way Forward [35.29627164279813]
  Computational Pathology CPath is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. Main objective for CPath is to develop infrastructure and vision of digital diagnostics as an assistive CAD system for clinical pathology.
  arXiv  Detail & Related papers  (2023-04-11T20:28:33Z)
• Hierarchical Reinforcement Learning for Automatic Disease Diagnosis [52.111516253474285]
  We propose to integrate a hierarchical policy structure of two levels into the dialogue systemfor policy learning. The proposed policy structure is capable to deal with diagnosis problem including large number of diseases and symptoms.
  arXiv  Detail & Related papers  (2020-04-29T15:02:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.