STEP: A Modular Silent Trial Engine for Operational Evaluation of Digital Pathology AI in Routine Workflow

• URL: http://arxiv.org/abs/2608.28708v1
• Date: Thu, 27 Aug 2026 20:33:39 GMT
• Title: STEP: A Modular Silent Trial Engine for Operational Evaluation of Digital Pathology AI in Routine Workflow
• Abstract summary: Silent trials provide a bridge between retrospective validation of AI models and their use in clinical care.<n>We developed a reusable software platform for orchestrating prospective silent trials of computational pathology AI models.
• Score: 1.6877591150411722
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Prospective silent trials provide an important bridge between retrospective validation of artificial intelligence (AI) models and their use in clinical care by evaluating model performance and operational reliability on live clinical data without influencing patient management. In computational pathology, conducting silent trials requires integration across laboratory information systems, digital pathology infrastructure, computational resources, and model inference pipelines, and these workflows are often implemented using application-specific software. We developed the Silent Trial Engine for Pathology (STEP), a reusable software platform for orchestrating prospective silent trials of computational pathology AI models across heterogeneous clinical and computational environments. STEP separates common trial orchestration from institution-specific data access and compute infrastructure through modular adapter interfaces. The platform supports scheduled case discovery, per-slide inference submission, deterministic idempotency, failure recovery, result and ancillary-data ingestion, persistent trial and run state, and audit logging, with compute adapters supporting local execution and high-performance computing environments using LSF and Slurm. STEP was deployed at three institutions to support prospective silent evaluation of EAGLE, an AI model for predicting EGFR mutation status from hematoxylin and eosin-stained whole-slide images. By separating trial-level workflow logic from site-specific integrations, STEP enables a common execution framework to operate across heterogeneous pathology environments while maintaining durable and auditable trial state. This approach may reduce duplicated engineering effort and facilitate systematic real-world evaluation of computational pathology AI before interventional clinical deployment.

Related papers

• A Scalable AI-Powered System for Explainable Machine Learning Pipelines in Brain Tumor [2.2689094912853767]
  We present the first version of a scalable web-based visual analytics system designed to support radiomics-driven machine learning inference.<n>The proposed framework offers a practical foundation for clinically oriented AI applications in brain tumor analysis.
  arXiv  Detail & Related papers  (2026-07-29T12:26:15Z)
• Dementia Etiology Diagnosis via Collaborative Meta Knowledge Enhancement [81.27196033392559]
  We propose a Collaborative Meta Knowledge Enhancement (COME) framework for dementia etiology diagnosis.<n>COME injects multi-center acquisition semantics, source identifiers, and modality indicators as heterogeneity-aware embeddings into a unified Transformer architecture for scale-up training.<n>Our method achieves state-of-the-art in-domain performance with a mean macro-averaged AUC of 85.62% and a 4.29-point gain over the strongest baseline.
  arXiv  Detail & Related papers  (2026-07-24T04:26:47Z)
• FMRP-LEAN: A HIPAA-Compliant AI-Augmented LIMS Architecture for End-to-End Clinical Assay Workflow Optimization [0.0]
  This paper presents FMRP-LEAN, a HIPAA-compliant, AI-augmented Laboratory Information Management System (LIMS) architecture that formalizes bio-specimen lifecycle management through a finite-state workflow model with explicit transition guards and dwell-time observability.
  arXiv  Detail & Related papers  (2026-07-22T17:11:52Z)
• The Large Cancer Assistant (LCA): A Model-Agnostic Orchestration Framework for Scalable Clinical Decision Support in Oncology [0.0]
  Large Cancer Assistant (LCA) is a model-agnostic, post-hoc orchestration framework designed for scalable clinical decision support.<n>LCA is mathematically formalized as a 7-tuple architecture grounded in the principle of Algorithmic Impermeability.<n>System dynamically orchestrates data via a Cancer Switching Module and intentionally isolates the core AI execution from volatile hospital IT infrastructures.
  arXiv  Detail & Related papers  (2026-07-07T17:38:47Z)
• Evaluating Agentic Harness Systems for Autonomous Computational Pathology [19.24356620524394]
  ACP-Bench is a framework that adapts general agentic harness systems from computational pathology support toward ACP workflow capability.<n>ACP-Bench evaluates 41 pathology workflow tasks, including 24 biomarker, 7 morphology and 10 prognosis tasks spanning 6 body-system groups and 9 endpoint families.
  arXiv  Detail & Related papers  (2026-07-01T10:13:13Z)
• Democratizing and accelerating AI-driven pathology research through agentic intelligence [32.63552924838788]
  PathLab is an agentic framework that translates research objectives into executable and validated computational pathology.<n>We evaluated PathLab across 12 public datasets spanning four representative task families.<n>In controlled user studies, PathLab substantially reduced the time required to generate executable analytical pipelines.
  arXiv  Detail & Related papers  (2026-06-12T16:11:50Z)
• A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Models [48.385356148620815]
  Recent EEG foundation models have demonstrated promising transfer capabilities across tasks and datasets.<n>We propose a multi-dimensional evaluation framework for assessing EEG models under realistic low-resource conditions.
  arXiv  Detail & Related papers  (2026-05-27T14:51:54Z)
• Towards a Virtual Neuroscientist: Autonomous Neuroimaging Analysis via Multi-Agent Collaboration [53.772014300855375]
  We introduce NIAgent, a multi-agent system for autonomous end-to-end neuroimaging analysis.<n>Unlike conventional flat tool-calling agents, NIAgent adopts a code-centric execution paradigm.<n>We propose a hierarchical verification framework for autonomous quality control, integrating cohort-level metric screening with agentic visual inspection.
  arXiv  Detail & Related papers  (2026-05-10T06:30:19Z)
• SelfAI: Building a Self-Training AI System with LLM Agents [79.10991818561907]
  SelfAI is a general multi-agent platform that combines a User Agent for translating high-level research objectives into standardized experimental configurations.<n>An Experiment Manager orchestrates parallel, fault-tolerant training across heterogeneous hardware while maintaining a structured knowledge base for continuous feedback.<n>Across regression, computer vision, scientific computing, medical imaging, and drug discovery benchmarks, SelfAI consistently achieves strong performance and reduces redundant trials.
  arXiv  Detail & Related papers  (2025-11-29T09:18:39Z)
• Timely Clinical Diagnosis through Active Test Selection [49.091903570068155]
  We propose ACTMED (Adaptive Clinical Test selection via Model-based Experimental Design) to better emulate real-world diagnostic reasoning.<n>LLMs act as flexible simulators, generating plausible patient state distributions and supporting belief updates without requiring structured, task-specific training data.<n>We evaluate ACTMED on real-world datasets and show it can optimize test selection to improve diagnostic accuracy, interpretability, and resource use.
  arXiv  Detail & Related papers  (2025-10-21T18:10:45Z)
• PyTDC: A multimodal machine learning training, evaluation, and inference platform for biomedical foundation models [59.17570021208177]
  PyTDC is a machine-learning platform providing streamlined training, evaluation, and inference software for multimodal biological AI models.<n>This paper discusses the components of PyTDC's architecture and, to our knowledge, the first-of-its-kind case study on the introduced single-cell drug-target nomination ML task.
  arXiv  Detail & Related papers  (2025-05-08T18:15:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.