Unified Ultrasound Intelligence Toward an End-to-End Agentic System

• URL: http://arxiv.org/abs/2604.16914v2
• Date: Wed, 22 Apr 2026 12:38:58 GMT
• Title: Unified Ultrasound Intelligence Toward an End-to-End Agentic System
• Abstract summary: USTri is a tri-stage ultrasound intelligence pipeline for unified multi-organ, multi-task analysis.<n>Stage I trains a universal generalist USGen on different domains to learn broad, transferable priors.<n>Stage II builds USpec keeping USGen frozen and finetuning heads.<n>Stage III introduces USAgent, which mimics clinician specialists for multi-step inference and structured reports.
• Score: 8.884663182013282
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Clinical ultrasound analysis demands models that generalize across heterogeneous organs, views, and devices, while supporting interpretable workflow-level analysis. Existing methods often rely on task-wise adaptation, and joint learning may be unstable due to cross-task interference, making it hard to deliver workflow-level outputs in practice. To address these challenges, we present USTri, a tri-stage ultrasound intelligence pipeline for unified multi-organ, multi-task analysis. Stage I trains a universal generalist USGen on different domains to learn broad, transferable priors that are robust to device and protocol variability. To better handle domain shifts and reach task-aligned performance while preserving ultrasound shared knowledge, Stage II builds USpec by keeping USGen frozen and finetuning dataset-specific heads. Stage III introduces USAgent, which mimics clinician workflows by orchestrating USpec specialists for multi-step inference and deterministic structured reports. On the FMC\_UIA validation set, our model achieves the best overall performance across 4 task types and 27 datasets, outperforming state-of-the-art methods. Moreover, qualitative results show that USAgent produces clinically structured reports with high accuracy and interpretability. Our study suggests a scalable path to ultrasound intelligence that generalizes across heterogeneous ultrasound tasks and supports consistent end-to-end clinical workflows. The code is publicly available at: https://github.com/MacDunno/USTri.

Related papers

• US-VLA: An Ultrasound Vision-Language-Action Model for Embodied Abdomina [18.156551505447226]
  We propose an ultrasound vision-language-action model (US-VLA) for automated ultrasound scanning.<n>US-VLA encodes clinical semantic goals and generates sequential probe manipulation actions under real-time ultrasound feedback.<n>Experiments demonstrate that US-VLA achieves competitive performance in ultrasound probe manipulation tasks.
  arXiv  Detail & Related papers  (2026-08-17T04:12:21Z)
• Towards Autonomous and Auditable Medical Imaging Model Development [53.326510777116766]
  We introduce AMID, an autonomous multi-agent framework for medical imaging model development.<n>AMID first proposes Data-Conditioned Method Planning, which refines coarse task-level search spaces into executable, parallelizable method lanes.<n>It then develops Verification-Guided Two-Stage Optimization, moving from broad early exploration of diverse method lanes to selective exploitation of promising candidates.
  arXiv  Detail & Related papers  (2026-07-12T00:54:06Z)
• Towards Reliable Fetal Ultrasound Interpretation with Multi-Agent Collaboration [29.755530162930707]
  FetUSAgents is a tool-augmented multi-agent system for comprehensive fetal ultrasound interpretation.<n>It supports visual question answering (VQA), report generation, image captioning, and video summarization.<n>We construct FetUS-VQA, a dedicated VQA benchmark for fetal ultrasound, comprising 1,892 images and 3,205 question-answer pairs.
  arXiv  Detail & Related papers  (2026-05-25T02:22:53Z)
• Towards a Virtual Neuroscientist: Autonomous Neuroimaging Analysis via Multi-Agent Collaboration [53.772014300855375]
  We introduce NIAgent, a multi-agent system for autonomous end-to-end neuroimaging analysis.<n>Unlike conventional flat tool-calling agents, NIAgent adopts a code-centric execution paradigm.<n>We propose a hierarchical verification framework for autonomous quality control, integrating cohort-level metric screening with agentic visual inspection.
  arXiv  Detail & Related papers  (2026-05-10T06:30:19Z)
• Agentic Large Language Models for Training-Free Neuro-Radiological Image Analysis [19.715805184063168]
  Agentic AI offers a new solution, eliminating the need for intrinsic 3D processing.<n>We present a training-free agentic pipeline for automated brain MRI analysis.<n>Our results demonstrate that agentic AI can solve highly neuro-radiological image analysis tasks through tool use without the need for training or fine-tuning.
  arXiv  Detail & Related papers  (2026-04-17T22:04:16Z)
• AURORA: Adaptive Unified Representation for Robust Ultrasound Analysis [18.677691292710325]
  We propose a unified multi-task framework based on a transformer visual encoder from the Qwen3-VL family.<n>Each task is handled by a small task-specific prediction head, while training uses task-aware sampling and selective loss balancing.<n>The performance improved from 67% to 85% on the validation set and achieved an average score of 81.84% on the official test set.
  arXiv  Detail & Related papers  (2026-03-19T18:01:38Z)
• FetalAgents: A Multi-Agent System for Fetal Ultrasound Image and Video Analysis [25.102840990979985]
  We propose FetalAgents, the first multi-agent system for comprehensive fetal US analysis.<n>Through a lightweight, agentic coordination framework, FetalAgents dynamically orchestrates specialized vision experts to maximize performance across diagnosis, measurement, and segmentation.<n>Furthermore, FetalAgents advances beyond static image analysis by supporting end-to-end video stream summarization.
  arXiv  Detail & Related papers  (2026-03-10T14:37:28Z)
• Towards Better Ultrasound Video Segmentation Foundation Model: An Empirical study on SAM2 Finetuning from Data Perspective [0.7629717457706325]
  We present a data-centric investigation of SAM2 adaptation for ultrasound video segmentation.<n>We analyze how training-set size, video duration, and augmentation schemes affect adaptation performance.
  arXiv  Detail & Related papers  (2025-11-07T21:45:18Z)
• A Fully Open and Generalizable Foundation Model for Ultrasound Clinical Applications [77.3888788549565]
  We present EchoCare, a novel ultrasound foundation model for generalist clinical use.<n>We developed EchoCare via self-supervised learning on our curated, publicly available, large-scale dataset EchoCareData.<n>With minimal training, EchoCare outperforms state-of-the-art comparison models across 10 representative ultrasound benchmarks.
  arXiv  Detail & Related papers  (2025-09-15T10:05:31Z)
• MedSeqFT: Sequential Fine-tuning Foundation Models for 3D Medical Image Segmentation [55.37355146924576]
  MedSeqFT is a sequential fine-tuning framework for medical image analysis.<n>It adapts pre-trained models to new tasks while refining their representational capacity.<n>It consistently outperforms state-of-the-art fine-tuning strategies.
  arXiv  Detail & Related papers  (2025-09-07T15:22:53Z)
• The Efficacy of Semantics-Preserving Transformations in Self-Supervised Learning for Medical Ultrasound [60.80780313225093]
  This study systematically investigated the impact of data augmentation and preprocessing strategies in self-supervised learning for lung ultrasound.<n>Three data augmentation pipelines were assessed: a baseline pipeline commonly used across imaging domains, a novel semantic-preserving pipeline designed for ultrasound, and a distilled set of the most effective transformations from both pipelines.
  arXiv  Detail & Related papers  (2025-04-10T16:26:47Z)
• Clairvoyance: A Pipeline Toolkit for Medical Time Series [95.22483029602921]
  Time-series learning is the bread and butter of data-driven *clinical decision support* Clairvoyance proposes a unified, end-to-end, autoML-friendly pipeline that serves as a software toolkit. Clairvoyance is the first to demonstrate viability of a comprehensive and automatable pipeline for clinical time-series ML.
  arXiv  Detail & Related papers  (2023-10-28T12:08:03Z)
• Learning Autonomous Ultrasound via Latent Task Representation and Robotic Skills Adaptation [2.3830437836694185]
  We propose the latent task representation and the robotic skills adaptation for autonomous ultrasound in this paper. During the offline stage, the multimodal ultrasound skills are merged and encapsulated into a low-dimensional probability model. During the online stage, the probability model will select and evaluate the optimal prediction.
  arXiv  Detail & Related papers  (2023-07-25T08:32:36Z)
• Factored Attention and Embedding for Unstructured-view Topic-related Ultrasound Report Generation [70.7778938191405]
  We propose a novel factored attention and embedding model (termed FAE-Gen) for the unstructured-view topic-related ultrasound report generation. The proposed FAE-Gen mainly consists of two modules, i.e., view-guided factored attention and topic-oriented factored embedding, which capture the homogeneous and heterogeneous morphological characteristic across different views.
  arXiv  Detail & Related papers  (2022-03-12T15:24:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.