3D Ultrasound-Derived Pseudo-CT Synthesis Using a Transformer-Augmented Residual Network for Real-Time Operator Guidance

• URL: http://arxiv.org/abs/2605.04856v1
• Date: Wed, 06 May 2026 12:52:59 GMT
• Title: 3D Ultrasound-Derived Pseudo-CT Synthesis Using a Transformer-Augmented Residual Network for Real-Time Operator Guidance
• Abstract summary: Ultrasound (US) is non-ionizing and widely accessible; however, it is highly operator dependent and lacks quantitative tissue characterization.<n>This work presents a 3D ultrasound-derived pseudo-CT framework that generates CT-like anatomical reference volumes inferred from US.<n>The proposed method outperforms established baselines in structural fidelity and perceptual image quality.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Computed tomography (CT) is indispensable for clinical diagnosis and image-guided interventions but exposes patients to ionizing radiation, motivating the development of safer imaging alternatives. Ultrasound (US) is non-ionizing and widely accessible; however, it is highly operator dependent and lacks quantitative tissue characterization, often leading to diagnostic uncertainty and unnecessary CT examinations. This work presents a 3D ultrasound-derived pseudo-CT (UD-pCT) framework that generates CT-like anatomical reference volumes inferred from US, without aiming to reproduce physically accurate Hounsfield Units. Paired 3D kidney US and CT volumes from the TRUSTED dataset are first spatially aligned using a landmark-based multimodal registration pipeline, creating high-quality paired inputs for supervised training of an adversarial framework. The proposed Bottleneck Transformer Residual U-Net3D (BT-ResUNet3D) model employs a 3D residual encoder-decoder generator augmented with a transformer bottleneck, enabling effective modeling of fine-grained local anatomical structures as well as long-range volumetric dependencies, while a 3D Conditional PatchGAN discriminator enforces local structural realism in the synthesized pseudo-CT volumes. Quantitative evaluation using PSNR and SSIM demonstrates that the proposed method outperforms established baselines in structural fidelity and perceptual image quality. The UD-pCT volumes provide real-time anatomical reference for operator guidance, potentially reducing acquisition variability and unnecessary CT use. A limitation of this study is the relatively small paired dataset, which may limit the generalizability of the proposed model.

Related papers

• TR-GS: High-Fidelity Sparse-View CT Volumetric Rendering via t-Distribution Gaussian Splatting and Ray-Confidence Modeling [2.2725140324263333]
  TR-GS is a Gaussian-splatting framework for sparse view CT volumetric rendering.<n> Confidence-guided 3D wavelet regularization is used to balance high-frequency detail preservation and noise suppression.
  arXiv  Detail & Related papers  (2026-08-17T03:11:28Z)
• Big, Bright, or Invisible: A Frozen-Feature Benchmark of 3D CT Foundation Models [30.102620002840904]
  3D CT foundation models could assist routine interpretation by providing generalizable representations of anatomy and pathology.<n>We benchmark ten frozen CT encoders across three cohorts of thoracic CT scans.<n>We find no universal state-of-the-art, with rankings fluctuating significantly depending on the evaluation context.
  arXiv  Detail & Related papers  (2026-08-06T12:34:17Z)
• Learning from Compressed CT: Feature Attention Style Transfer and Structured Factorized Projections for Resource-Efficient Medical Image Analysis [0.18352113484137622]
  Feature Attention Style Transfer Transfer (FAST) is a novel framework that transfers from high-fidelity CT representations to a visual encoder operating on compressed inputs.<n>Structured Factorized Projection (SFP) is a parameter-efficient alternative to dense projection layers, reducing parameters by almost half.<n>Our contrastive learning pipeline, CT-Lite, integrates these components with a SigLIP-based objective alignment objective.
  arXiv  Detail & Related papers  (2026-05-01T06:35:53Z)
• Beyond the Embedding Bottleneck: Adaptive Retrieval-Augmented 3D CT Report Generation [10.885951167009694]
  3D CT embeddings encode discriminative pathology signals, yet exhibit severe dimensional concentration.<n>We propose textbfAdaRAG-CT, an adaptive augmentation framework that compensates for this visual bottleneck.<n>AdaRAG-CT achieves state-of-the-art clinical efficacy, improving Clinical F1 from 0.420 (CT-Agent) to 0.480 (+6 points)
  arXiv  Detail & Related papers  (2026-03-16T18:56:14Z)
• Resolution-Independent Neural Operators for Multi-Rate Sparse-View CT [67.14700058302016]
  Deep learning methods achieve high-fidelity reconstructions but often overfit to a fixed acquisition setup.<n>We propose Computed Tomography neural Operator (CTO), a unified CT reconstruction framework that extends to continuous function space.<n>CTO enables consistent multi-sampling-rate and cross-resolution performance, with on average >4dB PSNR gain over CNNs.
  arXiv  Detail & Related papers  (2025-12-13T08:31:46Z)
• Scaling Self-Supervised and Cross-Modal Pretraining for Volumetric CT Transformers [10.972744049555553]
  We introduce SPECTRE, a fully transformer-based foundation model for volumetric computed tomography (CT)<n>Our approach utilizes scalable 3D Vision Transformer architectures and modern self-supervised and vision-language pretraining strategies.<n>SPECTRE consistently outperforms prior CT foundation models in both zero-shot and fine-tuned settings.
  arXiv  Detail & Related papers  (2025-11-21T12:41:27Z)
• Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
  Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
  arXiv  Detail & Related papers  (2025-09-11T23:12:55Z)
• INeAT: Iterative Neural Adaptive Tomography [34.84974955073465]
  Iterative Neural Adaptive Tomography (INeAT) incorporates posture optimization to counteract the influence of posture perturbations in data. We demonstrate that INeAT achieves artifact-suppressed and resolution-enhanced reconstruction in scenarios with significant pose disturbances.
  arXiv  Detail & Related papers  (2023-11-03T01:00:36Z)
• AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers [75.20925220246689]
  endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature. This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
  arXiv  Detail & Related papers  (2023-09-25T19:34:12Z)
• On the Localization of Ultrasound Image Slices within Point Distribution Models [84.27083443424408]
  Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US) Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology. We present a framework for automated US image slice localization within a 3D shape representation.
  arXiv  Detail & Related papers  (2023-09-01T10:10:46Z)
• Unsupervised Contrastive Learning based Transformer for Lung Nodule Detection [6.693379403133435]
  Early detection of lung nodules with computed tomography (CT) is critical for the longer survival of lung cancer patients and better quality of life. Computer-aided detection/diagnosis (CAD) is proven valuable as a second or concurrent reader in this context. accurate detection of lung nodules remains a challenge for such CAD systems and even radiologists due to variability in size, location, and appearance of lung nodules. Motivated by recent computer vision techniques, here we present a self-supervised region-based 3D transformer model to identify lung nodules.
  arXiv  Detail & Related papers  (2022-04-30T01:19:00Z)
• A unified 3D framework for Organs at Risk Localization and Segmentation for Radiation Therapy Planning [56.52933974838905]
  Current medical workflow requires manual delineation of organs-at-risk (OAR) In this work, we aim to introduce a unified 3D pipeline for OAR localization-segmentation. Our proposed framework fully enables the exploitation of 3D context information inherent in medical imaging.
  arXiv  Detail & Related papers  (2022-03-01T17:08:41Z)
• Revisiting 3D Context Modeling with Supervised Pre-training for Universal Lesion Detection in CT Slices [48.85784310158493]
  We propose a Modified Pseudo-3D Feature Pyramid Network (MP3D FPN) to efficiently extract 3D context enhanced 2D features for universal lesion detection in CT slices. With the novel pre-training method, the proposed MP3D FPN achieves state-of-the-art detection performance on the DeepLesion dataset. The proposed 3D pre-trained weights can potentially be used to boost the performance of other 3D medical image analysis tasks.
  arXiv  Detail & Related papers  (2020-12-16T07:11:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.