OSCAR: Occupancy-based Shape Completion via Acoustic Neural Implicit Representations

• URL: http://arxiv.org/abs/2603.08279v1
• Date: Mon, 09 Mar 2026 11:51:56 GMT
• Title: OSCAR: Occupancy-based Shape Completion via Acoustic Neural Implicit Representations
• Abstract summary: We propose an occupancy-based shape completion method that reconstructs complete 3D anatomical geometry from partial ultrasound observations.<n>Our approach extracts the anatomical surface directly from the image, avoiding the need for anatomical labels during inference.<n>We show that this method outperforms state-of-the-art shape completion for B-mode ultrasound by 80% in HD95 score.
• Score: 35.20946695773807
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate 3D reconstruction of vertebral anatomy from ultrasound is important for guiding minimally invasive spine interventions, but it remains challenging due to acoustic shadowing and view-dependent signal variations. We propose an occupancy-based shape completion method that reconstructs complete 3D anatomical geometry from partial ultrasound observations. Crucially for intra-operative applications, our approach extracts the anatomical surface directly from the image, avoiding the need for anatomical labels during inference. This label-free completion relies on a coupled latent space representing both the image appearance and the underlying anatomical shape. By leveraging a Neural Implicit Representation (NIR) that jointly models both spatial occupancy and acoustic interactions, the method uses acoustic parameters to become implicitly aware of the unseen regions without explicit shadowing labels through tracking acoustic signal transmission. We show that this method outperforms state-of-the-art shape completion for B-mode ultrasound by 80% in HD95 score. We validate our approach both in-silico and on phantom US images with registered mesh models from CT labels, demonstrating accurate reconstruction of occluded anatomy and robust generalization across diverse imaging conditions. Code and data will be released on publication.

Related papers

• Anatomy-Grounded Synthetic Coronary Angiography for Geometry-Informed Multi-View Matching [6.620961894485603]
  We introduce a physically-grounded data generation framework that synthesizes high-fidelity Digital Reconstructed Radiographs (DRRs) from 3D Coronary CT Angiography (CCTA) volumes.<n>Our framework generates dense, highly accurate 3D-to-2D projection labels by simulating realistic C-arm acquisition geometry on patient anatomy at zero human cost.<n>Unlike real angiography where assessment relies on subjective human annotation, our dataset provides 2D correspondence labels with paired images, allowing human-free evaluation.
  arXiv  Detail & Related papers  (2026-06-26T14:58:23Z)
• US-X Complete: A Multi-Modal Approach to Anatomical 3D Shape Recovery [38.0728021642047]
  We present a novel multi-modal learning method for completing occluded anatomical structures in 3D ultrasound.<n>We generate paired training data consisting of: (1) 2D lateral vertebral views that simulate X-ray scans, and (2) 3D partial vertebrae representations.<n>Our method integrates morphological information both imaging modalities and demonstrates significant improvements in vertebral reconstruction.
  arXiv  Detail & Related papers  (2025-11-19T16:45:04Z)
• UltrON: Ultrasound Occupancy Networks [38.32197440821245]
  Implicit representations, such as SDF and occupancy function, offer a powerful alternative to traditional voxel- or mesh-based methods.<n>These approaches hinge on precise annotations, overlooking the rich acoustic information embedded in B-mode intensity.<n>We propose an occupancy-based representation and introduce glsUltrON that leverages acoustic features to improve geometric consistency.
  arXiv  Detail & Related papers  (2025-09-10T20:38:59Z)
• Intraoperative Registration by Cross-Modal Inverse Neural Rendering [61.687068931599846]
  We present a novel approach for 3D/2D intraoperative registration during neurosurgery via cross-modal inverse neural rendering. Our approach separates implicit neural representation into two components, handling anatomical structure preoperatively and appearance intraoperatively. We tested our method on retrospective patients' data from clinical cases, showing that our method outperforms state-of-the-art while meeting current clinical standards for registration.
  arXiv  Detail & Related papers  (2024-09-18T13:40:59Z)
• Class-Aware Cartilage Segmentation for Autonomous US-CT Registration in Robotic Intercostal Ultrasound Imaging [39.597735935731386]
  A class-aware cartilage bone segmentation network with geometry-constraint post-processing is presented to capture patient-specific rib skeletons. A dense skeleton graph-based non-rigid registration is presented to map the intercostal scanning path from a generic template to individual patients. Results demonstrate that the proposed graph-based registration method can robustly and precisely map the path from CT template to individual patients.
  arXiv  Detail & Related papers  (2024-06-06T14:15:15Z)
• CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
  We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images. The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism. We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
  arXiv  Detail & Related papers  (2024-03-21T15:13:36Z)
• AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers [75.20925220246689]
  endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature. This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
  arXiv  Detail & Related papers  (2023-09-25T19:34:12Z)
• On the Localization of Ultrasound Image Slices within Point Distribution Models [84.27083443424408]
  Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US) Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology. We present a framework for automated US image slice localization within a 3D shape representation.
  arXiv  Detail & Related papers  (2023-09-01T10:10:46Z)
• Feature-aggregated spatiotemporal spine surface estimation for wearable patch ultrasound volumetric imaging [4.287216236596808]
  We propose to use a patch-like wearable ultrasound solution to capture the reflective bone surfaces from multiple imaging angles. Our wearable ultrasound system can potentially provide intuitive and accurate interventional guidance for clinicians in augmented reality setting.
  arXiv  Detail & Related papers  (2022-11-11T02:15:48Z)
• SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detection [76.01333073259677]
  We propose the use of Space-aware Memory Queues for In-painting and Detecting anomalies from radiography images (abbreviated as SQUID) We show that SQUID can taxonomize the ingrained anatomical structures into recurrent patterns; and in the inference, it can identify anomalies (unseen/modified patterns) in the image.
  arXiv  Detail & Related papers  (2021-11-26T13:47:34Z)
• Tattoo tomography: Freehand 3D photoacoustic image reconstruction with an optical pattern [49.240017254888336]
  Photoacoustic tomography (PAT) is a novel imaging technique that can resolve both morphological and functional tissue properties. A current drawback is the limited field-of-view provided by the conventionally applied 2D probes. We present a novel approach to 3D reconstruction of PAT data that does not require an external tracking system.
  arXiv  Detail & Related papers  (2020-11-10T09:27:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.