UltrON: Ultrasound Occupancy Networks
- URL: http://arxiv.org/abs/2509.08991v1
- Date: Wed, 10 Sep 2025 20:38:59 GMT
- Title: UltrON: Ultrasound Occupancy Networks
- Authors: Magdalena Wysocki, Felix Duelmer, Ananya Bal, Nassir Navab, Mohammad Farid Azampour,
- Abstract summary: Implicit representations, such as SDF and occupancy function, offer a powerful alternative to traditional voxel- or mesh-based methods.<n>These approaches hinge on precise annotations, overlooking the rich acoustic information embedded in B-mode intensity.<n>We propose an occupancy-based representation and introduce glsUltrON that leverages acoustic features to improve geometric consistency.
- Score: 38.32197440821245
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In free-hand ultrasound imaging, sonographers rely on expertise to mentally integrate partial 2D views into 3D anatomical shapes. Shape reconstruction can assist clinicians in this process. Central to this task is the choice of shape representation, as it determines how accurately and efficiently the structure can be visualized, analyzed, and interpreted. Implicit representations, such as SDF and occupancy function, offer a powerful alternative to traditional voxel- or mesh-based methods by modeling continuous, smooth surfaces with compact storage, avoiding explicit discretization. Recent studies demonstrate that SDF can be effectively optimized using annotations derived from segmented B-mode ultrasound images. Yet, these approaches hinge on precise annotations, overlooking the rich acoustic information embedded in B-mode intensity. Moreover, implicit representation approaches struggle with the ultrasound's view-dependent nature and acoustic shadowing artifacts, which impair reconstruction. To address the problems resulting from occlusions and annotation dependency, we propose an occupancy-based representation and introduce \gls{UltrON} that leverages acoustic features to improve geometric consistency in weakly-supervised optimization regime. We show that these features can be obtained from B-mode images without additional annotation cost. Moreover, we propose a novel loss function that compensates for view-dependency in the B-mode images and facilitates occupancy optimization from multiview ultrasound. By incorporating acoustic properties, \gls{UltrON} generalizes to shapes of the same anatomy. We show that \gls{UltrON} mitigates the limitations of occlusions and sparse labeling and paves the way for more accurate 3D reconstruction. Code and dataset will be available at https://github.com/magdalena-wysocki/ultron.
Related papers
- Joint Semantic and Rendering Enhancements in 3D Gaussian Modeling with Anisotropic Local Encoding [86.55824709875598]
We propose a joint enhancement framework for 3D semantic Gaussian modeling that synergizes both semantic and rendering branches.<n>Unlike conventional point cloud shape encoding, we introduce an anisotropic 3D Gaussian Chebyshev descriptor to capture fine-grained 3D shape details.<n>We employ a cross-scene knowledge transfer module to continuously update learned shape patterns, enabling faster convergence and robust representations.
arXiv Detail & Related papers (2026-01-05T18:33:50Z) - DiffUS: Differentiable Ultrasound Rendering from Volumetric Imaging [0.0]
Intraoperative ultrasound imaging provides real-time guidance during numerous surgical procedures.<n>But its interpretation is complicated by noise, volumetric artifacts, and poor alignment with high-resolution preoperative MRI/CT scans.<n>We present DiffUS, a physics-based reflection that synthesizes realistic B-mode images from volumetric imaging.
arXiv Detail & Related papers (2025-08-09T01:04:11Z) - Decompositional Neural Scene Reconstruction with Generative Diffusion Prior [64.71091831762214]
Decompositional reconstruction of 3D scenes, with complete shapes and detailed texture, is intriguing for downstream applications.<n>Recent approaches incorporate semantic or geometric regularization to address this issue, but they suffer significant degradation in underconstrained areas.<n>We propose DP-Recon, which employs diffusion priors in the form of Score Distillation Sampling (SDS) to optimize the neural representation of each individual object under novel views.
arXiv Detail & Related papers (2025-03-19T02:11:31Z) - Denoising via Repainting: an image denoising method using layer wise medical image repainting [6.195127726026568]
We propose a multi-scale approach that integrates anisotropic Gaussian filtering and progressive Bezier-path redrawing.<n>Our method constructs a scale-space pyramid to mitigate noise while preserving structural details.<n> Empirical results on multiple MRI datasets demonstrate consistent improvements in PSNR and SSIM over competing methods.
arXiv Detail & Related papers (2025-03-11T06:54:37Z) - Enhancing Free-hand 3D Photoacoustic and Ultrasound Reconstruction using Deep Learning [3.8426872518410997]
This study introduces a motion-based learning network with a global-local self-attention module (MoGLo-Net) to enhance 3D reconstruction in handheld photoacoustic and ultrasound (PAUS) imaging.<n>MoGLo-Net exploits the critical regions, such as fully-developed speckle area or high-echogenic tissue area within successive ultrasound images to accurately estimate motion parameters.
arXiv Detail & Related papers (2025-02-05T11:59:23Z) - CP-UNet: Contour-based Probabilistic Model for Medical Ultrasound Images Segmentation [15.56723271531489]
We propose a contour-based probabilistic segmentation model CP-UNet.
It guides the segmentation network to enhance its focus on contour during decoding.
We show that our method performs better on breast and thyroid lesions segmentation.
arXiv Detail & Related papers (2024-11-21T15:56:30Z) - FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenes [50.534213038479926]
FreeSplat is capable of reconstructing geometrically consistent 3D scenes from long sequence input towards free-view synthesis.
We propose a simple but effective free-view training strategy that ensures robust view synthesis across broader view range regardless of the number of views.
arXiv Detail & Related papers (2024-05-28T08:40:14Z) - Feature-aggregated spatiotemporal spine surface estimation for wearable
patch ultrasound volumetric imaging [4.287216236596808]
We propose to use a patch-like wearable ultrasound solution to capture the reflective bone surfaces from multiple imaging angles.
Our wearable ultrasound system can potentially provide intuitive and accurate interventional guidance for clinicians in augmented reality setting.
arXiv Detail & Related papers (2022-11-11T02:15:48Z) - DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurring [66.91879314310842]
We propose an explicit deconvolution process in a feature space by integrating a classical Wiener deconvolution framework with learned deep features.
A multi-scale cascaded feature refinement module then predicts the deblurred image from the deconvolved deep features.
We show that the proposed deep Wiener deconvolution network facilitates deblurred results with visibly fewer artifacts and quantitatively outperforms state-of-the-art non-blind image deblurring methods by a wide margin.
arXiv Detail & Related papers (2021-03-18T00:38:11Z) - Weakly-supervised Learning For Catheter Segmentation in 3D Frustum
Ultrasound [74.22397862400177]
We propose a novel Frustum ultrasound based catheter segmentation method.
The proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume.
arXiv Detail & Related papers (2020-10-19T13:56:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.