Dual-domain U-Nets with embedded back projection operators for motion-resolved 4D CBCT reconstruction

• URL: http://arxiv.org/abs/2608.03430v1
• Date: Tue, 04 Aug 2026 10:20:07 GMT
• Title: Dual-domain U-Nets with embedded back projection operators for motion-resolved 4D CBCT reconstruction
• Abstract summary: We propose a deep learning method for motion-resolved 4D CBCT reconstruction from conventional free-breathing scans.<n>Our CNN takes free-breathing 3D CBCT projections as input and predicts a static volume at maximum inhalation.<n>On clinical scans, our method showed sharper dynamic structures (e.g., diaphragm) and fewer motion streak artifacts than traditional reconstruction.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Four-dimensional cone beam CT (4D CBCT) is important for image-guided radiation therapy of thoracic cancers, but its use is limited by long scan times, causing high patient dose and motion/sparse-sampling artifacts. We propose a deep learning method for motion-resolved 4D CBCT reconstruction from conventional free-breathing scans, without a respiratory signal or explicit projection binning. Our CNN takes free-breathing 3D CBCT projections as input and predicts a static volume at maximum inhalation plus ten displacement vector fields (DVFs) spanning a breathing cycle. The network extends U-Net: the encoder acts on filtered projection stacks, the decoder acts in the volume domain, and skip connections are replaced with non-trainable back-projection functions at multiple resolutions to transfer features between domains. The model is trained on simulated CBCT scans and evaluated on 11 unseen simulated patients and 13 clinical free-breathing scans. Two additional models (60 s and 6 s scans) were evaluated by clinical experts on three and two scans, comparing single phases of our 4D reconstruction to reference 3D SART-TV images for tumor and esophagus visibility. Experts preferred our method for tumor visibility (59% vs. 36% no preference, 5% reference) and esophagus visibility (47% vs. 42%, 11%). On simulated data, image quality matched SART-TV (mean RMSE: -1.19 HU, PSNR: +0.09 dB, SSIM: -0.009) while enabling 4D reconstruction. On clinical scans, our method showed sharper dynamic structures (e.g., diaphragm) and fewer motion streak artifacts than traditional reconstruction. This non-patient-specific CNN predicts static volumes and full 4D respiratory motion models from a single free-breathing scan, without a respiratory surrogate or projection binning, reducing motion artifacts while adding motion-modeling capability.

Related papers

• Echo4DIR: 4D Implicit Heart Reconstruction from 2D Echocardiography Videos [35.992365807108584]
  We propose Echo4DIR, a novel test-time 4D implicit reconstruction framework.<n>We learn robust 3D shape priors from statistical shape models (SSMs) via a cardiac conditional SDF.<n>We show that Echo4DIR achieves state-of-the-art 4D cardiac mesh reconstruction, notably an impressive clinical overlap of up to 98.35% Dice and 96.75% IoU.
  arXiv  Detail & Related papers  (2026-05-21T07:01:23Z)
• CPT-4DMR: Continuous sPatial-Temporal Representation for 4D-MRI Reconstruction [11.238319012891324]
  We introduce a neural framework that considers respiratory motion as a smooth, continuous deformation steered by a 1D surrogate signal.<n>The proposed method significantly improves efficiency, reducing the total processing time from approximately five hours required to just 15 minutes of training.<n>It achieves superior performance compared to conventional methods, and demonstrates strong potential for application in 4D radiation therapy planning and real-time adaptive treatment.
  arXiv  Detail & Related papers  (2025-09-22T21:18:26Z)
• X$^{2}$-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction [64.2059940799033]
  Current methods discretize temporal resolution into fixed phases with respiratory gating devices.<n>X$2$-Gaussian, a novel framework, enables continuous-time 4DCT reconstruction by integrating dynamic radiative splatting with self-supervised respiratory motion learning.
  arXiv  Detail & Related papers  (2025-03-27T17:59:57Z)
• 4DRGS: 4D Radiative Gaussian Splatting for Efficient 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images [49.170407434313475]
  Existing methods often produce suboptimal results or require excessive computation time.<n>We propose 4D radiative Gaussian splatting (4DRGS) to achieve high-quality reconstruction efficiently.<n>4DRGS achieves impressive results in 5 minutes training, which is 32x faster than the state-of-the-art method.
  arXiv  Detail & Related papers  (2024-12-17T13:51:56Z)
• Resolving Variable Respiratory Motion From Unsorted 4D Computed Tomography [0.6938240959023204]
  Surrogate driven motion models can estimate variable motion across multiple cycles based on CT segments unsorted' from 4DCT. Our method produces a high-quality motion-compensated image together with estimates of the motion, including breath-to-breath variability.
  arXiv  Detail & Related papers  (2024-06-30T11:22:55Z)
• RSTAR4D: Rotational Streak Artifact Reduction in 4D CBCT using a Separable 4D CNN [13.596931860186013]
  Four-dimensional cone-beam computed tomography (4D CBCT) provides respiration-resolved images and can be used for image-guided radiation therapy. However, the ability to reveal respiratory motion comes at the cost of image artifacts. We propose a novel 4D neural network model, RSTAR4D-Net, designed to address Rotational STreak Artifact Reduction.
  arXiv  Detail & Related papers  (2024-03-25T01:54:57Z)
• TiAVox: Time-aware Attenuation Voxels for Sparse-view 4D DSA Reconstruction [34.1903749611458]
  We propose a Time-aware Attenuation Voxel (TiAVox) approach for sparse-view 4D DSA reconstruction. TiAVox introduces 4D attenuation voxel grids, which reflect attenuation properties from both spatial and temporal dimensions. We validated the TiAVox approach on both clinical and simulated datasets.
  arXiv  Detail & Related papers  (2023-09-05T15:34:37Z)
• Geometry-Aware Attenuation Learning for Sparse-View CBCT Reconstruction [53.93674177236367]
  Cone Beam Computed Tomography (CBCT) plays a vital role in clinical imaging. Traditional methods typically require hundreds of 2D X-ray projections to reconstruct a high-quality 3D CBCT image. This has led to a growing interest in sparse-view CBCT reconstruction to reduce radiation doses. We introduce a novel geometry-aware encoder-decoder framework to solve this problem.
  arXiv  Detail & Related papers  (2023-03-26T14:38:42Z)
• REGAS: REspiratory-GAted Synthesis of Views for Multi-Phase CBCT Reconstruction from a single 3D CBCT Acquisition [75.64791080418162]
  REGAS proposes a self-supervised method to synthesize the undersampled tomographic views and mitigate aliasing artifacts in reconstructed images. To address the large memory cost of deep neural networks on high resolution 4D data, REGAS introduces a novel Ray Path Transformation (RPT) that allows for distributed, differentiable forward projections.
  arXiv  Detail & Related papers  (2022-08-17T03:42:19Z)
• Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans [72.04652116817238]
  We propose a differentiable neural architecture search (DNAS) framework to automatically search for the 3D DL models for 3D chest CT scans classification. We also exploit the Class Activation Mapping (CAM) technique on our models to provide the interpretability of the results.
  arXiv  Detail & Related papers  (2021-01-14T03:45:01Z)
• 4D Spatio-Temporal Convolutional Networks for Object Position Estimation in OCT Volumes [69.62333053044712]
  3D convolutional neural networks (CNNs) have shown promising performance for pose estimation of a marker object using single OCT images. We extend 3D CNNs to 4D-temporal CNNs to evaluate the impact of additional temporal information for marker object tracking.
  arXiv  Detail & Related papers  (2020-07-02T12:02:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.