Epi-NAF: Enhancing Neural Attenuation Fields for Limited-Angle CT with Epipolar Consistency Conditions

• URL: http://arxiv.org/abs/2411.06181v1
• Date: Sat, 09 Nov 2024 13:48:34 GMT
• Title: Epi-NAF: Enhancing Neural Attenuation Fields for Limited-Angle CT with Epipolar Consistency Conditions
• Authors: Daniel Gilo, Tzofi Klinghoffer, Or Litany,
• Abstract summary: We present a novel loss term based on consistency conditions between corresponding epipolar lines in X-ray projection images. Epi-NAF propagates supervision from input views within the limited-angle range to predicted projections over the full cone-beam CT range. This loss results in both qualitative and quantitative improvements in reconstruction compared to baseline methods.
• Score: 13.793995728900779
• License:
• Abstract: Neural field methods, initially successful in the inverse rendering domain, have recently been extended to CT reconstruction, marking a paradigm shift from traditional techniques. While these approaches deliver state-of-the-art results in sparse-view CT reconstruction, they struggle in limited-angle settings, where input projections are captured over a restricted angle range. We present a novel loss term based on consistency conditions between corresponding epipolar lines in X-ray projection images, aimed at regularizing neural attenuation field optimization. By enforcing these consistency conditions, our approach, Epi-NAF, propagates supervision from input views within the limited-angle range to predicted projections over the full cone-beam CT range. This loss results in both qualitative and quantitative improvements in reconstruction compared to baseline methods.

Related papers

• Intraoperative Registration by Cross-Modal Inverse Neural Rendering [61.687068931599846]
  We present a novel approach for 3D/2D intraoperative registration during neurosurgery via cross-modal inverse neural rendering. Our approach separates implicit neural representation into two components, handling anatomical structure preoperatively and appearance intraoperatively. We tested our method on retrospective patients' data from clinical cases, showing that our method outperforms state-of-the-art while meeting current clinical standards for registration.
  arXiv  Detail & Related papers  (2024-09-18T13:40:59Z)
• CoCPF: Coordinate-based Continuous Projection Field for Ill-Posed Inverse Problem in Imaging [78.734927709231]
  Sparse-view computed tomography (SVCT) reconstruction aims to acquire CT images based on sparsely-sampled measurements. Due to ill-posedness, implicit neural representation (INR) techniques may leave considerable holes'' (i.e., unmodeled spaces) in their fields, leading to sub-optimal results. We propose the Coordinate-based Continuous Projection Field (CoCPF), which aims to build hole-free representation fields for SVCT reconstruction.
  arXiv  Detail & Related papers  (2024-06-21T08:38:30Z)
• DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction [45.00528216648563]
  Diffusion Prior Driven Neural Representation (DPER) is an unsupervised framework designed to address the exceptionally ill-posed CT reconstruction inverse problems. DPER adopts the Half Quadratic Splitting (HQS) algorithm to decompose the inverse problem into data fidelity and distribution prior sub-problems. We conduct comprehensive experiments to evaluate the performance of DPER on LACT and ultra-SVCT reconstruction with two public datasets.
  arXiv  Detail & Related papers  (2024-04-27T12:55:13Z)
• Solving Low-Dose CT Reconstruction via GAN with Local Coherence [2.325977856241404]
  We propose a novel approach using generative adversarial networks (GANs) with enhanced local coherence. The proposed method can capture the local coherence of adjacent images by optical flow, which yields significant improvements in the precision and stability of the constructed images.
  arXiv  Detail & Related papers  (2023-09-24T08:55:42Z)
• Neural Modulation Fields for Conditional Cone Beam Neural Tomography [18.721488634071193]
  Cone Beam Neural Tomography (CondCBNT) shows improved performance for both high and low numbers of available projections on noise-free and noisy data. We propose a novel conditioning method where local modulations are modeled per patient as a field over the input domain through a Neural Modulation Field (NMF)
  arXiv  Detail & Related papers  (2023-07-17T09:41:01Z)
• APRF: Anti-Aliasing Projection Representation Field for Inverse Problem in Imaging [74.9262846410559]
  Sparse-view Computed Tomography (SVCT) reconstruction is an ill-posed inverse problem in imaging. Recent works use Implicit Neural Representations (INRs) to build the coordinate-based mapping between sinograms and CT images. We propose a self-supervised SVCT reconstruction method -- Anti-Aliasing Projection Representation Field (APRF) APRF can build the continuous representation between adjacent projection views via the spatial constraints.
  arXiv  Detail & Related papers  (2023-07-11T14:04:12Z)
• From NeurODEs to AutoencODEs: a mean-field control framework for width-varying Neural Networks [68.8204255655161]
  We propose a new type of continuous-time control system, called AutoencODE, based on a controlled field that drives dynamics. We show that many architectures can be recovered in regions where the loss function is locally convex.
  arXiv  Detail & Related papers  (2023-07-05T13:26:17Z)
• SNAF: Sparse-view CBCT Reconstruction with Neural Attenuation Fields [71.84366290195487]
  We propose SNAF for sparse-view CBCT reconstruction by learning the neural attenuation fields. Our approach achieves superior performance in terms of high reconstruction quality (30+ PSNR) with only 20 input views.
  arXiv  Detail & Related papers  (2022-11-30T14:51:14Z)
• FocalUNETR: A Focal Transformer for Boundary-aware Segmentation of CT Images [6.616213497895369]
  We propose a novel focal transformer-based image segmentation architecture to extract local visual features and global context from CT images. We demonstrate that this design significantly improves the quality of the CT-based prostate segmentation task over other competing methods.
  arXiv  Detail & Related papers  (2022-10-06T20:06:24Z)
• Body Composition Assessment with Limited Field-of-view Computed Tomography: A Semantic Image Extension Perspective [5.373119949253442]
  Field-of-view (FOV) tissue truncation beyond the lungs is common in routine lung screening computed tomography (CT) In this work, we formulate the problem from the semantic image extension perspective which only requires image data as inputs. The proposed two-stage method identifies a new FOV border based on the estimated extent of the complete body and imputes missing tissues in the truncated region.
  arXiv  Detail & Related papers  (2022-07-13T23:19:22Z)
• Computed Tomography Reconstruction using Generative Energy-Based Priors [13.634603375405744]
  We learn a parametric regularizer with a global receptive field by maximizing it's likelihood on reference CT data. We apply the regularizer to limited-angle and few-view CT reconstruction problems, where it outperforms traditional reconstruction algorithms by a large margin.
  arXiv  Detail & Related papers  (2022-03-23T18:26:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.