Learning Perspective Deformation in X-Ray Transmission Imaging

• URL: http://arxiv.org/abs/2202.06366v1
• Date: Sun, 13 Feb 2022 17:25:01 GMT
• Title: Learning Perspective Deformation in X-Ray Transmission Imaging
• Authors: Yixing Huang, Andreas Maier, Rainer Fietkau, Christoph Bert, Florian Putz
• Abstract summary: In cone-beam X-ray transmission imaging, due to the divergence of X-rays, imaged structures with different depths have different magnification factors on an X-ray detector. Perspective deformation causes difficulty in direct, accurate geometric assessments of anatomical structures. We investigate on learning perspective deformation, i.e., converting perspective projections into orthogonal projections.
• Score: 8.55389652039053
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In cone-beam X-ray transmission imaging, due to the divergence of X-rays, imaged structures with different depths have different magnification factors on an X-ray detector, which results in perspective deformation. Perspective deformation causes difficulty in direct, accurate geometric assessments of anatomical structures. In this work, to reduce perspective deformation in X-ray images acquired from regular cone-beam computed tomography (CBCT) systems, we investigate on learning perspective deformation, i.e., converting perspective projections into orthogonal projections. Directly converting a single perspective projection image into an orthogonal projection image is extremely challenging due to the lack of depth information. Therefore, we propose to utilize one additional perspective projection, a complementary (180-degree) or orthogonal (90-degree) view, to provide a certain degree of depth information. Furthermore, learning perspective deformation in different spatial domains is investigated. Our proposed method is evaluated on numerical spherical bead phantoms as well as patients' chest and head X-ray data. The experiments on numerical bead phantom data demonstrate that learning perspective deformation in polar coordinates has significant advantages over learning in Cartesian coordinates, as root-mean-square error (RMSE) decreases from 5.31 to 1.40, while learning in log-polar coordinates has no further considerable improvement (RMSE = 1.85). In addition, using a complementary view (RMSE = 1.40) is better than an orthogonal view (RMSE = 3.87). The experiments on patients' chest and head data demonstrate that learning perspective deformation using dual complementary views is also applicable in anatomical X-ray data, allowing accurate cardiothoracic ratio measurements in chest X-ray images and cephalometric analysis in synthetic cephalograms from cone-beam X-ray projections.

Related papers

• 3DDX: Bone Surface Reconstruction from a Single Standard-Geometry Radiograph via Dual-Face Depth Estimation [7.832005676209272]
  3D reconstruction from a single radiograph, so-called 2D-3D reconstruction, offers the possibility of various clinical applications. We propose a novel approach that simultaneously learns multiple depth maps derived from the X-ray image to computed tomography registration.
  arXiv  Detail & Related papers  (2024-09-25T07:48:57Z)
• Calculation of Femur Caput Collum Diaphyseal angle for X-Rays images using Semantic Segmentation [2.3757237109481557]
  This paper investigates the use of deep learning approaches to estimate the femur caput-collum-diaphyseal angle from X-ray images. We present a deep-learning algorithm that can reliably estimate the femur CCD angle from X-ray images.
  arXiv  Detail & Related papers  (2024-04-25T23:42:09Z)
• XProspeCT: CT Volume Generation from Paired X-Rays [0.0]
  We build on previous research to convert X-ray images into simulated CT volumes. Model variations include UNet architectures, custom connections, activation functions, loss functions, and a novel back projection approach.
  arXiv  Detail & Related papers  (2024-02-11T21:57:49Z)
• B-Spine: Learning B-Spline Curve Representation for Robust and Interpretable Spinal Curvature Estimation [50.208310028625284]
  We propose B-Spine, a novel deep learning pipeline to learn B-spline curve representation of the spine. We estimate the Cobb angles for spinal curvature estimation from low-quality X-ray images.
  arXiv  Detail & Related papers  (2023-10-14T15:34:57Z)
• XTransCT: Ultra-Fast Volumetric CT Reconstruction using Two Orthogonal X-Ray Projections for Image-guided Radiation Therapy via a Transformer Network [8.966238080182263]
  We introduce a novel Transformer architecture, termed XTransCT, to facilitate real-time reconstruction of CT images from two-dimensional X-ray images. Our findings indicate that our algorithm surpasses other methods in image quality, structural precision, and generalizability. In comparison to previous 3D convolution-based approaches, we note a substantial speed increase of approximately 300 %, achieving 44 ms per 3D image reconstruction.
  arXiv  Detail & Related papers  (2023-05-31T07:41:10Z)
• Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging [65.47834983591957]
  We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan. The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
  arXiv  Detail & Related papers  (2023-05-27T03:55:19Z)
• Perspective Projection-Based 3D CT Reconstruction from Biplanar X-rays [32.98966469644061]
  We propose PerX2CT, a novel CT reconstruction framework from X-ray. Our proposed method provides a different combination of features for each coordinate which implicitly allows the model to obtain information about the 3D location.
  arXiv  Detail & Related papers  (2023-03-09T14:45:25Z)
• Incremental Cross-view Mutual Distillation for Self-supervised Medical CT Synthesis [88.39466012709205]
  This paper builds a novel medical slice to increase the between-slice resolution. Considering that the ground-truth intermediate medical slices are always absent in clinical practice, we introduce the incremental cross-view mutual distillation strategy. Our method outperforms state-of-the-art algorithms by clear margins.
  arXiv  Detail & Related papers  (2021-12-20T03:38:37Z)
• SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detection [76.01333073259677]
  We propose the use of Space-aware Memory Queues for In-painting and Detecting anomalies from radiography images (abbreviated as SQUID) We show that SQUID can taxonomize the ingrained anatomical structures into recurrent patterns; and in the inference, it can identify anomalies (unseen/modified patterns) in the image.
  arXiv  Detail & Related papers  (2021-11-26T13:47:34Z)
• XraySyn: Realistic View Synthesis From a Single Radiograph Through CT Priors [118.27130593216096]
  A radiograph visualizes the internal anatomy of a patient through the use of X-ray, which projects 3D information onto a 2D plane. To the best of our knowledge, this is the first work on radiograph view synthesis. We show that by gaining an understanding of radiography in 3D space, our method can be applied to radiograph bone extraction and suppression without groundtruth bone labels.
  arXiv  Detail & Related papers  (2020-12-04T05:08:53Z)
• From Perspective X-ray Imaging to Parallax-Robust Orthographic Stitching [47.44626333193997]
  In this work, we leverage the Fourier slice theorem to aggregate information from multiple transmission images in parallax-free domains. The semantics of the stitched image are restored using a novel deep learning strategy that exploits similarity measures designed around frequency. Our pipeline, not only stitches images, but also provides orthographic reconstruction that enables metric measurements of clinically relevant quantities directly on the 2D image plane.
  arXiv  Detail & Related papers  (2020-03-05T23:16:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.