Slice Imputation: Intermediate Slice Interpolation for Anisotropic 3D Medical Image Segmentation

• URL: http://arxiv.org/abs/2203.10773v1
• Date: Mon, 21 Mar 2022 07:33:49 GMT
• Title: Slice Imputation: Intermediate Slice Interpolation for Anisotropic 3D Medical Image Segmentation
• Authors: Zhaotao Wu, Jia Wei, Jiabing Wang, Rui Li
• Abstract summary: We introduce a novel frame-interpolation-based method for slice imputation to improve segmentation accuracy for anisotropic 3D medical images. Our method outperforms the competing slice imputation methods on both computed tomography and magnetic resonance images volumes.
• Score: 4.975202573768993
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce a novel frame-interpolation-based method for slice imputation to improve segmentation accuracy for anisotropic 3D medical images, in which the number of slices and their corresponding segmentation labels can be increased between two consecutive slices in anisotropic 3D medical volumes. Unlike previous inter-slice imputation methods, which only focus on the smoothness in the axial direction, this study aims to improve the smoothness of the interpolated 3D medical volumes in all three directions: axial, sagittal, and coronal. The proposed multitask inter-slice imputation method, in particular, incorporates a smoothness loss function to evaluate the smoothness of the interpolated 3D medical volumes in the through-plane direction (sagittal and coronal). It not only improves the resolution of the interpolated 3D medical volumes in the through-plane direction but also transforms them into isotropic representations, which leads to better segmentation performances. Experiments on whole tumor segmentation in the brain, liver tumor segmentation, and prostate segmentation indicate that our method outperforms the competing slice imputation methods on both computed tomography and magnetic resonance images volumes in most cases.

Related papers

• Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registration [50.602074919305636]
  This paper introduces a lightweight end-to-end Cardiac Ultrasound frame-to-volume Registration network, termed CU-Reg. We use epicardium prompt-guided anatomical clues to reinforce the interaction of 2D sparse and 3D dense features, followed by a voxel-wise local-global aggregation of enhanced features.
  arXiv  Detail & Related papers  (2024-06-20T17:47:30Z)
• Intensity-based 3D motion correction for cardiac MR images [9.413178499853156]
  We propose an algorithm that simultaneously aligns all SA and LA slices by maximizing the pair-wise intensity agreement between their intersections. Unlike previous works, our approach is formulated as a subject-specific optimization problem and requires no prior knowledge of the underlying anatomy.
  arXiv  Detail & Related papers  (2024-03-31T18:45:13Z)
• On the Localization of Ultrasound Image Slices within Point Distribution Models [84.27083443424408]
  Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US) Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology. We present a framework for automated US image slice localization within a 3D shape representation.
  arXiv  Detail & Related papers  (2023-09-01T10:10:46Z)
• 3DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation [52.699139151447945]
  We propose a novel adaptation method for transferring the segment anything model (SAM) from 2D to 3D for promptable medical image segmentation. Our model can outperform domain state-of-the-art medical image segmentation models on 3 out of 4 tasks, specifically by 8.25%, 29.87%, and 10.11% for kidney tumor, pancreas tumor, colon cancer segmentation, and achieve similar performance for liver tumor segmentation.
  arXiv  Detail & Related papers  (2023-06-23T12:09:52Z)
• Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging [65.47834983591957]
  We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan. The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
  arXiv  Detail & Related papers  (2023-05-27T03:55:19Z)
• Joint Semi-supervised 3D Super-Resolution and Segmentation with Mixed Adversarial Gaussian Domain Adaptation [13.477290490742224]
  Super-resolution in medical imaging aims to increase the resolution of images but is conventionally trained on features from low resolution datasets. Here we propose a semi-supervised multi-task generative adversarial network (Gemini-GAN) that performs joint super-resolution of the images and their labels. Our proposed approach is extensively evaluated on two transnational multi-ethnic populations of 1,331 and 205 adults respectively.
  arXiv  Detail & Related papers  (2021-07-16T15:42:39Z)
• Revisiting 3D Context Modeling with Supervised Pre-training for Universal Lesion Detection in CT Slices [48.85784310158493]
  We propose a Modified Pseudo-3D Feature Pyramid Network (MP3D FPN) to efficiently extract 3D context enhanced 2D features for universal lesion detection in CT slices. With the novel pre-training method, the proposed MP3D FPN achieves state-of-the-art detection performance on the DeepLesion dataset. The proposed 3D pre-trained weights can potentially be used to boost the performance of other 3D medical image analysis tasks.
  arXiv  Detail & Related papers  (2020-12-16T07:11:16Z)
• Convolutional 3D to 2D Patch Conversion for Pixel-wise Glioma Segmentation in MRI Scans [22.60715394470069]
  We devise a novel pixel-wise segmentation framework through a convolutional 3D to 2D MR patch conversion model. In our architecture, both local inter-slice and global intra-slice features are jointly exploited to predict class label of the central voxel in a given patch.
  arXiv  Detail & Related papers  (2020-10-20T20:42:52Z)
• Efficient and high accuracy 3-D OCT angiography motion correction in pathology [6.875092432376952]
  We propose a novel method for non-rigid 3-D motion correction of optical coherence tomography angiography volumes. This is the first approach that aligns predominantly axial structural features in a joint optimization. We show significant advances in both transverse co-alignment and distortion correction, especially in the pathologic subgroup.
  arXiv  Detail & Related papers  (2020-10-14T10:20:17Z)
• Enhanced 3D Myocardial Strain Estimation from Multi-View 2D CMR Imaging [0.0]
  We propose an enhanced 3D myocardial strain estimation procedure, which combines complementary displacement information from multiple orientations of a single imaging modality (untagged CMR SSFP images) We register the sets of short-axis, four-chamber and two-chamber views via a 2D non-rigid registration algorithm implemented in a commercial software (Segment, Medviso) We then create a series of interpolating functions for the three directions of motion and use them to deform a tetrahedral mesh representation of a patient-specific left ventricle.
  arXiv  Detail & Related papers  (2020-09-25T22:47:50Z)
• Deep Negative Volume Segmentation [60.44793799306154]
  We propose a new angle to the 3D segmentation task: segment empty spaces between all the tissues surrounding the object. Our approach is an end-to-end pipeline that comprises a V-Net for bone segmentation. We validate the idea on the CT scans in a 50-patient dataset, annotated by experts in maxillofacial medicine.
  arXiv  Detail & Related papers  (2020-06-22T16:55:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.