Unsupervised CT Metal Artifact Learning using Attention-guided
beta-CycleGAN
- URL: http://arxiv.org/abs/2007.03480v1
- Date: Tue, 7 Jul 2020 14:11:47 GMT
- Title: Unsupervised CT Metal Artifact Learning using Attention-guided
beta-CycleGAN
- Authors: Junghyun Lee, Jawook Gu, and Jong Chul Ye
- Abstract summary: Metal artifact reduction (MAR) is one of the most important research topics in computed tomography (CT)
Here we propose a much simpler and much effective unsupervised MAR method for CT.
- Score: 36.1921415839058
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Metal artifact reduction (MAR) is one of the most important research topics
in computed tomography (CT). With the advance of deep learning technology for
image reconstruction,various deep learning methods have been also suggested for
metal artifact removal, among which supervised learning methods are most
popular. However, matched non-metal and metal image pairs are difficult to
obtain in real CT acquisition. Recently, a promising unsupervised learning for
MAR was proposed using feature disentanglement, but the resulting network
architecture is complication and difficult to handle large size clinical
images. To address this, here we propose a much simpler and much effective
unsupervised MAR method for CT. The proposed method is based on a novel
beta-cycleGAN architecture derived from the optimal transport theory for
appropriate feature space disentanglement. Another important contribution is to
show that attention mechanism is the key element to effectively remove the
metal artifacts. Specifically, by adding the convolutional block attention
module (CBAM) layers with a proper disentanglement parameter, experimental
results confirm that we can get more improved MAR that preserves the detailed
texture of the original image.
Related papers
- Unlocking the Potential of Early Epochs: Uncertainty-aware CT Metal Artifact Reduction [7.4965536794782945]
In computed tomography (CT), the presence of metallic implants in patients often leads to disruptive artifacts in the reconstructed images.
In this paper, we have discovered that the uncertainty image computed from the restoration result of initial training weights can effectively highlight high-frequency regions.
We propose an uncertainty constraint (UC) loss that utilizes the uncertainty image as an adaptive weight to guide the MAR network to focus on the metal artifact region.
arXiv Detail & Related papers (2024-06-18T01:36:58Z) - MARformer: An Efficient Metal Artifact Reduction Transformer for Dental CBCT Images [53.62335292022492]
Metal teeth implants could bring annoying metal artifacts during the CBCT imaging process.
We develop an efficient Transformer to perform metal artifacts reduction (MAR) from dental CBCT images.
A Patch-wise Perceptive Feed Forward Network (P2FFN) is also proposed to perceive local image information for fine-grained restoration.
arXiv Detail & Related papers (2023-11-16T06:02:03Z) - Orientation-Shared Convolution Representation for CT Metal Artifact
Learning [63.67718355820655]
During X-ray computed tomography (CT) scanning, metallic implants carrying with patients often lead to adverse artifacts.
Existing deep-learning-based methods have gained promising reconstruction performance.
We propose an orientation-shared convolution representation strategy to adapt the physical prior structures of artifacts.
arXiv Detail & Related papers (2022-12-26T13:56:12Z) - Metal artifact correction in cone beam computed tomography using
synthetic X-ray data [0.0]
Metal implants inserted into the anatomy cause severe artifacts in reconstructed images.
One approach is to use a deep learning method to segment metals in the projections.
We show that simulations with relatively small number of photons are suitable for the metal segmentation task.
arXiv Detail & Related papers (2022-08-17T13:31:38Z) - Adaptive Convolutional Dictionary Network for CT Metal Artifact
Reduction [62.691996239590125]
We propose an adaptive convolutional dictionary network (ACDNet) for metal artifact reduction.
Our ACDNet can automatically learn the prior for artifact-free CT images via training data and adaptively adjust the representation kernels for each input CT image.
Our method inherits the clear interpretability of model-based methods and maintains the powerful representation ability of learning-based methods.
arXiv Detail & Related papers (2022-05-16T06:49:36Z) - InDuDoNet+: A Model-Driven Interpretable Dual Domain Network for Metal
Artifact Reduction in CT Images [53.4351366246531]
We construct a novel interpretable dual domain network, termed InDuDoNet+, into which CT imaging process is finely embedded.
We analyze the CT values among different tissues, and merge the prior observations into a prior network for our InDuDoNet+, which significantly improve its generalization performance.
arXiv Detail & Related papers (2021-12-23T15:52:37Z) - Metal Artifact Reduction in 2D CT Images with Self-supervised
Cross-domain Learning [30.977044473457]
We present a novel deep-learning-based approach for metal artifact reduction (MAR)
We train a neural network to restore the metal trace region values in the given metal-free sinogram.
We then design a novel FBP reconstruction loss to encourage the network to generate more perfect completion results.
arXiv Detail & Related papers (2021-09-28T04:40:57Z) - A Multi-Stage Attentive Transfer Learning Framework for Improving
COVID-19 Diagnosis [49.3704402041314]
We propose a multi-stage attentive transfer learning framework for improving COVID-19 diagnosis.
Our proposed framework consists of three stages to train accurate diagnosis models through learning knowledge from multiple source tasks and data of different domains.
Importantly, we propose a novel self-supervised learning method to learn multi-scale representations for lung CT images.
arXiv Detail & Related papers (2021-01-14T01:39:19Z) - Combining multimodal information for Metal Artefact Reduction: An
unsupervised deep learning framework [1.1374919153601266]
Metal artefact reduction (MAR) techniques aim at removing metal-induced noise from clinical images.
In MRI, no method has yet been introduced to correct the susceptibility artefact.
We propose an unsupervised deep learning method for multimodal MAR.
arXiv Detail & Related papers (2020-04-20T14:12:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.