UVTomo-GAN: An adversarial learning based approach for unknown view
X-ray tomographic reconstruction
- URL: http://arxiv.org/abs/2102.04590v1
- Date: Tue, 9 Feb 2021 00:51:25 GMT
- Title: UVTomo-GAN: An adversarial learning based approach for unknown view
X-ray tomographic reconstruction
- Authors: Mona Zehni, Zhizhen Zhao
- Abstract summary: Tomographic reconstruction recovers an unknown image given its projections from different angles.
Here, we tackle a more challenging setting: 1) the projection angles are unknown, 2) they are drawn from an unknown probability distribution.
In this set-up our goal is to recover the image and the projection angle distribution using an unsupervised adversarial learning approach.
- Score: 27.661868972910742
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Tomographic reconstruction recovers an unknown image given its projections
from different angles. State-of-the-art methods addressing this problem assume
the angles associated with the projections are known a-priori. Given this
knowledge, the reconstruction process is straightforward as it can be
formulated as a convex problem. Here, we tackle a more challenging setting: 1)
the projection angles are unknown, 2) they are drawn from an unknown
probability distribution. In this set-up our goal is to recover the image and
the projection angle distribution using an unsupervised adversarial learning
approach. For this purpose, we formulate the problem as a distribution matching
between the real projection lines and the generated ones from the estimated
image and projection distribution. This is then solved by reaching the
equilibrium in a min-max game between a generator and a discriminator. Our
novel contribution is to recover the unknown projection distribution and the
image simultaneously using adversarial learning. To accommodate this, we use
Gumbel-softmax approximation of samples from categorical distribution to
approximate the generator's loss as a function of the unknown image and the
projection distribution. Our approach can be generalized to different inverse
problems. Our simulation results reveal the ability of our method in
successfully recovering the image and the projection distribution in various
settings.
Related papers
- Probabilistic Contrastive Learning Recovers the Correct Aleatoric
Uncertainty of Ambiguous Inputs [21.38099300190815]
Contrastively trained encoders have recently been proven to invert the data-generating process.
We extend the common InfoNCE objective and encoders to predict latent distributions instead of points.
arXiv Detail & Related papers (2023-02-06T15:30:08Z) - HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand
Reconstruction with Normalizing Flow [73.7895717883622]
We explicitly model the distribution of plausible reconstructions in a conditional normalizing flow framework.
We show that explicit ambiguity modeling is better-suited for this challenging problem.
arXiv Detail & Related papers (2022-10-04T15:42:22Z) - Self-Supervised Learning of Image Scale and Orientation [35.94215211409985]
We study the problem of learning to assign a characteristic pose, i.e., scale and orientation, for an image region of interest.
It is hard to obtain a large-scale set of image regions with explicit pose annotations that a model directly learns from.
We propose a self-supervised learning framework with a histogram alignment technique.
arXiv Detail & Related papers (2022-06-15T02:43:39Z) - Low-Light Image Enhancement with Normalizing Flow [92.52290821418778]
In this paper, we investigate to model this one-to-many relationship via a proposed normalizing flow model.
An invertible network that takes the low-light images/features as the condition and learns to map the distribution of normally exposed images into a Gaussian distribution.
The experimental results on the existing benchmark datasets show our method achieves better quantitative and qualitative results, obtaining better-exposed illumination, less noise and artifact, and richer colors.
arXiv Detail & Related papers (2021-09-13T12:45:08Z) - An Adversarial Learning Based Approach for Unknown View Tomographic
Reconstruction [27.661868972910742]
It is often presumed that projection angles associated with the projection lines are known in advance.
Under certain situations, however, these angles are known only approximately or are completely unknown.
We propose an adversarial learning based approach to recover the image and the projection angle distribution.
arXiv Detail & Related papers (2021-08-23T00:28:47Z) - Scene Uncertainty and the Wellington Posterior of Deterministic Image
Classifiers [68.9065881270224]
We introduce the Wellington Posterior, which is the distribution of outcomes that would have been obtained in response to data that could have been generated by the same scene.
We explore the use of data augmentation, dropout, ensembling, single-view reconstruction, and model linearization to compute a Wellington Posterior.
Additional methods include the use of conditional generative models such as generative adversarial networks, neural radiance fields, and conditional prior networks.
arXiv Detail & Related papers (2021-06-25T20:10:00Z) - DeepI2P: Image-to-Point Cloud Registration via Deep Classification [71.3121124994105]
DeepI2P is a novel approach for cross-modality registration between an image and a point cloud.
Our method estimates the relative rigid transformation between the coordinate frames of the camera and Lidar.
We circumvent the difficulty by converting the registration problem into a classification and inverse camera projection optimization problem.
arXiv Detail & Related papers (2021-04-08T04:27:32Z) - Efficient and Differentiable Shadow Computation for Inverse Problems [64.70468076488419]
Differentiable geometric computation has received increasing interest for image-based inverse problems.
We propose an efficient yet efficient approach for differentiable visibility and soft shadow computation.
As our formulation is differentiable, it can be used to solve inverse problems such as texture, illumination, rigid pose, and deformation recovery from images.
arXiv Detail & Related papers (2021-04-01T09:29:05Z) - Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
Blind image restoration is a common yet challenging problem in computer vision.
We propose a novel blind image restoration method, aiming to integrate both the advantages of them.
Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
arXiv Detail & Related papers (2020-08-25T03:30:53Z) - Unsupervised Sparse-view Backprojection via Convolutional and Spatial
Transformer Networks [8.564644163856318]
We introduce an unsupervised sparse-view backprojection algorithm, which does not require ground-truth.
Our algorithm significantly out-performs filtered backprojection when the projection angles are very sparse.
Our approach has practical applications for medical imaging and other imaging modalities.
arXiv Detail & Related papers (2020-06-01T05:02:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.