Exploring the Power of Generative Deep Learning for Image-to-Image
Translation and MRI Reconstruction: A Cross-Domain Review
- URL: http://arxiv.org/abs/2303.09012v1
- Date: Thu, 16 Mar 2023 00:56:30 GMT
- Title: Exploring the Power of Generative Deep Learning for Image-to-Image
Translation and MRI Reconstruction: A Cross-Domain Review
- Authors: Yuda Bi
- Abstract summary: This research analyzes the different deep-learning methods used for image-to-image translation and reconstruction in the natural and medical imaging domains.
In the field of natural computer vision, we investigate the development and extension of various deep-learning generative models.
In comparison, we investigate the possible applications of deep learning to generative medical imaging problems, including medical image translation, MRI reconstruction, and multi-contrast MRI synthesis.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep learning has become a prominent computational modeling tool in the areas
of computer vision and image processing in recent years. This research
comprehensively analyzes the different deep-learning methods used for
image-to-image translation and reconstruction in the natural and medical
imaging domains. We examine the famous deep learning frameworks, such as
convolutional neural networks and generative adversarial networks, and their
variants, delving into the fundamental principles and difficulties of each. In
the field of natural computer vision, we investigate the development and
extension of various deep-learning generative models. In comparison, we
investigate the possible applications of deep learning to generative medical
imaging problems, including medical image translation, MRI reconstruction, and
multi-contrast MRI synthesis. This thorough review provides scholars and
practitioners in the areas of generative computer vision and medical imaging
with useful insights for summarizing past works and getting insight into future
research paths.
Related papers
- fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for
Multi-Subject Brain Activity Decoding [54.17776744076334]
We propose fMRI-PTE, an innovative auto-encoder approach for fMRI pre-training.
Our approach involves transforming fMRI signals into unified 2D representations, ensuring consistency in dimensions and preserving brain activity patterns.
Our contributions encompass introducing fMRI-PTE, innovative data transformation, efficient training, a novel learning strategy, and the universal applicability of our approach.
arXiv Detail & Related papers (2023-11-01T07:24:22Z) - A Trustworthy Framework for Medical Image Analysis with Deep Learning [71.48204494889505]
TRUDLMIA is a trustworthy deep learning framework for medical image analysis.
It is anticipated that the framework will support researchers and clinicians in advancing the use of deep learning for dealing with public health crises including COVID-19.
arXiv Detail & Related papers (2022-12-06T05:30:22Z) - Vision Transformers in Medical Computer Vision -- A Contemplative
Retrospection [0.9677949377607575]
Vision Transformers are evolved as one of the most contemporary and dominant architectures that are being used in the field of computer vision.
We surveyed the application of Vision transformers in different areas of medical computer vision such as image-based disease classification, anatomical structure segmentation, registration, region-based lesion Detection, captioning, report generation.
We also put some light on available data sets, adopted methodology, their performance measures, challenges and their solutions in form of discussion.
arXiv Detail & Related papers (2022-03-29T06:32:43Z) - Natural Image Reconstruction from fMRI using Deep Learning: A Survey [5.821090056678976]
We survey the most recent deep learning methods for natural image reconstruction from fMRI.
We examine these methods in terms of architectural design, benchmark datasets, and evaluation metrics.
We discuss the strengths and limitations of existing studies and present potential future directions.
arXiv Detail & Related papers (2021-10-18T04:05:29Z) - Recent advances and clinical applications of deep learning in medical
image analysis [7.132678647070632]
We reviewed and summarized more than 200 recently published papers to provide a comprehensive overview of applying deep learning methods in various medical image analysis tasks.
Especially, we emphasize the latest progress and contributions of state-of-the-art unsupervised and semi-supervised deep learning in medical images.
arXiv Detail & Related papers (2021-05-27T18:05:12Z) - Domain Shift in Computer Vision models for MRI data analysis: An
Overview [64.69150970967524]
Machine learning and computer vision methods are showing good performance in medical imagery analysis.
Yet only a few applications are now in clinical use.
Poor transferability of themodels to data from different sources or acquisition domains is one of the reasons for that.
arXiv Detail & Related papers (2020-10-14T16:34:21Z) - NAS-DIP: Learning Deep Image Prior with Neural Architecture Search [65.79109790446257]
Recent work has shown that the structure of deep convolutional neural networks can be used as a structured image prior.
We propose to search for neural architectures that capture stronger image priors.
We search for an improved network by leveraging an existing neural architecture search algorithm.
arXiv Detail & Related papers (2020-08-26T17:59:36Z) - Deep learning for photoacoustic imaging: a survey [4.877447414423669]
The deep artificial neural network began to surpass other established mature models in 2009.
Deep neural networks have great potential in medical imaging technology, medical data analysis, medical diagnosis and other healthcare issues.
The aim of this review is threefold: (i) introducing deep learning with some important basics, (ii) reviewing recent works that apply deep learning in the entire ecological chain of photoacoustic imaging, from image reconstruction to disease diagnosis, (iii) providing some open source materials and other resources for researchers interested in applying deep learning to photoacoustic imaging.
arXiv Detail & Related papers (2020-08-10T15:53:30Z) - Medical Image Generation using Generative Adversarial Networks [0.0]
Generative adversarial networks (GANs) are unsupervised Deep Learning approach in the computer vision community.
GANs generate realistic medical images and corresponding annotations.
The various framework of GANs which gained popularity in the interpretation of medical images, such as Deep Convolutional GAN (DCGAN), Laplacian GAN (LAPGAN), pix2pix, CycleGAN, and unsupervised image-to-image translation model (UNIT)
arXiv Detail & Related papers (2020-05-19T20:31:57Z) - State of the Art on Neural Rendering [141.22760314536438]
We focus on approaches that combine classic computer graphics techniques with deep generative models to obtain controllable and photo-realistic outputs.
This report is focused on the many important use cases for the described algorithms such as novel view synthesis, semantic photo manipulation, facial and body reenactment, relighting, free-viewpoint video, and the creation of photo-realistic avatars for virtual and augmented reality telepresence.
arXiv Detail & Related papers (2020-04-08T04:36:31Z) - Image Segmentation Using Deep Learning: A Survey [58.37211170954998]
Image segmentation is a key topic in image processing and computer vision.
There has been a substantial amount of works aimed at developing image segmentation approaches using deep learning models.
arXiv Detail & Related papers (2020-01-15T21:37:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.