Photoacoustic Microscopy with Sparse Data Enabled by Convolutional
Neural Networks for Fast Imaging
- URL: http://arxiv.org/abs/2006.04368v1
- Date: Mon, 8 Jun 2020 05:49:32 GMT
- Title: Photoacoustic Microscopy with Sparse Data Enabled by Convolutional
Neural Networks for Fast Imaging
- Authors: Jiasheng Zhou, Da He, Xiaoyu Shang, Zhendong Guo, Sung-liang Chen,
Jiajia Luo
- Abstract summary: Photoacoustic microscopy (PAM) has been a promising biomedical imaging technology in recent years.
Reducing sampling density can naturally shorten image acquisition time, which is at the cost of image quality.
We propose a method using convolutional neural networks (CNNs) to improve the quality of sparse PAM images.
- Score: 0.9786690381850356
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Photoacoustic microscopy (PAM) has been a promising biomedical imaging
technology in recent years. However, the point-by-point scanning mechanism
results in low-speed imaging, which limits the application of PAM. Reducing
sampling density can naturally shorten image acquisition time, which is at the
cost of image quality. In this work, we propose a method using convolutional
neural networks (CNNs) to improve the quality of sparse PAM images, thereby
speeding up image acquisition while keeping good image quality. The CNN model
utilizes both squeeze-and-excitation blocks and residual blocks to achieve the
enhancement, which is a mapping from a 1/4 or 1/16 low-sampling sparse PAM
image to a latent fully-sampled image. The perceptual loss function is applied
to keep the fidelity of images. The model is mainly trained and validated on
PAM images of leaf veins. The experiments show the effectiveness of our
proposed method, which significantly outperforms existing methods
quantitatively and qualitatively. Our model is also tested using in vivo PAM
images of blood vessels of mouse ears and eyes. The results show that the model
can enhance the image quality of the sparse PAM image of blood vessels from
several aspects, which may help fast PAM and facilitate its clinical
applications.
Related papers
- Speeding up Photoacoustic Imaging using Diffusion Models [0.0]
Photoacoustic Microscopy (PAM) integrates optical and acoustic imaging, offering enhanced penetration depth for detecting optical-absorbing components in tissues.
With speed limitations imposed by laser pulse repetition rates, the potential role of computational methods is highlighted in accelerating PAM imaging.
We are proposing a novel and highly adaptable DiffPam algorithm that utilizes diffusion models for speeding up the PAM imaging process.
arXiv Detail & Related papers (2023-12-14T11:34:27Z) - Style transfer between Microscopy and Magnetic Resonance Imaging via
Generative Adversarial Network in small sample size settings [49.84018914962972]
Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising.
We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
arXiv Detail & Related papers (2023-10-16T13:58:53Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - De-Noising of Photoacoustic Microscopy Images by Deep Learning [0.9786690381850356]
Photoacoustic microscopy (PAM) imaging suffers from noise due to the maximum permissible exposure of laser intensity, attenuation of ultrasound in the tissue, and the inherent noise of the transducer.
We propose a deep learning-based method to remove complex noise from PAM images without mathematical priors and manual selection of settings for different input images.
arXiv Detail & Related papers (2022-01-12T05:13:57Z) - Multi-modal Aggregation Network for Fast MR Imaging [85.25000133194762]
We propose a novel Multi-modal Aggregation Network, named MANet, which is capable of discovering complementary representations from a fully sampled auxiliary modality.
In our MANet, the representations from the fully sampled auxiliary and undersampled target modalities are learned independently through a specific network.
Our MANet follows a hybrid domain learning framework, which allows it to simultaneously recover the frequency signal in the $k$-space domain.
arXiv Detail & Related papers (2021-10-15T13:16:59Z) - Compressed Sensing for Photoacoustic Computed Tomography Using an
Untrained Neural Network [1.7237160821929758]
Photoacoustic (PA) computed tomography (PACT) shows great potentials in various preclinical and clinical applications.
The artifacts or sidelobes could pollute the image if we decrease the number of measured channels or limit the detected view.
In this paper, a novel compressed sensing method for PACT using an untrained neural network is proposed.
arXiv Detail & Related papers (2021-05-29T09:01:58Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z) - Deep image prior for undersampling high-speed photoacoustic microscopy [14.15152499875691]
Photoacoustic microscopy (PAM) is an emerging imaging method combining light and sound.
High-speed PAM technology often sacrifices spatial sampling density (i.e., undersampling) for increased imaging speed over a large field-of-view.
We propose the use of deep image prior (DIP) to improve the image quality of undersampled PAM images.
arXiv Detail & Related papers (2020-10-15T15:46:19Z) - Improved Slice-wise Tumour Detection in Brain MRIs by Computing
Dissimilarities between Latent Representations [68.8204255655161]
Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods.
We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder.
We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
arXiv Detail & Related papers (2020-07-24T14:02:09Z) - Reconstructing undersampled photoacoustic microscopy images using deep
learning [11.74890470096844]
We propose a novel application of deep learning principles to reconstruct undersampled PAM images.
Our results have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels.
arXiv Detail & Related papers (2020-05-30T12:39:52Z) - Multifold Acceleration of Diffusion MRI via Slice-Interleaved Diffusion
Encoding (SIDE) [50.65891535040752]
We propose a diffusion encoding scheme, called Slice-Interleaved Diffusion.
SIDE, that interleaves each diffusion-weighted (DW) image volume with slices encoded with different diffusion gradients.
We also present a method based on deep learning for effective reconstruction of DW images from the highly slice-undersampled data.
arXiv Detail & Related papers (2020-02-25T14:48:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.