Photoacoustic Microscopy with Sparse Data Enabled by Convolutional Neural Networks for Fast Imaging

• URL: http://arxiv.org/abs/2006.04368v1
• Date: Mon, 8 Jun 2020 05:49:32 GMT
• Title: Photoacoustic Microscopy with Sparse Data Enabled by Convolutional Neural Networks for Fast Imaging
• Authors: Jiasheng Zhou, Da He, Xiaoyu Shang, Zhendong Guo, Sung-liang Chen, Jiajia Luo
• Abstract summary: Photoacoustic microscopy (PAM) has been a promising biomedical imaging technology in recent years. Reducing sampling density can naturally shorten image acquisition time, which is at the cost of image quality. We propose a method using convolutional neural networks (CNNs) to improve the quality of sparse PAM images.
• Score: 0.9786690381850356
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Photoacoustic microscopy (PAM) has been a promising biomedical imaging technology in recent years. However, the point-by-point scanning mechanism results in low-speed imaging, which limits the application of PAM. Reducing sampling density can naturally shorten image acquisition time, which is at the cost of image quality. In this work, we propose a method using convolutional neural networks (CNNs) to improve the quality of sparse PAM images, thereby speeding up image acquisition while keeping good image quality. The CNN model utilizes both squeeze-and-excitation blocks and residual blocks to achieve the enhancement, which is a mapping from a 1/4 or 1/16 low-sampling sparse PAM image to a latent fully-sampled image. The perceptual loss function is applied to keep the fidelity of images. The model is mainly trained and validated on PAM images of leaf veins. The experiments show the effectiveness of our proposed method, which significantly outperforms existing methods quantitatively and qualitatively. Our model is also tested using in vivo PAM images of blood vessels of mouse ears and eyes. The results show that the model can enhance the image quality of the sparse PAM image of blood vessels from several aspects, which may help fast PAM and facilitate its clinical applications.

Related papers

• On the Foundation Model for Cardiac MRI Reconstruction [6.284878525302227]
  We propose a foundation model that uses adaptive unrolling, channel-shifting, and Pattern and Contrast-Prompt-UNet to tackle the problem. The PCP-UNet is equipped with an image contrast and sampling pattern prompt.
  arXiv  Detail & Related papers  (2024-11-15T18:15:56Z)
• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements. Our model is based on neural operators, a discretization-agnostic architecture. Our inference speed is also 1,400x faster than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Speeding up Photoacoustic Imaging using Diffusion Models [0.0]
  Photoacoustic Microscopy (PAM) integrates optical and acoustic imaging, offering enhanced penetration depth for detecting optical-absorbing components in tissues. With speed limitations imposed by laser pulse repetition rates, the potential role of computational methods is highlighted in accelerating PAM imaging. We are proposing a novel and highly adaptable DiffPam algorithm that utilizes diffusion models for speeding up the PAM imaging process.
  arXiv  Detail & Related papers  (2023-12-14T11:34:27Z)
• Style transfer between Microscopy and Magnetic Resonance Imaging via Generative Adversarial Network in small sample size settings [49.84018914962972]
  Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising. We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
  arXiv  Detail & Related papers  (2023-10-16T13:58:53Z)
• Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
  We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images. We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem. Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-03-29T08:41:17Z)
• Compressed Sensing for Photoacoustic Computed Tomography Using an Untrained Neural Network [1.7237160821929758]
  Photoacoustic (PA) computed tomography (PACT) shows great potentials in various preclinical and clinical applications. The artifacts or sidelobes could pollute the image if we decrease the number of measured channels or limit the detected view. In this paper, a novel compressed sensing method for PACT using an untrained neural network is proposed.
  arXiv  Detail & Related papers  (2021-05-29T09:01:58Z)
• Adaptive Gradient Balancing for UndersampledMRI Reconstruction and Image-to-Image Translation [60.663499381212425]
  We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique. In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
  arXiv  Detail & Related papers  (2021-04-05T13:05:22Z)
• Augmented Equivariant Attention Networks for Microscopy Image Reconstruction [44.965820245167635]
  It is time-consuming and expensive to take high-quality or high-resolution electron microscopy (EM) and fluorescence microscopy (FM) images. Deep learning enables us to perform image-to-image transformation tasks for various types of microscopy image reconstruction. We propose the augmented equivariant attention networks (AEANets) with better capability to capture inter-image dependencies.
  arXiv  Detail & Related papers  (2020-11-06T23:37:49Z)
• Deep image prior for undersampling high-speed photoacoustic microscopy [14.15152499875691]
  Photoacoustic microscopy (PAM) is an emerging imaging method combining light and sound. High-speed PAM technology often sacrifices spatial sampling density (i.e., undersampling) for increased imaging speed over a large field-of-view. We propose the use of deep image prior (DIP) to improve the image quality of undersampled PAM images.
  arXiv  Detail & Related papers  (2020-10-15T15:46:19Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Reconstructing undersampled photoacoustic microscopy images using deep learning [11.74890470096844]
  We propose a novel application of deep learning principles to reconstruct undersampled PAM images. Our results have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels.
  arXiv  Detail & Related papers  (2020-05-30T12:39:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.