Self-similarity-based super-resolution of photoacoustic angiography from hand-drawn doodles

• URL: http://arxiv.org/abs/2305.01165v1
• Date: Tue, 2 May 2023 02:40:47 GMT
• Title: Self-similarity-based super-resolution of photoacoustic angiography from hand-drawn doodles
• Authors: Yuanzheng Ma, Wangting Zhou, Rui Ma, Sihua Yang, Yansong Tang, and Xun Guan
• Abstract summary: Photoacoustic angiography (PAA) is a powerful tool that restores blood vessel images from under-sampled images to facilitate disease diagnosis. We propose a novel approach that employs a super-resolution PAA method trained with forged PAA images. Our approach shows promising potential for exploring zero-shot learning neural networks for vision tasks.
• Score: 9.646172419644088
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep-learning-based super-resolution photoacoustic angiography (PAA) is a powerful tool that restores blood vessel images from under-sampled images to facilitate disease diagnosis. Nonetheless, due to the scarcity of training samples, PAA super-resolution models often exhibit inadequate generalization capabilities, particularly in the context of continuous monitoring tasks. To address this challenge, we propose a novel approach that employs a super-resolution PAA method trained with forged PAA images. We start by generating realistic PAA images of human lips from hand-drawn curves using a diffusion-based image generation model. Subsequently, we train a self-similarity-based super-resolution model with these forged PAA images. Experimental results show that our method outperforms the super-resolution model trained with authentic PAA images in both original-domain and cross-domain tests. Specially, our approach boosts the quality of super-resolution reconstruction using the images forged by the deep learning model, indicating that the collaboration between deep learning models can facilitate generalization, despite limited initial dataset. This approach shows promising potential for exploring zero-shot learning neural networks for vision tasks.

Related papers

• Histopathology image embedding based on foundation models features aggregation for patient treatment response prediction [0.0]
  We propose a novel methodology for predicting Diffuse Large B-Cell Lymphoma patients treatment response from Whole Slide Images. Our method exploits several foundation models as feature extractors to obtain a local representation of the image corresponding to a small region of the tissue. Our experimental study conducted on a dataset of 152 patients, shows the promising results of our methodology.
  arXiv  Detail & Related papers  (2024-07-23T13:31:12Z)
• Inter-slice Super-resolution of Magnetic Resonance Images by Pre-training and Self-supervised Fine-tuning [49.197385954021456]
  In clinical practice, 2D magnetic resonance (MR) sequences are widely adopted. While individual 2D slices can be stacked to form a 3D volume, the relatively large slice spacing can pose challenges for visualization and subsequent analysis tasks. To reduce slice spacing, deep-learning-based super-resolution techniques are widely investigated. Most current solutions require a substantial number of paired high-resolution and low-resolution images for supervised training, which are typically unavailable in real-world scenarios.
  arXiv  Detail & Related papers  (2024-06-10T02:20:26Z)
• RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detection [60.960988614701414]
  RIGID is a training-free and model-agnostic method for robust AI-generated image detection. RIGID significantly outperforms existing trainingbased and training-free detectors.
  arXiv  Detail & Related papers  (2024-05-30T14:49:54Z)
• DensePANet: An improved generative adversarial network for photoacoustic tomography image reconstruction from sparse data [1.4665304971699265]
  We propose an end-to-end method called DensePANet to solve the problem of PAT image reconstruction from sparse data. The proposed model employs a novel modification of UNet in its generator, called FD-UNet++, which considerably improves the reconstruction performance.
  arXiv  Detail & Related papers  (2024-04-19T09:52:32Z)
• Diffusion Models for Image Restoration and Enhancement -- A Comprehensive Survey [96.99328714941657]
  We present a comprehensive review of recent diffusion model-based methods on image restoration. We classify and emphasize the innovative designs using diffusion models for both IR and blind/real-world IR. We propose five potential and challenging directions for the future research of diffusion model-based IR.
  arXiv  Detail & Related papers  (2023-08-18T08:40:38Z)
• Iterative-in-Iterative Super-Resolution Biomedical Imaging Using One Real Image [8.412910029745762]
  We propose an approach to train the deep learning-based super-resolution models using only one real image. We employ a mixed metric of image screening to automatically select images with a distribution similar to ground truth. After five training iterations, the proposed deep learning-based super-resolution model experienced a 7.5% and 5.49% improvement in structural similarity and peak-signal-to-noise ratio.
  arXiv  Detail & Related papers  (2023-06-26T07:57:03Z)
• Fine-tuned Generative Adversarial Network-based Model for Medical Image Super-Resolution [2.647302105102753]
  Real-Enhanced Super-Resolution Generative Adversarial Network (Real-ESRGAN) is a practical model for recovering HR images from real-world LR images. We employ the high-order degradation model of the Real-ESRGAN which better simulates real-world image degradations. The proposed model achieves superior perceptual quality compared to the Real-ESRGAN model, effectively preserving fine details and generating images with more realistic textures.
  arXiv  Detail & Related papers  (2022-11-01T16:48:04Z)
• Incremental Cross-view Mutual Distillation for Self-supervised Medical CT Synthesis [88.39466012709205]
  This paper builds a novel medical slice to increase the between-slice resolution. Considering that the ground-truth intermediate medical slices are always absent in clinical practice, we introduce the incremental cross-view mutual distillation strategy. Our method outperforms state-of-the-art algorithms by clear margins.
  arXiv  Detail & Related papers  (2021-12-20T03:38:37Z)
• High-Frequency aware Perceptual Image Enhancement [0.08460698440162888]
  We introduce a novel deep neural network suitable for multi-scale analysis and propose efficient model-agnostic methods. Our model can be applied to multi-scale image enhancement problems including denoising, deblurring and single image super-resolution.
  arXiv  Detail & Related papers  (2021-05-25T07:33:14Z)
• Proactive Pseudo-Intervention: Causally Informed Contrastive Learning For Interpretable Vision Models [103.64435911083432]
  We present a novel contrastive learning strategy called it Proactive Pseudo-Intervention (PPI) PPI leverages proactive interventions to guard against image features with no causal relevance. We also devise a novel causally informed salience mapping module to identify key image pixels to intervene, and show it greatly facilitates model interpretability.
  arXiv  Detail & Related papers  (2020-12-06T20:30:26Z)
• Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
  Blind image restoration is a common yet challenging problem in computer vision. We propose a novel blind image restoration method, aiming to integrate both the advantages of them. Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
  arXiv  Detail & Related papers  (2020-08-25T03:30:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.