Zero-Shot Artifact2Artifact: Self-incentive artifact removal for photoacoustic imaging without any data

• URL: http://arxiv.org/abs/2412.14873v2
• Date: Fri, 27 Dec 2024 05:49:15 GMT
• Title: Zero-Shot Artifact2Artifact: Self-incentive artifact removal for photoacoustic imaging without any data
• Authors: Shuang Li, Qian Chen, Chulhong Kim, Seongwook Choi, Yibing Wang, Yu Zhang, Changhui Li,
• Abstract summary: ZS-A2A is a zero-shot self-supervised artifact removal method based on a super-lightweight network. ZS-A2A achieves state-of-the-art (SOTA) performance compared to existing zero-shot methods. For the $ in vivo $ rat liver, ZS-A2A improves CNR from 17.48 to 43.46 in just 8 seconds.
• Score: 18.154498077143195
• License:
• Abstract: Photoacoustic imaging (PAI) uniquely combines optical contrast with the penetration depth of ultrasound, making it critical for clinical applications. However, the quality of 3D PAI is often degraded due to reconstruction artifacts caused by the sparse and angle-limited configuration of detector arrays. Existing iterative or deep learning-based methods are either time-consuming or require large training datasets, significantly limiting their practical application. Here, we propose Zero-Shot Artifact2Artifact (ZS-A2A), a zero-shot self-supervised artifact removal method based on a super-lightweight network, which leverages the fact that reconstruction artifacts are sensitive to irregularities caused by data loss. By introducing random perturbations to the acquired PA data, it spontaneously generates subset data, which in turn stimulates the network to learn the artifact patterns in the reconstruction results, thus enabling zero-shot artifact removal. This approach requires neither training data nor prior knowledge of the artifacts, and is capable of artifact removal for 3D PAI. For maximum amplitude projection (MAP) images or slice images in 3D PAI acquired with arbitrarily sparse or angle-limited detector arrays, ZS-A2A employs a self-incentive strategy to complete artifact removal and improves the Contrast-to-Noise Ratio (CNR). We validated ZS-A2A in both simulation study and $ in\ vivo $ animal experiments. Results demonstrate that ZS-A2A achieves state-of-the-art (SOTA) performance compared to existing zero-shot methods, and for the $ in\ vivo $ rat liver, ZS-A2A improves CNR from 17.48 to 43.46 in just 8 seconds. The project for ZS-A2A will be available in the following GitHub repository: https://github.com/JaegerCQ/ZS-A2A.

Related papers

• Unsupervised Multi-Parameter Inverse Solving for Reducing Ring Artifacts in 3D X-Ray CBCT [35.73129314731503]
  Ring artifacts are prevalent in 3D cone-beam computed tomography (CBCT) due to non-ideal responses of X-ray detectors. Current state-of-the-art (SOTA) ring artifact reduction (RAR) algorithms rely on extensive paired CT samples for supervised learning. We introduce textbfRiner, an unsupervised method formulating 3D CBCT RAR as a multi- parameter inverse problem.
  arXiv  Detail & Related papers  (2024-12-08T08:22:58Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models. In this paper, we investigate how detection performance varies across model backbones, types, and datasets. We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspective [45.210030086193775]
  Current synthetic image detection (SID) pipelines are primarily dedicated to crafting universal artifact features. We propose SAFE, a lightweight and effective detector with three simple image transformations. Our pipeline achieves a new state-of-the-art performance, with remarkable improvements of 4.5% in accuracy and 2.9% in average precision against existing methods.
  arXiv  Detail & Related papers  (2024-08-13T09:01:12Z)
• StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D [88.66678730537777]
  We present StableDreamer, a methodology incorporating three advances. First, we formalize the equivalence of the SDS generative prior and a simple supervised L2 reconstruction loss. Second, our analysis shows that while image-space diffusion contributes to geometric precision, latent-space diffusion is crucial for vivid color rendition.
  arXiv  Detail & Related papers  (2023-12-02T02:27:58Z)
• Leveraging Neural Radiance Fields for Uncertainty-Aware Visual Localization [56.95046107046027]
  We propose to leverage Neural Radiance Fields (NeRF) to generate training samples for scene coordinate regression. Despite NeRF's efficiency in rendering, many of the rendered data are polluted by artifacts or only contain minimal information gain.
  arXiv  Detail & Related papers  (2023-10-10T20:11:13Z)
• FreeSeed: Frequency-band-aware and Self-guided Network for Sparse-view CT Reconstruction [34.91517935951518]
  Sparse-view computed tomography (CT) is a promising solution for expediting the scanning process and mitigating radiation exposure to patients. Recently, deep learning-based image post-processing methods have shown promising results. We propose a simple yet effective FREquency-band-awarE and SElf-guidED network, termed FreeSeed, which can effectively remove artifact and recover missing detail.
  arXiv  Detail & Related papers  (2023-07-12T03:39:54Z)
• Patch-Based Denoising Diffusion Probabilistic Model for Sparse-View CT Reconstruction [6.907847093036819]
  Sparse-view computed tomography (CT) can be used to reduce radiation dose greatly but suffers from severe image artifacts. Deep learning based method for sparse-view CT reconstruction has attracted a major attention. We propose a patch-based denoising diffusion probabilistic model (DDPM) for sparse-view CT reconstruction.
  arXiv  Detail & Related papers  (2022-11-18T17:35:36Z)
• Noise Self-Regression: A New Learning Paradigm to Enhance Low-Light Images Without Task-Related Data [86.68013790656762]
  We propose Noise SElf-Regression (NoiSER) without access to any task-related data. NoiSER is highly competitive in enhancement quality, yet with a much smaller model size, and much lower training and inference cost.
  arXiv  Detail & Related papers  (2022-11-09T06:18:18Z)
• Learning MRI Artifact Removal With Unpaired Data [74.48301038665929]
  Retrospective artifact correction (RAC) improves image quality post acquisition and enhances image usability. Recent machine learning driven techniques for RAC are predominantly based on supervised learning. Here we show that unwanted image artifacts can be disentangled and removed from an image via an RAC neural network learned with unpaired data.
  arXiv  Detail & Related papers  (2021-10-09T16:09:27Z)
• CutPaste: Self-Supervised Learning for Anomaly Detection and Localization [59.719925639875036]
  We propose a framework for building anomaly detectors using normal training data only. We first learn self-supervised deep representations and then build a generative one-class classifier on learned representations. Our empirical study on MVTec anomaly detection dataset demonstrates the proposed algorithm is general to be able to detect various types of real-world defects.
  arXiv  Detail & Related papers  (2021-04-08T19:04:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.