Prominence-Aware Artifact Detection and Dataset for Image Super-Resolution

• URL: http://arxiv.org/abs/2510.16752v1
• Date: Sun, 19 Oct 2025 08:28:53 GMT
• Title: Prominence-Aware Artifact Detection and Dataset for Image Super-Resolution
• Authors: Ivan Molodetskikh, Kirill Malyshev, Mark Mirgaleev, Nikita Zagainov, Evgeney Bogatyrev, Dmitriy Vatolin,
• Abstract summary: We argue that artifacts should be characterized by their prominence to human observers rather than treated as uniform binary defects.<n>Motivated by this, we present a novel dataset of 1302 artifact examples from 11 contemporary image-SR methods.<n>We train a lightweight regressor that produces spatial prominence heatmaps and outperforms existing methods at detecting prominent artifacts.
• Score: 0.7297638898415074
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generative image super-resolution (SR) is rapidly advancing in visual quality and detail restoration. As the capacity of SR models expands, however, so does their tendency to produce artifacts: incorrect, visually disturbing details that reduce perceived quality. Crucially, their perceptual impact varies: some artifacts are barely noticeable while others strongly degrade the image. We argue that artifacts should be characterized by their prominence to human observers rather than treated as uniform binary defects. Motivated by this, we present a novel dataset of 1302 artifact examples from 11 contemporary image-SR methods, where each artifact is paired with a crowdsourced prominence score. Building on this dataset, we train a lightweight regressor that produces spatial prominence heatmaps and outperforms existing methods at detecting prominent artifacts. We release the dataset and code to facilitate prominence-aware evaluation and mitigation of SR artifacts.

Related papers

• DiffDoctor: Diagnosing Image Diffusion Models Before Treating [57.82359018425674]
  We propose DiffDoctor, a two-stage pipeline to assist image diffusion models in generating fewer artifacts.<n>We collect a dataset of over 1M flawed synthesized images and set up an efficient human-in-the-loop annotation process.<n>The learned artifact detector is then involved in the second stage to optimize the diffusion model by providing pixel-level feedback.
  arXiv  Detail & Related papers  (2025-01-21T18:56:41Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models.<n>In this paper, we investigate how detection performance varies across model backbones, types, and datasets.<n>We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectors [62.63467652611788]
  We introduce SEMI-TRUTHS, featuring 27,600 real images, 223,400 masks, and 1,472,700 AI-augmented images. Each augmented image is accompanied by metadata for standardized and targeted evaluation of detector robustness. Our findings suggest that state-of-the-art detectors exhibit varying sensitivities to the types and degrees of perturbations, data distributions, and augmentation methods used.
  arXiv  Detail & Related papers  (2024-11-12T01:17:27Z)
• Self-Adaptive Reality-Guided Diffusion for Artifact-Free Super-Resolution [47.29558685384506]
  Artifact-free super-resolution (SR) aims to translate low-resolution images into their high-resolution counterparts with a strict integrity of the original content. Traditional diffusion-based SR techniques are prone to artifact introduction during iterative procedures. We propose Self-Adaptive Reality-Guided Diffusion to identify and mitigate the propagation of artifacts.
  arXiv  Detail & Related papers  (2024-03-25T11:29:19Z)
• SynArtifact: Classifying and Alleviating Artifacts in Synthetic Images via Vision-Language Model [15.616316848126642]
  We develop a comprehensive artifact taxonomy and construct a dataset of synthetic images with artifact annotations for fine-tuning Vision-Language Model (VLM) The fine-tuned VLM exhibits superior ability of identifying artifacts and outperforms the baseline by 25.66%.
  arXiv  Detail & Related papers  (2024-02-28T05:54:02Z)
• Perceptual Artifacts Localization for Image Synthesis Tasks [59.638307505334076]
  We introduce a novel dataset comprising 10,168 generated images, each annotated with per-pixel perceptual artifact labels. A segmentation model, trained on our proposed dataset, effectively localizes artifacts across a range of tasks. We propose an innovative zoom-in inpainting pipeline that seamlessly rectifies perceptual artifacts in the generated images.
  arXiv  Detail & Related papers  (2023-10-09T10:22:08Z)
• On quantifying and improving realism of images generated with diffusion [50.37578424163951]
  We propose a metric, called Image Realism Score (IRS), computed from five statistical measures of a given image. IRS is easily usable as a measure to classify a given image as real or fake. We experimentally establish the model- and data-agnostic nature of the proposed IRS by successfully detecting fake images generated by Stable Diffusion Model (SDM), Dalle2, Midjourney and BigGAN. Our efforts have also led to Gen-100 dataset, which provides 1,000 samples for 100 classes generated by four high-quality models.
  arXiv  Detail & Related papers  (2023-09-26T08:32:55Z)
• DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Models [41.60982753592467]
  Image super-resolution (SR) with generative adversarial networks (GAN) has achieved great success in restoring realistic details. It is notorious that GAN-based SR models will inevitably produce unpleasant and undesirable artifacts. In this paper, we analyze the cause and characteristics of the GAN artifacts produced in unseen test data without ground-truths. We develop a novel method, namely, DeSRA, to Detect and then Delete those SR Artifacts in practice.
  arXiv  Detail & Related papers  (2023-07-05T17:31:44Z)
• A Conditional Denoising Diffusion Probabilistic Model for Radio Interferometric Image Reconstruction [4.715025376297672]
  We present VIC-DDPM, a Visibility and Image Conditioned Denoising Diffusion Probabilistic Model. Our main idea is to use both the original visibility data in the spectral domain and dirty images in the spatial domain to guide the image generation process with DDPM. Our results show that our method significantly improves the resulting images by reducing artifacts, preserving fine details, and recovering dim sources.
  arXiv  Detail & Related papers  (2023-05-16T03:00:04Z)
• Learning MRI Artifact Removal With Unpaired Data [74.48301038665929]
  Retrospective artifact correction (RAC) improves image quality post acquisition and enhances image usability. Recent machine learning driven techniques for RAC are predominantly based on supervised learning. Here we show that unwanted image artifacts can be disentangled and removed from an image via an RAC neural network learned with unpaired data.
  arXiv  Detail & Related papers  (2021-10-09T16:09:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.