SR-Prominence: A Crowdsourced Protocol and Dataset Suite for Perceptually-Weighted Super-Resolution Artifact Evaluation

• URL: http://arxiv.org/abs/2605.14847v1
• Date: Thu, 14 May 2026 13:56:08 GMT
• Title: SR-Prominence: A Crowdsourced Protocol and Dataset Suite for Perceptually-Weighted Super-Resolution Artifact Evaluation
• Abstract summary: SR-Prominence is a dataset suite containing 3,935 artifact masks from DeSRA, Open Images, Urban100, and a realistic no-ground-truth Urban100-HR setting, annotated with prominence.<n>Across the suite, we audit SR artifact detectors, image-quality metrics, and SR methods. We find that classical full-reference metrics, especially SSIM and DISTS, provide surprisingly strong localized prominence signals.<n> SR-Prominence is released with an objective scoring protocol that allows new metrics to be benchmarked on our suite without further crowdsourcing.
• Score: 0.7297638898415074
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modern image super-resolution methods generate detailed, visually appealing results, but they often introduce visual artifacts: unnatural patterns and texture distortions that degrade perceived quality. These defects vary widely in perceptual impact--some are barely noticeable, while others are highly disturbing--yet existing detection methods treat them equally. We propose artifact prominence as an evaluative target, defined as the fraction of viewers who judge a highlighted region to contain a noticeable artifact. We design a crowdsourced annotation protocol and construct SR-Prominence, a dataset suite containing 3,935 artifact masks from DeSRA, Open Images, Urban100, and a realistic no-ground-truth Urban100-HR setting, annotated with prominence. Re-annotating DeSRA reveals that 48.2% of its in-lab binary artifacts are not noticed by a majority of viewers. Across the suite, we audit SR artifact detectors, image-quality metrics, and SR methods. We find that classical full-reference metrics, especially SSIM and DISTS, provide surprisingly strong localized prominence signals, whereas no-reference IQA methods and specialized artifact detectors often fail to generalize across datasets and reference settings. SR-Prominence is released with an objective scoring protocol that allows new metrics to be benchmarked on our suite without further crowdsourcing. Together, the data and protocols enable SR artifact evaluation to move from binary defect presence toward perceptual impact. SR-Prominence is available at https://huggingface.co/datasets/imolodetskikh/sr-artifact-prominence.

Related papers

• Benchmarking Spatial, Spectral, and Self-Supervised Cues for Face Forgery Detection under Realistic Degradation [0.6619186532078049]
  This paper presents a standardized benchmark for face forgery detection using the Multi-Dimensional Face Forgery Image (MFFI) dataset.<n>We compare six model families, including convolutional networks, transformer-based models, and a frozen self-supervised DINOv3 backbone.<n>Xception with RGB obtains the best clean performance, reaching 0.884 mean ROC-AUC, but degrades substantially on the harder partition.
  arXiv  Detail & Related papers  (2026-09-01T16:41:55Z)
• REAL-OW: Rehearsal-free Open World Object Detection with Low-Rank Adaptation and Dual-Stage Objectness Modeling [56.888597798431704]
  Open-World Object Detection (OWOD) requires detectors to identify previously unseen objects as unknown and incrementally incorporate them into the set of known categories.<n>Existing frameworks rely heavily on exemplar replay to mitigate catastrophic forgetting, but in some real applications, storing raw data conflicts with data access restrictions and leads to data exposure risks.<n>We propose REAL-OW, a novel rehearsal-free framework that decouples incremental knowledge through a collaborative adapter architecture.
  arXiv  Detail & Related papers  (2026-07-03T06:38:54Z)
• SR-Ground: Image Quality Grounding for Super-Resolved Content [0.9295952050309632]
  We introduce SR-Ground, a dataset specifically designed for fine-grained artifact segmentation in super-resolved images.<n>The dataset comprises images processed by a diverse set of state-of-the-art SR models, with pixel-level annotations for multiple artifact categories.<n>We conduct a large-scale crowdsourcing study involving 1,062 participants to validate and refine automatically generated segmentations.<n>We demonstrate that training IQA models with grounding capabilities on SR-Ground significantly improves performance on downstream tasks.
  arXiv  Detail & Related papers  (2026-05-20T14:33:13Z)
• Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration [61.02313993032298]
  Super-resolution (SR) techniques have made major advances in reconstructing high-resolution images from low-resolution inputs.<n>GeoSR-Bench is the first SR benchmark that directly connects improved image resolution from SR models with downstream Earth monitoring tasks.<n>We conduct experiments with 270 settings, covering 2 cross-platform SR tasks, 9 SR models, 3 downstream task models, and 5 downstream tasks for each SR task.
  arXiv  Detail & Related papers  (2026-05-01T00:44:46Z)
• When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection [48.75021863792367]
  Vision Foundation Models (VFMs, emphe.g., CLIP) often struggle to generalize to images created using unseen generation pipelines.<n>We propose textbfGeometric Semantic Decoupling (GSD), a parameter-free module that explicitly removes semantic components from learned representations.<n>GSD estimates semantic directions from batch-wise statistics and projects them out via a geometric constraint, forcing the artifact detector to rely on semantic-invariant forensic evidence.
  arXiv  Detail & Related papers  (2026-03-10T06:16:35Z)
• Perceptual Quality Optimization of Image Super-Resolution [31.948003749760105]
  Single-image super-resolution (SR) has achieved remarkable progress with deep learning, yet most approaches rely on distortion-oriented losses or perceptual priors.<n>We propose an textitEfficient Perceptual Bi-directional Attention Network (Efficient-PBAN) that explicitly optimize SR towards human-preferred quality.
  arXiv  Detail & Related papers  (2026-02-25T01:17:24Z)
• Unveiling Perceptual Artifacts: A Fine-Grained Benchmark for Interpretable AI-Generated Image Detection [95.08316274158165]
  X-AIGD provides pixel-level, categorized annotations of perceptual artifacts, spanning low-level distortions, high-level semantics, and cognitive-level counterfactuals.<n>Existing AIGI detectors demonstrate negligible reliance on perceptual artifacts, even at the most basic distortion level.<n>Explicitly aligning model attention with artifact regions can increase the interpretability and generalization of detectors.
  arXiv  Detail & Related papers  (2026-01-27T10:09:17Z)
• Prominence-Aware Artifact Detection and Dataset for Image Super-Resolution [0.7297638898415074]
  We argue that artifacts should be characterized by their prominence to human observers rather than treated as uniform binary defects.<n>Motivated by this, we present a novel dataset of 1302 artifact examples from 11 contemporary image-SR methods.<n>We train a lightweight regressor that produces spatial prominence heatmaps and outperforms existing methods at detecting prominent artifacts.
  arXiv  Detail & Related papers  (2025-10-19T08:28:53Z)
• Collaborative Learning of Scattering and Deep Features for SAR Target Recognition with Noisy Labels [7.324728751991982]
  We propose collaborative learning of scattering and deep features (DF) for SAR automatic target recognition with noisy labels.<n>Specifically, a multi-model feature fusion framework is designed to integrate scattering and deep features.<n>The proposed method can achieve state-of-the-art performance under different operating conditions with various label noises.
  arXiv  Detail & Related papers  (2025-08-11T06:10:23Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models.<n>In this paper, we investigate how detection performance varies across model backbones, types, and datasets.<n>We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectors [62.63467652611788]
  We introduce SEMI-TRUTHS, featuring 27,600 real images, 223,400 masks, and 1,472,700 AI-augmented images. Each augmented image is accompanied by metadata for standardized and targeted evaluation of detector robustness. Our findings suggest that state-of-the-art detectors exhibit varying sensitivities to the types and degrees of perturbations, data distributions, and augmentation methods used.
  arXiv  Detail & Related papers  (2024-11-12T01:17:27Z)
• Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspective [45.210030086193775]
  Current synthetic image detection (SID) pipelines are primarily dedicated to crafting universal artifact features.<n>We propose SAFE, a lightweight and effective detector with three simple image transformations.<n>Our pipeline achieves a new state-of-the-art performance, with remarkable improvements of 4.5% in accuracy and 2.9% in average precision against existing methods.
  arXiv  Detail & Related papers  (2024-08-13T09:01:12Z)
• Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detection [86.97062579515833]
  We introduce the concept of Neighboring Pixel Relationships(NPR) as a means to capture and characterize the generalized structural artifacts stemming from up-sampling operations. A comprehensive analysis is conducted on an open-world dataset, comprising samples generated by tft28 distinct generative models. This analysis culminates in the establishment of a novel state-of-the-art performance, showcasing a remarkable tft11.6% improvement over existing methods.
  arXiv  Detail & Related papers  (2023-12-16T14:27:06Z)
• DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Models [41.60982753592467]
  Image super-resolution (SR) with generative adversarial networks (GAN) has achieved great success in restoring realistic details. It is notorious that GAN-based SR models will inevitably produce unpleasant and undesirable artifacts. In this paper, we analyze the cause and characteristics of the GAN artifacts produced in unseen test data without ground-truths. We develop a novel method, namely, DeSRA, to Detect and then Delete those SR Artifacts in practice.
  arXiv  Detail & Related papers  (2023-07-05T17:31:44Z)
• On the Frequency Bias of Generative Models [61.60834513380388]
  We analyze proposed measures against high-frequency artifacts in state-of-the-art GAN training. We find that none of the existing approaches can fully resolve spectral artifacts yet. Our results suggest that there is great potential in improving the discriminator.
  arXiv  Detail & Related papers  (2021-11-03T18:12:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.