Representation and Reference Selection in Training-Free Synthetic Image Attribution

• URL: http://arxiv.org/abs/2607.12052v1
• Date: Mon, 13 Jul 2026 18:10:39 GMT
• Title: Representation and Reference Selection in Training-Free Synthetic Image Attribution
• Abstract summary: Synthetic image attribution aims at identifying the generator responsible for a given AI-generated image.<n>We provide a controlled analysis of this interaction using references and off-the-shelf pretrained representations.<n>Our results show that attribution accuracy consistently peaks at intermediate representation levels.
• Score: 20.117588342501758
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Synthetic image attribution aims at identifying the generator responsible for a given AI-generated image. Training-free reference-based attribution methods are easily scalable, since newly emerging generators can be incorporated by adding source-specific references rather than retraining a task-specific classifier. Their performance depends on two coupled factors: the representation space used for comparison and the way source-specific references are constructed. However, the interaction between these two factors remains largely unexplored. In this paper, we provide a controlled analysis of this interaction using references and off-the-shelf pretrained representations. We study representations extracted from different layers of CLIP and DINOv2, along with three reference selection methods with varying semantic constraints: arbitrary, semantically aligned, and resynthesis-based references. Our results show that attribution accuracy consistently peaks at intermediate representation levels, indicating that source-discriminative cues are more accessible before strong semantic abstraction dominates. We further show that intermediate representations are not completely semantically neutral, making reference selection critical: semantically constrained references reduce query-reference mismatch and improve attribution, especially under limited reference budgets. Resynthesis is most useful in low-reference regimes, while semantically aligned references provide a better accuracy-cost trade-off when a moderate-sized reference pool is available. Our findings show that training-free reference-based attribution should be understood as the interaction between where images are compared, how the reference set is constructed, and how many references are available.

Related papers

• A Dynamic-Semantics Framework for Grounding Human Referring Expressions in Visual Perceptual Data [0.0]
  We present a framework that externalizes pact state into three explicit, inspectable sets of referent-object bindings.<n>We evaluate the framework on the Stanford Repeated Reference Game corpus.
  arXiv  Detail & Related papers  (2026-08-09T12:14:10Z)
• RefAlign: Representation Alignment for Reference-to-Video Generation [53.368296137314225]
  RefAlign is a representation alignment framework that aligns DiT reference-branch features to the semantic space of a visual foundation model (VFM)<n>Experiments on the OpenS2V-Eval benchmark demonstrate that RefAlign outperforms current state-of-the-art methods in TotalScore.
  arXiv  Detail & Related papers  (2026-03-26T17:59:57Z)
• Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modeling [42.10910149675583]
  Real-world degradations make correspondences between low-quality (LQ) inputs and reference (Ref) images unreliable.<n>We propose Ada-RefSR, a single-step diffusion framework guided by a "Trust but verify" principle.<n>Experiments on multiple datasets demonstrate that Ada-RefSR achieves a strong balance of fidelity, naturalness, and efficiency.
  arXiv  Detail & Related papers  (2026-02-02T09:34:57Z)
• Learning from Reference Answers: Versatile Language Model Alignment without Binary Human Preference Data [56.44985139322512]
  RefAlign is a versatile REINFORCE-style alignment algorithm that does not rely on reward or reference models.<n>We introduce textitRefAlign, a versatile REINFORCE-style alignment algorithm that does not rely on reward or reference models.
  arXiv  Detail & Related papers  (2025-04-14T05:43:21Z)
• Spatial Semantic Recurrent Mining for Referring Image Segmentation [63.34997546393106]
  We propose Stextsuperscript2RM to achieve high-quality cross-modality fusion. It follows a working strategy of trilogy: distributing language feature, spatial semantic recurrent coparsing, and parsed-semantic balancing. Our proposed method performs favorably against other state-of-the-art algorithms.
  arXiv  Detail & Related papers  (2024-05-15T00:17:48Z)
• Collaborative Group: Composed Image Retrieval via Consensus Learning from Noisy Annotations [67.92679668612858]
  We propose the Consensus Network (Css-Net), inspired by the psychological concept that groups outperform individuals. Css-Net comprises two core components: (1) a consensus module with four diverse compositors, each generating distinct image-text embeddings; and (2) a Kullback-Leibler divergence loss that encourages learning of inter-compositor interactions. On benchmark datasets, particularly FashionIQ, Css-Net demonstrates marked improvements. Notably, it achieves significant recall gains, with a 2.77% increase in R@10 and 6.67% boost in R@50, underscoring its
  arXiv  Detail & Related papers  (2023-06-03T11:50:44Z)
• Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References [123.39034752499076]
  Div-Ref is a method to enhance evaluation benchmarks by enriching the number of references. We conduct experiments to empirically demonstrate that diversifying the expression of reference can significantly enhance the correlation between automatic evaluation and human evaluation.
  arXiv  Detail & Related papers  (2023-05-24T11:53:29Z)
• BERM: Training the Balanced and Extractable Representation for Matching to Improve Generalization Ability of Dense Retrieval [54.66399120084227]
  We propose a novel method to improve the generalization of dense retrieval via capturing matching signal called BERM. Dense retrieval has shown promise in the first-stage retrieval process when trained on in-domain labeled datasets.
  arXiv  Detail & Related papers  (2023-05-18T15:43:09Z)
• Assessing a Single Image in Reference-Guided Image Synthesis [14.936460594115953]
  We propose a learning-based framework, Reference-guided Image Synthesis Assessment (RISA) to quantitatively evaluate the quality of a single generated image. As this annotation is too coarse as a supervision signal, we introduce two techniques: 1) a pixel-wise scheme to refine the coarse labels, and 2) multiple binary classifiers to replace a na"ive regressor. RISA is highly consistent with human preference and transfers well across models.
  arXiv  Detail & Related papers  (2021-12-08T08:22:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.