ChatGPT Images 2.5 in the Wild: A Launch-Period Dataset and Detector Evaluation

• URL: http://arxiv.org/abs/2609.15100v1
• Date: Mon, 14 Sep 2026 06:25:39 GMT
• Title: ChatGPT Images 2.5 in the Wild: A Launch-Period Dataset and Detector Evaluation
• Abstract summary: ChatGPT Images 2.5 can change its underlying generator while retaining its public name, making version attribution from online posts ambiguous.<n>Our frozen collection contains 3,478 images from 2,440 posts across 8 sources.<n>It records three attribution tiers and retains standalone images after image-form filtering and targeted review.
• Score: 12.307366979757065
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: An image tool can change its underlying generator while retaining its public name, making version attribution from online posts ambiguous. We study this problem after the ChatGPT Images 2.5 launch. Our frozen collection contains 3,478 images from 2,440 posts across 8 sources. Recorded posting times fall within the first 51.1 hours after the announcement. It records three attribution tiers and retains standalone images after image-form filtering and targeted review. Caption claims and host records provide admission evidence, not independently verified generator identity. The observed content profile depends on the source mixture: NightCafe supplies 39.0% of images but 77.0% of CLIP-assigned fantasy scenes. We then evaluate six frozen detectors at thresholds calibrated to a 5% flag rate on reference photographs. Collection flag rates range from 3.7 to 56.4%, falling 42-81 percentage points below GenImage recall. Held-out artwork false-positive rates range from 1.5 to 96.5%, so a higher collection flag rate does not by itself establish better detection. An exploratory X-only comparison with our April collection finds a higher September flag rate for Effort, and a suggestive difference for DoU, under fixed-threshold post-clustered bootstrap intervals. Attribution, content and processing differences prevent a causal interpretation of these contrasts. The collection supports analysis of reported model use during a product transition, with source and attribution evidence retained for interpretation.

Related papers

• CITECHOICE: A Causal Audit of How Document Presentation Redistributes Citation Credit in Agentic Search [0.0]
  CITECHOICE is a causal audit of authentic multi-turn agentic search.<n>It selects 113 same-call document pairs with independently verified support for the same pre-specified fact.<n> structured rendering concentrates citation credit rather than clearly increasing source admission.
  arXiv  Detail & Related papers  (2026-09-14T07:47:47Z)
• From Advertised Improvements to Measured Capabilities: Evaluating ChatGPT Images 2.5 on Forgery Tasks [15.787104302260168]
  After image registration, Flare and Sunburst show fewer OCR-detected changes to surrounding receipt text.<n>Flare retains fewer earlier edits on CORD receipts, while photo-edit sequences provide little separation between models.<n>Fine-print improvements remain unresolved below the OCR reliability limit.
  arXiv  Detail & Related papers  (2026-09-12T00:15:01Z)
• Forging Tree-Ring: Reproducing and Instrumenting Black-Box Semantic Watermark Forgery [0.0]
  We reproduce the Reprompt forgery attack of Mller et al. against Tree-Ring on Stable Diffusion XL.<n>We detect genuine images 6/6, clean images 0/6, and forged images 5/6, at 325-332 s per attack.
  arXiv  Detail & Related papers  (2026-09-11T14:35:42Z)
• Vulnerabilities, Secrets and Misconfiguration in the Highest-Exposure Docker Hub Images [0.0]
  ChimangoScan crawls the Docker Hub (12,716,568 repositories, 66 billion cumulative pulls)<n>It ranks images by an exposure score that folds an image's own pull count and those of its entire downstream subtree into one scalar.<n>It scans the 52,895 highest-exposure repositories with six independent scanners, yielding 170.4 million findings.
  arXiv  Detail & Related papers  (2026-08-02T13:57:28Z)
• Explaining AI-Image Detection: What the Heatmap Actually Shows [65.01025489527173]
  We build a detector and attach an attribution map as its evidence.<n>We measure what that pair delivers on 186,527 images under controls.<n>Whether an attribution ranking exists at all depends on whether the detector reacts to the image.
  arXiv  Detail & Related papers  (2026-07-31T16:07:05Z)
• Medical thinking with multiple images [44.04557445622649]
  We introduce MedThinkVQA, an expert-annotated benchmark for thinking with multiple images.<n>The dataset contains 8,067 cases, including 720 test cases, with an average of 6.62 images per case.<n>On the test set, the best closed-source models, Claude-4.6-Opus, Gemini-3-Pro, and GPT-5.2-xhigh, reach only 57.2%, 55.3%, and 54.9% accuracy.
  arXiv  Detail & Related papers  (2026-04-14T18:51:07Z)
• Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation [58.77994391566484]
  We propose W1KP, a human-calibrated measure of variability in a set of images. Our best perceptual distance outperforms nine baselines by up to 18 points in accuracy. We analyze 56 linguistic features of real prompts, finding that the prompt's length, CLIP embedding norm, concreteness, and word senses influence variability most.
  arXiv  Detail & Related papers  (2024-06-12T17:59:27Z)
• ImagenHub: Standardizing the evaluation of conditional image generation models [48.51117156168]
  This paper proposes ImagenHub, which is a one-stop library to standardize the inference and evaluation of all conditional image generation models. We design two human evaluation scores, i.e. Semantic Consistency and Perceptual Quality, along with comprehensive guidelines to evaluate generated images. Our human evaluation achieves a high inter-worker agreement of Krippendorff's alpha on 76% models with a value higher than 0.4.
  arXiv  Detail & Related papers  (2023-10-02T19:41:42Z)
• Invariant Learning via Diffusion Dreamed Distribution Shifts [121.71383835729848]
  We propose a dataset called Diffusion Dreamed Distribution Shifts (D3S) D3S consists of synthetic images generated through StableDiffusion using text prompts and image guides obtained by pasting a sample foreground image onto a background template image. Due to the incredible photorealism of the diffusion model, our images are much closer to natural images than previous synthetic datasets.
  arXiv  Detail & Related papers  (2022-11-18T17:07:43Z)
• Content-Based Detection of Temporal Metadata Manipulation [91.34308819261905]
  We propose an end-to-end approach to verify whether the purported time of capture of an image is consistent with its content and geographic location. The central idea is the use of supervised consistency verification, in which we predict the probability that the image content, capture time, and geographical location are consistent. Our approach improves upon previous work on a large benchmark dataset, increasing the classification accuracy from 59.03% to 81.07%.
  arXiv  Detail & Related papers  (2021-03-08T13:16:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.