Naïve PAINE: Lightweight Text-to-Image Generation Improvement with Prompt Evaluation

• URL: http://arxiv.org/abs/2603.12506v1
• Date: Thu, 12 Mar 2026 22:51:39 GMT
• Title: Naïve PAINE: Lightweight Text-to-Image Generation Improvement with Prompt Evaluation
• Abstract summary: Text-to-Image (T2I) generation is primarily driven by Diffusion Models (DM)<n>We propose Nave PAINE for improving the generative quality of Diffusion Models by leveraging T2I preference benchmarks.<n>Nave PAINE provides feedback on the DM generative quality given the prompt and is lightweight enough to seamlessly fit into existing DM pipelines.
• Score: 8.62911650097065
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Text-to-Image (T2I) generation is primarily driven by Diffusion Models (DM) which rely on random Gaussian noise. Thus, like playing the slots at a casino, a DM will produce different results given the same user-defined inputs. This imposes a gambler's burden: To perform multiple generation cycles to obtain a satisfactory result. However, even though DMs use stochastic sampling to seed generation, the distribution of generated content quality highly depends on the prompt and the generative ability of a DM with respect to it. To account for this, we propose Naïve PAINE for improving the generative quality of Diffusion Models by leveraging T2I preference benchmarks. We directly predict the numerical quality of an image from the initial noise and given prompt. Naïve PAINE then selects a handful of quality noises and forwards them to the DM for generation. Further, Naïve PAINE provides feedback on the DM generative quality given the prompt and is lightweight enough to seamlessly fit into existing DM pipelines. Experimental results demonstrate that Naïve PAINE outperforms existing approaches on several prompt corpus benchmarks.

Related papers

• Can We Predict The Human Preference For Text-to-Image Content Prior To Generation And Is It Even Useful To Do So? [4.8986598953553555]
  Diffusion Models (DM) have revolutionized text-driven generation by enabling the synthesis of high-quality, photorealistic visual content from user prompts.<n>We investigate what extent we can predict scalar Human Preference Metrics (HPM) scores prior to committing compute resources for generation.<n>Our investigation reveals that not only is this possible, but that it is feasible to achieve negligible hardware overhead.
  arXiv  Detail & Related papers  (2026-06-03T21:57:05Z)
• Locally Confident, Globally Stuck: The Quality-Exploration Dilemma in Diffusion Language Models [52.61023005303122]
  We show that low-confidence remasking improves a proxy for quality while constraining the entropy of the induced sequence distribution.<n>We develop a simple Independent--Hastings sampler that approximately targets this distribution during decoding.
  arXiv  Detail & Related papers  (2026-04-01T02:01:30Z)
• NDM: A Noise-driven Detection and Mitigation Framework against Implicit Sexual Intentions in Text-to-Image Generation [41.058425895887616]
  Text-to-image (T2I) models are vulnerable to generating inappropriate content.<n> implicit sexual prompts, often disguised as seemingly benign terms, can unexpectedly trigger sexual content.<n>We propose NDM, the first noise-driven detection and mitigation framework.
  arXiv  Detail & Related papers  (2025-10-17T15:37:02Z)
• Diffusion Models with Adaptive Negative Sampling Without External Resources [54.84368884047812]
  ANSWER is a training-free technique, applicable to any model that supports CFG, and allows for negative grounding of image concepts without an explicit negative prompts.<n>Experiments show that adding ANSWER to existing DMs outperforms the baselines on multiple benchmarks and is preferred by humans 2x more over the other methods.
  arXiv  Detail & Related papers  (2025-08-05T00:45:54Z)
• HAODiff: Human-Aware One-Step Diffusion via Dual-Prompt Guidance [71.5820853722963]
  Human-centered images often suffer from severe generic degradation during transmission and are prone to human motion blur (HMB)<n>We design a degradation pipeline that simulates the coexistence of HMB and generic noise, generating synthetic degraded data to train our proposed HAODiff.<n>For fair evaluation, we introduce MPII-Test, a benchmark rich in combined noise and HMB cases.
  arXiv  Detail & Related papers  (2025-05-26T09:24:11Z)
• Regression is all you need for medical image translation [0.0]
  We propose YODA, a 2.5D diffusion-based framework for medical image translation (MIT)<n>We find that conventional diffusion sampling replicates noise. To this, we draw and average multiple samples, akin to physical signal averaging.<n>We additionally propose regression sampling YODA, which retains the initial DM prediction and mitigates iterative refinement to produce noise-free images in a single step.
  arXiv  Detail & Related papers  (2025-05-04T09:57:10Z)
• The Silent Assistant: NoiseQuery as Implicit Guidance for Goal-Driven Image Generation [31.599902235859687]
  We propose to leverage an aligned Gaussian noise as implicit guidance to complement explicit user-defined inputs, such as text prompts.<n>NoiseQuery enables fine-grained control and yields significant performance boosts over high-level semantics and over low-level visual attributes.
  arXiv  Detail & Related papers  (2024-12-06T14:59:00Z)
• Improving image synthesis with diffusion-negative sampling [54.84368884047812]
  We propose a new diffusion-negative prompting (DNP) strategy for image generation with diffusion models (DMs) DNP is based on a new procedure to sample images that are least compliant with p under the distribution of the DM, denoted as diffusion-negative sampling (DNS) DNS is straightforward to implement and requires no training. Experiments and human evaluations show that DNP performs well both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2024-11-08T10:58:09Z)
• Minority-Focused Text-to-Image Generation via Prompt Optimization [57.319845580050924]
  We investigate the generation of minority samples using pretrained text-to-image (T2I) latent diffusion models.<n>We develop an online prompt optimization framework that encourages emergence of desired properties during inference.<n>We then tailor this generic prompt distributions into a specialized solver that promotes generation of minority features.
  arXiv  Detail & Related papers  (2024-10-10T11:56:09Z)
• Improved Distribution Matching Distillation for Fast Image Synthesis [54.72356560597428]
  We introduce DMD2, a set of techniques that lift this limitation and improve DMD training. First, we eliminate the regression loss and the need for expensive dataset construction. Second, we integrate a GAN loss into the distillation procedure, discriminating between generated samples and real images.
  arXiv  Detail & Related papers  (2024-05-23T17:59:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.