Ad Headline Generation using Self-Critical Masked Language Model

• URL: http://arxiv.org/abs/2607.06818v1
• Date: Tue, 07 Jul 2026 21:25:49 GMT
• Title: Ad Headline Generation using Self-Critical Masked Language Model
• Abstract summary: We propose a programmatic solution to generate product advertising headlines using retail content.<n>Our method creates the advertising headline by jointly conditioning on multiple products that a seller wishes to advertise.
• Score: 4.556167062902223
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: For any E-commerce website it is a nontrivial problem to build enduring advertisements that attract shoppers. It is hard to pass the creative quality bar of the website, especially at a large scale. We thus propose a programmatic solution to generate product advertising headlines using retail content. We propose a state of the art application of Reinforcement Learning (RL) Policy gradient methods on Transformer based Masked Language Models. Our method creates the advertising headline by jointly conditioning on multiple products that a seller wishes to advertise. We demonstrate that our method outperforms existing Transformer and LSTM + RL methods in overlap metrics and quality audits. We also show that our model-generated headlines outperform human submitted headlines in terms of both grammar and creative quality as determined by audits.

Related papers

• I Am AdMan: A Pipeline for Automatic Generation of Personalized Advertising Imagery [4.662993987530914]
  We propose AdMan, a pipeline that transforms customer data into personas, and generates personalized advertisement images conditioned on product reference images.<n>We implement the pipeline with two different model configurations and evaluate it across four products, using six celebrity personas for qualitative inspection, and 100 real customer profiles, producing 1745 advertisements.<n>Our findings extend the literature on AI-based personalized advertising by demonstrating the feasibility and current limitations of fully automated image generation for advertising.
  arXiv  Detail & Related papers  (2026-09-11T10:39:18Z)
• CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity [67.74087963315213]
  CreativeInstruct is an instruction-tuning method that teaches large language models to balance creative, base-model-like generations with the quality of post-trained models.<n>We show that CreativeInstruct matches or exceeds the diversity of both multi-model baselines and distilled variants of their outputs.<n>We also show the benefits of creative models as a substrate for RL: GRPO applied to a CreativeInstruct checkpoint improves by 4% on AMC and 5% points on MATH.
  arXiv  Detail & Related papers  (2026-08-07T17:55:48Z)
• Design Your Ad: Personalized Advertising Image and Text Generation with Unified Autoregressive Models [75.31791398000492]
  We develop a Unified Advertisement Generative model (Uni-AdGen) that employs a single autoregressive framework to produce both advertising images and texts.<n>To further personalize advertisements, we equip Uni-AdGen with a coarse-to-fine preference understanding module.<n>Our method outperforms baselines in general and personalized advertisement generation.
  arXiv  Detail & Related papers  (2026-05-12T13:58:06Z)
• AI-Salesman: Towards Reliable Large Language Model Driven Telemarketing [79.0112532518727]
  We release TeleSalesCorpus, the first real-world-grounded dialogue dataset for this domain.<n>We then propose AI-Salesman, a novel framework featuring a dual-stage architecture.<n>We show that our proposed AI-Salesman significantly outperforms baseline models in both automatic metrics and comprehensive human evaluations.
  arXiv  Detail & Related papers  (2025-11-15T09:44:42Z)
• Improving Generative Ad Text on Facebook using Reinforcement Learning [11.28110246872973]
  We present the first deployment of an RL-trained large language model for generative advertising on Facebook.<n>Our model, "AdLlama," powers an AI tool that helps advertisers create new variations of human-written ad text.<n>In a large-scale 10-week A/B test on Facebook, we find that AdLlama improves click-through rates by 6.7% compared to a supervised imitation model trained on curated ads.
  arXiv  Detail & Related papers  (2025-07-29T16:34:02Z)
• AI Realtor: Towards Grounded Persuasive Language Generation for Automated Copywriting [39.08860456325049]
  We develop an agentic framework that employs large language models for persuasive language generation in automated copywriting.<n>Our method is designed to align the generated content with user preferences while highlighting useful factual attributes.<n>We conduct systematic human-subject experiments in the domain of real estate marketing, with a focus group of potential house buyers.
  arXiv  Detail & Related papers  (2025-02-24T03:36:57Z)
• CTR-Driven Advertising Image Generation with Multimodal Large Language Models [53.40005544344148]
  We explore the use of Multimodal Large Language Models (MLLMs) for generating advertising images by optimizing for Click-Through Rate (CTR) as the primary objective.<n>To further improve the CTR of generated images, we propose a novel reward model to fine-tune pre-trained MLLMs through Reinforcement Learning (RL)<n>Our method achieves state-of-the-art performance in both online and offline metrics.
  arXiv  Detail & Related papers  (2025-02-05T09:06:02Z)
• IPL: Leveraging Multimodal Large Language Models for Intelligent Product Listing [26.930588075458008]
  We develop IPL, an Intelligent Product Listing tool tailored to generate descriptions using various product attributes. IPL has been successfully deployed in our production system, where 72% of users have their published product listings based on the generated content. Those product listings are shown to have a quality score 5.6% higher than those without AI assistance.
  arXiv  Detail & Related papers  (2024-10-22T12:56:04Z)
• A Multimodal In-Context Tuning Approach for E-Commerce Product Description Generation [47.70824723223262]
  We propose a new setting for generating product descriptions from images, augmented by marketing keywords. We present a simple and effective Multimodal In-Context Tuning approach, named ModICT, which introduces a similar product sample as the reference. Experiments demonstrate that ModICT significantly improves the accuracy (by up to 3.3% on Rouge-L) and diversity (by up to 9.4% on D-5) of generated results compared to conventional methods.
  arXiv  Detail & Related papers  (2024-02-21T07:38:29Z)
• Continuous Prompt Tuning Based Textual Entailment Model for E-commerce Entity Typing [12.77583836715184]
  Rapid activity in e-commerce has led to the rapid emergence of new entities, which is difficult to be solved by general entity typing. We propose our textual entailment model with continuous prompt tuning based hypotheses and fusion embeddings for e-commerce entity typing. We show our proposed model improves the average F1 score by around 2% compared to the baseline BERT entity typing model.
  arXiv  Detail & Related papers  (2022-11-04T14:20:40Z)
• Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hiding [80.3811072650087]
  We study natural language watermarking as a defense to help better mark and trace the provenance of text. We introduce the Adversarial Watermarking Transformer (AWT) with a jointly trained encoder-decoder and adversarial training. AWT is the first end-to-end model to hide data in text by automatically learning -- without ground truth -- word substitutions along with their locations.
  arXiv  Detail & Related papers  (2020-09-07T11:01:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.