AdsWorldEngine: A Self-Evolving Conversational Advertising Agent through Orchestrator and Tool Coevolution

• URL: http://arxiv.org/abs/2608.13833v1
• Date: Thu, 13 Aug 2026 23:53:05 GMT
• Title: AdsWorldEngine: A Self-Evolving Conversational Advertising Agent through Orchestrator and Tool Coevolution
• Abstract summary: We propose AdsWorldEngine, an agentic framework for conversational advertising.<n>AdsWorldEngine uses an Opportunity Gate to determine whether ads should be shown, an Orchestrator to generate commercial intents, call advertising tools, and construct a top-3 ad slate.<n>Offline, AdsWorldEngine improves diversity by 60% and relevance by 80% over the current production ad delivery system.
• Score: 10.959681786863412
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Conversational advertising aims to deliver useful ads within multi-turn assistant interactions. Unlike conventional query-based advertising, where the user's intent is often expressed in a short standalone query, conversational ads must infer latent commercial intent from the current user query, the assistant response, and dialogue history while also deciding whether an ad would be helpful rather than intrusive. We propose AdsWorldEngine, an agentic framework for conversational advertising. AdsWorldEngine uses an Opportunity Gate to determine whether ads should be shown, an Orchestrator to generate commercial intents, call advertising tools, and construct a top-3 ad slate, and an Evaluator to score delivered ads for offline optimization. The central contribution is an iterative actor-tool training procedure: we first train the Orchestrator with supervised fine-tuning and agentic reinforcement learning, then use high- and low-reward rollouts to construct preference data to train tools. This creates a self-improving loop in which the system learns not only how to use advertising tools, but also how to improve them from rewarded behavior. To support subjective production decisions, we introduce label grounded judgment modeling, which trains judgment models from human labels collected under explicit guidelines. It enriches labels with thinking traces, filters inconsistent rationales through reflection, and further optimizes binary judgments with a cost sensitive GRPO variant that preserves asymmetric reward gaps. Offline, AdsWorldEngine improves diversity by 60% and relevance by 80% over the current production ad delivery system. In an online A/B test, it increases RPM by 22% and ads coverage by 74%.

Related papers

• Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search [12.65264204975306]
  This paper focuses on automatically generating informative ad descriptions in sponsored search.<n>We propose Interactor, a multi-turn iterative creation framework optimized with agentic RL for ad description generation.
  arXiv  Detail & Related papers  (2026-06-14T16:40:41Z)
• Design Your Ad: Personalized Advertising Image and Text Generation with Unified Autoregressive Models [75.31791398000492]
  We develop a Unified Advertisement Generative model (Uni-AdGen) that employs a single autoregressive framework to produce both advertising images and texts.<n>To further personalize advertisements, we equip Uni-AdGen with a coarse-to-fine preference understanding module.<n>Our method outperforms baselines in general and personalized advertisement generation.
  arXiv  Detail & Related papers  (2026-05-12T13:58:06Z)
• Sponsored Questions and How to Auction Them [48.75306452169514]
  A key challenge is that a user's search query often leaves their true intent ambiguous.<n>The shift from traditional search to conversational AI provides a new approach.<n>We show that the VCG mechanism can be adopted to jointly optimize the sponsored suggestion and the ads that follow.
  arXiv  Detail & Related papers  (2025-12-03T17:06:27Z)
• TeamCMU at Touché: Adversarial Co-Evolution for Advertisement Integration and Detection in Conversational Search [1.187456026346823]
  integration of advertisements into generated responses presents both commercial opportunities and challenges for user experience.<n>We propose a modular pipeline for advertisement management in RAG-based conversational systems, consisting of an ad-rewriter for seamless ad integration and a robust ad-classifier for detection.
  arXiv  Detail & Related papers  (2025-07-01T07:24:29Z)
• Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systems [54.709976343045824]
  Current offline reinforcement learning (RL) methods face substantial challenges when applied to sparse advertising scenarios.<n>We propose MTORL, a novel multi-task offline RL model that targets two key objectives.<n>We employ multi-task learning to decode actions and rewards, simultaneously addressing channel recommendation and budget allocation.
  arXiv  Detail & Related papers  (2025-06-29T05:05:13Z)
• Long-Term Ad Memorability: Understanding & Generating Memorable Ads [54.23854539909078]
  Despite the importance of long-term memory in marketing and brand building, until now, there has been no large-scale study on the memorability of ads.<n>We release the first memorability dataset, LAMBDA, consisting of 1749 participants and 2205 ads covering 276 brands.<n>Running statistical tests over different participant subpopulations and ad types, we find many interesting insights into what makes an ad memorable, e.g., fast-moving ads are more memorable than those with slower scenes.<n>We present a scalable method to build a high-quality memorable ad generation model by leveraging automatically annotated data.
  arXiv  Detail & Related papers  (2023-09-01T10:27:04Z)
• Online Ad Procurement in Non-stationary Autobidding Worlds [10.871587311621974]
  We introduce a primal-dual algorithm for online decision making with multi-dimension decision variables, bandit feedback and long-term uncertain constraints. We show that our algorithm achieves low regret in many worlds when procurement outcomes are generated through procedures that are adversarial, adversarially corrupted, periodic, and ergodic.
  arXiv  Detail & Related papers  (2023-07-10T00:41:08Z)
• AI-Driven Contextual Advertising: A Technology Report and Implication Analysis [0.0]
  Programmatic advertising consists in automated auctioning of digital ad space. The interest in contextual advertising is in part a counterreaction to the current dependency on personal data. Developments in Artificial Intelligence (AI) allow for a deeper semantic understanding of context.
  arXiv  Detail & Related papers  (2022-05-02T13:44:58Z)
• A Cooperative-Competitive Multi-Agent Framework for Auto-bidding in Online Advertising [53.636153252400945]
  We propose a general Multi-Agent reinforcement learning framework for Auto-Bidding, namely MAAB, to learn the auto-bidding strategies. Our approach outperforms several baseline methods in terms of social welfare and guarantees the ad platform's revenue.
  arXiv  Detail & Related papers  (2021-06-11T08:07:14Z)
• An Empirical Study of In-App Advertising Issues Based on Large Scale App Review Analysis [67.58267006314415]
  We present a large-scale analysis on ad-related user feedback from App Store and Google Play. From a statistical analysis of 36,309 ad-related reviews, we find that users care most about the number of unique ads and ad display frequency during usage. Some ad issue types are addressed more quickly by developers than other ad issues.
  arXiv  Detail & Related papers  (2020-08-22T05:38:24Z)
• Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinement [26.70647666598025]
  We study approaches to refine the given ad text and image by: (i) generating new ad text, (ii) recommending keyphrases for new ad text, and (iii) recommending image tags (objects in image) Based on A/B tests conducted by multiple advertisers, we form pairwise examples of inferior and superior ad creatives. We also share broadly applicable insights from our experiments using data from the Yahoo Gemini ad platform.
  arXiv  Detail & Related papers  (2020-08-17T16:46:28Z)
• Dynamic Knapsack Optimization Towards Efficient Multi-Channel Sequential Advertising [52.3825928886714]
  We formulate the sequential advertising strategy optimization as a dynamic knapsack problem. We propose a theoretically guaranteed bilevel optimization framework, which significantly reduces the solution space of the original optimization space. To improve the exploration efficiency of reinforcement learning, we also devise an effective action space reduction approach.
  arXiv  Detail & Related papers  (2020-06-29T18:50:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.