Dynamic Knapsack Optimization Towards Efficient Multi-Channel Sequential
Advertising
- URL: http://arxiv.org/abs/2006.16312v1
- Date: Mon, 29 Jun 2020 18:50:35 GMT
- Title: Dynamic Knapsack Optimization Towards Efficient Multi-Channel Sequential
Advertising
- Authors: Xiaotian Hao, Zhaoqing Peng, Yi Ma, Guan Wang, Junqi Jin, Jianye Hao,
Shan Chen, Rongquan Bai, Mingzhou Xie, Miao Xu, Zhenzhe Zheng, Chuan Yu, Han
Li, Jian Xu, Kun Gai
- Abstract summary: We formulate the sequential advertising strategy optimization as a dynamic knapsack problem.
We propose a theoretically guaranteed bilevel optimization framework, which significantly reduces the solution space of the original optimization space.
To improve the exploration efficiency of reinforcement learning, we also devise an effective action space reduction approach.
- Score: 52.3825928886714
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: In E-commerce, advertising is essential for merchants to reach their target
users. The typical objective is to maximize the advertiser's cumulative revenue
over a period of time under a budget constraint. In real applications, an
advertisement (ad) usually needs to be exposed to the same user multiple times
until the user finally contributes revenue (e.g., places an order). However,
existing advertising systems mainly focus on the immediate revenue with single
ad exposures, ignoring the contribution of each exposure to the final
conversion, thus usually falls into suboptimal solutions. In this paper, we
formulate the sequential advertising strategy optimization as a dynamic
knapsack problem. We propose a theoretically guaranteed bilevel optimization
framework, which significantly reduces the solution space of the original
optimization space while ensuring the solution quality. To improve the
exploration efficiency of reinforcement learning, we also devise an effective
action space reduction approach. Extensive offline and online experiments show
the superior performance of our approaches over state-of-the-art baselines in
terms of cumulative revenue.
Related papers
- Procurement Auctions via Approximately Optimal Submodular Optimization [53.93943270902349]
We study procurement auctions, where an auctioneer seeks to acquire services from strategic sellers with private costs.
Our goal is to design computationally efficient auctions that maximize the difference between the quality of the acquired services and the total cost of the sellers.
arXiv Detail & Related papers (2024-11-20T18:06:55Z) - Optimizing Search Advertising Strategies: Integrating Reinforcement Learning with Generalized Second-Price Auctions for Enhanced Ad Ranking and Bidding [36.74368014856906]
We propose a model that adjusts to varying user interactions and optimize the balance between advertiser cost, user relevance, and platform revenue.
Our results suggest significant improvements in ad placement accuracy and cost efficiency, demonstrating the model's applicability in real-world scenarios.
arXiv Detail & Related papers (2024-05-22T06:30:55Z) - User Welfare Optimization in Recommender Systems with Competing Content Creators [65.25721571688369]
In this study, we perform system-side user welfare optimization under a competitive game setting among content creators.
We propose an algorithmic solution for the platform, which dynamically computes a sequence of weights for each user based on their satisfaction of the recommended content.
These weights are then utilized to design mechanisms that adjust the recommendation policy or the post-recommendation rewards, thereby influencing creators' content production strategies.
arXiv Detail & Related papers (2024-04-28T21:09:52Z) - An End-to-End Framework for Marketing Effectiveness Optimization under
Budget Constraint [25.89397524825504]
We propose a novel end-to-end framework to directly optimize the business goal under budget constraints.
Our core idea is to construct a regularizer to represent the marketing goal and optimize it efficiently using gradient estimation techniques.
Our proposed method is currently deployed to allocate marketing budgets for hundreds of millions of users on a short video platform.
arXiv Detail & Related papers (2023-02-09T07:39:34Z) - A Profit-Maximizing Strategy for Advertising on the e-Commerce Platforms [1.565361244756411]
The proposed model aims to find the optimal set of features to maximize the probability of converting targeted audiences into actual buyers.
We conduct an empirical study featuring real-world data from Tmall to show that our proposed method can effectively optimize the advertising strategy with budgetary constraints.
arXiv Detail & Related papers (2022-10-31T01:45:42Z) - Functional Optimization Reinforcement Learning for Real-Time Bidding [14.5826735379053]
Real-time bidding is the new paradigm of programmatic advertising.
Existing approaches are struggling to provide a satisfactory solution for bidding optimization.
This paper proposes a multi-agent reinforcement learning architecture for RTB with functional optimization.
arXiv Detail & Related papers (2022-06-25T06:12:17Z) - Towards Revenue Maximization with Popular and Profitable Products [69.21810902381009]
A common goal for companies marketing is to maximize the return revenue/profit by utilizing the various effective marketing strategies.
Finding credible and reliable information on products' profitability is difficult since most products tends to peak at certain times.
This paper proposes a general profit-oriented framework to address the problem of revenue based on economic behavior, and conducting the 0n-shelf Popular and most Profitable Products (OPPPs) for the targeted marketing.
arXiv Detail & Related papers (2022-02-26T02:07:25Z) - A Cooperative-Competitive Multi-Agent Framework for Auto-bidding in
Online Advertising [53.636153252400945]
We propose a general Multi-Agent reinforcement learning framework for Auto-Bidding, namely MAAB, to learn the auto-bidding strategies.
Our approach outperforms several baseline methods in terms of social welfare and guarantees the ad platform's revenue.
arXiv Detail & Related papers (2021-06-11T08:07:14Z) - We Know What You Want: An Advertising Strategy Recommender System for
Online Advertising [26.261736843187045]
We propose a recommender system for dynamic bidding strategy recommendation on display advertising platform.
We use a neural network as the agent to predict the advertisers' demands based on their profile and historical adoption behaviors.
Online evaluations show that the system can optimize the advertisers' advertising performance.
arXiv Detail & Related papers (2021-05-25T17:06:59Z) - Online Joint Bid/Daily Budget Optimization of Internet Advertising
Campaigns [115.96295568115251]
We study the problem of automating the online joint bid/daily budget optimization of pay-per-click advertising campaigns over multiple channels.
For every campaign, we capture the dependency of the number of clicks on the bid and daily budget by Gaussian Processes.
We design four algorithms and show that they suffer from a regret that is upper bounded with high probability as O(sqrtT)
We present the results of the adoption of our algorithms in a real-world application with a daily average spent of 1,000 Euros for more than one year.
arXiv Detail & Related papers (2020-03-03T11:07:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.