GateDiffInt: Gate-Mediated Controllable Diffusion and Multi-Intent LLM Distillation for User Behavior Modeling
- URL: http://arxiv.org/abs/2608.18764v2
- Date: Thu, 20 Aug 2026 02:34:04 GMT
- Title: GateDiffInt: Gate-Mediated Controllable Diffusion and Multi-Intent LLM Distillation for User Behavior Modeling
- Abstract summary: Noise and intent in behavior sequences are mutually reinforcing.<n>Noise dilutes true intents, while the lack of structured intent priors leaves denoising without a clear target.<n>GateDiffInt is an intent interaction framework for industrial ranking.
- Score: 13.581855767148303
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Existing ranking models encode intent only implicitly, making it hard to disentangle structured intents of varying strength and temporal scale. Noise and intent in behavior sequences are mutually reinforcing---we call this Noise--Intent Coupling (NIC). Noise dilutes true intents, while the lack of structured intent priors leaves denoising without a clear target. To address NIC, we propose GateDiffInt, an intent interaction framework for industrial ranking. It uses the final conversion signal to jointly align sequence denoising and intent extraction. GateDiffInt applies a controllable forward diffusion process with dual gating to enhance and denoise behavior sequences. A large language model then acts as teacher to distill four structured intents---long-term, short-term, latent, and conversion into a lightweight student model. The enhanced sequence and structured intent representations are deeply fused via attention to produce intent-aware representations for conversion-rate prediction. Extensive experiments on public and large-scale industrial datasets show consistent gains over strong baselines. In online A/B tests serving hundreds of millions of daily active users, GateDiffInt delivers substantial GMV improvements and has been deployed to primary traffic, confirming both effectiveness and production readiness.
Related papers
- SoK: Intent-Oriented Systematization of Multi-Turn LLM Jailbreaks [69.08780911753102]
Multi-turn jailbreaks exploit a pattern by advancing a harmful intent across turns, so that no single message exposes the full objective.<n>We develop a four-part, intent-oriented taxonomy that organizes multi-turn jailbreaks by adversarial intent structure.
arXiv Detail & Related papers (2026-08-02T09:24:08Z) - Understanding-Enhanced Model Collaboration for Long-Tailed Egocentric Mistake Detection [85.49213290363834]
We propose an Understanding-Enhanced Model Collaboration Method (UE-MCM)<n>It combines efficient coarse-grained video understanding with accurate fine-grained action reasoning.<n>The resulting system balances speed and accuracy, making it effective for detecting subtle, rare, and ambiguous mistakes in egocentric instructional videos.
arXiv Detail & Related papers (2026-06-01T11:50:16Z) - Action Emergence from Streaming Intent [32.90086331157582]
We formalize action emergence as a target capability for end-to-end autonomous driving.<n>We show that previous paradigms cannot deliver action emergence.<n>We propose Streaming Intent as a mechanism that makes driving intent semantically streamed.
arXiv Detail & Related papers (2026-05-12T18:09:04Z) - Learning to Credit the Right Steps: Objective-aware Process Optimization for Visual Generation [57.61006679699323]
Reinforcement learning has emerged as an effective framework for post-training visual generative models with human preference signals.<n>In modern visual generation, multiple reward models are often used to capture heterogeneous objectives, such as visual quality, motion consistency, and text alignment.<n>We propose Objective-aware Trajectory Credit Assignment (OTCA), a structured framework for fine-grained GRPO training.
arXiv Detail & Related papers (2026-04-21T08:37:13Z) - Mimic Intent, Not Just Trajectories [39.77112205526461]
We argue this stems from mimicking raw trajectories without understanding the underlying intent.<n>We propose explicitly disentangling behavior intent from execution details in end-2-end IL: Mimic Intent, Not just Trajectories.<n> Experiments on several manipulation benchmarks and on a real robot demonstrate state-of-the-art success rates, superior inference efficiency, robust generalization against disturbances, and effective one-shot transfer.
arXiv Detail & Related papers (2026-02-09T12:44:35Z) - GAP-Net: Calibrating User Intent via Gated Adaptive Progressive Learning for CTR Prediction [0.6372261626436676]
GAP-Net is a unified framework establishing a "Triple Gating" architecture to progressively refine information from micro-level features to macro-level views.<n>It achieves substantial improvements over state-of-the-art baselines, exhibiting superior robustness against interaction noise and intent drift.
arXiv Detail & Related papers (2026-01-12T15:01:12Z) - $\mathcal{E}_0$: Enhancing Generalization and Fine-Grained Control in VLA Models via Continuized Discrete Diffusion [65.77755100137728]
We introduce E0, a continuized discrete diffusion framework that formulates action generation as iterative denoising over quantized action tokens.<n>E0 achieves state-of-the-art performance across 14 diverse environments, outperforming strong baselines by 10.7% on average.
arXiv Detail & Related papers (2025-11-26T16:14:20Z) - Continuously Augmented Discrete Diffusion model for Categorical Generative Modeling [87.34677262370924]
Standard discrete diffusion models treat all unobserved states identically by mapping them to an absorbing [MASK] token.<n>This creates an 'information void' where semantic information that could be inferred from unmasked tokens is lost between denoising steps.<n>We introduce Continuously Augmented Discrete Diffusion, a framework that augments the discrete state space with a paired diffusion in a continuous latent space.
arXiv Detail & Related papers (2025-10-01T18:00:56Z) - Robustifying Diffusion-Denoised Smoothing Against Covariate Shift [3.2010481260411834]
We propose a novel adversarial objective function focused on the added noise of the denoising diffusion model.<n>Our method significantly improves certified accuracy across three standard classification benchmarks.
arXiv Detail & Related papers (2025-09-13T17:27:37Z) - Intent-aware Diffusion with Contrastive Learning for Sequential Recommendation [0.552480439325792]
We propose Intent-aware Diffusion with contrastive learning for sequential Recommendation (InDiRec)<n>InDiRec first performs intent clustering on sequence representations using K-means to build intent-guided signals.<n>It retrieves the intent representation of the target interaction sequence to guide a conditional diffusion model, generating positive views that share the same underlying intent.
arXiv Detail & Related papers (2025-04-22T17:55:56Z) - AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent
Detection and Slot Filling [69.59096090788125]
In this paper, we propose an Adaptive Graph-Interactive Framework (AGIF) for joint multiple intent detection and slot filling.
We introduce an intent-slot graph interaction layer to model the strong correlation between the slot and intents.
Such an interaction layer is applied to each token adaptively, which has the advantage to automatically extract the relevant intents information.
arXiv Detail & Related papers (2020-04-21T15:07:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.