Topology-Masked Unified Backbone for Joint Feature Interaction and Multi-Domain Sequence Modeling
- URL: http://arxiv.org/abs/2608.27005v1
- Date: Thu, 27 Aug 2026 11:49:55 GMT
- Title: Topology-Masked Unified Backbone for Joint Feature Interaction and Multi-Domain Sequence Modeling
- Abstract summary: MaskRec is a topology-masked unified token interaction architecture for feature interaction and multi-domain sequence modeling.<n>Based on this unified token space, MaskRec designs a structured attention mask, TopoMask, which selectively enables or blocks attention connections.<n>MaskRec achieves stable improvements over the official baseline, validating the effectiveness of the proposed unified framework for industrial CVR prediction.
- Score: 8.950162084237288
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Large-scale post-click conversion rate (CVR) prediction requires jointly modeling heterogeneous feature interactions and dependencies over multi-domain user behavior sequences. Existing industrial ranking models usually handle these two aspects with separate modules. Recent unified architectures attempt to incorporate them into a single framework, but such unification often relies on coordination between modules and does not fully organize all information sources within the same interaction space. To address this problem, we propose MaskRec, a topology-masked unified token interaction architecture for feature interaction and multi-domain sequence modeling. MaskRec transforms heterogeneous features, multi-domain behavior sequences, and contextual signals into unified token representations, and further introduces learnable global memory tokens and domain-level memory tokens as information aggregation nodes. Based on this unified token space, MaskRec designs a structured attention mask, TopoMask, which selectively enables or blocks attention connections according to the structural differences and modeling requirements of different information sources. In this way, heterogeneous feature interaction and multi-domain sequence modeling are performed within the same topology-constrained attention process. In addition, MaskRec incorporates a dual-path interactive query generation module to inject candidate-conditioned user--item interaction signals before the unified backbone. Experiments on the Tencent Advertising Algorithm Competition dataset show that MaskRec achieves stable improvements over the official baseline, validating the effectiveness of the proposed unified framework for industrial CVR prediction.
Related papers
- UniDot: A Unified Network for Sequence Modeling and Feature Interaction in Large-scale Recommendation [3.59042069607434]
We present UniDot, a novel architecture for post-click conversion prediction built from the factorization-machine point of view.<n>A single dot-product of tokens can underlie both feature interaction and sequence modeling.<n>UniDot finished as the runner-up on the Industrial track of the TAAC KDD Cup 2026.
arXiv Detail & Related papers (2026-08-17T16:52:56Z) - A Unified Backbone--Expert Framework with Relation-Token and Residual--Classifier Interfaces for Automatic Modulation Recognition [1.547549252134621]
We propose a unified backbone-expert framework with a common convolutional state-space backbone and two specialized interfaces.<n>Our framework achieves overall average accuracies of 67.28 pm 0.14% on RML2016.10b and 87.19 pm 0.77% on HisarMod 2019.
arXiv Detail & Related papers (2026-08-15T10:26:42Z) - RoleMix: Unifying Sequential and Non-Sequential Features via Semantic Tokenization for Post-Click Conversion Rate Prediction [1.6050320174037502]
RoleMix represents sequential and non-sequential evidence through a shared, role-preserving token interface.<n>On the large-scale KDD Cup 2026 Tencent UniRec Challenge, RoleMix achieves 83.648% online AUC, outperforming the official industrial baseline by 1.953%.
arXiv Detail & Related papers (2026-07-18T15:44:48Z) - COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations [73.40758654107724]
We introduce a COMposed image retrieval network guided by By attrIbute-based NEighbor Relations (COMBINER)<n>Specifically, we first design an Adaptive Semantic Disentanglement module, which is capable of disentangling attribute features.<n> Secondly, we propose a Unified Prototype-based Composition module, which can construct cross-modal unified prototypes.<n>Finally, we introduce a Dual Relations Modeling module, which can mine pairwise and neighbor relations based on attribute similarity.
arXiv Detail & Related papers (2026-06-03T08:43:51Z) - Deferred is Better: A Framework for Multi-Granularity Deferred Interaction of Heterogeneous Features [11.38122944188751]
We propose a Multi-Granularity Information-Aware Deferred Interaction Network (MGDIN)<n>MGDIN adaptively defers the introduction of features into the feature interaction process.<n>It mitigates the effects of extreme individual feature sparsity and enabling the model to capture feature interactions from diverse perspectives.
arXiv Detail & Related papers (2026-03-13T02:36:25Z) - Dynamic Prototype Mask for Occluded Person Re-Identification [88.7782299372656]
Existing methods mainly address this issue by employing body clues provided by an extra network to distinguish the visible part.
We propose a novel Dynamic Prototype Mask (DPM) based on two self-evident prior knowledge.
Under this condition, the occluded representation could be well aligned in a selected subspace spontaneously.
arXiv Detail & Related papers (2022-07-19T03:31:13Z) - SODAR: Segmenting Objects by DynamicallyAggregating Neighboring Mask
Representations [90.8752454643737]
Recent state-of-the-art one-stage instance segmentation model SOLO divides the input image into a grid and directly predicts per grid cell object masks with fully-convolutional networks.
We observe SOLO generates similar masks for an object at nearby grid cells, and these neighboring predictions can complement each other as some may better segment certain object part.
Motivated by the observed gap, we develop a novel learning-based aggregation method that improves upon SOLO by leveraging the rich neighboring information.
arXiv Detail & Related papers (2022-02-15T13:53:03Z) - Modular Interactive Video Object Segmentation: Interaction-to-Mask,
Propagation and Difference-Aware Fusion [68.45737688496654]
We present a modular interactive VOS framework which decouples interaction-to-mask and mask propagation.
We show that our method outperforms current state-of-the-art algorithms while requiring fewer frame interactions.
arXiv Detail & Related papers (2021-03-14T14:39:08Z) - Cascaded Human-Object Interaction Recognition [175.60439054047043]
We introduce a cascade architecture for a multi-stage, coarse-to-fine HOI understanding.
At each stage, an instance localization network progressively refines HOI proposals and feeds them into an interaction recognition network.
With our carefully-designed human-centric relation features, these two modules work collaboratively towards effective interaction understanding.
arXiv Detail & Related papers (2020-03-09T17:05:04Z) - Universal-RCNN: Universal Object Detector via Transferable Graph R-CNN [117.80737222754306]
We present a novel universal object detector called Universal-RCNN.
We first generate a global semantic pool by integrating all high-level semantic representation of all the categories.
An Intra-Domain Reasoning Module learns and propagates the sparse graph representation within one dataset guided by a spatial-aware GCN.
arXiv Detail & Related papers (2020-02-18T07:57:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.