Heterogeneous Network Embedding for Deep Semantic Relevance Match in
E-commerce Search
- URL: http://arxiv.org/abs/2101.04850v1
- Date: Wed, 13 Jan 2021 03:12:53 GMT
- Title: Heterogeneous Network Embedding for Deep Semantic Relevance Match in
E-commerce Search
- Authors: Ziyang Liu, Zhaomeng Cheng, Yunjiang Jiang, Yue Shang, Wei Xiong,
Sulong Xu, Bo Long, Di Jin
- Abstract summary: We design an end-to-end First-and-Second-order Relevance prediction model for e-commerce item relevance.
We introduce external knowledge generated from BERT to refine the network of user behaviors.
Results of offline experiments showed that the new model significantly improved the prediction accuracy in terms of human relevance judgment.
- Score: 29.881612817309716
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Result relevance prediction is an essential task of e-commerce search engines
to boost the utility of search engines and ensure smooth user experience. The
last few years eyewitnessed a flurry of research on the use of
Transformer-style models and deep text-match models to improve relevance.
However, these two types of models ignored the inherent bipartite network
structures that are ubiquitous in e-commerce search logs, making these models
ineffective. We propose in this paper a novel Second-order Relevance, which is
fundamentally different from the previous First-order Relevance, to improve
result relevance prediction. We design, for the first time, an end-to-end
First-and-Second-order Relevance prediction model for e-commerce item
relevance. The model is augmented by the neighborhood structures of bipartite
networks that are built using the information of user behavioral feedback,
including clicks and purchases. To ensure that edges accurately encode
relevance information, we introduce external knowledge generated from BERT to
refine the network of user behaviors. This allows the new model to integrate
information from neighboring items and queries, which are highly relevant to
the focus query-item pair under consideration. Results of offline experiments
showed that the new model significantly improved the prediction accuracy in
terms of human relevance judgment. An ablation study showed that the
First-and-Second-order model gained a 4.3% average gain over the First-order
model. Results of an online A/B test revealed that the new model derived more
commercial benefits compared to the base model.
Related papers
- A Collaborative Ensemble Framework for CTR Prediction [73.59868761656317]
We propose a novel framework, Collaborative Ensemble Training Network (CETNet), to leverage multiple distinct models.
Unlike naive model scaling, our approach emphasizes diversity and collaboration through collaborative learning.
We validate our framework on three public datasets and a large-scale industrial dataset from Meta.
arXiv Detail & Related papers (2024-11-20T20:38:56Z) - Probabilistic Demand Forecasting with Graph Neural Networks [0.0]
This paper builds on previous research on Graph Neural Networks (GNNs) and makes two contributions.
First, we integrate a GNN encoder into a state-of-the-art DeepAR model. The combined model produces probabilistic forecasts, which are crucial for decision-making under uncertainty.
Second, we propose to build graphs using article similarity, which avoids reliance on a pre-defined graph structure. Experiments on three real-world datasets show that the proposed approach consistently outperforms non-graph benchmarks.
arXiv Detail & Related papers (2024-01-23T21:20:48Z) - Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective [64.04617968947697]
We introduce a novel data-model co-design perspective: to promote superior weight sparsity.
Specifically, customized Visual Prompts are mounted to upgrade neural Network sparsification in our proposed VPNs framework.
arXiv Detail & Related papers (2023-12-03T13:50:24Z) - Improving Text Matching in E-Commerce Search with A Rationalizable,
Intervenable and Fast Entity-Based Relevance Model [78.80174696043021]
We propose a novel model called the Entity-Based Relevance Model (EBRM)
The decomposition allows us to use a Cross-encoder QE relevance module for high accuracy.
We also show that pretraining the QE module with auto-generated QE data from user logs can further improve the overall performance.
arXiv Detail & Related papers (2023-07-01T15:44:53Z) - Unified Embedding Based Personalized Retrieval in Etsy Search [0.206242362470764]
We propose learning a unified embedding model incorporating graph, transformer and term-based embeddings end to end.
Our personalized retrieval model significantly improves the overall search experience, as measured by a 5.58% increase in search purchase rate and a 2.63% increase in site-wide conversion rate.
arXiv Detail & Related papers (2023-06-07T23:24:50Z) - Part-Based Models Improve Adversarial Robustness [57.699029966800644]
We show that combining human prior knowledge with end-to-end learning can improve the robustness of deep neural networks.
Our model combines a part segmentation model with a tiny classifier and is trained end-to-end to simultaneously segment objects into parts.
Our experiments indicate that these models also reduce texture bias and yield better robustness against common corruptions and spurious correlations.
arXiv Detail & Related papers (2022-09-15T15:41:47Z) - A Graph-Enhanced Click Model for Web Search [67.27218481132185]
We propose a novel graph-enhanced click model (GraphCM) for web search.
We exploit both intra-session and inter-session information for the sparsity and cold-start problems.
arXiv Detail & Related papers (2022-06-17T08:32:43Z) - PreSizE: Predicting Size in E-Commerce using Transformers [76.33790223551074]
PreSizE is a novel deep learning framework which utilizes Transformers for accurate size prediction.
We demonstrate that PreSizE is capable of achieving superior prediction performance compared to previous state-of-the-art baselines.
As a proof of concept, we demonstrate that size predictions made by PreSizE can be effectively integrated into an existing production recommender system.
arXiv Detail & Related papers (2021-05-04T15:23:59Z) - Learning Robust Models for e-Commerce Product Search [23.537201383165755]
Showing items that do not match search query intent degrades customer experience in e-commerce.
Mitigating the problem requires a large labeled dataset.
We develop a deep, end-to-end model that learns to effectively classify mismatches.
arXiv Detail & Related papers (2020-05-07T17:22:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.