Shop The Look: Building a Large Scale Visual Shopping System at
Pinterest
- URL: http://arxiv.org/abs/2006.10866v1
- Date: Thu, 18 Jun 2020 21:38:07 GMT
- Title: Shop The Look: Building a Large Scale Visual Shopping System at
Pinterest
- Authors: Raymond Shiau, Hao-Yu Wu, Eric Kim, Yue Li Du, Anqi Guo, Zhiyuan
Zhang, Eileen Li, Kunlong Gu, Charles Rosenberg, Andrew Zhai
- Abstract summary: Shop The Look is an online shopping discovery service at Pinterest, leveraging visual search to enable users to find and buy products within an image.
We discuss topics including core technology across object detection and visual embeddings, serving infrastructure for realtime inference, and data labeling methodology for training/evaluation data collection and human evaluation.
The user-facing impacts of our system design choices are measured through offline evaluations, human relevance judgements, and online A/B experiments.
- Score: 16.132346347702075
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: As online content becomes ever more visual, the demand for searching by
visual queries grows correspondingly stronger. Shop The Look is an online
shopping discovery service at Pinterest, leveraging visual search to enable
users to find and buy products within an image. In this work, we provide a
holistic view of how we built Shop The Look, a shopping oriented visual search
system, along with lessons learned from addressing shopping needs. We discuss
topics including core technology across object detection and visual embeddings,
serving infrastructure for realtime inference, and data labeling methodology
for training/evaluation data collection and human evaluation. The user-facing
impacts of our system design choices are measured through offline evaluations,
human relevance judgements, and online A/B experiments. The collective
improvements amount to cumulative relative gains of over 160% in end-to-end
human relevance judgements and over 80% in engagement. Shop The Look is
deployed in production at Pinterest.
Related papers
- Exploring Query Understanding for Amazon Product Search [62.53282527112405]
We study how query understanding-based ranking features influence the ranking process.
We propose a query understanding-based multi-task learning framework for ranking.
We present our studies and investigations using the real-world system on Amazon Search.
arXiv Detail & Related papers (2024-08-05T03:33:11Z) - Freeview Sketching: View-Aware Fine-Grained Sketch-Based Image Retrieval [85.73149096516543]
We address the choice of viewpoint during sketch creation in Fine-Grained Sketch-Based Image Retrieval (FG-SBIR)
A pilot study highlights the system's struggle when query-sketches differ in viewpoint from target instances.
To reconcile this, we advocate for a view-aware system, seamlessly accommodating both view-agnostic and view-specific tasks.
arXiv Detail & Related papers (2024-07-01T21:20:44Z) - A Comprehensive Survey on Underwater Image Enhancement Based on Deep Learning [51.7818820745221]
Underwater image enhancement (UIE) presents a significant challenge within computer vision research.
Despite the development of numerous UIE algorithms, a thorough and systematic review is still absent.
arXiv Detail & Related papers (2024-05-30T04:46:40Z) - Shopping Queries Image Dataset (SQID): An Image-Enriched ESCI Dataset for Exploring Multimodal Learning in Product Search [0.6106642353538779]
Shopping Queries Image dataset (SQID) is an extension of the Amazon Shopping Queries dataset enriched with image information associated with 190,000 products.
By integrating visual information, SQID facilitates research around multimodal learning techniques for improving product search and ranking.
We provide experimental results leveraging SQID and pretrained models, showing the value of using multimodal data for search and ranking.
arXiv Detail & Related papers (2024-05-24T03:50:31Z) - Efficient Large-Scale Visual Representation Learning And Evaluation [0.13192560874022083]
We describe challenges in e-commerce vision applications at scale and highlight methods to efficiently train, evaluate, and serve visual representations.
We present ablation studies evaluating visual representations in several downstream tasks.
We include online results from deployed machine learning systems in production on a large scale e-commerce platform.
arXiv Detail & Related papers (2023-05-22T18:25:03Z) - Visually Similar Products Retrieval for Shopsy [0.0]
We design a visual search system for reseller commerce using a multi-task learning approach.
Our model consists of three different tasks: attribute classification, triplet ranking and variational autoencoder (VAE)
arXiv Detail & Related papers (2022-10-10T10:59:18Z) - ItemSage: Learning Product Embeddings for Shopping Recommendations at
Pinterest [60.841761065439414]
At Pinterest, we build a single set of product embeddings called ItemSage to provide relevant recommendations in all shopping use cases.
This approach has led to significant improvements in engagement and conversion metrics, while reducing both infrastructure and maintenance cost.
arXiv Detail & Related papers (2022-05-24T02:28:58Z) - Characterization of Frequent Online Shoppers using Statistical Learning
with Sparsity [54.26540039514418]
This work reports a method to learn the shopping preferences of frequent shoppers to an online gift store by combining ideas from retail analytics and statistical learning with sparsity.
arXiv Detail & Related papers (2021-11-11T05:36:39Z) - Vision-based Price Suggestion for Online Second-hand Items [40.42940050851797]
We present a vision-based price suggestion system for the online second-hand item shopping platform.
The goal of vision-based price suggestion is to help sellers set effective prices for their second-hand listings with the images uploaded to the online platforms.
arXiv Detail & Related papers (2020-12-10T22:56:29Z) - Deep Learning for Person Re-identification: A Survey and Outlook [233.36948173686602]
Person re-identification (Re-ID) aims at retrieving a person of interest across multiple non-overlapping cameras.
By dissecting the involved components in developing a person Re-ID system, we categorize it into the closed-world and open-world settings.
arXiv Detail & Related papers (2020-01-13T12:49:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.