Shop The Look: Building a Large Scale Visual Shopping System at
Pinterest
- URL: http://arxiv.org/abs/2006.10866v1
- Date: Thu, 18 Jun 2020 21:38:07 GMT
- Title: Shop The Look: Building a Large Scale Visual Shopping System at
Pinterest
- Authors: Raymond Shiau, Hao-Yu Wu, Eric Kim, Yue Li Du, Anqi Guo, Zhiyuan
Zhang, Eileen Li, Kunlong Gu, Charles Rosenberg, Andrew Zhai
- Abstract summary: Shop The Look is an online shopping discovery service at Pinterest, leveraging visual search to enable users to find and buy products within an image.
We discuss topics including core technology across object detection and visual embeddings, serving infrastructure for realtime inference, and data labeling methodology for training/evaluation data collection and human evaluation.
The user-facing impacts of our system design choices are measured through offline evaluations, human relevance judgements, and online A/B experiments.
- Score: 16.132346347702075
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: As online content becomes ever more visual, the demand for searching by
visual queries grows correspondingly stronger. Shop The Look is an online
shopping discovery service at Pinterest, leveraging visual search to enable
users to find and buy products within an image. In this work, we provide a
holistic view of how we built Shop The Look, a shopping oriented visual search
system, along with lessons learned from addressing shopping needs. We discuss
topics including core technology across object detection and visual embeddings,
serving infrastructure for realtime inference, and data labeling methodology
for training/evaluation data collection and human evaluation. The user-facing
impacts of our system design choices are measured through offline evaluations,
human relevance judgements, and online A/B experiments. The collective
improvements amount to cumulative relative gains of over 160% in end-to-end
human relevance judgements and over 80% in engagement. Shop The Look is
deployed in production at Pinterest.
Related papers
- Freeview Sketching: View-Aware Fine-Grained Sketch-Based Image Retrieval [85.73149096516543]
We address the choice of viewpoint during sketch creation in Fine-Grained Sketch-Based Image Retrieval (FG-SBIR)
A pilot study highlights the system's struggle when query-sketches differ in viewpoint from target instances.
To reconcile this, we advocate for a view-aware system, seamlessly accommodating both view-agnostic and view-specific tasks.
arXiv Detail & Related papers (2024-07-01T21:20:44Z) - A Comprehensive Survey on Underwater Image Enhancement Based on Deep Learning [51.7818820745221]
Underwater image enhancement (UIE) presents a significant challenge within computer vision research.
Despite the development of numerous UIE algorithms, a thorough and systematic review is still absent.
arXiv Detail & Related papers (2024-05-30T04:46:40Z) - Efficient Large-Scale Visual Representation Learning And Evaluation [0.13192560874022083]
We describe challenges in e-commerce vision applications at scale and highlight methods to efficiently train, evaluate, and serve visual representations.
We present ablation studies evaluating visual representations in several downstream tasks.
We include online results from deployed machine learning systems in production on a large scale e-commerce platform.
arXiv Detail & Related papers (2023-05-22T18:25:03Z) - Visually Similar Products Retrieval for Shopsy [0.0]
We design a visual search system for reseller commerce using a multi-task learning approach.
Our model consists of three different tasks: attribute classification, triplet ranking and variational autoencoder (VAE)
arXiv Detail & Related papers (2022-10-10T10:59:18Z) - ItemSage: Learning Product Embeddings for Shopping Recommendations at
Pinterest [60.841761065439414]
At Pinterest, we build a single set of product embeddings called ItemSage to provide relevant recommendations in all shopping use cases.
This approach has led to significant improvements in engagement and conversion metrics, while reducing both infrastructure and maintenance cost.
arXiv Detail & Related papers (2022-05-24T02:28:58Z) - Characterization of Frequent Online Shoppers using Statistical Learning
with Sparsity [54.26540039514418]
This work reports a method to learn the shopping preferences of frequent shoppers to an online gift store by combining ideas from retail analytics and statistical learning with sparsity.
arXiv Detail & Related papers (2021-11-11T05:36:39Z) - Scaling up Search Engine Audits: Practical Insights for Algorithm
Auditing [68.8204255655161]
We set up experiments for eight search engines with hundreds of virtual agents placed in different regions.
We demonstrate the successful performance of our research infrastructure across multiple data collections.
We conclude that virtual agents are a promising venue for monitoring the performance of algorithms across long periods of time.
arXiv Detail & Related papers (2021-06-10T15:49:58Z) - Vision-based Price Suggestion for Online Second-hand Items [40.42940050851797]
We present a vision-based price suggestion system for the online second-hand item shopping platform.
The goal of vision-based price suggestion is to help sellers set effective prices for their second-hand listings with the images uploaded to the online platforms.
arXiv Detail & Related papers (2020-12-10T22:56:29Z) - Neural Networks for Fashion Image Classification and Visual Search [1.8899300124593648]
We discuss two potentially challenging problems faced by the ecommerce industry.
One relates to the problem faced by sellers while uploading pictures of products on the platform for sale and the consequent manual tagging involved.
The other problem concerns with the potential bottleneck in placing orders when a customer may not know the right keywords but has a visual impression of an image.
An image based search algorithm can unleash the true potential of ecommerce by enabling customers to click a picture of an object and search for similar products without the need for typing.
arXiv Detail & Related papers (2020-05-17T05:25:41Z) - Deep Learning for Person Re-identification: A Survey and Outlook [233.36948173686602]
Person re-identification (Re-ID) aims at retrieving a person of interest across multiple non-overlapping cameras.
By dissecting the involved components in developing a person Re-ID system, we categorize it into the closed-world and open-world settings.
arXiv Detail & Related papers (2020-01-13T12:49:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.