PinLanding: Content-First Keyword Landing Page Generation via Multi-Modal AI for Web-Scale Discovery
- URL: http://arxiv.org/abs/2503.00619v1
- Date: Sat, 01 Mar 2025 20:55:28 GMT
- Title: PinLanding: Content-First Keyword Landing Page Generation via Multi-Modal AI for Web-Scale Discovery
- Abstract summary: We present PinLanding, a novel content-first architecture that transforms the way platforms create topical collections.<n>Our system employs a multi-stage pipeline combining vision-language model (VLM) for attribute extraction, large language model (LLM) for topic generation, and a CLIP-based dual-encoder architecture for precise content matching.
- Score: 7.842599502996326
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Online platforms like Pinterest hosting vast content collections traditionally rely on manual curation or user-generated search logs to create keyword landing pages (KLPs) -- topic-centered collection pages that serve as entry points for content discovery. While manual curation ensures quality, it doesn't scale to millions of collections, and search log approaches result in limited topic coverage and imprecise content matching. In this paper, we present PinLanding, a novel content-first architecture that transforms the way platforms create topical collections. Instead of deriving topics from user behavior, our system employs a multi-stage pipeline combining vision-language model (VLM) for attribute extraction, large language model (LLM) for topic generation, and a CLIP-based dual-encoder architecture for precise content matching. Our model achieves 99.7% Recall@10 on Fashion200K benchmark, demonstrating strong attribute understanding capabilities. In production deployment for search engine optimization with 4.2 million shopping landing pages, the system achieves a 4X increase in topic coverage and 14.29% improvement in collection attribute precision over the traditional search log-based approach via human evaluation. The architecture can be generalized beyond search traffic to power various user experiences, including content discovery and recommendations, providing a scalable solution to transform unstructured content into curated topical collections across any content domain.
Related papers
- Query-Driven Multimodal Information Extraction from Long Documents [6.155740787063792]
We propose query-driven image-text joint extraction from long documents.<n>Based on challenges related to both user intent and document content, we designed a two-level taxonomy.<n>We construct ITJoint, the first high-quality, manually annotated benchmark for this new task.
arXiv Detail & Related papers (2026-08-23T04:37:34Z) - Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing [53.41293908252118]
We introduce Dr. DocBench, a difficulty-aware benchmark for expert-level document parsing.<n>Dr. DocBench spans 52 BISAC domains and selects documents through failure-based sampling.<n>It contains 4,514 annotated pages from long documents averaging around 100 pages, with 65k high-quality annotations for layout, reading order, hierarchical relations, and domain-specific visual contents.<n>Our analysis reveals substantial failures across subjects, content types, and structural attributes, highlighting Dr. DocBench as a comprehensive testbed for diagnosing and advancing document intelligence.
arXiv Detail & Related papers (2026-05-31T18:35:30Z) - WCXB: A Multi-Type Web Content Extraction Benchmark [0.0]
We introduce the Web Content Extraction Benchmark (WCXB), a dataset of 2,008 web pages from 1,613 domains.<n>The dataset includes a 1,497-page development set and a 511-page held-out test set with matched page type distributions.<n>We evaluate 13 extraction systems and find that while top systems converge on articles, performance diverges sharply on structured page types.
arXiv Detail & Related papers (2026-05-20T12:28:12Z) - CoverageBench: Evaluating Information Coverage across Tasks and Domains [57.33043453870487]
Information coverage is a central aspect for retrieval, especially when the retrieval system is integrated with generative models.<n>Test collections developed around the notion of diversity ranking in web search incorporate multiple aspects that support a concept of coverage in the web domain.
arXiv Detail & Related papers (2026-03-20T15:20:44Z) - Enhancing Document VQA Models via Retrieval-Augmented Generation [1.6769365072542683]
Document VQA must cope with documents that span dozens of pages, yet leading systems still rely on very large vision-language models.<n>Retrieval-Augmented Generation (RAG) offers an attractive alternative, first retrieving a concise set of relevant segments before generating answers.
arXiv Detail & Related papers (2025-08-26T12:32:55Z) - Composed Object Retrieval: Object-level Retrieval via Composed Expressions [71.47650333199628]
Composed Object Retrieval (COR) is a brand-new task that goes beyond image-level retrieval to achieve object-level precision.<n>We construct COR127K, the first large-scale COR benchmark that contains 127,166 retrieval triplets with various semantic transformations in 408 categories.<n>We also present CORE, a unified end-to-end model that integrates reference region encoding, adaptive visual-textual interaction, and region-level contrastive learning.
arXiv Detail & Related papers (2025-08-06T13:11:40Z) - Relation-Rich Visual Document Generator for Visual Information Extraction [12.4941229258054]
We propose a Relation-rIch visual Document GEnerator (RIDGE) that addresses these limitations through a two-stage approach.
Our method significantly enhances the performance of document understanding models on various VIE benchmarks.
arXiv Detail & Related papers (2025-04-14T19:19:26Z) - QID: Efficient Query-Informed ViTs in Data-Scarce Regimes for OCR-free Visual Document Understanding [53.69841526266547]
Fine-tuning a pre-trained Vision-Language Model with new datasets often falls short in optimizing the vision encoder.
We introduce QID, a novel, streamlined, architecture-preserving approach that integrates query embeddings into the vision encoder.
arXiv Detail & Related papers (2025-04-03T18:47:16Z) - Iterative NLP Query Refinement for Enhancing Domain-Specific Information Retrieval: A Case Study in Career Services [0.13980986259786224]
Retrieving semantically relevant documents in niche domains poses significant challenges for TF-IDF-based systems.<n>This paper introduces an iterative and semi-automated query refinement methodology tailored to Humber College's career services webpages.
arXiv Detail & Related papers (2024-12-22T15:57:35Z) - ClusterChat: Multi-Feature Search for Corpus Exploration [3.4123736336071864]
ClusterChat is an open-source system for corpus exploration that integrates cluster-based organization of documents.<n>We validate the system with two case studies on a four million abstract PubMed dataset.
arXiv Detail & Related papers (2024-12-19T05:11:16Z) - Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval [49.42043077545341]
We propose a knowledge-aware query expansion framework, augmenting LLMs with structured document relations from knowledge graph (KG)<n>We leverage document texts as rich KG node representations and use document-based relation filtering for our Knowledge-Aware Retrieval (KAR)
arXiv Detail & Related papers (2024-10-17T17:03:23Z) - Multi-view Content-aware Indexing for Long Document Retrieval [19.74258792456242]
Long document question answering (DocQA) aims to answer questions from long documents over 10k words.
We propose the Multi-view Content-aware indexing (MC-indexing) for more effective long DocQA.
MC-indexing has significantly increased the recall by 42.8%, 30.0%, 23.9%, and 16.3% via top k= 1.5, 3, 5, and 10 respectively.
arXiv Detail & Related papers (2024-04-23T14:55:32Z) - How Does Generative Retrieval Scale to Millions of Passages? [68.98628807288972]
We conduct the first empirical study of generative retrieval techniques across various corpus scales.
We scale generative retrieval to millions of passages with a corpus of 8.8M passages and evaluating model sizes up to 11B parameters.
While generative retrieval is competitive with state-of-the-art dual encoders on small corpora, scaling to millions of passages remains an important and unsolved challenge.
arXiv Detail & Related papers (2023-05-19T17:33:38Z) - DAMO-NLP at SemEval-2023 Task 2: A Unified Retrieval-augmented System
for Multilingual Named Entity Recognition [94.90258603217008]
The MultiCoNER RNum2 shared task aims to tackle multilingual named entity recognition (NER) in fine-grained and noisy scenarios.
Previous top systems in the MultiCoNER RNum1 either incorporate the knowledge bases or gazetteers.
We propose a unified retrieval-augmented system (U-RaNER) for fine-grained multilingual NER.
arXiv Detail & Related papers (2023-05-05T16:59:26Z) - Multi-Content Time-Series Popularity Prediction with Multiple-Model
Transformers in MEC Networks [34.44384973176474]
Coded/uncoded content placement in Mobile Edge Caching (MEC) has evolved to meet the significant growth of global mobile data traffic.
Most existing datadriven popularity prediction models are not suitable for the coded/uncoded content placement frameworks.
We develop a Multiple-model (hybrid) Transformer-based Edge Caching (MTEC) framework with higher generalization ability.
arXiv Detail & Related papers (2022-10-12T02:24:49Z) - Semantic Parsing of Interpage Relations [0.0]
We formalize the task as semantic parsing of interpage relations and we propose an end-to-end approach for interpage dependency extraction.
We also design a multi-task training approach to jointly optimize for page embeddings to be used in segmentation, classification, and parsing of the page dependencies.
Our experimental results show that the proposed method increased LAS by 41 percentage points for semantic parsing, increased accuracy by 33 percentage points for page stream segmentation, and 45 percentage points for page classification over a naive baseline.
arXiv Detail & Related papers (2022-05-26T17:50:43Z) - One-shot Key Information Extraction from Document with Deep Partial
Graph Matching [60.48651298832829]
Key Information Extraction (KIE) from documents improves efficiency, productivity, and security in many industrial scenarios.
Existing supervised learning methods for the KIE task need to feed a large number of labeled samples and learn separate models for different types of documents.
We propose a deep end-to-end trainable network for one-shot KIE using partial graph matching.
arXiv Detail & Related papers (2021-09-26T07:45:53Z) - Structural Textile Pattern Recognition and Processing Based on
Hypergraphs [2.4963790083110426]
We introduce an approach for recognising similar weaving patterns based on their structures for textile archives.
We first represent textile structures using hypergraphs and extract multisets of k-neighbourhoods describing weaving patterns from these graphs.
The resulting multisets are clustered using various distance measures and various clustering algorithms.
arXiv Detail & Related papers (2021-03-21T00:44:40Z) - AutoSTR: Efficient Backbone Search for Scene Text Recognition [80.7290173000068]
Scene text recognition (STR) is very challenging due to the diversity of text instances and the complexity of scenes.
We propose automated STR (AutoSTR) to search data-dependent backbones to boost text recognition performance.
Experiments demonstrate that, by searching data-dependent backbones, AutoSTR can outperform the state-of-the-art approaches on standard benchmarks.
arXiv Detail & Related papers (2020-03-14T06:51:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.