Term-Centric Hierarchy Induction from Heterogeneous Corpora

• URL: http://arxiv.org/abs/2606.26963v1
• Date: Thu, 25 Jun 2026 12:37:33 GMT
• Title: Term-Centric Hierarchy Induction from Heterogeneous Corpora
• Abstract summary: We propose a term-centric framework for inducing hierarchical corpora that scales to massive document collections.<n>Our approach maps documents from diverse sources into a shared representation space using automatic term extraction.<n> Experiments on a novel English and German multi-source benchmark of over one million documents demonstrate that our method improves cross-source coherence and hierarchy quality.
• Score: 39.04226660046721
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Organizing knowledge from diverse text sources into interpretable hierarchies is crucial for tasks such as policy analysis, innovation monitoring, and exploratory domain mapping. Existing taxonomy induction methods typically rely on document-level representations that capture entire documents rather than the specific domain concepts relevant for knowledge organization, limiting their ability to generalize across heterogeneous sources. We propose a term-centric framework for inducing hierarchical taxonomies from heterogeneous corpora that scales to massive document collections. Our approach maps documents from diverse sources into a shared representation space using automatic term extraction, enabling robust cross-source alignment. Based on these representations, we construct interpretable hierarchies that integrate domain priors with datadriven clustering. Experiments on a novel English and German multi-source benchmark of over one million documents demonstrate that our method improves cross-source coherence and hierarchy quality over text- and summarybased baselines. A case study on German regional innovation analysis further demonstrates its practical utility for technology landscape mapping.

Related papers

• W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases [9.232743201134792]
  Existing RAG pipelines assume that evidence retrieved from multiple repositories can be ranked globally using a single similarity function.<n>We propose W-RAG, a source-aware retrieval framework that performs ontology-guided retrieval, local ranking within each knowledge base, and source-level weighting to regulate evidence composition.
  arXiv  Detail & Related papers  (2026-08-22T19:01:59Z)
• OmniRetrieval: Unified Retrieval across Heterogeneous Knowledge Sources [67.62754856088591]
  Existing retrievers operate over one source at a time under a fixed query language.<n>We present OmniRetrieval, a framework that takes any natural-language query and identifies appropriate knowledge sources.
  arXiv  Detail & Related papers  (2026-05-28T02:10:35Z)
• Learning Hierarchical Knowledge in Text-Rich Networks with Taxonomy-Informed Representation Learning [16.211492894357473]
  We propose TIER, which first constructs an implicit hierarchical taxonomy and then integrates it into the learned node representations.<n>By learning representations that encode both fine-grained and coarse-grained semantics, TIER enables more interpretable and structured modeling of real-world Text-Rich Networks (TRNs)<n>We demonstrate that our approach significantly outperforms existing methods on multiple datasets across diverse domains.
  arXiv  Detail & Related papers  (2026-03-09T09:40:18Z)
• Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding [61.36285696607487]
  Document understanding is critical for applications from financial analysis to scientific discovery.<n>Current approaches, whether OCR-based pipelines feeding Large Language Models (LLMs) or native Multimodal LLMs (MLLMs) face key limitations.<n>Retrieval-Augmented Generation (RAG) helps ground models in external data, but documents' multimodal nature, combining text, tables, charts, and layout, demands a more advanced paradigm: Multimodal RAG.
  arXiv  Detail & Related papers  (2025-10-17T02:33:16Z)
• Context-Aware Hierarchical Taxonomy Generation for Scientific Papers via LLM-Guided Multi-Aspect Clustering [59.54662810933882]
  Existing taxonomy construction methods, leveraging unsupervised clustering or direct prompting of large language models, often lack coherence and granularity.<n>We propose a novel context-aware hierarchical taxonomy generation framework that integrates LLM-guided multi-aspect encoding with dynamic clustering.
  arXiv  Detail & Related papers  (2025-09-23T15:12:58Z)
• PosterForest: Hierarchical Multi-Agent Collaboration for Scientific Poster Generation [28.02969134846803]
  We introduce the textitPoster Tree, a hierarchical intermediate representation that jointly encodes document structure and visual-textual relationships.<n>Our framework employs a multi-agent collaboration strategy, where agents specializing in content summarization and layout planning iteratively coordinate and provide mutual feedback.
  arXiv  Detail & Related papers  (2025-08-29T15:36:06Z)
• Beyond Chunking: Discourse-Aware Hierarchical Retrieval for Long Document Question Answering [51.7493726399073]
  We present a discourse-aware hierarchical framework to enhance long document question answering.<n>The framework involves three key innovations: specialized discourse parsing for lengthy documents, LLM-based enhancement of discourse relation nodes, and structure-guided hierarchical retrieval.
  arXiv  Detail & Related papers  (2025-05-26T14:45:12Z)
• Your Next State-of-the-Art Could Come from Another Domain: A Cross-Domain Analysis of Hierarchical Text Classification [13.210645250173997]
  Text classification with hierarchical labels is a prevalent and challenging task in natural language processing.<n>We provide the first comprehensive cross-domain overview with empirical analysis of state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-12-17T10:08:57Z)
• Data-driven Coreference-based Ontology Building [48.995395445597225]
  Coreference resolution is traditionally used as a component in individual document understanding. We take a more global view and explore what can we learn about a domain from the set of all document-level coreference relations. We release the coreference chains resulting under a creative-commons license, along with the code.
  arXiv  Detail & Related papers  (2024-10-22T14:30:40Z)
• Leveraging Collection-Wide Similarities for Unsupervised Document Structure Extraction [61.998789448260005]
  We propose to identify the typical structure of document within a collection. We abstract over arbitrary header paraphrases, and ground each topic to respective document locations. We develop an unsupervised graph-based method which leverages both inter- and intra-document similarities.
  arXiv  Detail & Related papers  (2024-02-21T16:22:21Z)
• Document AI: A Comparative Study of Transformer-Based, Graph-Based Models, and Convolutional Neural Networks For Document Layout Analysis [3.231170156689185]
  Document AI aims to automatically analyze documents by leveraging natural language processing and computer vision techniques. One of the major tasks of Document AI is document layout analysis, which structures document pages by interpreting the content and spatial relationships of layout, image, and text.
  arXiv  Detail & Related papers  (2023-08-29T16:58:03Z)
• Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmark [44.06803331843307]
  paragraph-level topic structure can grasp and understand the overall context of a document from a higher level. The lack of large-scale, high-quality Chinese paragraph-level topic structure corpora restrained research and applications. We propose a hierarchical paragraph-level topic structure representation with three layers to guide the corpus construction. We employ a two-stage man-machine collaborative annotation method to construct the largest Chinese paragraph-level Topic Structure corpus.
  arXiv  Detail & Related papers  (2023-05-24T06:43:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.