Conversational Retrieval and On-the-Fly Knowledge Modeling of Historical Penitentiary Repression Records

• URL: http://arxiv.org/abs/2607.08459v1
• Date: Thu, 09 Jul 2026 13:18:52 GMT
• Title: Conversational Retrieval and On-the-Fly Knowledge Modeling of Historical Penitentiary Repression Records
• Abstract summary: We present a document analysis system designed for the management of historical digital libraries.<n>The system is equipped with the capability to store facts produced by expert archivists or derived from document retrieval processes.
• Score: 1.4804887845421213
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Recent developments in digital libraries increasingly favor conversational and natural language access to information through Retrieval-Augmented Generation (RAG). Although these approaches are effective for extractive tasks grounded in individual records, they remain limited in their ability to interpret document collections holistically and to incorporate expert knowledge dynamically. In this article, we present a document analysis system designed for the management of historical digital libraries that supports on-the-fly knowledge modeling. The system is equipped with the capability to store facts produced either by expert archivists or derived from document retrieval processes within a graph-based structure. Through continuous professional interaction, the system can retrieve information not only from primary sources such as documents, but also from previously modeled knowledge, with the graph-based index acting as a memory for the language model to access. This enables increasingly complex queries involving long-term dependencies across documents, link discovery, and the integration of expert knowledge that may not be explicitly present in the original sources. As a result, the proposed approach facilitates the generation of richer and more comprehensive information.

Related papers

• Robust Interpretation of Historical Documents in Knowledge Graphs Through Query Inference and Execution [5.02509168950652]
  We present an agentic retrieval system designed to deliver more accurate and verifiable access to historical data.<n>We introduce a semi-symbolic framework that integrates word-spotting techniques for post-OCR correction with a knowledge graph representation.
  arXiv  Detail & Related papers  (2026-07-27T14:11:20Z)
• Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction [24.62245834301022]
  Document parsing is essential for converting unstructured and semi-structured documents into structured, machine-readable data.<n>This survey presents a comprehensive review of the current state of document parsing.<n>It covers key methodologies, from modular pipeline systems to end-to-end models driven by large vision-language models.
  arXiv  Detail & Related papers  (2024-10-28T16:11:35Z)
• DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models [66.91204604417912]
  This study aims to enhance generalizability of small VDU models by distilling knowledge from LLMs. We present a new framework (called DocKD) that enriches the data generation process by integrating external document knowledge. Experiments show that DocKD produces high-quality document annotations and surpasses the direct knowledge distillation approach.
  arXiv  Detail & Related papers  (2024-10-04T00:53:32Z)
• DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text [73.68051228972024]
  Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when relying on their internal knowledge. Retrieval-augmented LLMs have emerged as a potential solution to ground LLMs in external knowledge.
  arXiv  Detail & Related papers  (2023-10-31T04:37:57Z)
• Continual Learning for Generative Retrieval over Dynamic Corpora [115.79012933205756]
  Generative retrieval (GR) directly predicts the identifiers of relevant documents (i.e., docids) based on a parametric model.<n>The ability to incrementally index new documents while preserving the ability to answer queries is vital to applying GR models.<n>We put forward a novel Continual-LEarner for generatiVE Retrieval (CLEVER) model and make two major contributions to continual learning for GR.
  arXiv  Detail & Related papers  (2023-08-29T01:46:06Z)
• Expository Text Generation: Imitate, Retrieve, Paraphrase [26.43857184008374]
  We propose the task of expository text generation, which seeks to automatically generate an accurate and stylistically consistent text for a topic. We develop IRP, a framework that overcomes the limitations of retrieval-augmented models and iteratively performs content planning, fact retrieval, and rephrasing. We show that IRP produces factual and organized expository texts that accurately inform readers.
  arXiv  Detail & Related papers  (2023-05-05T04:26:29Z)
• Coarse-to-Fine Knowledge Selection for Document Grounded Dialogs [11.63334863772068]
  Multi-document grounded dialogue systems (DGDS) answer users' requests by finding supporting knowledge from a collection of documents. This paper proposes Re3G, which aims to optimize both coarse-grained knowledge retrieval and fine-grained knowledge extraction in a unified framework.
  arXiv  Detail & Related papers  (2023-02-23T08:28:29Z)
• Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog [12.081212540168055]
  We present a modified version of the MutliWOZ based dataset prepared by SeKnow to demonstrate how current methods have significant degradation in performance. In line with recent work exploiting pre-trained language models, we fine-tune a BART based model using prompts for the tasks of querying knowledge sources. We demonstrate that our model is robust to perturbations to knowledge modality (source of information) and that it can fuse information from structured as well as unstructured knowledge to generate responses.
  arXiv  Detail & Related papers  (2022-10-13T18:49:59Z)
• Generate rather than Retrieve: Large Language Models are Strong Context Generators [74.87021992611672]
  We present a novel perspective for solving knowledge-intensive tasks by replacing document retrievers with large language model generators. We call our method generate-then-read (GenRead), which first prompts a large language model to generate contextutal documents based on a given question, and then reads the generated documents to produce the final answer.
  arXiv  Detail & Related papers  (2022-09-21T01:30:59Z)
• Layout-Aware Information Extraction for Document-Grounded Dialogue: Dataset, Method and Demonstration [75.47708732473586]
  We propose a layout-aware document-level Information Extraction dataset, LIE, to facilitate the study of extracting both structural and semantic knowledge from visually rich documents. LIE contains 62k annotations of three extraction tasks from 4,061 pages in product and official documents. Empirical results show that layout is critical for VRD-based extraction, and system demonstration also verifies that the extracted knowledge can help locate the answers that users care about.
  arXiv  Detail & Related papers  (2022-07-14T07:59:45Z)
• Embedding Knowledge for Document Summarization: A Survey [66.76415502727802]
  Previous works proved that knowledge-embedded document summarizers excel at generating superior digests. We propose novel to recapitulate knowledge and knowledge embeddings under the document summarization view.
  arXiv  Detail & Related papers  (2022-04-24T04:36:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.