Named Entity Recognition and Classification on Historical Documents: A Survey

• URL: http://arxiv.org/abs/2109.11406v1
• Date: Thu, 23 Sep 2021 14:37:40 GMT
• Title: Named Entity Recognition and Classification on Historical Documents: A Survey
• Abstract summary: We present the array of challenges posed by historical documents to named entity recognition systems. We describe the main approaches deployed so far, and identify key priorities for future developments.
• Score: 0.9039665244779184
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: After decades of massive digitisation, an unprecedented amount of historical documents is available in digital format, along with their machine-readable texts. While this represents a major step forward with respect to preservation and accessibility, it also opens up new opportunities in terms of content mining and the next fundamental challenge is to develop appropriate technologies to efficiently search, retrieve and explore information from this 'big data of the past'. Among semantic indexing opportunities, the recognition and classification of named entities are in great demand among humanities scholars. Yet, named entity recognition (NER) systems are heavily challenged with diverse, historical and noisy inputs. In this survey, we present the array of challenges posed by historical documents to NER, inventory existing resources, describe the main approaches deployed so far, and identify key priorities for future developments.

Related papers

• Conversational Retrieval and On-the-Fly Knowledge Modeling of Historical Penitentiary Repression Records [1.4804887845421213]
  We present a document analysis system designed for the management of historical digital libraries.<n>The system is equipped with the capability to store facts produced by expert archivists or derived from document retrieval processes.
  arXiv  Detail & Related papers  (2026-07-09T13:18:52Z)
• Personalized Generation In Large Model Era: A Survey [90.7579254803302]
  In the era of large models, content generation is gradually shifting to Personalized Generation (PGen) This paper presents the first comprehensive survey on PGen, investigating existing research in this rapidly growing field. By bridging PGen research across multiple modalities, this survey serves as a valuable resource for fostering knowledge sharing and interdisciplinary collaboration.
  arXiv  Detail & Related papers  (2025-03-04T13:34:19Z)
• Handwritten Text Recognition: A Survey [9.121437356699358]
  Handwritten Text Recognition (HTR) has become an essential field within pattern recognition and machine learning. The complexity of HTR lies in the high variability of handwriting, which makes it challenging to develop robust recognition systems. This survey examines the evolution of HTR models, tracing their progression from early-based approaches to modern state-of-the-art neural models.
  arXiv  Detail & Related papers  (2025-02-12T13:59:37Z)
• Towards Data-Centric AI: A Comprehensive Survey of Traditional, Reinforcement, and Generative Approaches for Tabular Data Transformation [37.43210238341124]
  This survey examines the key aspects of data-centric AI, emphasizing feature selection and feature generation as essential techniques for data space refinement. We provide a systematic review of feature selection methods, which identify and retain the most relevant data attributes, and feature generation approaches, which create new features to simplify the capture of complex data patterns.
  arXiv  Detail & Related papers  (2025-01-17T21:05:09Z)
• A Survey of Generative Information Retrieval [25.1249210843116]
  Generative Retrieval (GR) is an emerging paradigm in information retrieval that leverages generative models to map queries to relevant document identifiers (DocIDs) without the need for traditional query processing or document reranking. This survey provides a comprehensive overview of GR, highlighting key developments, indexing and retrieval strategies, and challenges.
  arXiv  Detail & Related papers  (2024-06-03T10:59:33Z)
• A Survey of Generative Search and Recommendation in the Era of Large Language Models [125.26354486027408]
  generative search (retrieval) and recommendation aims to address the matching problem in a generative manner. Superintelligent generative large language models have sparked a new paradigm in search and recommendation.
  arXiv  Detail & Related papers  (2024-04-25T17:58:17Z)
• Deepfake Generation and Detection: A Benchmark and Survey [134.19054491600832]
  Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions. This survey comprehensively reviews the latest developments in deepfake generation and detection. We focus on researching four representative deepfake fields: face swapping, face reenactment, talking face generation, and facial attribute editing.
  arXiv  Detail & Related papers  (2024-03-26T17:12:34Z)
• Unearthing Large Scale Domain-Specific Knowledge from Public Corpora [103.0865116794534]
  We introduce large models into the data collection pipeline to guide the generation of domain-specific information.<n>We refer to this approach as Retrieve-from-CC.<n>It not only collects data related to domain-specific knowledge but also mines the data containing potential reasoning procedures from the public corpus.
  arXiv  Detail & Related papers  (2024-01-26T03:38:23Z)
• Capture the Flag: Uncovering Data Insights with Large Language Models [90.47038584812925]
  This study explores the potential of using Large Language Models (LLMs) to automate the discovery of insights in data. We propose a new evaluation methodology based on a "capture the flag" principle, measuring the ability of such models to recognize meaningful and pertinent information (flags) in a dataset.
  arXiv  Detail & Related papers  (2023-12-21T14:20:06Z)
• Yes but.. Can ChatGPT Identify Entities in Historical Documents? [8.591605318423321]
  Large language models (LLMs) have been leveraged for several years now, obtaining state-of-the-art performance in recognizing entities from modern documents. ChatGPT has "prompted" a lot of interest in the scientific community and public due to its capacity of generating plausible-sounding answers.
  arXiv  Detail & Related papers  (2023-03-30T12:23:39Z)
• Embedding Knowledge for Document Summarization: A Survey [66.76415502727802]
  Previous works proved that knowledge-embedded document summarizers excel at generating superior digests. We propose novel to recapitulate knowledge and knowledge embeddings under the document summarization view.
  arXiv  Detail & Related papers  (2022-04-24T04:36:07Z)
• Algorithmic Fairness Datasets: the Story so Far [68.45921483094705]
  Data-driven algorithms are studied in diverse domains to support critical decisions, directly impacting people's well-being. A growing community of researchers has been investigating the equity of existing algorithms and proposing novel ones, advancing the understanding of risks and opportunities of automated decision-making for historically disadvantaged populations. Progress in fair Machine Learning hinges on data, which can be appropriately used only if adequately documented. Unfortunately, the algorithmic fairness community suffers from a collective data documentation debt caused by a lack of information on specific resources (opacity) and scatteredness of available information (sparsity)
  arXiv  Detail & Related papers  (2022-02-03T17:25:46Z)
• Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making [66.72253432908693]
  Kinship recognition is a challenging problem with many practical applications. We review the public resources and data challenges that enabled and inspired many to hone-in on the views. For the tenth anniversary, the demo code is provided for the various kin-based tasks.
  arXiv  Detail & Related papers  (2020-06-29T13:25:45Z)
• Ontologies in CLARIAH: Towards Interoperability in History, Language and Media [0.05277024349608833]
  One of the most important goals of digital humanities is to provide researchers with data and tools for new research questions. The FAIR principles provide a framework as these state that data needs to be: Findable, as they are often scattered among various sources; Accessible, since some might be offline or behind paywalls; Interoperable, thus using standard knowledge representation formats and shared. We describe the tools developed and integrated in the Dutch national project CLARIAH to address these issues.
  arXiv  Detail & Related papers  (2020-04-06T17:38:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.