Text Extraction and Restoration of Old Handwritten Documents

• URL: http://arxiv.org/abs/2001.08742v1
• Date: Thu, 23 Jan 2020 05:42:39 GMT
• Title: Text Extraction and Restoration of Old Handwritten Documents
• Authors: Mayank Wadhwani, Debapriya Kundu, Deepayan Chakraborty, Bhabatosh Chanda
• Abstract summary: This paper describes two novel methods for the restoration of old degraded handwritten documents using deep neural network. A small-scale dataset of 26 heritage letters images is introduced. Experiments demonstrate that the proposed systems perform well on handwritten document images with severe degradations.
• Score: 3.514869837986596
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image restoration is very crucial computer vision task. This paper describes two novel methods for the restoration of old degraded handwritten documents using deep neural network. In addition to that, a small-scale dataset of 26 heritage letters images is introduced. The ground truth data to train the desired network is generated semi automatically involving a pragmatic combination of color transformation, Gaussian mixture model based segmentation and shape correction by using mathematical morphological operators. In the first approach, a deep neural network has been used for text extraction from the document image and later background reconstruction has been done using Gaussian mixture modeling. But Gaussian mixture modelling requires to set parameters manually, to alleviate this we propose a second approach where the background reconstruction and foreground extraction (which which includes extracting text with its original colour) both has been done using deep neural network. Experiments demonstrate that the proposed systems perform well on handwritten document images with severe degradations, even when trained with small dataset. Hence, the proposed methods are ideally suited for digital heritage preservation repositories. It is worth mentioning that, these methods can be extended easily for printed degraded documents.

Related papers

• Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generation [78.13793505707952]
  Existing autoregressive models follow the two-stage generation paradigm that first learns a codebook in the latent space for image reconstruction and then completes the image generation autoregressively based on the learned codebook. We propose a novel two-stage framework, which consists of Masked Quantization VAE (MQ-VAE) Stack model from modeling redundancy.
  arXiv  Detail & Related papers  (2023-05-23T02:15:53Z)
• PromptMix: Text-to-image diffusion models enhance the performance of lightweight networks [83.08625720856445]
  Deep learning tasks require annotations that are too time consuming for human operators. In this paper, we introduce PromptMix, a method for artificially boosting the size of existing datasets. We show that PromptMix can significantly increase the performance of lightweight networks by up to 26%.
  arXiv  Detail & Related papers  (2023-01-30T14:15:47Z)
• Pattern Spotting and Image Retrieval in Historical Documents using Deep Hashing [60.67014034968582]
  This paper presents a deep learning approach for image retrieval and pattern spotting in digital collections of historical documents. Deep learning models are used for feature extraction, considering two distinct variants, which provide either real-valued or binary code representations. The proposed approach also reduces the search time by up to 200x and the storage cost up to 6,000x when compared to related works.
  arXiv  Detail & Related papers  (2022-08-04T01:39:37Z)
• Reconstructing vehicles from orthographic drawings using deep neural networks [0.0]
  The paper proposes a system based on pixel-aligned implicit functions (PIFu) and develops an advanced sampling strategy to generate signed distance samples. The trained neural network generalizes well to real-world inputs and creates plausible and detailed reconstructions.
  arXiv  Detail & Related papers  (2022-06-14T12:32:32Z)
• NeuralReshaper: Single-image Human-body Retouching with Deep Neural Networks [50.40798258968408]
  We present NeuralReshaper, a novel method for semantic reshaping of human bodies in single images using deep generative networks. Our approach follows a fit-then-reshape pipeline, which first fits a parametric 3D human model to a source human image. To deal with the lack-of-data problem that no paired data exist, we introduce a novel self-supervised strategy to train our network.
  arXiv  Detail & Related papers  (2022-03-20T09:02:13Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• RectiNet-v2: A stacked network architecture for document image dewarping [16.249023269158734]
  We propose an end-to-end CNN architecture that can produce distortion free document images from warped documents it takes as input. We train this model on warped document images simulated synthetically to compensate for lack of enough natural data. We evaluate our method on the DocUNet dataset, a benchmark in this domain, and obtain results comparable to state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-02-01T19:26:17Z)
• Using Graph Neural Networks to Reconstruct Ancient Documents [2.4366811507669124]
  We present a solution based on a Graph Neural Network, using pairwise patch information to assign labels to edges. This network classifies the relationship between a source and a target patch as being one of Up, Down, Left, Right or None. We show that our model is not only able to provide correct classifications at the edge-level, but also to generate partial or full reconstruction graphs from a set of patches.
  arXiv  Detail & Related papers  (2020-11-13T18:36:36Z)
• Two-stage generative adversarial networks for document image binarization with color noise and background removal [7.639067237772286]
  We propose a two-stage color document image enhancement and binarization method using generative adversarial neural networks. In the first stage, four color-independent adversarial networks are trained to extract color foreground information from an input image. In the second stage, two independent adversarial networks with global and local features are trained for image binarization of documents of variable size.
  arXiv  Detail & Related papers  (2020-10-20T07:51:50Z)
• Self-supervised Deep Reconstruction of Mixed Strip-shredded Text Documents [63.41717168981103]
  This work extends our previous deep learning method for single-page reconstruction to a more realistic/complex scenario. In our approach, the compatibility evaluation is modeled as a two-class (valid or invalid) pattern recognition problem. The proposed method outperforms the competing ones on complex scenarios, achieving accuracy superior to 90%.
  arXiv  Detail & Related papers  (2020-07-01T21:48:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.