End-to-End Unsupervised Document Image Blind Denoising

• URL: http://arxiv.org/abs/2105.09437v1
• Date: Wed, 19 May 2021 23:55:15 GMT
• Title: End-to-End Unsupervised Document Image Blind Denoising
• Authors: Mehrdad J Gangeh, Marcin Plata, Hamid Motahari, Nigel P Duffy
• Abstract summary: We propose a unified end-to-end unsupervised deep learning model, for the first time, that can effectively remove multiple types of noise. We demonstrate that the proposed model significantly improves the quality of scanned images and the OCR of the pages on several test datasets.
• Score: 0.8717253904965373
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Removing noise from scanned pages is a vital step before their submission to optical character recognition (OCR) system. Most available image denoising methods are supervised where the pairs of noisy/clean pages are required. However, this assumption is rarely met in real settings. Besides, there is no single model that can remove various noise types from documents. Here, we propose a unified end-to-end unsupervised deep learning model, for the first time, that can effectively remove multiple types of noise, including salt \& pepper noise, blurred and/or faded text, as well as watermarks from documents at various levels of intensity. We demonstrate that the proposed model significantly improves the quality of scanned images and the OCR of the pages on several test datasets.

Related papers

• Image Denoising via Style Disentanglement [9.38519460509602]
  We propose a novel approach to image denoising that offers both clear denoising mechanism and good performance. We view noise as a type of image style and remove it by incorporating noise-free styles derived from clean images. We conduct extensive experiments on synthetic noise removal and real-world image denoising datasets.
  arXiv  Detail & Related papers  (2023-09-26T08:29:33Z)
• Joint Demosaicing and Denoising with Double Deep Image Priors [5.3686304202729]
  Demosaicing and denoising RAW images are crucial steps in the processing pipeline of modern digital cameras. Recent deep neural-network-based approaches have shown the effectiveness of joint demosaicing and denoising to mitigate such challenges. We propose a novel joint demosaicing and denoising method, dubbed JDD-DoubleDIP, which operates directly on a single RAW image without requiring any training data.
  arXiv  Detail & Related papers  (2023-09-18T01:53:10Z)
• Multi-view Self-supervised Disentanglement for General Image Denoising [22.28610604896056]
  We propose to learn to disentangle the noisy image, under the intuitive assumption that different corrupted versions of the same clean image share a common latent space. A self-supervised learning framework is proposed to achieve the goal, without looking at the latent clean image. By taking two different corrupted versions of the same image as input, the proposed Multi-view Self-supervised Disentanglement (MeD) approach learns to disentangle the latent clean features from the corruptions and recover the clean image consequently.
  arXiv  Detail & Related papers  (2023-09-10T14:54:44Z)
• EraseNet: A Recurrent Residual Network for Supervised Document Cleaning [0.0]
  This paper introduces a supervised approach for cleaning dirty documents using a new fully convolutional auto-encoder architecture. The experiments in this paper have shown promising results as the model is able to learn a variety of ordinary as well as unusual noises and rectify them efficiently.
  arXiv  Detail & Related papers  (2022-10-03T04:23:25Z)
• Deep Variation Prior: Joint Image Denoising and Noise Variance Estimation without Clean Data [2.3061446605472558]
  This paper investigates the tasks of image denoising and noise variance estimation in a single, joint learning framework. We build upon DVP, an unsupervised deep learning framework, that simultaneously learns a denoiser and estimates noise variances. Our method does not require any clean training images or an external step of noise estimation, and instead, approximates the minimum mean squared error denoisers using only a set of noisy images.
  arXiv  Detail & Related papers  (2022-09-19T17:29:32Z)
• Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training [50.018580462619425]
  We propose a novel framework, namely Pixel-level Noise-aware Generative Adrial Network (PNGAN) PNGAN employs a pre-trained real denoiser to map the fake and real noisy images into a nearly noise-free solution space. For better noise fitting, we present an efficient architecture Simple Multi-versa-scale Network (SMNet) as the generator.
  arXiv  Detail & Related papers  (2022-04-06T14:09:02Z)
• IDR: Self-Supervised Image Denoising via Iterative Data Refinement [66.5510583957863]
  We present a practical unsupervised image denoising method to achieve state-of-the-art denoising performance. Our method only requires single noisy images and a noise model, which is easily accessible in practical raw image denoising. To evaluate raw image denoising performance in real-world applications, we build a high-quality raw image dataset SenseNoise-500 that contains 500 real-life scenes.
  arXiv  Detail & Related papers  (2021-11-29T07:22:53Z)
• Unpaired Learning of Deep Image Denoising [80.34135728841382]
  This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation. For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images. Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
  arXiv  Detail & Related papers  (2020-08-31T16:22:40Z)
• Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generation [52.75909685172843]
  Real-world image noise removal is a long-standing yet very challenging task in computer vision. We propose a novel unified framework to deal with the noise removal and noise generation tasks. Our method learns the joint distribution of the clean-noisy image pairs.
  arXiv  Detail & Related papers  (2020-07-12T09:16:06Z)
• Fully Unsupervised Diversity Denoising with Convolutional Variational Autoencoders [81.30960319178725]
  We propose DivNoising, a denoising approach based on fully convolutional variational autoencoders (VAEs) First we introduce a principled way of formulating the unsupervised denoising problem within the VAE framework by explicitly incorporating imaging noise models into the decoder. We show that such a noise model can either be measured, bootstrapped from noisy data, or co-learned during training.
  arXiv  Detail & Related papers  (2020-06-10T21:28:13Z)
• Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
  Blind image denoising is an important yet very challenging problem in computer vision. We propose a new variational inference method, which integrates both noise estimation and image denoising.
  arXiv  Detail & Related papers  (2019-08-29T15:54:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.