Npix2Cpix: A GAN-based Image-to-Image Translation Network with Retrieval-Classification Integration for Watermark Retrieval from Historical Document Images

• URL: http://arxiv.org/abs/2406.03556v2
• Date: Wed, 24 Jul 2024 18:50:51 GMT
• Title: Npix2Cpix: A GAN-based Image-to-Image Translation Network with Retrieval-Classification Integration for Watermark Retrieval from Historical Document Images
• Authors: Utsab Saha, Sawradip Saha, Shaikh Anowarul Fattah, Mohammad Saquib,
• Abstract summary: The identification and restoration of ancient watermarks has long been a major topic in codicology and history. This paper proposes a modified U-net-based conditional generative adversarial network (GAN) named Npix2Cpix to translate noisy raw historical watermarked images into clean, handwriting-free watermarked images.
• Score: 1.3549498237473223
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The identification and restoration of ancient watermarks have long been a major topic in codicology and history. Classifying historical documents based on watermarks is challenging due to their diversity, noisy samples, multiple representation modes, and minor distinctions between classes and intra-class variations. This paper proposes a modified U-net-based conditional generative adversarial network (GAN) named Npix2Cpix to translate noisy raw historical watermarked images into clean, handwriting-free watermarked images by performing image translation from degraded (noisy) pixels to clean pixels. Using image-to-image translation and adversarial learning, the network creates clutter-free images for watermark restoration and categorization. The generator and discriminator of the proposed GAN are trained using two separate loss functions, each based on the distance between images, to learn the mapping from the input noisy image to the output clean image. After using the proposed GAN to pre-process noisy watermarked images, Siamese-based one-shot learning is employed for watermark classification. Experimental results on a large-scale historical watermark dataset demonstrate that cleaning the noisy watermarked images can help to achieve high one-shot classification accuracy. The qualitative and quantitative evaluation of the retrieved watermarked image highlights the effectiveness of the proposed approach.

Related papers

• ProMark: Proactive Diffusion Watermarking for Causal Attribution [25.773438257321793]
  We propose ProMark, a causal attribution technique to attribute a synthetically generated image to its training data concepts. The concept information is proactively embedded into the input training images using imperceptible watermarks. We show that we can embed as many as $216$ unique watermarks into the training data, and each training image can contain more than one watermark.
  arXiv  Detail & Related papers  (2024-03-14T23:16:43Z)
• A self-supervised CNN for image watermark removal [102.94929746450902]
  We propose a self-supervised convolutional neural network (CNN) in image watermark removal (SWCNN) SWCNN uses a self-supervised way to construct reference watermarked images rather than given paired training samples, according to watermark distribution. Taking into account texture information, a mixed loss is exploited to improve visual effects of image watermark removal.
  arXiv  Detail & Related papers  (2024-03-09T05:59:48Z)
• Perceptive self-supervised learning network for noisy image watermark removal [59.440951785128995]
  We propose a perceptive self-supervised learning network for noisy image watermark removal (PSLNet) Our proposed method is very effective in comparison with popular convolutional neural networks (CNNs) for noisy image watermark removal.
  arXiv  Detail & Related papers  (2024-03-04T16:59:43Z)
• RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guarantees [33.61946642460661]
  This paper introduces a robust and agile watermark detection framework, dubbed as RAW. We employ a classifier that is jointly trained with the watermark to detect the presence of the watermark. We show that the framework provides provable guarantees regarding the false positive rate for misclassifying a watermarked image.
  arXiv  Detail & Related papers  (2024-01-23T22:00:49Z)
• Removing Interference and Recovering Content Imaginatively for Visible Watermark Removal [63.576748565274706]
  This study introduces the Removing Interference and Recovering Content Imaginatively (RIRCI) framework. RIRCI embodies a two-stage approach: the initial phase centers on discerning and segregating the watermark component, while the subsequent phase focuses on background content restoration. To achieve meticulous background restoration, our proposed model employs a dual-path network capable of fully exploring the intrinsic background information beneath semi-transparent watermarks.
  arXiv  Detail & Related papers  (2023-12-22T02:19:23Z)
• Robustness of AI-Image Detectors: Fundamental Limits and Practical Attacks [47.04650443491879]
  We analyze the robustness of various AI-image detectors including watermarking and deepfake detectors. We show that watermarking methods are vulnerable to spoofing attacks where the attacker aims to have real images identified as watermarked ones.
  arXiv  Detail & Related papers  (2023-09-29T18:30:29Z)
• T2IW: Joint Text to Image & Watermark Generation [74.20148555503127]
  We introduce a novel task for the joint generation of text to image and watermark (T2IW) This T2IW scheme ensures minimal damage to image quality when generating a compound image by forcing the semantic feature and the watermark signal to be compatible in pixels. We demonstrate remarkable achievements in image quality, watermark invisibility, and watermark robustness, supported by our proposed set of evaluation metrics.
  arXiv  Detail & Related papers  (2023-09-07T16:12:06Z)
• Visible Watermark Removal via Self-calibrated Localization and Background Refinement [21.632823897244037]
  Superimposing visible watermarks on images provides a powerful weapon to cope with the copyright issue. Modern watermark removal methods perform watermark localization and background restoration simultaneously. We propose a two-stage multi-task network to address the above issues.
  arXiv  Detail & Related papers  (2021-08-08T06:43:55Z)
• WDNet: Watermark-Decomposition Network for Visible Watermark Removal [61.14614115654322]
  The uncertainty of the size, shape, color and transparency of watermarks set a huge barrier for image-to-image translation techniques. We combine traditional watermarked image decomposition into a two-stage generator, called Watermark-Decomposition Network (WDNet) The decomposition formulation enables WDNet to separate watermarks from the images rather than simply removing them.
  arXiv  Detail & Related papers  (2020-12-14T15:07:35Z)
• Split then Refine: Stacked Attention-guided ResUNets for Blind Single Image Visible Watermark Removal [69.92767260794628]
  Previous watermark removal methods require to gain the watermark location from users or train a multi-task network to recover the background indiscriminately. We propose a novel two-stage framework with a stacked attention-guided ResUNets to simulate the process of detection, removal and refinement. We extensively evaluate our algorithm over four different datasets under various settings and the experiments show that our approach outperforms other state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2020-12-13T09:05:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.