Web Photo Source Identification based on Neural Enhanced Camera Fingerprint

• URL: http://arxiv.org/abs/2302.09228v1
• Date: Sat, 18 Feb 2023 04:14:45 GMT
• Title: Web Photo Source Identification based on Neural Enhanced Camera Fingerprint
• Authors: Feng Qian, Sifeng He, Honghao Huang, Huanyu Ma, Xiaobo Zhang, Lei Yang
• Abstract summary: Source camera identification of web photos aims to establish a reliable linkage from the captured images to their source cameras. This paper presents an innovative and practical source identification framework that employs neural-network enhanced sensor pattern noise. By incorporating metric learning and frequency consistency into the deep network design, our proposed fingerprint extraction algorithm achieves state-of-the-art performance on modern smartphone photos.
• Score: 9.606477062236499
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the growing popularity of smartphone photography in recent years, web photos play an increasingly important role in all walks of life. Source camera identification of web photos aims to establish a reliable linkage from the captured images to their source cameras, and has a broad range of applications, such as image copyright protection, user authentication, investigated evidence verification, etc. This paper presents an innovative and practical source identification framework that employs neural-network enhanced sensor pattern noise to trace back web photos efficiently while ensuring security. Our proposed framework consists of three main stages: initial device fingerprint registration, fingerprint extraction and cryptographic connection establishment while taking photos, and connection verification between photos and source devices. By incorporating metric learning and frequency consistency into the deep network design, our proposed fingerprint extraction algorithm achieves state-of-the-art performance on modern smartphone photos for reliable source identification. Meanwhile, we also propose several optimization sub-modules to prevent fingerprint leakage and improve accuracy and efficiency. Finally for practical system design, two cryptographic schemes are introduced to reliably identify the correlation between registered fingerprint and verified photo fingerprint, i.e. fuzzy extractor and zero-knowledge proof (ZKP). The codes for fingerprint extraction network and benchmark dataset with modern smartphone cameras photos are all publicly available at https://github.com/PhotoNecf/PhotoNecf.

Related papers

• RFDforFin: Robust Deep Forgery Detection for GAN-generated Fingerprint Images [45.73061833269094]
  We propose the first deep forgery detection approach for fingerprint images, which combines unique ridge features of fingerprint and generation artifacts of the GAN-generated images. Our proposed approach is effective and robust with low complexities.
  arXiv  Detail & Related papers  (2023-08-18T04:05:18Z)
• Docmarking: Real-Time Screen-Cam Robust Document Image Watermarking [97.77394585669562]
  Proposed approach does not try to prevent leak in the first place but rather aims to determine source of the leak. Method works by applying on the screen a unique identifying watermark as semi-transparent image. Watermark image is static and stays on the screen all the time thus watermark present on every captured photograph of the screen.
  arXiv  Detail & Related papers  (2023-04-25T09:32:11Z)
• Hierarchical Perceptual Noise Injection for Social Media Fingerprint Privacy Protection [106.5308793283895]
  fingerprint leakage from social media raises a strong desire for anonymizing shared images. To guard the fingerprint leakage, adversarial attack emerges as a solution by adding imperceptible perturbations on images. We propose FingerSafe, a hierarchical perceptual protective noise injection framework to address the mentioned problems.
  arXiv  Detail & Related papers  (2022-08-23T02:20:46Z)
• FIGO: Enhanced Fingerprint Identification Approach Using GAN and One Shot Learning Techniques [0.0]
  We propose a Fingerprint Identification approach based on Generative adversarial network and One-shot learning techniques. First, we propose a Pix2Pix model to transform low-quality fingerprint images to a higher level of fingerprint images pixel by pixel directly in the fingerprint enhancement tier. Second, we construct a fully automated fingerprint feature extraction model using a one-shot learning approach to differentiate each fingerprint from the others in the fingerprint identification process.
  arXiv  Detail & Related papers  (2022-08-11T02:45:42Z)
• A review of schemes for fingerprint image quality computation [66.32254395574994]
  This paper reviews existing approaches for fingerprint image quality computation. We also implement, test and compare a selection of them using the MCYT database including 9000 fingerprint images.
  arXiv  Detail & Related papers  (2022-07-12T10:34:03Z)
• PRNU Based Source Camera Identification for Webcam and Smartphone Videos [137.6408511310322]
  This communication is about an application of image forensics where we use camera sensor fingerprints to identify source camera (SCI: Source Camera Identification) in webcam/smartphone videos.
  arXiv  Detail & Related papers  (2022-01-27T18:57:14Z)
• Synthesis and Reconstruction of Fingerprints using Generative Adversarial Networks [6.700873164609009]
  We propose a novel fingerprint synthesis and reconstruction framework based on the StyleGan2 architecture. We also derive a computational approach to modify the attributes of the generated fingerprint while preserving their identity. The proposed framework was experimentally shown to outperform contemporary state-of-the-art approaches for both fingerprint synthesis and reconstruction.
  arXiv  Detail & Related papers  (2022-01-17T00:18:00Z)
• Beyond PRNU: Learning Robust Device-Specific Fingerprint for Source Camera Identification [14.404497406560104]
  Source camera identification tools assist image forensic investigators to associate an image in question with a suspect camera. Photo Response Non Uniformity (PRNU) noise pattern caused by sensor imperfections has been proven to be an effective way to identify the source camera. PRNU is susceptible to camera settings, image content, image processing operations, and counter-forensic attacks. New device fingerprint is extracted from the low and mid-frequency bands, which resolves the fragility issue that the PRNU is unable to contend with.
  arXiv  Detail & Related papers  (2021-11-03T11:25:19Z)
• A Contactless Fingerprint Recognition System [5.565364597145569]
  We propose an approach for developing a contactless fingerprint recognition system that captures finger photo from a distance. The captured finger photos are then processed further to obtain global and local (minutiae-based) features. The proposed system is developed using the Nvidia Jetson Nano development kit, which allows us to perform contactless fingerprint recognition in real-time.
  arXiv  Detail & Related papers  (2021-08-20T08:21:55Z)
• Fingerprinting Image-to-Image Generative Adversarial Networks [53.02510603622128]
  Generative Adversarial Networks (GANs) have been widely used in various application scenarios. This paper presents a novel fingerprinting scheme for the Intellectual Property protection of image-to-image GANs based on a trusted third party.
  arXiv  Detail & Related papers  (2021-06-19T06:25:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.