The Forchheim Image Database for Camera Identification in the Wild

• URL: http://arxiv.org/abs/2011.02241v1
• Date: Wed, 4 Nov 2020 11:54:54 GMT
• Title: The Forchheim Image Database for Camera Identification in the Wild
• Authors: Benjamin Hadwiger, Christian Riess
• Abstract summary: Forchheim Image Database (FODB) consists of more than 23,000 images of 143 scenes by 27 smartphone cameras. Each image is provided in 6 different qualities: the original camera-native version, and five copies from social networks. General-purpose EfficientNet remarkably outperforms several dedicated forensic CNNs both on clean and compressed images.
• Score: 10.091921099426294
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image provenance can represent crucial knowledge in criminal investigation and journalistic fact checking. In the last two decades, numerous algorithms have been proposed for obtaining information on the source camera and distribution history of an image. For a fair ranking of these techniques, it is important to rigorously assess their performance on practically relevant test cases. To this end, a number of datasets have been proposed. However, we argue that there is a gap in existing databases: to our knowledge, there is currently no dataset that simultaneously satisfies two goals, namely a) to cleanly separate scene content and forensic traces, and b) to support realistic post-processing like social media recompression. In this work, we propose the Forchheim Image Database (FODB) to close this gap. It consists of more than 23,000 images of 143 scenes by 27 smartphone cameras, and it allows to cleanly separate image content from forensic artifacts. Each image is provided in 6 different qualities: the original camera-native version, and five copies from social networks. We demonstrate the usefulness of FODB in an evaluation of methods for camera identification. We report three findings. First, the recently proposed general-purpose EfficientNet remarkably outperforms several dedicated forensic CNNs both on clean and compressed images. Second, classifiers obtain a performance boost even on unknown post-processing after augmentation by artificial degradations. Third, FODB's clean separation of scene content and forensic traces imposes important, rigorous boundary conditions for algorithm benchmarking.

Related papers

• FORB: A Flat Object Retrieval Benchmark for Universal Image Embedding [7.272083488859574]
  We introduce a new dataset for benchmarking visual search methods on flat images with diverse patterns. Our flat object retrieval benchmark (FORB) supplements the commonly adopted 3D object domain. It serves as a testbed for assessing the image embedding quality on out-of-distribution domains.
  arXiv  Detail & Related papers  (2023-09-28T08:41:51Z)
• Scrape, Cut, Paste and Learn: Automated Dataset Generation Applied to Parcel Logistics [58.720142291102135]
  We present a fully automated pipeline to generate a synthetic dataset for instance segmentation in four steps. We first scrape images for the objects of interest from popular image search engines. We compare three different methods for image selection: Object-agnostic pre-processing, manual image selection and CNN-based image selection.
  arXiv  Detail & Related papers  (2022-10-18T12:49:04Z)
• Forensicability Assessment of Questioned Images in Recapturing Detection [78.45849869266834]
  We propose a forensicability assessment network to quantify the forensicability of the questioned samples. The low-forensicability samples are rejected before the actual recapturing detection process to improve the efficiency of recapturing systems. We integrate the trained FANet with practical recapturing detection schemes in face anti-spoofing and recaptured document detection tasks.
  arXiv  Detail & Related papers  (2022-09-05T12:26:01Z)
• Learning Co-segmentation by Segment Swapping for Retrieval and Discovery [67.6609943904996]
  The goal of this work is to efficiently identify visually similar patterns from a pair of images. We generate synthetic training pairs by selecting object segments in an image and copy-pasting them into another image. We show our approach provides clear improvements for artwork details retrieval on the Brueghel dataset.
  arXiv  Detail & Related papers  (2021-10-29T16:51:16Z)
• Content-Based Detection of Temporal Metadata Manipulation [91.34308819261905]
  We propose an end-to-end approach to verify whether the purported time of capture of an image is consistent with its content and geographic location. The central idea is the use of supervised consistency verification, in which we predict the probability that the image content, capture time, and geographical location are consistent. Our approach improves upon previous work on a large benchmark dataset, increasing the classification accuracy from 59.03% to 81.07%.
  arXiv  Detail & Related papers  (2021-03-08T13:16:19Z)
• Deep Bingham Networks: Dealing with Uncertainty and Ambiguity in Pose Estimation [74.76155168705975]
  Deep Bingham Networks (DBN) can handle pose-related uncertainties and ambiguities arising in almost all real life applications concerning 3D data. DBN extends the state of the art direct pose regression networks by (i) a multi-hypotheses prediction head which can yield different distribution modes. We propose new training strategies so as to avoid mode or posterior collapse during training and to improve numerical stability.
  arXiv  Detail & Related papers  (2020-12-20T19:20:26Z)
• Video Camera Identification from Sensor Pattern Noise with a Constrained ConvNet [7.229968041355052]
  We propose a method to identify the source camera of a video based on camera specific noise patterns that we extract from video frames. Our system is designed to classify individual video frames which are in turn combined by a majority vote to identify the source camera. This work is part of the EU-funded project 4NSEEK focused on forensics against child sexual abuse.
  arXiv  Detail & Related papers  (2020-12-11T12:17:30Z)
• UDBNET: Unsupervised Document Binarization Network via Adversarial Game [26.60652038277151]
  We present a novel approach towards document image binarization by introducing three-player min-max adversarial game. In our approach, an Adversarial Texture Augmentation Network (ATANet) first superimposes the texture of a degraded reference image over a clean image. The clean image along with its generated degraded version constitute the pseudo paired-data which is used to train the Unsupervised Document Binarization Network (UDBNet)
  arXiv  Detail & Related papers  (2020-07-14T14:58:46Z)
• Device-based Image Matching with Similarity Learning by Convolutional Neural Networks that Exploit the Underlying Camera Sensor Pattern Noise [6.6602878519516135]
  We propose a two-part network to quantify the likelihood that a given pair of images have the same source camera. To the best of our knowledge, we are the first ones addressing the challenge of device-based image matching. This work is part of the EU-funded project 4NSEEK concerned with forensics against child sexual abuse.
  arXiv  Detail & Related papers  (2020-04-23T20:03:40Z)
• Camera Trace Erasing [86.15997461603568]
  We address a new low-level vision problem, camera trace erasing, to reveal the weakness of trace-based forensic methods. We propose Siamese Trace Erasing (SiamTE), in which a novel hybrid loss is designed on the basis of Siamese architecture for network training.
  arXiv  Detail & Related papers  (2020-03-16T00:09:55Z)
• CNN-based fast source device identification [30.17213343080699]
  We propose a fast and accurate solution using convolutional neural networks (CNNs) Specifically, we propose a 2-channel-based CNN that learns a way of comparing camera fingerprint and image noise at patch level. This makes the approach particularly suitable in scenarios where large databases of images are analyzed, like over social networks.
  arXiv  Detail & Related papers  (2020-01-31T14:01:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.