Learning to identify image manipulations in scientific publications

• URL: http://arxiv.org/abs/2102.01874v1
• Date: Wed, 3 Feb 2021 04:47:34 GMT
• Title: Learning to identify image manipulations in scientific publications
• Authors: Ghazal Mazaheri, Kevin Urrutia Avila, Amit K. Roy-Chowdhury
• Abstract summary: We propose a framework that combines image processing and deep learning methods to classify images in the articles as duplicated or unduplicated ones. We show that our method leads to a 90% accuracy rate of detecting duplicated images, a 13% improvement in detection accuracy in comparison to other manipulation detection methods.
• Score: 37.6933210164122
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Adherence to scientific community standards ensures objectivity, clarity, reproducibility, and helps prevent bias, fabrication, falsification, and plagiarism. To help scientific integrity officers and journal/publisher reviewers monitor if researchers stick with these standards, it is important to have a solid procedure to detect duplication as one of the most frequent types of manipulation in scientific papers. Images in scientific papers are used to support the experimental description and the discussion of the findings. Therefore, in this work we focus on detecting the duplications in images as one of the most important parts of a scientific paper. We propose a framework that combines image processing and deep learning methods to classify images in the articles as duplicated or unduplicated ones. We show that our method leads to a 90% accuracy rate of detecting duplicated images, a ~ 13% improvement in detection accuracy in comparison to other manipulation detection methods. We also show how effective the pre-processing steps are by comparing our method to other state-of-art manipulation detectors which lack these steps.

Related papers

• Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Method [77.65459419417533]
  We put face forgery in a semantic context and define that computational methods that alter semantic face attributes are sources of face forgery. We construct a large face forgery image dataset, where each image is associated with a set of labels organized in a hierarchical graph. We propose a semantics-oriented face forgery detection method that captures label relations and prioritizes the primary task.
  arXiv  Detail & Related papers  (2024-05-14T10:24:19Z)
• Deep Image Restoration For Image Anti-Forensics [0.0]
  JPEG compression, blurring and noising have long been used for anti-forensics. They make it difficult to detect fake images and are used for data augmentation in training deep image forgery detection models. Separate image forensics methods have also been developed to detect these traces. In this study, we go one step further and improve the image quality after these methods with deep image restoration models.
  arXiv  Detail & Related papers  (2024-05-04T20:49:06Z)
• Detecting Generated Images by Real Images Only [64.12501227493765]
  Existing generated image detection methods detect visual artifacts in generated images or learn discriminative features from both real and generated images by massive training. This paper approaches the generated image detection problem from a new perspective: Start from real images. By finding the commonality of real images and mapping them to a dense subspace in feature space, the goal is that generated images, regardless of their generative model, are then projected outside the subspace.
  arXiv  Detail & Related papers  (2023-11-02T03:09:37Z)
• MMNet: Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake Detection [81.59191603867586]
  Sequential deepfake detection aims to identify forged facial regions with the correct sequence for recovery. The recovery of forged images requires knowledge of the manipulation model to implement inverse transformations. We propose Multi-Collaboration and Multi-Supervision Network (MMNet) that handles various spatial scales and sequential permutations in forged face images.
  arXiv  Detail & Related papers  (2023-07-06T02:32:08Z)
• Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognition [101.60244147302197]
  We introduce contrastive learning and masked image modeling to learn discrimination and generation of text images. Our method outperforms previous self-supervised text recognition methods by 10.2%-20.2% on irregular scene text recognition datasets. Our proposed text recognizer exceeds previous state-of-the-art text recognition methods by averagely 5.3% on 11 benchmarks, with similar model size.
  arXiv  Detail & Related papers  (2022-07-01T03:50:26Z)
• ObjectFormer for Image Manipulation Detection and Localization [118.89882740099137]
  We propose ObjectFormer to detect and localize image manipulations. We extract high-frequency features of the images and combine them with RGB features as multimodal patch embeddings. We conduct extensive experiments on various datasets and the results verify the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2022-03-28T12:27:34Z)
• Detecting and Localizing Copy-Move and Image-Splicing Forgery [0.0]
  We focus on the methods to detect if an image has been tampered with using both Deep Learning and Image transformation methods. We then attempt to identify the tampered area of the image and predict the corresponding mask. Based on the results, suggestions and approaches are provided to achieve a more robust framework to detect and identify the forgeries.
  arXiv  Detail & Related papers  (2022-02-08T01:14:30Z)
• Benchmarking Scientific Image Forgery Detectors [18.225190509954874]
  This paper presents an extendable open-source library that reproduces the most common image forgery operations reported by the research integrity community. We create a large scientific forgery image benchmark (39,423 images) with an enriched ground-truth. In addition, concerned about the high number of retracted papers due to image duplication, this work evaluates the state-of-the-art copy-move detection methods in the proposed dataset.
  arXiv  Detail & Related papers  (2021-05-26T22:58:20Z)
• Scientific Image Tampering Detection Based On Noise Inconsistencies: A Method And Datasets [1.2691047660244335]
  We propose a scientific-image specific tampering detection method based on noise inconsistencies. We train and test our method on a new dataset of manipulated western blot and microscopy imagery.
  arXiv  Detail & Related papers  (2020-01-21T22:29:56Z)
• Fabricated Pictures Detection with Graph Matching [0.36832029288386137]
  Fabricating experimental pictures in research work is a serious academic misconduct. We present a framework to detect similar, or perhaps fabricated, pictures with the graph matching techniques.
  arXiv  Detail & Related papers  (2020-01-16T12:29:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.