Localization of Just Noticeable Difference for Image Compression

• URL: http://arxiv.org/abs/2306.07678v1
• Date: Tue, 13 Jun 2023 10:45:24 GMT
• Title: Localization of Just Noticeable Difference for Image Compression
• Authors: Guangan Chen, Hanhe Lin, Oliver Wiedemann, Dietmar Saupe
• Abstract summary: Just noticeable difference (PJND) is the minimal difference between stimuli that can be detected by a person. These differences can only be observed in some specific regions within the image, dubbed as JND-critical regions. Identifying these regions can improve the development of image compression algorithms.
• Score: 4.702729080310267
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The just noticeable difference (JND) is the minimal difference between stimuli that can be detected by a person. The picture-wise just noticeable difference (PJND) for a given reference image and a compression algorithm represents the minimal level of compression that causes noticeable differences in the reconstruction. These differences can only be observed in some specific regions within the image, dubbed as JND-critical regions. Identifying these regions can improve the development of image compression algorithms. Due to the fact that visual perception varies among individuals, determining the PJND values and JND-critical regions for a target population of consumers requires subjective assessment experiments involving a sufficiently large number of observers. In this paper, we propose a novel framework for conducting such experiments using crowdsourcing. By applying this framework, we created a novel PJND dataset, KonJND++, consisting of 300 source images, compressed versions thereof under JPEG or BPG compression, and an average of 43 ratings of PJND and 129 self-reported locations of JND-critical regions for each source image. Our experiments demonstrate the effectiveness and reliability of our proposed framework, which is easy to be adapted for collecting a large-scale dataset. The source code and dataset are available at https://github.com/angchen-dev/LocJND.

Related papers

• SG-JND: Semantic-Guided Just Noticeable Distortion Predictor For Image Compression [50.2496399381438]
  Just noticeable distortion (JND) represents the threshold of distortion in an image that is minimally perceptible to the human visual system. Traditional JND prediction methods only rely on pixel-level or sub-band level features. We propose a Semantic-Guided JND network to leverage semantic information for JND prediction.
  arXiv  Detail & Related papers  (2024-08-08T07:14:57Z)
• Recompression Based JPEG Tamper Detection and Localization Using Deep Neural Network Eliminating Compression Factor Dependency [2.8498944632323755]
  We propose a Convolution Neural Network based deep learning architecture, which is capable of detecting the presence of re compression based forgery in JPEG images. In this work, we also aim to localize the regions of image manipulation based on re compression features, using the trained neural network.
  arXiv  Detail & Related papers  (2024-07-03T09:19:35Z)
• The First Comprehensive Dataset with Multiple Distortion Types for Visual Just-Noticeable Differences [40.50003266570956]
  This work establishes a generalized JND dataset with a coarse-to-fine JND selection, which contains 106 source images and 1,642 JND maps, covering 25 distortion types. A fine JND selection is carried out on the JND candidates with a crowdsourced subjective assessment.
  arXiv  Detail & Related papers  (2023-03-05T03:12:57Z)
• Metaheuristic-based Energy-aware Image Compression for Mobile App Development [1.933681537640272]
  We propose a novel objective function for population-based JPEG image compression. Second, to tackle the lack of comprehensive coverage, we suggest a novel representation. Third, we provide a comprehensive benchmark on 22 state-of-the-art and recently-introduced PBMH algorithms.
  arXiv  Detail & Related papers  (2022-12-13T01:39:47Z)
• Estimating the Resize Parameter in End-to-end Learned Image Compression [50.20567320015102]
  We describe a search-free resizing framework that can further improve the rate-distortion tradeoff of recent learned image compression models. Our results show that our new resizing parameter estimation framework can provide Bjontegaard-Delta rate (BD-rate) improvement of about 10% against leading perceptual quality engines.
  arXiv  Detail & Related papers  (2022-04-26T01:35:02Z)
• Towards Top-Down Just Noticeable Difference Estimation of Natural Images [65.14746063298415]
  Just noticeable difference (JND) estimation mainly dedicates to modeling the visibility masking effects of different factors in spatial and frequency domains. In this work, we turn to a dramatically different way to address these problems with a top-down design philosophy. Our proposed JND model can achieve better performance than several latest JND models.
  arXiv  Detail & Related papers  (2021-08-11T06:51:50Z)
• Image Splicing Detection, Localization and Attribution via JPEG Primary Quantization Matrix Estimation and Clustering [49.75353434786065]
  Detection of inconsistencies of double JPEG artefacts across different image regions is often used to detect local image manipulations. We propose an end-to-end system that can also distinguish regions coming from different donor images.
  arXiv  Detail & Related papers  (2021-02-02T11:21:49Z)
• Discernible Image Compression [124.08063151879173]
  This paper aims to produce compressed images by pursuing both appearance and perceptual consistency. Based on the encoder-decoder framework, we propose using a pre-trained CNN to extract features of the original and compressed images. Experiments on benchmarks demonstrate that images compressed by using the proposed method can also be well recognized by subsequent visual recognition and detection models.
  arXiv  Detail & Related papers  (2020-02-17T07:35:08Z)
• Image Fine-grained Inpainting [89.17316318927621]
  We present a one-stage model that utilizes dense combinations of dilated convolutions to obtain larger and more effective receptive fields. To better train this efficient generator, except for frequently-used VGG feature matching loss, we design a novel self-guided regression loss. We also employ a discriminator with local and global branches to ensure local-global contents consistency.
  arXiv  Detail & Related papers  (2020-02-07T03:45:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.