The First Comprehensive Dataset with Multiple Distortion Types for Visual Just-Noticeable Differences

• URL: http://arxiv.org/abs/2303.02562v2
• Date: Wed, 8 Mar 2023 02:31:01 GMT
• Title: The First Comprehensive Dataset with Multiple Distortion Types for Visual Just-Noticeable Differences
• Authors: Yaxuan Liu, Jian Jin, Yuan Xue, Weisi Lin
• Abstract summary: This work establishes a generalized JND dataset with a coarse-to-fine JND selection, which contains 106 source images and 1,642 JND maps, covering 25 distortion types. A fine JND selection is carried out on the JND candidates with a crowdsourced subjective assessment.
• Score: 40.50003266570956
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recently, with the development of deep learning, a number of Just Noticeable Difference (JND) datasets have been built for JND modeling. However, all the existing JND datasets only label the JND points based on the level of compression distortion. Hence, JND models learned from such datasets can only be used for image/video compression. As known, JND is a major characteristic of the human visual system (HVS), which reflects the maximum visual distortion that the HVS can tolerate. Hence, a generalized JND modeling should take more kinds of distortion types into account. To benefit JND modeling, this work establishes a generalized JND dataset with a coarse-to-fine JND selection, which contains 106 source images and 1,642 JND maps, covering 25 distortion types. To this end, we proposed a coarse JND candidate selection scheme to select the distorted images from the existing Image Quality Assessment (IQA) datasets as JND candidates instead of generating JND maps ourselves. Then, a fine JND selection is carried out on the JND candidates with a crowdsourced subjective assessment.

Related papers

• SG-JND: Semantic-Guided Just Noticeable Distortion Predictor For Image Compression [50.2496399381438]
  Just noticeable distortion (JND) represents the threshold of distortion in an image that is minimally perceptible to the human visual system. Traditional JND prediction methods only rely on pixel-level or sub-band level features. We propose a Semantic-Guided JND network to leverage semantic information for JND prediction.
  arXiv  Detail & Related papers  (2024-08-08T07:14:57Z)
• IQNet: Image Quality Assessment Guided Just Noticeable Difference Prefiltering For Versatile Video Coding [0.9403328689534943]
  Image prefiltering with just noticeable distortion (JND) improves coding efficiency in a visual way by filtering the perceptually redundant information prior to compression. This paper proposes a fine-grained JND prefiltering dataset guided by image quality assessment for accurate block-level JND modeling.
  arXiv  Detail & Related papers  (2023-12-15T13:58:10Z)
• Localization of Just Noticeable Difference for Image Compression [4.702729080310267]
  Just noticeable difference (PJND) is the minimal difference between stimuli that can be detected by a person. These differences can only be observed in some specific regions within the image, dubbed as JND-critical regions. Identifying these regions can improve the development of image compression algorithms.
  arXiv  Detail & Related papers  (2023-06-13T10:45:24Z)
• Just Noticeable Difference Modeling for Face Recognition System [69.28990314553076]
  We make the first attempt to study just noticeable difference (JND) for the automatic face recognition system. We develop a novel JND prediction model to directly infer JND images for the FR system. Experimental results have demonstrated that the proposed model achieves higher accuracy of JND map prediction.
  arXiv  Detail & Related papers  (2022-09-13T10:06:36Z)
• HVS-Inspired Signal Degradation Network for Just Noticeable Difference Estimation [69.49393407465456]
  We propose an HVS-inspired signal degradation network for JND estimation. We analyze the HVS perceptual process in JND subjective viewing to obtain relevant insights. We show that the proposed method achieves the SOTA performance for accurately estimating the redundancy of the HVS.
  arXiv  Detail & Related papers  (2022-08-16T07:53:45Z)
• Full RGB Just Noticeable Difference (JND) Modelling [69.42889006770018]
  Just Noticeable Difference (JND) has many applications in multimedia signal processing. We propose a JND model to generate the JND by taking the characteristics of full RGB channels into account. An RGB-JND-NET is proposed, where the visual content in full RGB channels is used to extract features for JND generation.
  arXiv  Detail & Related papers  (2022-03-01T17:16:57Z)
• Towards Top-Down Just Noticeable Difference Estimation of Natural Images [65.14746063298415]
  Just noticeable difference (JND) estimation mainly dedicates to modeling the visibility masking effects of different factors in spatial and frequency domains. In this work, we turn to a dramatically different way to address these problems with a top-down design philosophy. Our proposed JND model can achieve better performance than several latest JND models.
  arXiv  Detail & Related papers  (2021-08-11T06:51:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.