Learning a Single Model with a Wide Range of Quality Factors for JPEG Image Artifacts Removal

• URL: http://arxiv.org/abs/2009.06912v1
• Date: Tue, 15 Sep 2020 08:16:58 GMT
• Title: Learning a Single Model with a Wide Range of Quality Factors for JPEG Image Artifacts Removal
• Authors: Jianwei Li, Yongtao Wang, Haihua Xie, Kai-Kuang Ma
• Abstract summary: Lossy compression brings artifacts into the compressed image and degrades the visual quality. In this paper, we propose a highly robust compression artifacts removal network. Our proposed network is a single model approach that can be trained for handling a wide range of quality factors.
• Score: 24.25688335628976
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Lossy compression brings artifacts into the compressed image and degrades the visual quality. In recent years, many compression artifacts removal methods based on convolutional neural network (CNN) have been developed with great success. However, these methods usually train a model based on one specific value or a small range of quality factors. Obviously, if the test image's quality factor does not match to the assumed value range, then degraded performance will be resulted. With this motivation and further consideration of practical usage, a highly robust compression artifacts removal network is proposed in this paper. Our proposed network is a single model approach that can be trained for handling a wide range of quality factors while consistently delivering superior or comparable image artifacts removal performance. To demonstrate, we focus on the JPEG compression with quality factors, ranging from 1 to 60. Note that a turnkey success of our proposed network lies in the novel utilization of the quantization tables as part of the training data. Furthermore, it has two branches in parallel---i.e., the restoration branch and the global branch. The former effectively removes the local artifacts, such as ringing artifacts removal. On the other hand, the latter extracts the global features of the entire image that provides highly instrumental image quality improvement, especially effective on dealing with the global artifacts, such as blocking, color shifting. Extensive experimental results performed on color and grayscale images have clearly demonstrated the effectiveness and efficacy of our proposed single-model approach on the removal of compression artifacts from the decoded image.

Related papers

• Recompression Based JPEG Tamper Detection and Localization Using Deep Neural Network Eliminating Compression Factor Dependency [2.8498944632323755]
  We propose a Convolution Neural Network based deep learning architecture, which is capable of detecting the presence of re compression based forgery in JPEG images. In this work, we also aim to localize the regions of image manipulation based on re compression features, using the trained neural network.
  arXiv  Detail & Related papers  (2024-07-03T09:19:35Z)
• Semantic Ensemble Loss and Latent Refinement for High-Fidelity Neural Image Compression [58.618625678054826]
  This study presents an enhanced neural compression method designed for optimal visual fidelity. We have trained our model with a sophisticated semantic ensemble loss, integrating Charbonnier loss, perceptual loss, style loss, and a non-binary adversarial loss. Our empirical findings demonstrate that this approach significantly improves the statistical fidelity of neural image compression.
  arXiv  Detail & Related papers  (2024-01-25T08:11:27Z)
• Transferable Learned Image Compression-Resistant Adversarial Perturbations [66.46470251521947]
  Adversarial attacks can readily disrupt the image classification system, revealing the vulnerability of DNN-based recognition tasks. We introduce a new pipeline that targets image classification models that utilize learned image compressors as pre-processing modules.
  arXiv  Detail & Related papers  (2024-01-06T03:03:28Z)
• Lightweight Adaptive Feature De-drifting for Compressed Image Classification [10.265991649449507]
  High-level vision models trained on high-quality images will suffer performance degradation when dealing with compressed images. Various learning-based JPEG artifact removal methods have been proposed to handle visual artifacts. This paper proposes a novel lightweight AFD module to boost the performance of pre-trained image classification models when facing compressed images.
  arXiv  Detail & Related papers  (2024-01-03T13:03:44Z)
• Multi-Modality Deep Network for JPEG Artifacts Reduction [33.02405073842042]
  We propose a multimodal fusion learning method for text-guided JPEG artifacts reduction. Our method can obtain better deblocking results compared to the state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-05-04T11:54:02Z)
• Machine Perception-Driven Image Compression: A Layered Generative Approach [32.23554195427311]
  layered generative image compression model is proposed to achieve high human vision-oriented image reconstructed quality. Task-agnostic learning-based compression model is proposed, which effectively supports various compressed domain-based analytical tasks. Joint optimization schedule is adopted to acquire best balance point among compression ratio, reconstructed image quality, and downstream perception performance.
  arXiv  Detail & Related papers  (2023-04-14T02:12:38Z)
• Image Quality Assessment using Contrastive Learning [50.265638572116984]
  We train a deep Convolutional Neural Network (CNN) using a contrastive pairwise objective to solve the auxiliary problem. We show through extensive experiments that CONTRIQUE achieves competitive performance when compared to state-of-the-art NR image quality models. Our results suggest that powerful quality representations with perceptual relevance can be obtained without requiring large labeled subjective image quality datasets.
  arXiv  Detail & Related papers  (2021-10-25T21:01:00Z)
• Towards Flexible Blind JPEG Artifacts Removal [73.46374658847675]
  We propose a flexible blind convolutional neural network, namely FBCNN, that can predict the adjustable quality factor to control the trade-off between artifacts removal and details preservation. Our proposed FBCNN achieves favorable performance against state-of-the-art methods in terms of both quantitative metrics and visual quality.
  arXiv  Detail & Related papers  (2021-09-29T17:12:10Z)
• Early Exit or Not: Resource-Efficient Blind Quality Enhancement for Compressed Images [54.40852143927333]
  Lossy image compression is pervasively conducted to save communication bandwidth, resulting in undesirable compression artifacts. We propose a resource-efficient blind quality enhancement (RBQE) approach for compressed images. Our approach can automatically decide to terminate or continue enhancement according to the assessed quality of enhanced images.
  arXiv  Detail & Related papers  (2020-06-30T07:38:47Z)
• Quantization Guided JPEG Artifact Correction [69.04777875711646]
  We develop a novel architecture for artifact correction using the JPEG files quantization matrix. This allows our single model to achieve state-of-the-art performance over models trained for specific quality settings.
  arXiv  Detail & Related papers  (2020-04-17T00:10:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.