Deep learning-based Edge-aware pre and post-processing methods for JPEG compressed images

• URL: http://arxiv.org/abs/2104.04926v2
• Date: Thu, 2 Nov 2023 15:35:45 GMT
• Title: Deep learning-based Edge-aware pre and post-processing methods for JPEG compressed images
• Abstract summary: We propose a learning-based compression scheme that envelopes a standard between pre and post-processing deep CNNs. We demonstrate improvements over prior approaches utilizing a compression-decompression network by introducing: (a) an edge-aware loss function to prevent blurring that is commonly occurred in prior works & (b) a super-resolution convolutional neural network (CNN) for post-processing along with a corresponding pre-processing network for improved rate-distortion performance in the low rate regime.
• Score: 7.803786205476811
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose a learning-based compression scheme that envelopes a standard codec between pre and post-processing deep CNNs. Specifically, we demonstrate improvements over prior approaches utilizing a compression-decompression network by introducing: (a) an edge-aware loss function to prevent blurring that is commonly occurred in prior works & (b) a super-resolution convolutional neural network (CNN) for post-processing along with a corresponding pre-processing network for improved rate-distortion performance in the low rate regime. The algorithm is assessed on a variety of datasets varying from low to high resolution namely Set 5, Set 7, Classic 5, Set 14, Live 1, Kodak, General 100, CLIC 2019. When compared to JPEG, JPEG2000, BPG, and recent CNN approach, the proposed algorithm contributes significant improvement in PSNR with an approximate gain of 20.75%, 8.47%, 3.22%, 3.23% and 24.59%, 14.46%, 10.14%, 8.57% at low and high bit-rates respectively. Similarly, this improvement in MS-SSIM is approximately 71.43%, 50%, 36.36%, 23.08%, 64.70% and 64.47%, 61.29%, 47.06%, 51.52%, 16.28% at low and high bit-rates respectively. With CLIC 2019 dataset, PSNR is found to be superior with approximately 16.67%, 10.53%, 6.78%, and 24.62%, 17.39%, 14.08% at low and high bit-rates respectively, over JPEG2000, BPG, and recent CNN approach. Similarly, the MS-SSIM is found to be superior with approximately 72%, 45.45%, 39.13%, 18.52%, and 71.43%, 50%, 41.18%, 17.07% at low and high bit-rates respectively, compared to the same approaches. A similar type of improvement is achieved with other datasets also.

Related papers

• HCF: Hierarchical Cascade Framework for Distributed Multi-Stage Image Compression [5.995201755175342]
  Hierarchical Cascade Framework (HCF) developed to achieve high rate-distortion performance and better computational efficiency.<n>HCF achieves high rate-distortion performance and better computational efficiency through direct latent-space transformations across network nodes.
  arXiv  Detail & Related papers  (2025-08-04T04:37:56Z)
• End-to-End Implicit Neural Representations for Classification [57.55927378696826]
  Implicit neural representations (INRs) encode a signal in neural network parameters and show excellent results for signal reconstruction. INR-based classification still significantly under-performs compared to pixel-based methods like CNNs. This work presents an end-to-end strategy for initializing SIRENs together with a learned learning-rate scheme.
  arXiv  Detail & Related papers  (2025-03-23T16:02:23Z)
• Sebica: Lightweight Spatial and Efficient Bidirectional Channel Attention Super Resolution Network [0.0]
  Single Image Super-Resolution (SISR) is a vital technique for improving the visual quality of low-resolution images. We present Sebica, a lightweight network that incorporates spatial and efficient bidirectional channel attention mechanisms. Sebica significantly reduces computational costs while maintaining high reconstruction quality.
  arXiv  Detail & Related papers  (2024-10-27T18:27:07Z)
• SINF: Semantic Neural Network Inference with Semantic Subgraphs [3.767257257405998]
  This paper proposes Semantic Inference (SINF) that creates semantic subgraphs in a Deep Neural Network(DNN) based on a new Discriminative Capability Score (DCS)<n>We evaluate the performance SINF on VGG16, VGG19, and ResNet50 DNNs trained on CIFAR100 and a subset of the ImageNet dataset.
  arXiv  Detail & Related papers  (2023-10-02T14:51:10Z)
• Application of Quantum Pre-Processing Filter for Binary Image Classification with Small Samples [1.2965700352825555]
  We investigated the application of our proposed quantum pre-processing filter (QPF) to binary image classification. We evaluated the QPF on four datasets: MNIST (handwritten digits), EMNIST (handwritten digits and alphabets), CIFAR-10 (photographic images) and GTSRB (real-life traffic sign images)
  arXiv  Detail & Related papers  (2023-08-28T23:08:32Z)
• Patch-Level Contrasting without Patch Correspondence for Accurate and Dense Contrastive Representation Learning [79.43940012723539]
  ADCLR is a self-supervised learning framework for learning accurate and dense vision representation. Our approach achieves new state-of-the-art performance for contrastive methods.
  arXiv  Detail & Related papers  (2023-06-23T07:38:09Z)
• Pruning by Active Attention Manipulation [49.61707925611295]
  Filter pruning of a CNN is typically achieved by applying discrete masks on the CNN's filter weights or activation maps, post-training. Here, we present a new filter-importance-scoring concept named pruning by active attention manipulation (PAAM) PAAM learns analog filter scores from the filter weights by optimizing a cost function regularized by an additive term in the scores.
  arXiv  Detail & Related papers  (2022-10-20T09:17:02Z)
• Simple Baselines for Image Restoration [79.48718779396971]
  We propose a simple baseline that exceeds the state-of-the-art (SOTA) methods and is computationally efficient. We derive a Activation Free Network, namely NAFNet, from the baseline. SOTA results are achieved on various challenging benchmarks, e.g. 33.69 dB PSNR on GoPro (for image deblurring), exceeding the previous SOTA 0.38 dB with only 8.4% of its computational costs; 40.30 dB PSNR on SIDD (for image denoising), exceeding the previous SOTA 0.28 dB with less than half of its computational costs.
  arXiv  Detail & Related papers  (2022-04-10T12:48:38Z)
• Neural JPEG: End-to-End Image Compression Leveraging a Standard JPEG Encoder-Decoder [73.48927855855219]
  We propose a system that learns to improve the encoding performance by enhancing its internal neural representations on both the encoder and decoder ends. Experiments demonstrate that our approach successfully improves the rate-distortion performance over JPEG across various quality metrics.
  arXiv  Detail & Related papers  (2022-01-27T20:20:03Z)
• Learning True Rate-Distortion-Optimization for End-To-End Image Compression [59.816251613869376]
  Rate-distortion optimization is crucial part of traditional image and video compression. In this paper, we enhance the training by introducing low-complexity estimations of the RDO result into the training. We achieve average rate savings of 19.6% in MS-SSIM over the previous RDONet model, which equals rate savings of 27.3% over a comparable conventional deep image coder.
  arXiv  Detail & Related papers  (2022-01-05T13:02:00Z)
• Problem-dependent attention and effort in neural networks with applications to image resolution and model selection [0.0]
  This paper introduces two new ensemble-based methods to reduce the data and computation costs of image classification. They can be used with any set of classifiers and do not require additional training.
  arXiv  Detail & Related papers  (2022-01-05T02:27:35Z)
• TACTIC: Joint Rate-Distortion-Accuracy Optimisation for Low Bitrate Compression [28.88113725832339]
  TACTIC: Task-Aware Compression Through Intelligent Coding. Our lossy compression model learns based on the ratedistortion-accuracy trade-off for a specific task. Our approach is able to improve the accuracy of the ImageNet subset classification by 4.5%.
  arXiv  Detail & Related papers  (2021-09-22T11:27:57Z)
• Non-Parametric Adaptive Network Pruning [125.4414216272874]
  We introduce non-parametric modeling to simplify the algorithm design. Inspired by the face recognition community, we use a message passing algorithm to obtain an adaptive number of exemplars. EPruner breaks the dependency on the training data in determining the "important" filters.
  arXiv  Detail & Related papers  (2021-01-20T06:18:38Z)
• Improved Image Coding Autoencoder With Deep Learning [8.92071749364712]
  We build autoencoder based pipelines for extreme end-to-end image compression based on Ball'e's approach. It achieved around 4.0% reduction in bits per pixel (bpp), 0.03% increase in multi-scale structural similarity (MS-SSIM) and only 0.47% decrease in peak signal-to-noise ratio (PSNR)
  arXiv  Detail & Related papers  (2020-02-28T03:21:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.