What's in the Image? Explorable Decoding of Compressed Images
- URL: http://arxiv.org/abs/2006.09332v2
- Date: Sat, 27 Mar 2021 09:01:59 GMT
- Title: What's in the Image? Explorable Decoding of Compressed Images
- Authors: Yuval Bahat and Tomer Michaeli
- Abstract summary: We develop a novel decoder architecture for the ubiquitous JPEG standard, which allows traversing the set of decompressed images.
We exemplify our framework on graphical, medical and forensic use cases, demonstrating its wide range of potential applications.
- Score: 45.22726784749359
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The ever-growing amounts of visual contents captured on a daily basis
necessitate the use of lossy compression methods in order to save storage space
and transmission bandwidth. While extensive research efforts are devoted to
improving compression techniques, every method inevitably discards information.
Especially at low bit rates, this information often corresponds to semantically
meaningful visual cues, so that decompression involves significant ambiguity.
In spite of this fact, existing decompression algorithms typically produce only
a single output, and do not allow the viewer to explore the set of images that
map to the given compressed code. In this work we propose the first image
decompression method to facilitate user-exploration of the diverse set of
natural images that could have given rise to the compressed input code, thus
granting users the ability to determine what could and what could not have been
there in the original scene. Specifically, we develop a novel deep-network
based decoder architecture for the ubiquitous JPEG standard, which allows
traversing the set of decompressed images that are consistent with the
compressed JPEG file. To allow for simple user interaction, we develop a
graphical user interface comprising several intuitive exploration tools,
including an automatic tool for examining specific solutions of interest. We
exemplify our framework on graphical, medical and forensic use cases,
demonstrating its wide range of potential applications.
Related papers
- Multiple Latent Space Mapping for Compressed Dark Image Enhancement [51.112925890246444]
Existing dark image enhancement methods take compressed dark images as inputs and achieve great performance.
We propose a novel latent mapping network based on variational auto-encoder (VAE)
Comprehensive experiments demonstrate that the proposed method achieves state-of-the-art performance in compressed dark image enhancement.
arXiv Detail & Related papers (2024-03-12T13:05:51Z) - A study on the use of perceptual hashing to detect manipulation of
embedded messages in images [0.0]
This work searches for embedding principles which allow to distinguish between unintended changes by lossy image compression and malicious manipulation of the embedded message.
The study shows that embedding a message via integer wavelet transform and compression with Karhunen-Loeve-transform yields the best results.
arXiv Detail & Related papers (2023-02-28T21:32:49Z) - Metric Learning for Anti-Compression Facial Forgery Detection [32.33501564446107]
We propose a novel anti-compression facial forgery detection framework.
It learns a compression-insensitive embedding feature space utilizing both original and compressed forgeries.
arXiv Detail & Related papers (2021-03-15T14:11:14Z) - Towards Robust Data Hiding Against (JPEG) Compression: A
Pseudo-Differentiable Deep Learning Approach [78.05383266222285]
It is still an open challenge to achieve the goal of data hiding that can be against these compressions.
Deep learning has shown large success in data hiding, while non-differentiability of JPEG makes it challenging to train a deep pipeline for improving robustness against lossy compression.
In this work, we propose a simple yet effective approach to address all the above limitations at once.
arXiv Detail & Related papers (2020-12-30T12:30:09Z) - Soft Compression for Lossless Image Coding [17.714164324169037]
We propose a new concept, compressible indicator function with regard to image.
It is expected that the bandwidth and storage space needed when transmitting and storing the same kind of images can be greatly reduced by applying soft compression.
arXiv Detail & Related papers (2020-12-11T10:59:47Z) - Analyzing and Mitigating JPEG Compression Defects in Deep Learning [69.04777875711646]
We present a unified study of the effects of JPEG compression on a range of common tasks and datasets.
We show that there is a significant penalty on common performance metrics for high compression.
arXiv Detail & Related papers (2020-11-17T20:32:57Z) - Lossy Image Compression with Normalizing Flows [19.817005399746467]
State-of-the-art solutions for deep image compression typically employ autoencoders which map the input to a lower dimensional latent space.
In contrast, traditional approaches in image compression allow for a larger range of quality levels.
arXiv Detail & Related papers (2020-08-24T14:46:23Z) - Modeling Lost Information in Lossy Image Compression [72.69327382643549]
Lossy image compression is one of the most commonly used operators for digital images.
We propose a novel invertible framework called Invertible Lossy Compression (ILC) to largely mitigate the information loss problem.
arXiv Detail & Related papers (2020-06-22T04:04:56Z) - Discernible Image Compression [124.08063151879173]
This paper aims to produce compressed images by pursuing both appearance and perceptual consistency.
Based on the encoder-decoder framework, we propose using a pre-trained CNN to extract features of the original and compressed images.
Experiments on benchmarks demonstrate that images compressed by using the proposed method can also be well recognized by subsequent visual recognition and detection models.
arXiv Detail & Related papers (2020-02-17T07:35:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.