Compressive Sensing with Tensorized Autoencoder

• URL: http://arxiv.org/abs/2303.06235v1
• Date: Fri, 10 Mar 2023 22:59:09 GMT
• Title: Compressive Sensing with Tensorized Autoencoder
• Authors: Rakib Hyder and M. Salman Asif
• Abstract summary: In many cases, different images in a collection are articulated versions of one another. In this paper, our goal is to recover images without access to the ground-truth (clean) images using the articulations as structural prior to the data. We propose to learn autoencoder with tensor ring factorization on the the embedding space to impose structural constraints on the data.
• Score: 22.89029876274012
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep networks can be trained to map images into a low-dimensional latent space. In many cases, different images in a collection are articulated versions of one another; for example, same object with different lighting, background, or pose. Furthermore, in many cases, parts of images can be corrupted by noise or missing entries. In this paper, our goal is to recover images without access to the ground-truth (clean) images using the articulations as structural prior of the data. Such recovery problems fall under the domain of compressive sensing. We propose to learn autoencoder with tensor ring factorization on the the embedding space to impose structural constraints on the data. In particular, we use a tensor ring structure in the bottleneck layer of the autoencoder that utilizes the soft labels of the structured dataset. We empirically demonstrate the effectiveness of the proposed approach for inpainting and denoising applications. The resulting method achieves better reconstruction quality compared to other generative prior-based self-supervised recovery approaches for compressive sensing.

Related papers

• DIAR: Deep Image Alignment and Reconstruction using Swin Transformers [3.1000291317724993]
  We create a dataset that contains images with image distortions. We create perspective distortions with corresponding ground-truth homographies as labels. We use our dataset to train Swin transformer models to analyze sequential image data.
  arXiv  Detail & Related papers  (2023-10-17T21:59:45Z)
• Zero shot framework for satellite image restoration [25.163783640750573]
  We propose a distortion disentanglement and knowledge distillation framework for satellite image restoration. Our algorithm requires only two images: the distorted satellite image to be restored and a reference image with similar semantics.
  arXiv  Detail & Related papers  (2023-06-05T14:34:58Z)
• Sequential image recovery using joint hierarchical Bayesian learning [6.881629943427059]
  We present a method based on hierarchical Bayesian learning for the joint recovery of sequential images. Our method restores the missing information in each image by "borrowing" it from the other images. Some preliminary results indicate its potential use for sequential deblurring and magnetic resonance imaging.
  arXiv  Detail & Related papers  (2022-06-25T22:31:32Z)
• Reducing Redundancy in the Bottleneck Representation of the Autoencoders [98.78384185493624]
  Autoencoders are a type of unsupervised neural networks, which can be used to solve various tasks. We propose a scheme to explicitly penalize feature redundancies in the bottleneck representation. We tested our approach across different tasks: dimensionality reduction using three different dataset, image compression using the MNIST dataset, and image denoising using fashion MNIST.
  arXiv  Detail & Related papers  (2022-02-09T18:48:02Z)
• Modeling Lost Information in Lossy Image Compression [72.69327382643549]
  Lossy image compression is one of the most commonly used operators for digital images. We propose a novel invertible framework called Invertible Lossy Compression (ILC) to largely mitigate the information loss problem.
  arXiv  Detail & Related papers  (2020-06-22T04:04:56Z)
• Neural Sparse Representation for Image Restoration [116.72107034624344]
  Inspired by the robustness and efficiency of sparse coding based image restoration models, we investigate the sparsity of neurons in deep networks. Our method structurally enforces sparsity constraints upon hidden neurons. Experiments show that sparse representation is crucial in deep neural networks for multiple image restoration tasks.
  arXiv  Detail & Related papers  (2020-06-08T05:15:17Z)
• Pyramid Attention Networks for Image Restoration [124.34970277136061]
  Self-similarity refers to the image prior widely used in image restoration algorithms. Recent advanced deep convolutional neural network based methods for image restoration do not take full advantage of self-similarities. We present a novel Pyramid Attention module for image restoration, which captures long-range feature correspondences from a multi-scale feature pyramid.
  arXiv  Detail & Related papers  (2020-04-28T21:12:36Z)
• Disentangled Image Generation Through Structured Noise Injection [48.956122902434444]
  We show that disentanglement in the first layer of the generator network leads to disentanglement in the generated image. We achieve spatial disentanglement, scale-space disentanglement, and disentanglement of the foreground object from the background style. This empirically leads to better disentanglement scores than state-of-the-art methods on the FFHQ dataset.
  arXiv  Detail & Related papers  (2020-04-26T15:15:19Z)
• Distributed Learning and Inference with Compressed Images [40.07509530656681]
  This paper focuses on vision-based perception for autonomous driving as a paradigmatic scenario. We propose dataset restoration, based on image restoration with generative adversarial networks (GANs) Our method is agnostic to both the particular image compression method and the downstream task.
  arXiv  Detail & Related papers  (2020-04-22T11:20:53Z)
• Reconstructing the Noise Manifold for Image Denoising [56.562855317536396]
  We introduce the idea of a cGAN which explicitly leverages structure in the image noise space. By learning directly a low dimensional manifold of the image noise, the generator promotes the removal from the noisy image only that information which spans this manifold. Based on our experiments, our model substantially outperforms existing state-of-the-art architectures.
  arXiv  Detail & Related papers  (2020-02-11T00:31:31Z)
• Spatial-Adaptive Network for Single Image Denoising [14.643663950015334]
  We propose a novel spatial-adaptive denoising network (SADNet) for efficient single image blind noise removal. Our method can surpass the state-of-the-art denoising methods both quantitatively and visually.
  arXiv  Detail & Related papers  (2020-01-28T12:24:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.