WPPNets: Unsupervised CNN Training with Wasserstein Patch Priors for Image Superresolution

• URL: http://arxiv.org/abs/2201.08157v1
• Date: Thu, 20 Jan 2022 13:04:19 GMT
• Title: WPPNets: Unsupervised CNN Training with Wasserstein Patch Priors for Image Superresolution
• Authors: Fabian Altekr\"uger, Johannes Hertrich
• Abstract summary: WPPNets are CNNs trained by a new unsupervised loss function for image superresolution of materials microstructures. We show that WPPNets are much more stable under inaccurate knowledge or perturbations of the forward operator.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce WPPNets, which are CNNs trained by a new unsupervised loss function for image superresolution of materials microstructures. Instead of requiring access to a large database of registered high- and low-resolution images, we only assume to know a large database of low resolution images, the forward operator and one high-resolution reference image. Then, we propose a loss function based on the Wasserstein patch prior which measures the Wasserstein-2 distance between the patch distributions of the predictions and the reference image. We demonstrate by numerical examples that WPPNets outperform other methods with similar assumptions. In particular, we show that WPPNets are much more stable under inaccurate knowledge or perturbations of the forward operator. This enables us to use them in real-world applications, where neither a large database of registered data nor the exact forward operator are given.

Related papers

• Chasing Better Deep Image Priors between Over- and Under-parameterization [63.8954152220162]
  We study a novel "lottery image prior" (LIP) by exploiting DNN inherent sparsity. LIPworks significantly outperform deep decoders under comparably compact model sizes. We also extend LIP to compressive sensing image reconstruction, where a pre-trained GAN generator is used as the prior.
  arXiv  Detail & Related papers  (2024-10-31T17:49:44Z)
• Msmsfnet: a multi-stream and multi-scale fusion net for edge detection [6.1932429715357165]
  Edge detection relies heavily on the pre-trained weights of the backbone network on the ImageNet dataset.<n>We devise a new network architecture, the multi-stream and multi-scale fusion net (msmsfnet) for edge detection.<n>By training all models from scratch, our model outperforms state-of-the-art edge detectors in three publicly available datasets.
  arXiv  Detail & Related papers  (2024-04-07T08:03:42Z)
• SCAResNet: A ResNet Variant Optimized for Tiny Object Detection in Transmission and Distribution Towers [0.42028553027796633]
  Traditional deep learning-based object detection networks often resize images during the data pre-processing stage to achieve a uniform size and scale in the feature map. We introduce Positional-Multi-head Criss-Cross Imagery to capture contextual information and learn from multiple representation subspaces. This approach allows images of different sizes and scales to generate feature maps with uniform dimensions and can be employed in feature map propagation.
  arXiv  Detail & Related papers  (2024-04-05T15:48:36Z)
• Inverse Problems Leveraging Pre-trained Contrastive Representations [88.70821497369785]
  We study a new family of inverse problems for recovering representations of corrupted data. We propose a supervised inversion method that uses a contrastive objective to obtain excellent representations for highly corrupted images. Our method outperforms end-to-end baselines even with a fraction of the labeled data in a wide range of forward operators.
  arXiv  Detail & Related papers  (2021-10-14T15:06:30Z)
• Generic Perceptual Loss for Modeling Structured Output Dependencies [78.59700528239141]
  We show that, what matters is the network structure instead of the trained weights. We demonstrate that a randomly-weighted deep CNN can be used to model the structured dependencies of outputs.
  arXiv  Detail & Related papers  (2021-03-18T23:56:07Z)
• Image Restoration by Deep Projected GSURE [115.57142046076164]
  Ill-posed inverse problems appear in many image processing applications, such as deblurring and super-resolution. We propose a new image restoration framework that is based on minimizing a loss function that includes a "projected-version" of the Generalized SteinUnbiased Risk Estimator (GSURE) and parameterization of the latent image by a CNN.
  arXiv  Detail & Related papers  (2021-02-04T08:52:46Z)
• Shared Prior Learning of Energy-Based Models for Image Reconstruction [69.72364451042922]
  We propose a novel learning-based framework for image reconstruction particularly designed for training without ground truth data. In the absence of ground truth data, we change the loss functional to a patch-based Wasserstein functional. In shared prior learning, both aforementioned optimal control problems are optimized simultaneously with shared learned parameters of the regularizer.
  arXiv  Detail & Related papers  (2020-11-12T17:56:05Z)
• Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows [24.734388664558708]
  We propose DifferNet: It leverages the descriptiveness of features extracted by convolutional neural networks to estimate their density. Based on these likelihoods we develop a scoring function that indicates defects. We demonstrate the superior performance over existing approaches on the challenging and newly proposed MVTec AD and Magnetic Tile Defects datasets.
  arXiv  Detail & Related papers  (2020-08-28T10:49:28Z)
• Pixel-in-Pixel Net: Towards Efficient Facial Landmark Detection in the Wild [104.61677518999976]
  We propose Pixel-in-Pixel Net (PIPNet) for facial landmark detection. The proposed model is equipped with a novel detection head based on heatmap regression. To further improve the cross-domain generalization capability of PIPNet, we propose self-training with curriculum.
  arXiv  Detail & Related papers  (2020-03-08T12:23:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.