Data--driven Image Restoration with Option--driven Learning for Big and Small Astronomical Image Datasets

• URL: http://arxiv.org/abs/2011.03696v1
• Date: Sat, 7 Nov 2020 05:05:55 GMT
• Title: Data--driven Image Restoration with Option--driven Learning for Big and Small Astronomical Image Datasets
• Authors: Peng Jia, Ruiyu Ning, Ruiqi Sun, Xiaoshan Yang and Dongmei Cai
• Abstract summary: We propose a new data-driven image restoration method based on generative adversarial networks with option-driven learning. Our method can obtain very stable image restoration results, regardless of the number of reference images.
• Score: 11.96518190758417
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image restoration methods are commonly used to improve the quality of astronomical images. In recent years, developments of deep neural networks and increments of the number of astronomical images have evoked a lot of data--driven image restoration methods. However, most of these methods belong to supervised learning algorithms, which require paired images either from real observations or simulated data as training set. For some applications, it is hard to get enough paired images from real observations and simulated images are quite different from real observed ones. In this paper, we propose a new data--driven image restoration method based on generative adversarial networks with option--driven learning. Our method uses several high resolution images as references and applies different learning strategies when the number of reference images is different. For sky surveys with variable observation conditions, our method can obtain very stable image restoration results, regardless of the number of reference images.

Related papers

• One-Shot Image Restoration [0.0]
  Experimental results demonstrate the applicability, robustness and computational efficiency of the proposed approach for supervised image deblurring and super-resolution. Our results showcase significant improvement of learning models' sample efficiency, generalization and time complexity.
  arXiv  Detail & Related papers  (2024-04-26T14:03:23Z)
• CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition [73.51329037954866]
  We propose a robust global representation method with cross-image correlation awareness for visual place recognition. Our method uses the attention mechanism to correlate multiple images within a batch. Our method outperforms state-of-the-art methods by a large margin with significantly less training time.
  arXiv  Detail & Related papers  (2024-02-29T15:05:11Z)
• Detecting Generated Images by Real Images Only [64.12501227493765]
  Existing generated image detection methods detect visual artifacts in generated images or learn discriminative features from both real and generated images by massive training. This paper approaches the generated image detection problem from a new perspective: Start from real images. By finding the commonality of real images and mapping them to a dense subspace in feature space, the goal is that generated images, regardless of their generative model, are then projected outside the subspace.
  arXiv  Detail & Related papers  (2023-11-02T03:09:37Z)
• Zero shot framework for satellite image restoration [25.163783640750573]
  We propose a distortion disentanglement and knowledge distillation framework for satellite image restoration. Our algorithm requires only two images: the distorted satellite image to be restored and a reference image with similar semantics.
  arXiv  Detail & Related papers  (2023-06-05T14:34:58Z)
• Re-Imagen: Retrieval-Augmented Text-to-Image Generator [58.60472701831404]
  Retrieval-Augmented Text-to-Image Generator (Re-Imagen) Retrieval-Augmented Text-to-Image Generator (Re-Imagen)
  arXiv  Detail & Related papers  (2022-09-29T00:57:28Z)
• A comparison of different atmospheric turbulence simulation methods for image restoration [64.24948495708337]
  Atmospheric turbulence deteriorates the quality of images captured by long-range imaging systems. Various deep learning-based atmospheric turbulence mitigation methods have been proposed in the literature. We systematically evaluate the effectiveness of various turbulence simulation methods on image restoration.
  arXiv  Detail & Related papers  (2022-04-19T16:21:36Z)
• Underwater Image Restoration via Contrastive Learning and a Real-world Dataset [59.35766392100753]
  We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
  arXiv  Detail & Related papers  (2021-06-20T16:06:26Z)
• AugNet: End-to-End Unsupervised Visual Representation Learning with Image Augmentation [3.6790362352712873]
  We propose AugNet, a new deep learning training paradigm to learn image features from a collection of unlabeled pictures. Our experiments demonstrate that the method is able to represent the image in low dimensional space. Unlike many deep-learning-based image retrieval algorithms, our approach does not require access to external annotated datasets.
  arXiv  Detail & Related papers  (2021-06-11T09:02:30Z)
• Unsupervised Single-Image Reflection Separation Using Perceptual Deep Image Priors [6.333390830515411]
  We propose a novel unsupervised framework for single-image reflection separation. We optimize the parameters of two cross-coupled deep convolutional networks on a target image to generate two exclusive background and reflection layers. Our results show that our method significantly outperforms the closest unsupervised method in the literature for removing reflections from single images.
  arXiv  Detail & Related papers  (2020-09-01T21:08:30Z)
• Self-supervised Learning for Astronomical Image Classification [1.2891210250935146]
  In Astronomy, a huge amount of image data is generated daily by photometric surveys. We propose a technique to leverage unlabeled astronomical images to pre-train deep convolutional neural networks.
  arXiv  Detail & Related papers  (2020-04-23T17:32:19Z)
• Geometrically Mappable Image Features [85.81073893916414]
  Vision-based localization of an agent in a map is an important problem in robotics and computer vision. We propose a method that learns image features targeted for image-retrieval-based localization.
  arXiv  Detail & Related papers  (2020-03-21T15:36:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.