TextureWGAN: Texture Preserving WGAN with MLE Regularizer for Inverse Problems

• URL: http://arxiv.org/abs/2008.04861v2
• Date: Wed, 12 Aug 2020 01:24:02 GMT
• Title: TextureWGAN: Texture Preserving WGAN with MLE Regularizer for Inverse Problems
• Authors: Masaki Ikuta and Jun Zhang
• Abstract summary: Among all proposed methods, the most popular and effective method is the convolutional neural network (CNN) with mean square error (MSE) We proposed a new method based on Wasserstein GAN (WGAN) for inverse problems. We showed that the WGAN-based method was effective to preserve image texture. It also used a maximum likelihood estimation (MLE) regularizer to preserve pixel fidelity.
• Score: 4.112614964808275
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Many algorithms and methods have been proposed for inverse problems particularly with the recent surge of interest in machine learning and deep learning methods. Among all proposed methods, the most popular and effective method is the convolutional neural network (CNN) with mean square error (MSE). This method has been proven effective in super-resolution, image de-noising, and image reconstruction. However, this method is known to over-smooth images due to the nature of MSE. MSE based methods minimize Euclidean distance for all pixels between a baseline image and a generated image by CNN and ignore the spatial information of the pixels such as image texture. In this paper, we proposed a new method based on Wasserstein GAN (WGAN) for inverse problems. We showed that the WGAN-based method was effective to preserve image texture. It also used a maximum likelihood estimation (MLE) regularizer to preserve pixel fidelity. Maintaining image texture and pixel fidelity is the most important requirement for medical imaging. We used Peak Signal to Noise Ratio (PSNR) and Structure Similarity (SSIM) to evaluate the proposed method quantitatively. We also conducted first-order and second-order statistical image texture analysis to assess image texture.

Related papers

• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• A Dictionary Based Approach for Removing Out-of-Focus Blur [0.0]
  We propose an extension of the Rapid and Accurate Image Super-Resolution algorithm for the task of out-of-focus blur removal. A metric based blending strategy based on asset allocation management is also proposed. Our method demonstrates an average increase of approximately 13% (PSNR) and 10% (SSIM) compared to popular deblurring methods.
  arXiv  Detail & Related papers  (2024-06-17T08:42:03Z)
• Learning-Based and Quality Preserving Super-Resolution of Noisy Images [0.0]
  We propose a learning-based method that accounts for the presence of noise and preserves the properties of the input image. We perform our tests on the Cineca Marconi100 cluster, at the 26th position in the top500 list.
  arXiv  Detail & Related papers  (2023-11-03T22:00:50Z)
• Deep Richardson-Lucy Deconvolution for Low-Light Image Deblurring [48.80983873199214]
  We develop a data-driven approach to model the saturated pixels by a learned latent map. Based on the new model, the non-blind deblurring task can be formulated into a maximum a posterior (MAP) problem. To estimate high-quality deblurred images without amplified artifacts, we develop a prior estimation network.
  arXiv  Detail & Related papers  (2023-08-10T12:53:30Z)
• Improving Pixel-based MIM by Reducing Wasted Modeling Capability [77.99468514275185]
  We propose a new method that explicitly utilizes low-level features from shallow layers to aid pixel reconstruction. To the best of our knowledge, we are the first to systematically investigate multi-level feature fusion for isotropic architectures. Our method yields significant performance gains, such as 1.2% on fine-tuning, 2.8% on linear probing, and 2.6% on semantic segmentation.
  arXiv  Detail & Related papers  (2023-08-01T03:44:56Z)
• Dense Pixel-to-Pixel Harmonization via Continuous Image Representation [22.984119094424056]
  We propose a novel image Harmonization method based on Implicit neural Networks (HINet) Inspired by the Retinex theory, we decouple the harmonizations into two parts to respectively capture the content and environment of composite images. Extensive experiments have demonstrated the effectiveness of our method compared with state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-03-03T02:52:28Z)
• Patch-based image Super Resolution using generalized Gaussian mixture model [0.0]
  Single Image Super Resolution (SISR) methods aim to recover the clean images in high resolution from low resolution observations. A family of patch-based approaches have received considerable attention and development. This paper proposes an algorithm to learn a jointgeneralized Gaussian mixture model (GGMM) from a pair of the low resolution patches and the corresponding high resolution patches fromthe reference data.
  arXiv  Detail & Related papers  (2022-06-07T07:40:05Z)
• Highly Efficient Natural Image Matting [15.977598189574659]
  We propose a trimap-free natural image matting method with a lightweight model. We construct an extremely light-weighted model, which achieves comparable performance with 1% (344k) of large models on popular natural image benchmarks.
  arXiv  Detail & Related papers  (2021-10-25T09:23:46Z)
• Image Restoration by Deep Projected GSURE [115.57142046076164]
  Ill-posed inverse problems appear in many image processing applications, such as deblurring and super-resolution. We propose a new image restoration framework that is based on minimizing a loss function that includes a "projected-version" of the Generalized SteinUnbiased Risk Estimator (GSURE) and parameterization of the latent image by a CNN.
  arXiv  Detail & Related papers  (2021-02-04T08:52:46Z)
• Depth image denoising using nuclear norm and learning graph model [107.51199787840066]
  Group-based image restoration methods are more effective in gathering the similarity among patches. For each patch, we find and group the most similar patches within a searching window. The proposed method is superior to other current state-of-the-art denoising methods in both subjective and objective criterion.
  arXiv  Detail & Related papers  (2020-08-09T15:12:16Z)
• The Power of Triply Complementary Priors for Image Compressive Sensing [89.14144796591685]
  We propose a joint low-rank deep (LRD) image model, which contains a pair of complementaryly trip priors. We then propose a novel hybrid plug-and-play framework based on the LRD model for image CS. To make the optimization tractable, a simple yet effective algorithm is proposed to solve the proposed H-based image CS problem.
  arXiv  Detail & Related papers  (2020-05-16T08:17:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.