Deep Blind Video Super-resolution

• URL: http://arxiv.org/abs/2003.04716v1
• Date: Tue, 10 Mar 2020 13:43:24 GMT
• Title: Deep Blind Video Super-resolution
• Authors: Jinshan Pan, Songsheng Cheng, Jiawei Zhang, Jinhui Tang
• Abstract summary: We propose a deep convolutional neural network (CNN) model to solve video SR by a blur kernel modeling approach. The proposed CNN model consists of motion blur estimation, motion estimation, and latent image restoration modules. We show that the proposed algorithm is able to generate clearer images with finer structural details.
• Score: 85.79696784460887
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Existing video super-resolution (SR) algorithms usually assume that the blur kernels in the degradation process are known and do not model the blur kernels in the restoration. However, this assumption does not hold for video SR and usually leads to over-smoothed super-resolved images. In this paper, we propose a deep convolutional neural network (CNN) model to solve video SR by a blur kernel modeling approach. The proposed deep CNN model consists of motion blur estimation, motion estimation, and latent image restoration modules. The motion blur estimation module is used to provide reliable blur kernels. With the estimated blur kernel, we develop an image deconvolution method based on the image formation model of video SR to generate intermediate latent images so that some sharp image contents can be restored well. However, the generated intermediate latent images may contain artifacts. To generate high-quality images, we use the motion estimation module to explore the information from adjacent frames, where the motion estimation can constrain the deep CNN model for better image restoration. We show that the proposed algorithm is able to generate clearer images with finer structural details. Extensive experimental results show that the proposed algorithm performs favorably against state-of-the-art methods.

Related papers

• Deep learning-based blind image super-resolution with iterative kernel reconstruction and noise estimation [3.2157163136267934]
  We propose IKR-Net (Iterative Kernel Reconstruction Network) for blind SISR. IKR-Net achieves state-of-the-art results in blind SISR, especially for noisy images with motion blur.
  arXiv  Detail & Related papers  (2024-04-25T12:27:22Z)
• Learning Robust Multi-Scale Representation for Neural Radiance Fields from Unposed Images [65.41966114373373]
  We present an improved solution to the neural image-based rendering problem in computer vision. The proposed approach could synthesize a realistic image of the scene from a novel viewpoint at test time.
  arXiv  Detail & Related papers  (2023-11-08T08:18:23Z)
• Deep Richardson-Lucy Deconvolution for Low-Light Image Deblurring [48.80983873199214]
  We develop a data-driven approach to model the saturated pixels by a learned latent map. Based on the new model, the non-blind deblurring task can be formulated into a maximum a posterior (MAP) problem. To estimate high-quality deblurred images without amplified artifacts, we develop a prior estimation network.
  arXiv  Detail & Related papers  (2023-08-10T12:53:30Z)
• Deep Dynamic Scene Deblurring from Optical Flow [53.625999196063574]
  Deblurring can provide visually more pleasant pictures and make photography more convenient. It is difficult to model the non-uniform blur mathematically. We develop a convolutional neural network (CNN) to restore the sharp images from the deblurred features.
  arXiv  Detail & Related papers  (2023-01-18T06:37:21Z)
• Unfolded Deep Kernel Estimation for Blind Image Super-resolution [23.798845090992728]
  Blind image super-resolution (BISR) aims to reconstruct a high-resolution image from its low-resolution counterpart degraded by unknown blur kernel and noise. We propose a novel unfolded deep kernel estimation (UDKE) method, which, for the first time to our best knowledge, explicitly solves the data term with high efficiency.
  arXiv  Detail & Related papers  (2022-03-10T07:54:59Z)
• Deep Constrained Least Squares for Blind Image Super-Resolution [36.71106982590893]
  We tackle the problem of blind image super-resolution(SR) with a reformulated degradation model and two novel modules. To be more specific, we first reformulate the degradation model such that the deblurring kernel estimation can be transferred into the low resolution space. Our experiments demonstrate that the proposed method achieves better accuracy and visual improvements against state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-02-15T15:32:11Z)
• Deblur-NeRF: Neural Radiance Fields from Blurry Images [30.709331199256376]
  We propose De-NeRF, the first method that can recover a sharp NeRF from blurry input. We adopt an analysis-by-blur approach that reconstructs blurry views by simulating the blurring process. We demonstrate that our method can be used on both camera motion blur and defocus blur: the two most common types of blur in real scenes.
  arXiv  Detail & Related papers  (2021-11-29T01:49:15Z)
• Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
  Blind image restoration is a common yet challenging problem in computer vision. We propose a novel blind image restoration method, aiming to integrate both the advantages of them. Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
  arXiv  Detail & Related papers  (2020-08-25T03:30:53Z)
• Cascaded Deep Video Deblurring Using Temporal Sharpness Prior [88.98348546566675]
  The proposed algorithm mainly consists of optical flow estimation from intermediate latent frames and latent frame restoration steps. It first develops a deep CNN model to estimate optical flow from intermediate latent frames and then restores the latent frames based on the estimated optical flow. We show that exploring the domain knowledge of video deblurring is able to make the deep CNN model more compact and efficient.
  arXiv  Detail & Related papers  (2020-04-06T09:13:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.