A New Low-Rank Learning Robust Quaternion Tensor Completion Method for
Color Video Inpainting Problem and Fast Algorithms
- URL: http://arxiv.org/abs/2306.09652v1
- Date: Fri, 16 Jun 2023 07:15:38 GMT
- Title: A New Low-Rank Learning Robust Quaternion Tensor Completion Method for
Color Video Inpainting Problem and Fast Algorithms
- Authors: Zhigang Jia and Jingfei Zhu
- Abstract summary: We present a new robust quaternion tensor completion (RQTC) model to solve this challenging problem and derive the exact recovery theory.
In numerical experiments, the proposed methods successfully recover color videos with eliminating color contamination and keeping the continuity of video scenery.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The color video inpainting problem is one of the most challenging problem in
the modern imaging science. It aims to recover a color video from a small part
of pixels that may contain noise. However, there are less of robust models that
can simultaneously preserve the coupling of color channels and the evolution of
color video frames. In this paper, we present a new robust quaternion tensor
completion (RQTC) model to solve this challenging problem and derive the exact
recovery theory. The main idea is to build a quaternion tensor optimization
model to recover a low-rank quaternion tensor that represents the targeted
color video and a sparse quaternion tensor that represents noise. This new
model is very efficient to recover high dimensional data that satisfies the
prior low-rank assumption. To solve the case without low-rank property, we
introduce a new low-rank learning RQTC model, which rearranges similar patches
classified by a quaternion learning method into smaller tensors satisfying the
prior low-rank assumption. We also propose fast algorithms with global
convergence guarantees. In numerical experiments, the proposed methods
successfully recover color videos with eliminating color contamination and
keeping the continuity of video scenery, and their solutions are of higher
quality in terms of PSNR and SSIM values than the state-of-the-art algorithms.
Related papers
- Quaternion Generative Adversarial Neural Networks and Applications to Color Image Inpainting [2.9409095383085386]
This paper proposes a Quaternion Geneversarative Adrial Neural Network (QGAN) model and related theory to solve the problem of color image inpainting with large area missing.
The experimental results show that QGAN has superiority in color image inpainting with large area missing.
arXiv Detail & Related papers (2024-06-17T14:04:17Z) - A New Cross-Space Total Variation Regularization Model for Color Image Restoration with Quaternion Blur Operator [20.00683294783224]
Cross-channel deblurring problem in color image processing is difficult to solve due to complex coupling and structural blurring of color pixels.
We present a novel cross-space total variation (CSTV) regularization model for color image deblurring.
New L-curve method is proposed to find a sweet balance of regularization functionals on different color spaces.
arXiv Detail & Related papers (2024-05-20T15:29:26Z) - Progressive Fourier Neural Representation for Sequential Video
Compilation [75.43041679717376]
Motivated by continual learning, this work investigates how to accumulate and transfer neural implicit representations for multiple complex video data over sequential encoding sessions.
We propose a novel method, Progressive Fourier Neural Representation (PFNR), that aims to find an adaptive and compact sub-module in Fourier space to encode videos in each training session.
We validate our PFNR method on the UVG8/17 and DAVIS50 video sequence benchmarks and achieve impressive performance gains over strong continual learning baselines.
arXiv Detail & Related papers (2023-06-20T06:02:19Z) - Multi-channel Nuclear Norm Minus Frobenius Norm Minimization for Color
Image Denoising [9.20787253404652]
One traditional strategy is to convert the RGB image to a less correlated color space and denoise each channel of the new space separately.
This paper proposes a new multi-channel optimization model for color image denoising under the nuclear norm minus Frobenius norm minimization framework.
Experimental results on both synthetic and real noise datasets demonstrate the proposed model outperforms state-of-the-art models.
arXiv Detail & Related papers (2022-09-16T04:10:29Z) - Learning Dynamic View Synthesis With Few RGBD Cameras [60.36357774688289]
We propose to utilize RGBD cameras to synthesize free-viewpoint videos of dynamic indoor scenes.
We generate point clouds from RGBD frames and then render them into free-viewpoint videos via a neural feature.
We introduce a simple Regional Depth-Inpainting module that adaptively inpaints missing depth values to render complete novel views.
arXiv Detail & Related papers (2022-04-22T03:17:35Z) - A DCT-based Tensor Completion Approach for Recovering Color Images and
Videos from Highly Undersampled Data [0.8399688944263843]
We propose a novel tensor completion approach to recover color images and videos from undersampled data.
A series of numerical experiments including color image inpainting and video data recovery demonstrate that our proposed approach performs better than many existing state-of-theart tensor completion methods.
arXiv Detail & Related papers (2021-10-18T13:41:27Z) - Temporally Consistent Video Colorization with Deep Feature Propagation
and Self-regularization Learning [90.38674162878496]
We propose a novel temporally consistent video colorization framework (TCVC)
TCVC effectively propagates frame-level deep features in a bidirectional way to enhance the temporal consistency of colorization.
Experiments demonstrate that our method can not only obtain visually pleasing colorized video, but also achieve clearly better temporal consistency than state-of-the-art methods.
arXiv Detail & Related papers (2021-10-09T13:00:14Z) - Degrade is Upgrade: Learning Degradation for Low-light Image Enhancement [52.49231695707198]
We investigate the intrinsic degradation and relight the low-light image while refining the details and color in two steps.
Inspired by the color image formulation, we first estimate the degradation from low-light inputs to simulate the distortion of environment illumination color, and then refine the content to recover the loss of diffuse illumination color.
Our proposed method has surpassed the SOTA by 0.95dB in PSNR on LOL1000 dataset and 3.18% in mAP on ExDark dataset.
arXiv Detail & Related papers (2021-03-19T04:00:27Z) - Non-Local Robust Quaternion Matrix Completion for Color Images and
Videos Inpainting [24.43507443273408]
We find a potential causality between NSS and low-rank property of color images.
A new patch group based NSS prior scheme is proposed to learn explicit NSS models of natural color images.
The numerical experiments on color images and videos indicate the advantages of NSS-based QMC over the state-of-the-art methods.
arXiv Detail & Related papers (2020-11-17T14:50:40Z) - CycleISP: Real Image Restoration via Improved Data Synthesis [166.17296369600774]
We present a framework that models camera imaging pipeline in forward and reverse directions.
By training a new image denoising network on realistic synthetic data, we achieve the state-of-the-art performance on real camera benchmark datasets.
arXiv Detail & Related papers (2020-03-17T15:20:25Z) - Deep Blind Video Super-resolution [85.79696784460887]
We propose a deep convolutional neural network (CNN) model to solve video SR by a blur kernel modeling approach.
The proposed CNN model consists of motion blur estimation, motion estimation, and latent image restoration modules.
We show that the proposed algorithm is able to generate clearer images with finer structural details.
arXiv Detail & Related papers (2020-03-10T13:43:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.