Non-Local Robust Quaternion Matrix Completion for Color Images and
Videos Inpainting
- URL: http://arxiv.org/abs/2011.08675v3
- Date: Fri, 13 May 2022 14:27:27 GMT
- Title: Non-Local Robust Quaternion Matrix Completion for Color Images and
Videos Inpainting
- Authors: Zhigang Jia and Qiyu Jin and Michael K. Ng and Xile Zhao
- Abstract summary: We find a potential causality between NSS and low-rank property of color images.
A new patch group based NSS prior scheme is proposed to learn explicit NSS models of natural color images.
The numerical experiments on color images and videos indicate the advantages of NSS-based QMC over the state-of-the-art methods.
- Score: 24.43507443273408
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The image nonlocal self-similarity (NSS) prior refers to the fact that a
local patch often has many nonlocal similar patches to it across the image and
has been widely applied in many recently proposed machining learning algorithms
for image processing. However, there is no theoretical analysis on its working
principle in the literature. In this paper, we discover a potential causality
between NSS and low-rank property of color images, which is also available to
grey images. A new patch group based NSS prior scheme is proposed to learn
explicit NSS models of natural color images. The numerical low-rank property of
patched matrices is also rigorously proved. The NSS-based QMC algorithm
computes an optimal low-rank approximation to the high-rank color image,
resulting in high PSNR and SSIM measures and particularly the better visual
quality. A new tensor NSS-based QMC method is also presented to solve the color
video inpainting problem based on quaternion tensor representation. The
numerical experiments on color images and videos indicate the advantages of
NSS-based QMC over the state-of-the-art methods.
Related papers
- A New Low-Rank Learning Robust Quaternion Tensor Completion Method for
Color Video Inpainting Problem and Fast Algorithms [0.0]
We present a new robust quaternion tensor completion (RQTC) model to solve this challenging problem and derive the exact recovery theory.
In numerical experiments, the proposed methods successfully recover color videos with eliminating color contamination and keeping the continuity of video scenery.
arXiv Detail & Related papers (2023-06-16T07:15:38Z) - T-former: An Efficient Transformer for Image Inpainting [50.43302925662507]
A class of attention-based network architectures, called transformer, has shown significant performance on natural language processing fields.
In this paper, we design a novel attention linearly related to the resolution according to Taylor expansion, and based on this attention, a network called $T$-former is designed for image inpainting.
Experiments on several benchmark datasets demonstrate that our proposed method achieves state-of-the-art accuracy while maintaining a relatively low number of parameters and computational complexity.
arXiv Detail & Related papers (2023-05-12T04:10:42Z) - Decoupled Mixup for Generalized Visual Recognition [71.13734761715472]
We propose a novel "Decoupled-Mixup" method to train CNN models for visual recognition.
Our method decouples each image into discriminative and noise-prone regions, and then heterogeneously combines these regions to train CNN models.
Experiment results show the high generalization performance of our method on testing data that are composed of unseen contexts.
arXiv Detail & Related papers (2022-10-26T15:21:39Z) - Multi-channel Nuclear Norm Minus Frobenius Norm Minimization for Color
Image Denoising [9.20787253404652]
One traditional strategy is to convert the RGB image to a less correlated color space and denoise each channel of the new space separately.
This paper proposes a new multi-channel optimization model for color image denoising under the nuclear norm minus Frobenius norm minimization framework.
Experimental results on both synthetic and real noise datasets demonstrate the proposed model outperforms state-of-the-art models.
arXiv Detail & Related papers (2022-09-16T04:10:29Z) - Neural Color Operators for Sequential Image Retouching [62.99812889713773]
We propose a novel image retouching method by modeling the retouching process as performing a sequence of newly introduced trainable neural color operators.
The neural color operator mimics the behavior of traditional color operators and learns pixelwise color transformation while its strength is controlled by a scalar.
Our method consistently achieves the best results compared with SOTA methods in both quantitative measures and visual qualities.
arXiv Detail & Related papers (2022-07-17T05:33:19Z) - Neural Knitworks: Patched Neural Implicit Representation Networks [1.0470286407954037]
We propose Knitwork, an architecture for neural implicit representation learning of natural images that achieves image synthesis.
To the best of our knowledge, this is the first implementation of a coordinate-based patch tailored for synthesis tasks such as image inpainting, super-resolution, and denoising.
The results show that modeling natural images using patches, rather than pixels, produces results of higher fidelity.
arXiv Detail & Related papers (2021-09-29T13:10:46Z) - Generalized Two-Dimensional Quaternion Principal Component Analysis with
Weighting for Color Image Recognition [1.516937009186805]
One of the most powerful methods of color image recognition is the two-dimensional principle component analysis (2DQPCA) approach.
In this paper, a generalized 2DQPCA approach with weighting is presented with imposing $L_p$ norms on both constraint and objective functions.
The numerical results based on the real face databases validate that the newly proposed method is robust to noise and performs better than the state-of-the-art 2DQPCA-based algorithms and four prominent deep learning methods.
arXiv Detail & Related papers (2020-10-04T03:37:23Z) - Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
Blind image restoration is a common yet challenging problem in computer vision.
We propose a novel blind image restoration method, aiming to integrate both the advantages of them.
Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
arXiv Detail & Related papers (2020-08-25T03:30:53Z) - The Power of Triply Complementary Priors for Image Compressive Sensing [89.14144796591685]
We propose a joint low-rank deep (LRD) image model, which contains a pair of complementaryly trip priors.
We then propose a novel hybrid plug-and-play framework based on the LRD model for image CS.
To make the optimization tractable, a simple yet effective algorithm is proposed to solve the proposed H-based image CS problem.
arXiv Detail & Related papers (2020-05-16T08:17:44Z) - Learning to Structure an Image with Few Colors [59.34619548026885]
We propose a color quantization network, ColorCNN, which learns to structure the images from the classification loss in an end-to-end manner.
With only a 1-bit color space (i.e., two colors), the proposed network achieves 82.1% top-1 accuracy on the CIFAR10 dataset.
For applications, when encoded with PNG, the proposed color quantization shows superiority over other image compression methods in the extremely low bit-rate regime.
arXiv Detail & Related papers (2020-03-17T17:56:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.