Dynamic Attentive Graph Learning for Image Restoration
- URL: http://arxiv.org/abs/2109.06620v1
- Date: Tue, 14 Sep 2021 12:19:15 GMT
- Title: Dynamic Attentive Graph Learning for Image Restoration
- Authors: Chong Mou, Jian Zhang, Zhuoyuan Wu
- Abstract summary: We propose a dynamic attentive graph learning model (DAGL) to explore the dynamic non-local property on patch level for image restoration.
Our DAGL can produce state-of-the-art results with superior accuracy and visual quality.
- Score: 6.289143409131908
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Non-local self-similarity in natural images has been verified to be an
effective prior for image restoration. However, most existing deep non-local
methods assign a fixed number of neighbors for each query item, neglecting the
dynamics of non-local correlations. Moreover, the non-local correlations are
usually based on pixels, prone to be biased due to image degradation. To
rectify these weaknesses, in this paper, we propose a dynamic attentive graph
learning model (DAGL) to explore the dynamic non-local property on patch level
for image restoration. Specifically, we propose an improved graph model to
perform patch-wise graph convolution with a dynamic and adaptive number of
neighbors for each node. In this way, image content can adaptively balance
over-smooth and over-sharp artifacts through the number of its connected
neighbors, and the patch-wise non-local correlations can enhance the message
passing process. Experimental results on various image restoration tasks:
synthetic image denoising, real image denoising, image demosaicing, and
compression artifact reduction show that our DAGL can produce state-of-the-art
results with superior accuracy and visual quality. The source code is available
at https://github.com/jianzhangcs/DAGL.
Related papers
- Denoising Nearest Neighbor Graph via Continuous CRF for Visual Re-ranking without Fine-tuning [15.880661910248827]
We propose a complementary denoising method based on Continuous Conditional Random Field (C-CRF)
We demonstrate the complementarity of our method through its application to three visual re-ranking methods.
arXiv Detail & Related papers (2024-12-18T14:16:40Z) - ALIP: Adaptive Language-Image Pre-training with Synthetic Caption [78.93535202851278]
Contrastive Language-Image Pre-training (CLIP) has significantly boosted the performance of various vision-language tasks.
The presence of intrinsic noise and unmatched image-text pairs in web data can potentially affect the performance of representation learning.
We propose an Adaptive Language-Image Pre-training (ALIP), a bi-path model that integrates supervision from both raw text and synthetic caption.
arXiv Detail & Related papers (2023-08-16T15:19:52Z) - Diffusion-Based Scene Graph to Image Generation with Masked Contrastive
Pre-Training [112.94542676251133]
We propose to learn scene graph embeddings by directly optimizing their alignment with images.
Specifically, we pre-train an encoder to extract both global and local information from scene graphs.
The resulting method, called SGDiff, allows for the semantic manipulation of generated images by modifying scene graph nodes and connections.
arXiv Detail & Related papers (2022-11-21T01:11:19Z) - A low-rank representation for unsupervised registration of medical
images [10.499611180329804]
We propose a novel approach based on a low-rank representation, i.e., Regnet-LRR, to tackle the problem of noisy data registration scenarios.
We show that the low-rank representation can boost the ability and robustness of models as well as bring significant improvements in noisy data registration scenarios.
arXiv Detail & Related papers (2021-05-20T07:04:10Z) - Ensembling with Deep Generative Views [72.70801582346344]
generative models can synthesize "views" of artificial images that mimic real-world variations, such as changes in color or pose.
Here, we investigate whether such views can be applied to real images to benefit downstream analysis tasks such as image classification.
We use StyleGAN2 as the source of generative augmentations and investigate this setup on classification tasks involving facial attributes, cat faces, and cars.
arXiv Detail & Related papers (2021-04-29T17:58:35Z) - Image Retrieval for Structure-from-Motion via Graph Convolutional
Network [13.040952255039702]
We present a novel retrieval method based on Graph Convolutional Network (GCN) to generate accurate pairwise matches without costly redundancy.
By constructing a subgraph surrounding the query image as input data, we adopt a learnable GCN to exploit whether nodes in the subgraph have overlapping regions with the query photograph.
Experiments demonstrate that our method performs remarkably well on the challenging dataset of highly ambiguous and duplicated scenes.
arXiv Detail & Related papers (2020-09-17T04:03:51Z) - Cross-Scale Internal Graph Neural Network for Image Super-Resolution [147.77050877373674]
Non-local self-similarity in natural images has been well studied as an effective prior in image restoration.
For single image super-resolution (SISR), most existing deep non-local methods only exploit similar patches within the same scale of the low-resolution (LR) input image.
This is achieved using a novel cross-scale internal graph neural network (IGNN)
arXiv Detail & Related papers (2020-06-30T10:48:40Z) - High-Order Information Matters: Learning Relation and Topology for
Occluded Person Re-Identification [84.43394420267794]
We propose a novel framework by learning high-order relation and topology information for discriminative features and robust alignment.
Our framework significantly outperforms state-of-the-art by6.5%mAP scores on Occluded-Duke dataset.
arXiv Detail & Related papers (2020-03-18T12:18:35Z) - Image Fine-grained Inpainting [89.17316318927621]
We present a one-stage model that utilizes dense combinations of dilated convolutions to obtain larger and more effective receptive fields.
To better train this efficient generator, except for frequently-used VGG feature matching loss, we design a novel self-guided regression loss.
We also employ a discriminator with local and global branches to ensure local-global contents consistency.
arXiv Detail & Related papers (2020-02-07T03:45:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.