Single-Image Super-Resolution Reconstruction based on the Differences of
Neighboring Pixels
- URL: http://arxiv.org/abs/2212.13730v1
- Date: Wed, 28 Dec 2022 07:30:07 GMT
- Title: Single-Image Super-Resolution Reconstruction based on the Differences of
Neighboring Pixels
- Authors: Huipeng Zheng, Lukman Hakim, Takio Kurita, Junichi Miyao
- Abstract summary: The deep learning technique was used to increase the performance of single image super-resolution (SISR)
In this paper, we propose the differences of neighboring pixels to regularize the CNN by constructing a graph from the estimated image and the ground-truth image.
The proposed method outperforms the state-of-the-art methods in terms of quantitative and qualitative evaluation of the benchmark datasets.
- Score: 3.257500143434429
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The deep learning technique was used to increase the performance of single
image super-resolution (SISR). However, most existing CNN-based SISR approaches
primarily focus on establishing deeper or larger networks to extract more
significant high-level features. Usually, the pixel-level loss between the
target high-resolution image and the estimated image is used, but the neighbor
relations between pixels in the image are seldom used. On the other hand,
according to observations, a pixel's neighbor relationship contains rich
information about the spatial structure, local context, and structural
knowledge. Based on this fact, in this paper, we utilize pixel's neighbor
relationships in a different perspective, and we propose the differences of
neighboring pixels to regularize the CNN by constructing a graph from the
estimated image and the ground-truth image. The proposed method outperforms the
state-of-the-art methods in terms of quantitative and qualitative evaluation of
the benchmark datasets.
Keywords: Super-resolution, Convolutional Neural Networks, Deep Learning
Related papers
- Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localization [4.8454936010479335]
We propose a Multi-view Pixel-wise Contrastive algorithm (MPC) for image forgery localization.
Specifically, we first pre-train the backbone network with the supervised contrastive loss.
Then the localization head is fine-tuned using the cross-entropy loss, resulting in a better pixel localizer.
arXiv Detail & Related papers (2024-06-19T13:51:52Z) - Distance Weighted Trans Network for Image Completion [52.318730994423106]
We propose a new architecture that relies on Distance-based Weighted Transformer (DWT) to better understand the relationships between an image's components.
CNNs are used to augment the local texture information of coarse priors.
DWT blocks are used to recover certain coarse textures and coherent visual structures.
arXiv Detail & Related papers (2023-10-11T12:46:11Z) - Pixel Relationships-based Regularizer for Retinal Vessel Image
Segmentation [4.3251090426112695]
This study presents regularizers to give the pixel neighbor relationship information to the learning process.
Experiments show that our scheme successfully captures pixel neighbor relations and improves the performance of the convolutional neural network.
arXiv Detail & Related papers (2022-12-28T07:35:20Z) - Unsupervised Image Semantic Segmentation through Superpixels and Graph
Neural Networks [6.123324869194195]
Unsupervised image segmentation is an important task in many real-world scenarios where labelled data is of scarce availability.
We propose a novel approach that harnesses recent advances in unsupervised learning using a combination of Mutual Information Maximization (MIM), Neural Superpixel and Graph Neural Networks (GNNs) in an end-to-end manner.
arXiv Detail & Related papers (2022-10-21T08:35:18Z) - Rethinking Unsupervised Neural Superpixel Segmentation [6.123324869194195]
unsupervised learning for superpixel segmentation via CNNs has been studied.
We propose three key elements to improve the efficacy of such networks.
By experimenting with the BSDS500 dataset, we find evidence to the significance of our proposal.
arXiv Detail & Related papers (2022-06-21T09:30:26Z) - Image Super-resolution with An Enhanced Group Convolutional Neural
Network [102.2483249598621]
CNNs with strong learning abilities are widely chosen to resolve super-resolution problem.
We present an enhanced super-resolution group CNN (ESRGCNN) with a shallow architecture.
Experiments report that our ESRGCNN surpasses the state-of-the-arts in terms of SISR performance, complexity, execution speed, image quality evaluation and visual effect in SISR.
arXiv Detail & Related papers (2022-05-29T00:34:25Z) - Learning Enriched Features for Fast Image Restoration and Enhancement [166.17296369600774]
This paper presents a holistic goal of maintaining spatially-precise high-resolution representations through the entire network.
We learn an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details.
Our approach achieves state-of-the-art results for a variety of image processing tasks, including defocus deblurring, image denoising, super-resolution, and image enhancement.
arXiv Detail & Related papers (2022-04-19T17:59:45Z) - Superpixel-based Domain-Knowledge Infusion in Computer Vision [0.7349727826230862]
Superpixels are higher-order perceptual groups of pixels in an image, often carrying much more information than raw pixels.
There is an inherent relational structure to the relationship among different superpixels of an image.
This relational information can convey some form of domain information about the image, e.g. relationship between superpixels representing two eyes in a cat image.
arXiv Detail & Related papers (2021-05-20T01:25:42Z) - AINet: Association Implantation for Superpixel Segmentation [82.21559299694555]
We propose a novel textbfAssociation textbfImplantation (AI) module to enable the network to explicitly capture the relations between the pixel and its surrounding grids.
Our method could not only achieve state-of-the-art performance but maintain satisfactory inference efficiency.
arXiv Detail & Related papers (2021-01-26T10:40:13Z) - Learning Enriched Features for Real Image Restoration and Enhancement [166.17296369600774]
convolutional neural networks (CNNs) have achieved dramatic improvements over conventional approaches for image restoration task.
We present a novel architecture with the collective goals of maintaining spatially-precise high-resolution representations through the entire network.
Our approach learns an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details.
arXiv Detail & Related papers (2020-03-15T11:04:30Z) - A U-Net Based Discriminator for Generative Adversarial Networks [86.67102929147592]
We propose an alternative U-Net based discriminator architecture for generative adversarial networks (GANs)
The proposed architecture allows to provide detailed per-pixel feedback to the generator while maintaining the global coherence of synthesized images.
The novel discriminator improves over the state of the art in terms of the standard distribution and image quality metrics.
arXiv Detail & Related papers (2020-02-28T11:16:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.