ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution
- URL: http://arxiv.org/abs/2110.09992v1
- Date: Tue, 19 Oct 2021 14:04:16 GMT
- Title: ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution
- Authors: Anastasia Kirillova, Eugene Lyapustin, Anastasia Antsiferova, Dmitry
Vatolin
- Abstract summary: ERQA metric aims to estimate a model's ability to restore real details using VSR.
Code for the proposed metric is publicly available at https://github.com/msu-video-group/ERQA.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Despite the growing popularity of video super-resolution (VSR), there is
still no good way to assess the quality of the restored details in upscaled
frames. Some SR methods may produce the wrong digit or an entirely different
face. Whether a method's results are trustworthy depends on how well it
restores truthful details. Image super-resolution can use natural distributions
to produce a high-resolution image that is only somewhat similar to the real
one. VSR enables exploration of additional information in neighboring frames to
restore details from the original scene. The ERQA metric, which we propose in
this paper, aims to estimate a model's ability to restore real details using
VSR. On the assumption that edges are significant for detail and character
recognition, we chose edge fidelity as the foundation for this metric.
Experimental validation of our work is based on the MSU Video Super-Resolution
Benchmark, which includes the most difficult patterns for detail restoration
and verifies the fidelity of details from the original frame. Code for the
proposed metric is publicly available at
https://github.com/msu-video-group/ERQA.
Related papers
- Detail-Enhancing Framework for Reference-Based Image Super-Resolution [8.899312174844725]
We propose a Detail-Enhancing Framework (DEF) for reference-based super-resolution.
Our proposed method achieves superior visual results while maintaining comparable numerical outcomes.
arXiv Detail & Related papers (2024-05-01T10:27:22Z) - CoSeR: Bridging Image and Language for Cognitive Super-Resolution [74.24752388179992]
We introduce the Cognitive Super-Resolution (CoSeR) framework, empowering SR models with the capacity to comprehend low-resolution images.
We achieve this by marrying image appearance and language understanding to generate a cognitive embedding.
To further improve image fidelity, we propose a novel condition injection scheme called "All-in-Attention"
arXiv Detail & Related papers (2023-11-27T16:33:29Z) - Video Super-Resolution Using a Grouped Residual in Residual Network [12.691703425623055]
Video super-resolution (VSR) can be considered as the generalization of single image super-resolution (SISR)
In this paper, we propose a grouped residual in residual network (GRRN) for VSR.
arXiv Detail & Related papers (2023-10-17T13:55:43Z) - Towards Real-World Burst Image Super-Resolution: Benchmark and Method [93.73429028287038]
In this paper, we establish a large-scale real-world burst super-resolution dataset, i.e., RealBSR, to explore the faithful reconstruction of image details from multiple frames.
We also introduce a Federated Burst Affinity network (FBAnet) to investigate non-trivial pixel-wise displacement among images under real-world image degradation.
arXiv Detail & Related papers (2023-09-09T14:11:37Z) - Learning Data-Driven Vector-Quantized Degradation Model for Animation
Video Super-Resolution [59.71387128485845]
We explore the characteristics of animation videos and leverage the rich priors in real-world animation data for a more practical animation VSR model.
We propose a multi-scale Vector-Quantized Degradation model for animation video Super-Resolution (VQD-SR) to decompose the local details from global structures.
A rich-content Real Animation Low-quality (RAL) video dataset is collected for extracting the priors.
arXiv Detail & Related papers (2023-03-17T08:11:14Z) - Exploring Resolution and Degradation Clues as Self-supervised Signal for
Low Quality Object Detection [77.3530907443279]
We propose a novel self-supervised framework to detect objects in degraded low resolution images.
Our methods has achieved superior performance compared with existing methods when facing variant degradation situations.
arXiv Detail & Related papers (2022-08-05T09:36:13Z) - HIME: Efficient Headshot Image Super-Resolution with Multiple Exemplars [11.81364643562714]
We propose an efficient Headshot Image Super-Resolution with Multiple Exemplars network (HIME) method.
Compared with previous methods, our network can effectively handle the misalignment between the input and the reference.
We also propose a correlation loss that provides a rich representation of the local texture in a controllable spatial range.
arXiv Detail & Related papers (2022-03-28T16:13:28Z) - Towards True Detail Restoration for Super-Resolution: A Benchmark and a
Quality Metric [0.0]
Super-resolution (SR) methods can improve overall image and video quality and create new possibilities for content analysis.
But the SR mainstream focuses primarily on increasing the naturalness of the resulting image.
arXiv Detail & Related papers (2022-03-16T20:13:35Z) - RestoreDet: Degradation Equivariant Representation for Object Detection
in Low Resolution Images [81.91416537019835]
We propose a novel framework, RestoreDet, to detect objects in degraded low resolution images.
Our framework based on CenterNet has achieved superior performance compared with existing methods when facing variant degradation situations.
arXiv Detail & Related papers (2022-01-07T03:40:23Z) - AIM 2020 Challenge on Video Extreme Super-Resolution: Methods and
Results [96.74919503142014]
This paper reviews the video extreme super-resolution challenge associated with the AIM 2020 workshop at ECCV 2020.
Track 1 is set up to gauge the state-of-the-art for such a demanding task, where fidelity to the ground truth is measured by PSNR and SSIM.
Track 2 therefore aims at generating visually pleasing results, which are ranked according to human perception, evaluated by a user study.
arXiv Detail & Related papers (2020-09-14T09:36:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.