High Frame Rate Video Quality Assessment using VMAF and Entropic Differences

• URL: http://arxiv.org/abs/2109.12785v1
• Date: Mon, 27 Sep 2021 04:08:12 GMT
• Title: High Frame Rate Video Quality Assessment using VMAF and Entropic Differences
• Authors: Pavan C Madhusudana, Neil Birkbeck, Yilin Wang, Balu Adsumilli, Alan C. Bovik
• Abstract summary: The popularity of streaming videos with live, high-action content has led to an increased interest in High Frame Rate (HFR) videos. In this work we address the problem of frame rate dependent Video Quality Assessment (VQA) when the videos to be compared have different frame rate and compression factor. We show through various experiments that the proposed fusion framework results in more efficient features for predicting frame rate dependent video quality.
• Score: 50.265638572116984
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The popularity of streaming videos with live, high-action content has led to an increased interest in High Frame Rate (HFR) videos. In this work we address the problem of frame rate dependent Video Quality Assessment (VQA) when the videos to be compared have different frame rate and compression factor. The current VQA models such as VMAF have superior correlation with perceptual judgments when videos to be compared have same frame rates and contain conventional distortions such as compression, scaling etc. However this framework requires additional pre-processing step when videos with different frame rates need to be compared, which can potentially limit its overall performance. Recently, Generalized Entropic Difference (GREED) VQA model was proposed to account for artifacts that arise due to changes in frame rate, and showed superior performance on the LIVE-YT-HFR database which contains frame rate dependent artifacts such as judder, strobing etc. In this paper we propose a simple extension, where the features from VMAF and GREED are fused in order to exploit the advantages of both models. We show through various experiments that the proposed fusion framework results in more efficient features for predicting frame rate dependent video quality. We also evaluate the fused feature set on standard non-HFR VQA databases and obtain superior performance than both GREED and VMAF, indicating the combined feature set captures complimentary perceptual quality information.

Related papers

• Making Video Quality Assessment Models Sensitive to Frame Rate Distortions [63.749184706461826]
  We consider the problem of capturing distortions arising from changes in frame rate as part of Video Quality Assessment (VQA) We propose a simple fusion framework, whereby temporal features from GREED are combined with existing VQA models. Our results suggest that employing efficient temporal representations can result much more robust and accurate VQA models.
  arXiv  Detail & Related papers  (2022-05-21T04:13:57Z)
• FAVER: Blind Quality Prediction of Variable Frame Rate Videos [47.951054608064126]
  Video quality assessment (VQA) remains an important and challenging problem that affects many applications at the widest scales. We propose a first-of-a-kind blind VQA model for evaluating HFR videos, which we dub the Framerate-Aware Video Evaluator w/o Reference (FAVER) Our experiments on several HFR video quality datasets show that FAVER outperforms other blind VQA algorithms at a reasonable computational cost.
  arXiv  Detail & Related papers  (2022-01-05T07:54:12Z)
• ST-GREED: Space-Time Generalized Entropic Differences for Frame Rate Dependent Video Quality Prediction [63.749184706461826]
  We study how perceptual quality is affected by frame rate, and how frame rate and compression combine to affect perceived quality. We devise an objective VQA model called Space-Time GeneRalized Entropic Difference (GREED) which analyzes the statistics of spatial and temporal band-pass video coefficients. GREED achieves state-of-the-art performance on the LIVE-YT-HFR Database when compared with existing VQA models.
  arXiv  Detail & Related papers  (2020-10-26T16:54:33Z)
• Subjective and Objective Quality Assessment of High Frame Rate Videos [60.970191379802095]
  High frame rate (HFR) videos are becoming increasingly common with the tremendous popularity of live, high-action streaming content such as sports. Live-YT-HFR dataset is comprised of 480 videos having 6 different frame rates, obtained from 16 diverse contents. To obtain subjective labels on the videos, we conducted a human study yielding 19,000 human quality ratings obtained from a pool of 85 human subjects.
  arXiv  Detail & Related papers  (2020-07-22T19:11:42Z)
• Capturing Video Frame Rate Variations via Entropic Differencing [63.749184706461826]
  We propose a novel statistical entropic differencing method based on a Generalized Gaussian Distribution model. Our proposed model correlates very well with subjective scores in the recently proposed LIVE-YT-HFR database.
  arXiv  Detail & Related papers  (2020-06-19T22:16:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.