Towards Deep Learning Methods for Quality Assessment of Computer-Generated Imagery

• URL: http://arxiv.org/abs/2005.00836v1
• Date: Sat, 2 May 2020 14:08:39 GMT
• Title: Towards Deep Learning Methods for Quality Assessment of Computer-Generated Imagery
• Authors: Markus Utke, Saman Zadtootaghaj, Steven Schmidt, Sebastian M\"oller
• Abstract summary: In contrast to traditional video content, gaming content has special characteristics such as extremely high motion for some games. In this paper, we outline our plan to build a deep learningbased quality metric for video gaming quality assessment.
• Score: 2.580765958706854
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video gaming streaming services are growing rapidly due to new services such as passive video streaming, e.g. Twitch.tv, and cloud gaming, e.g. Nvidia Geforce Now. In contrast to traditional video content, gaming content has special characteristics such as extremely high motion for some games, special motion patterns, synthetic content and repetitive content, which makes the state-of-the-art video and image quality metrics perform weaker for this special computer generated content. In this paper, we outline our plan to build a deep learningbased quality metric for video gaming quality assessment. In addition, we present initial results by training the network based on VMAF values as a ground truth to give some insights on how to build a metric in future. The paper describes the method that is used to choose an appropriate Convolutional Neural Network architecture. Furthermore, we estimate the size of the required subjective quality dataset which achieves a sufficiently high performance. The results show that by taking around 5k images for training of the last six modules of Xception, we can obtain a relatively high performance metric to assess the quality of distorted video games.

Related papers

• VQA$^2$: Visual Question Answering for Video Quality Assessment [76.81110038738699]
  Video Quality Assessment (VQA) is a classic field in low-level visual perception. Recent studies in the image domain have demonstrated that Visual Question Answering (VQA) can enhance markedly low-level visual quality evaluation. We introduce the VQA2 Instruction dataset - the first visual question answering instruction dataset that focuses on video quality assessment. The VQA2 series models interleave visual and motion tokens to enhance the perception of spatial-temporal quality details in videos.
  arXiv  Detail & Related papers  (2024-11-06T09:39:52Z)
• CLIPVQA:Video Quality Assessment via CLIP [56.94085651315878]
  We propose an efficient CLIP-based Transformer method for the VQA problem ( CLIPVQA) The proposed CLIPVQA achieves new state-of-the-art VQA performance and up to 37% better generalizability than existing benchmark VQA methods.
  arXiv  Detail & Related papers  (2024-07-06T02:32:28Z)
• VCEval: Rethinking What is a Good Educational Video and How to Automatically Evaluate It [46.67441830344145]
  We focus on the task of automatically evaluating the quality of video course content. We propose three evaluation principles and design a new evaluation framework, textitVCEval, based on these principles. Our method effectively distinguishes video courses of different content quality and produces a range of interpretable results.
  arXiv  Detail & Related papers  (2024-06-15T13:18:30Z)
• RMT-BVQA: Recurrent Memory Transformer-based Blind Video Quality Assessment for Enhanced Video Content [7.283653823423298]
  We propose a novel blind deep video quality assessment (VQA) method specifically for enhanced video content. It employs a new Recurrent Memory Transformer (RMT) based network architecture to obtain video quality representations. The extracted quality representations are then combined through linear regression to generate video-level quality indices.
  arXiv  Detail & Related papers  (2024-05-14T14:01:15Z)
• Perceptual Video Quality Assessment: A Survey [63.61214597655413]
  Perceptual video quality assessment plays a vital role in the field of video processing. Various subjective and objective video quality assessment studies have been conducted over the past two decades. This survey provides an up-to-date and comprehensive review of these video quality assessment studies.
  arXiv  Detail & Related papers  (2024-02-05T16:13:52Z)
• A Video Is Worth 4096 Tokens: Verbalize Videos To Understand Them In Zero Shot [67.00455874279383]
  We propose verbalizing long videos to generate descriptions in natural language, then performing video-understanding tasks on the generated story as opposed to the original video. Our method, despite being zero-shot, achieves significantly better results than supervised baselines for video understanding. To alleviate a lack of story understanding benchmarks, we publicly release the first dataset on a crucial task in computational social science on persuasion strategy identification.
  arXiv  Detail & Related papers  (2023-05-16T19:13:11Z)
• Video Content Classification using Deep Learning [0.0]
  This paper presents a model that is a combination of Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) The model can identify the type of video content and classify them into categories such as "Animation, Gaming, natural content, flat content, etc"
  arXiv  Detail & Related papers  (2021-11-27T04:36:17Z)
• RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Content [44.03188436272383]
  We introduce an effective and efficient video quality model for content, which we dub the Rapid and Accurate Video Quality Evaluator (RAPIQUE) RAPIQUE combines and leverages the advantages of both quality-aware scene statistics features and semantics-aware deep convolutional features. Our experimental results on recent large-scale video quality databases show that RAPIQUE delivers top performances on all the datasets at a considerably lower computational expense.
  arXiv  Detail & Related papers  (2021-01-26T17:23:46Z)
• Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos [96.45804577283563]
  We present a novel hybrid dynAmic-static Context-aware attenTION NETwork (ACTION-NET) for action assessment in long videos. We learn the video dynamic information but also focus on the static postures of the detected athletes in specific frames. We combine the features of the two streams to regress the final video score, supervised by ground-truth scores given by experts.
  arXiv  Detail & Related papers  (2020-08-13T15:51:42Z)
• Encoding in the Dark Grand Challenge: An Overview [60.9261003831389]
  We propose a Grand Challenge on encoding low-light video sequences. VVC achieves a high performance compared to simply denoising the video source prior to encoding. The quality of the video streams can be further improved by employing a post-processing image enhancement method.
  arXiv  Detail & Related papers  (2020-05-07T08:22:56Z)
• Feature Re-Learning with Data Augmentation for Video Relevance Prediction [35.87597969685573]
  Re-learning is realized by projecting a given deep feature into a new space by an affine transformation. We propose a new data augmentation strategy which works directly on frame-level and video-level features.
  arXiv  Detail & Related papers  (2020-04-08T05:22:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.