Neural video codecs quality assessment dataset and benchmark

• URL: http://arxiv.org/abs/2608.29331v1
• Date: Sat, 29 Aug 2026 15:30:55 GMT
• Title: Neural video codecs quality assessment dataset and benchmark
• Abstract summary: We present a large-scale subjective dataset of videos compressed with both neural and traditional video codecs.<n>The proposed dataset provides a valuable resource for the development and benchmarking of video quality metrics tailored to neural video codecs.
• Score: 39.146761527401424
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Video traffic constitutes a significant share of global web traffic. To reduce its volume, video codecs have been developed and continuously improved. While the industry has achieved substantial progress in traditional video coding, neural video codecs (NVCs) have recently emerged as a new approach that applies deep learning to video compression. This creates new challenges for compression quality assessment, which is essential for the further development and improvement of such codecs. In particular, it is important to evaluate the novel temporal compression paradigms introduced by NVCs. In this work, we present a large-scale subjective dataset of videos compressed with both neural and traditional video codecs. The subjective scores were collected through crowd-sourced pairwise comparisons. The proposed dataset provides a valuable resource for the development and benchmarking of video quality metrics tailored to neural video codecs. The dataset is available at the following link: https://videoprocessing.github.io/nvc-dataset-benchmark

Related papers

• CodecArena: Codec Quality Assessment via Visual Reinforcement Learning [70.59130074737446]
  We propose CodecArena, the first vision-language framework for video coding quality assessment.<n>CodecArena casts evaluation as source-conditioned comparative reasoning between a reference and its reconstructions.<n>Its facet-anchored reward uses automatically derived facet directions as weak anchors, rather than human per-facet labels.
  arXiv  Detail & Related papers  (2026-08-10T05:37:06Z)
• FDIM: A Feature-distance-based Generic Video Quality Metric for Versatile Codecs [16.429817532129388]
  FDIM is a feature-distance-based generic video quality metric for both traditional and neural video codecs.<n>We trained FDIM on a large-scale subjective quality assessment dataset (DCV) consisting of over 16k video sequences.
  arXiv  Detail & Related papers  (2026-04-27T07:19:05Z)
• Generative Latent Video Compression [26.99743586846841]
  We present Generative Latent Video Compression (GLVC), an effective framework for perceptual video compression.<n>GLVC employs a pretrained continuous tokenizer to project video frames into a perceptually aligned latent space.<n>We show GLVC achieves state-of-the-art performance in terms of DISTS and LPIPS metrics.
  arXiv  Detail & Related papers  (2025-10-11T03:28:49Z)
• NU-Class Net: A Novel Approach for Video Quality Enhancement [1.7763979745248648]
  This paper introduces NU-Class Net, an innovative deep-learning model designed to mitigate compression artifacts stemming from lossy compression codecs. By employing the NU-Class Net, the video encoder within the video-capturing node can reduce output quality, thereby generating low-bit-rate videos. Experimental results affirm the efficacy of the proposed model in enhancing the perceptible quality of videos, especially those streamed at low bit rates.
  arXiv  Detail & Related papers  (2024-01-02T11:46:42Z)
• Towards Scalable Neural Representation for Diverse Videos [68.73612099741956]
  Implicit neural representations (INR) have gained increasing attention in representing 3D scenes and images. Existing INR-based methods are limited to encoding a handful of short videos with redundant visual content. This paper focuses on developing neural representations for encoding long and/or a large number of videos with diverse visual content.
  arXiv  Detail & Related papers  (2023-03-24T16:32:19Z)
• Neural Video Compression with Diverse Contexts [25.96187914295921]
  This paper proposes increasing the context diversity in both temporal and spatial dimensions. Experiments show that our codes obtains 23.5% saving over previous SOTA NVC.
  arXiv  Detail & Related papers  (2023-02-28T08:35:50Z)
• Video compression dataset and benchmark of learning-based video-quality metrics [55.41644538483948]
  We present a new benchmark for video-quality metrics that evaluates video compression. It is based on a new dataset consisting of about 2,500 streams encoded using different standards. Subjective scores were collected using crowdsourced pairwise comparisons.
  arXiv  Detail & Related papers  (2022-11-22T09:22:28Z)
• A Coding Framework and Benchmark towards Low-Bitrate Video Understanding [63.05385140193666]
  We propose a traditional-neural mixed coding framework that takes advantage of both traditional codecs and neural networks (NNs) The framework is optimized by ensuring that a transportation-efficient semantic representation of the video is preserved. We build a low-bitrate video understanding benchmark with three downstream tasks on eight datasets, demonstrating the notable superiority of our approach.
  arXiv  Detail & Related papers  (2022-02-06T16:29:15Z)
• Content Adaptive and Error Propagation Aware Deep Video Compression [110.31693187153084]
  We propose a content adaptive and error propagation aware video compression system. Our method employs a joint training strategy by considering the compression performance of multiple consecutive frames instead of a single frame. Instead of using the hand-crafted coding modes in the traditional compression systems, we design an online encoder updating scheme in our system.
  arXiv  Detail & Related papers  (2020-03-25T09:04:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.