ICME 2025 Generalizable HDR and SDR Video Quality Measurement Grand Challenge

• URL: http://arxiv.org/abs/2506.22790v2
• Date: Tue, 15 Jul 2025 23:50:11 GMT
• Title: ICME 2025 Generalizable HDR and SDR Video Quality Measurement Grand Challenge
• Authors: Yixu Chen, Bowen Chen, Hai Wei, Alan C. Bovik, Baojun Li, Wei Sun, Linhan Cao, Kang Fu, Dandan Zhu, Jun Jia, Menghan Hu, Xiongkuo Min, Guangtao Zhai, Dounia Hammou, Fei Yin, Rafal Mantiuk, Amritha Premkumar, Prajit T Rajendran, Vignesh V Menon,
• Abstract summary: The challenge was established to benchmark and promote VQA approaches capable of jointly handling HDR and SDR content.<n>The top-performing model achieved state-of-the-art performance, setting a new benchmark for generalizable video quality assessment.
• Score: 66.86693390673298
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: This paper reports IEEE International Conference on Multimedia \& Expo (ICME) 2025 Grand Challenge on Generalizable HDR and SDR Video Quality Measurement. With the rapid development of video technology, especially High Dynamic Range (HDR) and Standard Dynamic Range (SDR) contents, the need for robust and generalizable Video Quality Assessment (VQA) methods has become increasingly demanded. Existing VQA models often struggle to deliver consistent performance across varying dynamic ranges, distortion types, and diverse content. This challenge was established to benchmark and promote VQA approaches capable of jointly handling HDR and SDR content. In the final evaluation phase, five teams submitted seven models along with technical reports to the Full Reference (FR) and No Reference (NR) tracks. Among them, four methods outperformed VMAF baseline, while the top-performing model achieved state-of-the-art performance, setting a new benchmark for generalizable video quality assessment.

Related papers

• CompressedVQA-HDR: Generalized Full-reference and No-reference Quality Assessment Models for Compressed High Dynamic Range Videos [46.255654141741815]
  We introduce CompressedVQA-SDR, an effective VQA framework designed to address the challenges of HDR video quality assessment.<n>We adopt the Swin Transformer and SigLip 2 as the backbone networks for the proposed full-reference (FR) and no-reference (NR) VQA models, respectively.<n>Our models achieve state-of-the-art performance compared to existing FR and NR VQA models.
  arXiv  Detail & Related papers  (2025-07-16T04:33:06Z)
• HDRSDR-VQA: A Subjective Video Quality Dataset for HDR and SDR Comparative Evaluation [30.359510055375253]
  We introduce HDRSDR-VQA, a large-scale video quality assessment dataset designed to facilitate comparative analysis between High Dynamic Range (adaptive) and Standard Dynamic Range (SDR) content under realistic viewing conditions.<n>The dataset comprises 960 videos generated from 54 diverse source sequences, each presented in both HDR and SDR formats across nine distortion levels.
  arXiv  Detail & Related papers  (2025-05-27T23:35:57Z)
• SALOVA: Segment-Augmented Long Video Assistant for Targeted Retrieval and Routing in Long-Form Video Analysis [52.050036778325094]
  We introduce SALOVA: Segment-Augmented Video Assistant, a novel video-LLM framework designed to enhance the comprehension of lengthy video content.<n>We present a high-quality collection of 87.8K long videos, each densely captioned at the segment level to enable models to capture scene continuity and maintain rich context.<n>Our framework mitigates the limitations of current video-LMMs by allowing for precise identification and retrieval of relevant video segments in response to queries.
  arXiv  Detail & Related papers  (2024-11-25T08:04:47Z)
• AIM 2024 Challenge on Compressed Video Quality Assessment: Methods and Results [120.95863275142727]
  This paper presents the results of the Compressed Video Quality Assessment challenge, held in conjunction with the Advances in Image Manipulation (AIM) workshop at ECCV 2024. The challenge aimed to evaluate the performance of VQA methods on a diverse dataset of 459 videos encoded with 14 codecs of various compression standards.
  arXiv  Detail & Related papers  (2024-08-21T20:32:45Z)
• Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Model [56.03592388332793]
  We investigate the AIGC-VQA problem, considering both subjective and objective quality assessment perspectives.<n>For the subjective perspective, we construct the Large-scale Generated Video Quality assessment (LGVQ) dataset, consisting of 2,808 AIGC videos.<n>We evaluate the perceptual quality of AIGC videos from three critical dimensions: spatial quality, temporal quality, and text-video alignment.<n>We propose the Unify Generated Video Quality assessment (UGVQ) model, designed to accurately evaluate the multi-dimensional quality of AIGC videos.
  arXiv  Detail & Related papers  (2024-07-31T07:54:26Z)
• A FUNQUE Approach to the Quality Assessment of Compressed HDR Videos [36.26141980831573]
  State-of-the-art (SOTA) approach HDRMAX involves augmenting off-the-shelf video quality models, such as VMAF, with features computed on non-linearly transformed video frames. Here, we show that an efficient class of video quality prediction models named FUNQUE+ achieves higher HDR video quality prediction accuracy at lower computational cost.
  arXiv  Detail & Related papers  (2023-12-13T21:24:00Z)
• HIDRO-VQA: High Dynamic Range Oracle for Video Quality Assessment [36.1179702443845]
  We introduce HIDRO-VQA, a no-reference (NR) video quality assessment model designed to provide precise quality evaluations of High Dynamic Range () videos. Our findings demonstrate that self-supervised pre-trained neural networks can be further fine-tuned in a self-supervised setting to achieve state-of-the-art performance. Our algorithm can be extended to the Full Reference VQA setting, also achieving state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-11-18T12:33:19Z)
• Making Video Quality Assessment Models Robust to Bit Depth [38.504568225201915]
  We introduce a novel feature set, which we call HDRMAX features, that when included into Video Quality Assessment (VQA) algorithms, sensitizes them to distortions of High Dynamic Range (SDR) videos. While these features are not specific to HDR, and also augment the equality prediction performances of VQA models on SDR content, they are especially effective on HDR. As a demonstration of the efficacy of our approach, we show that, while current state-of-the-art VQA models perform poorly on 10-bit HDR databases, their performances are greatly improved by the inclusion of HDRMAX features when tested on
  arXiv  Detail & Related papers  (2023-04-25T18:54:28Z)
• AIM 2020 Challenge on Video Temporal Super-Resolution [118.46127362093135]
  Second AIM challenge on Video Temporal Super-Resolution (VTSR) This paper reports the second AIM challenge on Video Temporal Super-Resolution (VTSR)
  arXiv  Detail & Related papers  (2020-09-28T00:10:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.