NTIRE 2026 The 3rd Restore Any Image Model (RAIM) Challenge: Professional Image Quality Assessment (Track 1)

• URL: http://arxiv.org/abs/2604.12512v1
• Date: Tue, 14 Apr 2026 09:44:35 GMT
• Title: NTIRE 2026 The 3rd Restore Any Image Model (RAIM) Challenge: Professional Image Quality Assessment (Track 1)
• Abstract summary: We present an overview of the NTIRE 2026 challenge on the 3rd Restore Any Image Model in the Wild, specifically focusing on Track 1.<n>In total, the challenge attracted nearly 200 registrations and over 2,500 submissions.<n>The top-performing methods significantly advanced the state of the art in professional IQA.
• Score: 115.35873876159131
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: In this paper, we present an overview of the NTIRE 2026 challenge on the 3rd Restore Any Image Model in the Wild, specifically focusing on Track 1: Professional Image Quality Assessment. Conventional Image Quality Assessment (IQA) typically relies on scalar scores. By compressing complex visual characteristics into a single number, these methods fundamentally struggle to distinguish subtle differences among uniformly high-quality images. Furthermore, they fail to articulate why one image is superior, lacking the reasoning capabilities required to provide guidance for vision tasks. To bridge this gap, recent advancements in Multimodal Large Language Models (MLLMs) offer a promising paradigm. Inspired by this potential, our challenge establishes a novel benchmark exploring the ability of MLLMs to mimic human expert cognition in evaluating high-quality image pairs. Participants were tasked with overcoming critical bottlenecks in professional scenarios, centering on two primary objectives: (1) Comparative Quality Selection: reliably identifying the visually superior image within a high-quality pair; and (2) Interpretative Reasoning: generating grounded, expert-level explanations that detail the rationale behind the selection. In total, the challenge attracted nearly 200 registrations and over 2,500 submissions. The top-performing methods significantly advanced the state of the art in professional IQA. The challenge dataset is available at https://github.com/narthchin/RAIM-PIQA, and the official homepage is accessible at https://www.codabench.org/competitions/12789/.

Related papers

• Visual Aesthetic Benchmark: Can Frontier Models Judge Beauty? [59.923111838399144]
  We introduce the Visual Aesthetic Benchmark (VAB), which casts aesthetic evaluation as comparative selection over candidate sets with matched subject matter.<n>VAB contains 400 tasks and 1,195 images across fine art, photography, and illustration, with labels derived from the consensus of 10 independent expert judges per task.<n>We find that the strongest system identifies both the best and the worst image correctly across three random permutations of the candidate order in only 26.5% of tasks, far below the 68.9% achieved by human experts.
  arXiv  Detail & Related papers  (2026-05-12T19:33:28Z)
• NTIRE 2026 The 3rd Restore Any Image Model (RAIM) Challenge: AI Flash Portrait (Track 3) [127.69044386248355]
  We present a comprehensive overview of the NTIRE 2026 3rd Restore Any Image Model (RAIM) challenge.<n>This challenge aims to establish a novel benchmark for real-world low-light portrait restoration.<n>This report details the motivation behind the challenge, the dataset construction process, the evaluation metrics, and the various phases of the competition.
  arXiv  Detail & Related papers  (2026-04-13T09:30:56Z)
• Q-Bench-Portrait: Benchmarking Multimodal Large Language Models on Portrait Image Quality Perception [101.76154325436544]
  multimodal large language models (MLLMs) have demonstrated impressive performance on existing low-level vision benchmarks.<n>We introduce Q-Bench-Portrait, the first holistic benchmark specifically designed for portrait image quality perception.
  arXiv  Detail & Related papers  (2026-01-26T10:37:20Z)
• VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models: Methods and Results [106.15762208088985]
  VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models hosted as part of ICCV 2025 Workshop on Visual Quality Assessment.<n>Challenge aims to evaluate and enhance the ability of state-of-the-art LMMs to perform open-ended and detailed reasoning about visual quality differences across multiple images.<n>Around 100 participants submitted entries, with five models demonstrating the emerging capabilities of instruction-tuned LMMs on quality assessment.
  arXiv  Detail & Related papers  (2025-09-11T07:00:50Z)
• VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rank [30.316630325648834]
  We introduce VisualQuality-R1, a reasoning-induced no-reference IQA (NR-IQA) model, and we train it with reinforcement learning to rank.<n>We show that VisualQuality-R1 consistently outperforms discriminative deep learning-based NR-IQA models.<n>VisualQuality-R1 is capable of generating contextually rich, human-aligned quality descriptions.
  arXiv  Detail & Related papers  (2025-05-20T14:56:50Z)
• Next Token Is Enough: Realistic Image Quality and Aesthetic Scoring with Multimodal Large Language Model [19.2881640541533]
  Large language models (MLLMs) have shown great potential in image quality assessment (IQA) and image aesthetic assessment (IAA)<n>Here, we introduce a novel dataset, named Realistic image Quality and Aesthetic (RealQA)<n>These attributes span three levels: low level (e.g., image clarity), middle level (e.g., subject integrity) and high level (e.g. composition)<n>Surprisingly, by predicting just two extra significant digits, the next token paradigm can achieve SOTA performance.
  arXiv  Detail & Related papers  (2025-03-08T09:49:10Z)
• M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessment [65.3860007085689]
  M3-AGIQA is a comprehensive framework that enables more human-aligned, holistic evaluation of AI-generated images.<n>By aligning model outputs more closely with human judgment, M3-AGIQA delivers robust and interpretable quality scores.
  arXiv  Detail & Related papers  (2025-02-21T03:05:45Z)
• UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessment [4.563959812257119]
  We introduce a novel Image Quality Assessment dataset comprising 6073 UHD-1 (4K) images, annotated at a fixed width of 3840 pixels. Ours focuses on highly aesthetic photos of high technical quality, filling a gap in the literature. The dataset is annotated with perceptual quality ratings obtained through a crowdsourcing study.
  arXiv  Detail & Related papers  (2024-06-25T11:30:31Z)
• Surveillance Face Anti-spoofing [81.50018853811895]
  Face Anti-spoofing (FAS) is essential to secure face recognition systems from various physical attacks. We propose a Contrastive Quality-Invariance Learning (CQIL) network to alleviate the performance degradation caused by image quality. A large number of experiments verify the quality of the SuHiFiMask dataset and the superiority of the proposed CQIL.
  arXiv  Detail & Related papers  (2023-01-03T07:09:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.