Real-Time 4K Super-Resolution of Compressed AVIF Images. AIS 2024 Challenge Survey

• URL: http://arxiv.org/abs/2404.16484v1
• Date: Thu, 25 Apr 2024 10:12:42 GMT
• Title: Real-Time 4K Super-Resolution of Compressed AVIF Images. AIS 2024 Challenge Survey
• Abstract summary: This paper introduces a novel benchmark as part of the AIS 2024 Real-Time Image Super-Resolution Challenge. It aims to upscale compressed images from 540p to 4K resolution in real-time on commercial GPUs. We use a diverse test set containing a variety of 4K images ranging from digital art to gaming and photography.
• Score: 116.29700317843043
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This paper introduces a novel benchmark as part of the AIS 2024 Real-Time Image Super-Resolution (RTSR) Challenge, which aims to upscale compressed images from 540p to 4K resolution (4x factor) in real-time on commercial GPUs. For this, we use a diverse test set containing a variety of 4K images ranging from digital art to gaming and photography. The images are compressed using the modern AVIF codec, instead of JPEG. All the proposed methods improve PSNR fidelity over Lanczos interpolation, and process images under 10ms. Out of the 160 participants, 25 teams submitted their code and models. The solutions present novel designs tailored for memory-efficiency and runtime on edge devices. This survey describes the best solutions for real-time SR of compressed high-resolution images.

Related papers

• VINS-120K: Ultra High-Resolution Image Editing with A Large-Scale Dataset [35.077683100413076]
  We introduce VINS-120K, the first large-scale dataset for instruction-based UHR image editing.<n>We develop a high-frequency-aware post-adaptation strategy to extend pretrained non-high-resolution models to the UHR regime.<n>Experiments confirm that our work improves fine-grained detail synthesis and texture realism in UHR image editing.
  arXiv  Detail & Related papers  (2026-05-22T11:33:43Z)
• REDUCIO! Generating 1024$\times$1024 Video within 16 Seconds using Extremely Compressed Motion Latents [110.41795676048835]
  One crucial obstacle for large-scale applications is the expensive training and inference cost. In this paper, we argue that videos contain much more redundant information than images, thus can be encoded by very few motion latents. We train Reducio-DiT in around 3.2K training hours in total and generate a 16-frame 1024*1024 video clip within 15.5 seconds on a single A100 GPU.
  arXiv  Detail & Related papers  (2024-11-20T18:59:52Z)
• RTSR: A Real-Time Super-Resolution Model for AV1 Compressed Content [10.569678424799616]
  Super-resolution (SR) is a key technique for improving the visual quality of video content. To support real-time playback, it is important to implement fast SR models while preserving reconstruction quality. This paper proposes a low-complexity SR method, RTSR, designed to enhance the visual quality of compressed video content.
  arXiv  Detail & Related papers  (2024-11-20T14:36:06Z)
• AIM 2024 Challenge on Efficient Video Super-Resolution for AV1 Compressed Content [56.552444900457395]
  Video super-resolution (VSR) is a critical task for enhancing low-bitrate and low-resolution videos, particularly in streaming applications. In this work, we compile different methods to address these challenges, the solutions are end-to-end real-time video super-resolution frameworks. The proposed solutions tackle video up-scaling for two applications: 540p to 4K (x4) as a general case, and 360p to 1080p (x3) more tailored towards mobile devices.
  arXiv  Detail & Related papers  (2024-09-25T18:12:19Z)
• 4K4D: Real-Time 4D View Synthesis at 4K Resolution [86.6582179227016]
  This paper targets high-fidelity and real-time view of dynamic 3D scenes at 4K resolution. We propose a 4D point cloud representation that supports hardwareization and enables unprecedented rendering speed. Our representation can be rendered at over 400 FPS on the DNA-Rendering dataset at 1080p resolution and 80 FPS on the ENeRF-Outdoor dataset at 4K resolution using an 4090 GPU.
  arXiv  Detail & Related papers  (2023-10-17T17:57:38Z)
• AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutions [32.85522513271578]
  We propose a fast and lightweight super-resolution network to achieve real-time performance. By analyzing the applications of divide-and-conquer in super-resolution, we propose assembled convolutions which can adapt convolution kernels according to the input features. Our method also wins the first place in NTIRE 2023 Real-Time Super-Resolution - Track 1.
  arXiv  Detail & Related papers  (2023-05-05T09:33:34Z)
• 4K-HAZE: A Dehazing Benchmark with 4K Resolution Hazy and Haze-Free Images [12.402054374952485]
  We develop a novel method to simulate 4K hazy images from clear images, which first estimates the scene depth, simulates the light rays and object reflectance, then migrates the synthetic images to real domains by using a GAN. We wrap these synthesized images into a benchmark called the 4K-HAZE dataset. The most appealing aspect of our approach is the capability to run a 4K image on a single GPU with 24G RAM in real-time (33fps)
  arXiv  Detail & Related papers  (2023-03-28T09:39:29Z)
• CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Querying [52.91778151771145]
  In this paper, we try to break the limitations for the first time thanks to the recent development of continuous implicit representation. Experiments show that the proposed method achieves real-time performance on the 2048$times$2048 images using a single GTX 2080 Ti GPU.
  arXiv  Detail & Related papers  (2023-03-15T11:13:51Z)
• Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireing [71.62289021118983]
  We present an efficient baseline model ESDNet for tackling 4K moire images, wherein we build a semantic-aligned scale-aware module to address the scale variation of moire patterns. Our approach outperforms state-of-the-art methods by a large margin while being much more lightweight.
  arXiv  Detail & Related papers  (2022-07-20T14:20:52Z)
• ORStereo: Occlusion-Aware Recurrent Stereo Matching for 4K-Resolution Images [13.508624751092654]
  We present the Occlusion-aware Recurrent binocular Stereo matching (ORStereo) ORStereo generalizes to unseen high-resolution images with large disparity ranges by formulating the task as residual updates and refinements of an initial prediction. We test the model's capability on both synthetic and real-world high-resolution images.
  arXiv  Detail & Related papers  (2021-03-13T21:46:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.