Streaming of rendered content with adaptive frame rate and resolution

• URL: http://arxiv.org/abs/2605.10995v1
• Date: Sat, 09 May 2026 14:48:10 GMT
• Title: Streaming of rendered content with adaptive frame rate and resolution
• Abstract summary: Existing solutions render content on a server at a fixed frame rate, typically 30 or 60 frames per second, and reduce resolution when bandwidth is restricted.<n>We exploit limits of human visual system to improve perceived quality while reducing rendering costs by adaptively adjusting both frame rate and resolution based on scene content and motion.<n>We propose a system in which a lightweight neural network predicts the optimal combination of frame rate and resolution for a given transmission bandwidth, content and motion velocity.
• Score: 6.34507331016388
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Streaming rendered content is an attractive way to bring high-quality graphics to billions of mobile devices that do not have sufficient rendering power. Existing solutions render content on a server at a fixed frame rate, typically 30 or 60 frames per second, and reduce resolution when bandwidth is restricted. However, this strategy leads to suboptimal rendering quality under the bandwidth constraints. In this work, we exploit the spatio-temporal limits of the human visual system to improve perceived quality while reducing rendering costs by adaptively adjusting both frame rate and resolution based on scene content and motion. Our approach is codec-agnostic and requires only minimal modifications to existing rendering infrastructure. We propose a system in which a lightweight neural network predicts the optimal combination of frame rate and resolution for a given transmission bandwidth, content, and motion velocity. This prediction significantly enhances perceptual quality while minimizing computational cost under bandwidth constraints. The network is trained on a large dataset of rendered content labeled with a perceptual video quality metric. The dataset and further information can be found at the project web page: https://www.cl.cam.ac.uk/research/rainbow/projects/adaptive_streaming/.

Related papers

• Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions [69.01904860240938]
  Ultra Flash is a cascaded streaming framework capable of real-time high-resolution video generation.<n>It produces ultra-high-resolution streaming video while maintaining state-of-the-art visual quality and superior efficiency.
  arXiv  Detail & Related papers  (2026-06-08T07:45:03Z)
• BADiff: Bandwidth Adaptive Diffusion Model [55.10134744772338]
  Traditional diffusion models produce high-fidelity images by performing a fixed number of denoising steps, regardless of downstream transmission limitations.<n>In practical cloud-to-device scenarios, limited bandwidth often necessitates heavy compression, leading to loss of fine textures and wasted computation.<n>We introduce a joint end-to-end training strategy where the diffusion model is conditioned on a target quality level derived from the available bandwidth.
  arXiv  Detail & Related papers  (2025-10-24T11:50:03Z)
• Plug-and-Play Versatile Compressed Video Enhancement [57.62582951699999]
  Video compression effectively reduces the size of files, making it possible for real-time cloud computing.<n>However, it comes at the cost of visual quality, challenges the robustness of downstream vision models.<n>We present a versatile-aware enhancement framework that adaptively enhance videos under different compression settings.
  arXiv  Detail & Related papers  (2025-04-21T18:39:31Z)
• VoLUT: Efficient Volumetric streaming enhanced by LUT-based super-resolution [25.1343065912991]
  3D volumetric video provides immersive experience and is gaining traction in digital media.<n>Streaming of volumetric video content poses significant challenges due to the high data bandwidth requirement.<n>A natural approach to mitigate the bandwidth issue is to reduce the volumetric video's data rate by downsampling the content prior to transmission.<n>We have developed VoLUT with a new SR algorithm specifically designed for volumetric content.
  arXiv  Detail & Related papers  (2025-02-17T18:59:03Z)
• Adaptive Caching for Faster Video Generation with Diffusion Transformers [52.73348147077075]
  Diffusion Transformers (DiTs) rely on larger models and heavier attention mechanisms, resulting in slower inference speeds. We introduce a training-free method to accelerate video DiTs, termed Adaptive Caching (AdaCache) We also introduce a Motion Regularization (MoReg) scheme to utilize video information within AdaCache, controlling the compute allocation based on motion content.
  arXiv  Detail & Related papers  (2024-11-04T18:59:44Z)
• DeformStream: Deformation-based Adaptive Volumetric Video Streaming [4.366356163044466]
  Volumetric video streaming offers immersive 3D experiences but faces significant challenges due to high bandwidth requirements and latency issues. We introduce Deformation-based Adaptive Volumetric Video Streaming, a novel framework that enhances volumetric video streaming performance by leveraging the inherent deformability of mesh-based representations.
  arXiv  Detail & Related papers  (2024-09-25T04:43:59Z)
• Promptus: Can Prompts Streaming Replace Video Streaming with Stable Diffusion [6.093768205619601]
  We propose Promptus, a disruptive communication system that streaming prompts instead of video content.<n>It represents real-world video frames with a series of "prompts" for delivery and employs Stable Diffusion to generate videos at the receiver.<n>Our work opens up a new paradigm for efficient video communication.
  arXiv  Detail & Related papers  (2024-05-30T13:16:48Z)
• Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting [27.302681897961588]
  Deep convolutional neural networks (DNNs) are widely used in various fields of computer vision. We propose a novel method for high-quality and efficient video resolution upscaling tasks. We deploy our models on an off-the-shelf mobile phone, and experimental results show that our method achieves real-time video super-resolution with high video quality.
  arXiv  Detail & Related papers  (2023-03-15T02:40:02Z)
• FAVER: Blind Quality Prediction of Variable Frame Rate Videos [47.951054608064126]
  Video quality assessment (VQA) remains an important and challenging problem that affects many applications at the widest scales. We propose a first-of-a-kind blind VQA model for evaluating HFR videos, which we dub the Framerate-Aware Video Evaluator w/o Reference (FAVER) Our experiments on several HFR video quality datasets show that FAVER outperforms other blind VQA algorithms at a reasonable computational cost.
  arXiv  Detail & Related papers  (2022-01-05T07:54:12Z)
• Prediction-assistant Frame Super-Resolution for Video Streaming [40.60863957681011]
  We propose to enhance video quality using lossy frames in two situations. For the first case, we propose a small yet effective video frame prediction network. For the second case, we improve the video prediction network to associate current frames as well as previous frames to restore high-quality images.
  arXiv  Detail & Related papers  (2021-03-17T06:05:27Z)
• Deep Space-Time Video Upsampling Networks [47.62807427163614]
  Video super-resolution (VSR) and frame (FI) are traditional computer vision problems. We propose an end-to-end framework for the space-time video upsampling by efficiently merging VSR and FI into a joint framework. Results show better results both quantitatively and qualitatively, while reducing the time (x7 faster) and the number of parameters (30%) compared to baselines.
  arXiv  Detail & Related papers  (2020-04-06T07:04:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.