Auxiliary Features-Guided Super Resolution for Monte Carlo Rendering

• URL: http://arxiv.org/abs/2310.13235v1
• Date: Fri, 20 Oct 2023 02:45:13 GMT
• Title: Auxiliary Features-Guided Super Resolution for Monte Carlo Rendering
• Authors: Qiqi Hou, Feng Liu
• Abstract summary: Super resolution to reduce the number of pixels to render and thus speed up Monte Carlo rendering algorithms. We exploit high-resolution auxiliary features to guide super resolution of low-resolution renderings. Our experiments show that our auxiliary features-guided super-resolution method outperforms both super-resolution methods and Monte Carlo denoising methods in producing high-quality renderings.
• Score: 8.54858933529271
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper investigates super resolution to reduce the number of pixels to render and thus speed up Monte Carlo rendering algorithms. While great progress has been made to super resolution technologies, it is essentially an ill-posed problem and cannot recover high-frequency details in renderings. To address this problem, we exploit high-resolution auxiliary features to guide super resolution of low-resolution renderings. These high-resolution auxiliary features can be quickly rendered by a rendering engine and at the same time provide valuable high-frequency details to assist super resolution. To this end, we develop a cross-modality Transformer network that consists of an auxiliary feature branch and a low-resolution rendering branch. These two branches are designed to fuse high-resolution auxiliary features with the corresponding low-resolution rendering. Furthermore, we design residual densely-connected Swin Transformer groups to learn to extract representative features to enable high-quality super-resolution. Our experiments show that our auxiliary features-guided super-resolution method outperforms both super-resolution methods and Monte Carlo denoising methods in producing high-quality renderings.

Related papers

• Efficient Face Super-Resolution via Wavelet-based Feature Enhancement Network [27.902725520665133]
  Face super-resolution aims to reconstruct a high-resolution face image from a low-resolution face image. Previous methods typically employ an encoder-decoder structure to extract facial structural features. We propose a wavelet-based feature enhancement network, which mitigates feature distortion by losslessly decomposing the input feature into high and low-frequency components.
  arXiv  Detail & Related papers  (2024-07-29T08:03:33Z)
• ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance [46.64836025290448]
  ResMaster is a training-free method that empowers resolution-limited diffusion models to generate high-quality images beyond resolution restrictions. It provides structural and fine-grained guidance for crafting high-resolution images on a patch-by-patch basis. Experiments validate that ResMaster sets a new benchmark for high-resolution image generation and demonstrates promising efficiency.
  arXiv  Detail & Related papers  (2024-06-24T09:28:21Z)
• FuseSR: Super Resolution for Real-time Rendering through Efficient Multi-resolution Fusion [38.67110413800048]
  One of the most popular solutions is to render images at a low resolution to reduce rendering overhead. In this paper, we propose an efficient and effective super-resolution method that predicts high-quality upsampled reconstructions. Experiments show that our method is able to produce temporally consistent reconstructions in $4 times 4$ and even challenging $8 times 8$ upsampling cases at 4K resolution with real-time performance.
  arXiv  Detail & Related papers  (2023-10-15T04:01:05Z)
• Super-Resolving Face Image by Facial Parsing Information [52.1267613768555]
  Face super-resolution is a technology that transforms a low-resolution face image into the corresponding high-resolution one. We build a novel parsing map guided face super-resolution network which extracts the face prior from low-resolution face image. High-resolution features contain more precise spatial information while low-resolution features provide strong contextual information.
  arXiv  Detail & Related papers  (2023-04-06T08:19:03Z)
• Deep Learning based Super-Resolution for Medical Volume Visualization with Direct Volume Rendering [0.0]
  Recent advances in deep learning-based image and video super-resolution techniques motivate us to investigate such networks for high-fidelity upscaling of frames rendered at a lower resolution to a higher resolution. We propose a technique where our proposed system uses color information along with other medical features gathered from our volume to learn efficient upscaling of a low-resolution rendering to a higher-resolution space.
  arXiv  Detail & Related papers  (2022-10-14T19:58:59Z)
• Semi-Supervised Super-Resolution [30.872605139672086]
  Super-Resolution is the technique to improve the quality of a low-resolution photo by boosting its plausible resolution. Previous Super-Resolution methods require vast amounts of data for training which becomes problematic in domains where very few low-resolution, high-resolution pairs might be available. This paper introduces a semi-supervised way to perform super-resolution that can generate sharp, high-resolution images with as few as 500 paired examples.
  arXiv  Detail & Related papers  (2022-04-18T07:10:29Z)
• Hybrid Pixel-Unshuffled Network for Lightweight Image Super-Resolution [64.54162195322246]
  Convolutional neural network (CNN) has achieved great success on image super-resolution (SR) Most deep CNN-based SR models take massive computations to obtain high performance. We propose a novel Hybrid Pixel-Unshuffled Network (HPUN) by introducing an efficient and effective downsampling module into the SR task.
  arXiv  Detail & Related papers  (2022-03-16T20:10:41Z)
• Generating Superpixels for High-resolution Images with Decoupled Patch Calibration [82.21559299694555]
  Patch Networks (PCNet) is designed to efficiently and accurately implement high-resolution superpixel segmentation. DPC takes a local patch from the high-resolution images and dynamically generates a binary mask to impose the network to focus on region boundaries. In particular, DPC takes a local patch from the high-resolution images and dynamically generates a binary mask to impose the network to focus on region boundaries.
  arXiv  Detail & Related papers  (2021-08-19T10:33:05Z)
• Fast Monte Carlo Rendering via Multi-Resolution Sampling [6.203886925467029]
  We present a hybrid rendering method to speed up Monte Carlo rendering algorithms. Our method generates two versions of a rendering: one at a low resolution with a high sample rate (LRHS) and the other at a high resolution with a low sample rate (HRLS)
  arXiv  Detail & Related papers  (2021-06-24T07:35:27Z)
• Interpretable Detail-Fidelity Attention Network for Single Image Super-Resolution [89.1947690981471]
  We propose a purposeful and interpretable detail-fidelity attention network to progressively process smoothes and details in divide-and-conquer manner. Particularly, we propose a Hessian filtering for interpretable feature representation which is high-profile for detail inference. Experiments demonstrate that the proposed methods achieve superior performances over the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-09-28T08:31:23Z)
• Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
  We propose a dual-branch convolutional neural network to extract base features and recovered features separately. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
  arXiv  Detail & Related papers  (2020-03-02T13:28:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.