Filtering After Shading With Stochastic Texture Filtering

• URL: http://arxiv.org/abs/2407.06107v1
• Date: Tue, 14 May 2024 16:42:07 GMT
• Title: Filtering After Shading With Stochastic Texture Filtering
• Authors: Matt Pharr, Bartlomiej Wronski, Marco Salvi, Marcos Fajardo,
• Abstract summary: We show that applying the texture filter after evaluating shading generally gives more accurate imagery than filtering before BSDF evaluation. texture filtering offers additional benefits, including efficient implementation of high-quality texture filters and efficient filtering of textures stored in compressed and sparse data structures.
• Score: 1.8377890861896995
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: 2D texture maps and 3D voxel arrays are widely used to add rich detail to the surfaces and volumes of rendered scenes, and filtered texture lookups are integral to producing high-quality imagery. We show that applying the texture filter after evaluating shading generally gives more accurate imagery than filtering textures before BSDF evaluation, as is current practice. These benefits are not merely theoretical, but are apparent in common cases. We demonstrate that practical and efficient filtering after shading is possible through the use of stochastic sampling of texture filters. Stochastic texture filtering offers additional benefits, including efficient implementation of high-quality texture filters and efficient filtering of textures stored in compressed and sparse data structures, including neural representations. We demonstrate applications in both real-time and offline rendering and show that the additional error from stochastic filtering is minimal. We find that this error is handled well by either spatiotemporal denoising or moderate pixel sampling rates.

Related papers

• Improved Stochastic Texture Filtering Through Sample Reuse [1.9608359347635143]
  texture filtering (STF) has re-emerged as a technique that can bring down the cost of texture filtering of advanced texture compression methods. During texture magnification, the swapped order of filtering and shading with STF can result in aliasing. We present a novel method to improve the quality of textureally-filtered magnified textures and reduce the image difference.
  arXiv  Detail & Related papers  (2025-04-07T23:28:52Z)
• NeRF-Texture: Synthesizing Neural Radiance Field Textures [77.24205024987414]
  We propose a novel texture synthesis method with Neural Radiance Fields (NeRF) to capture and synthesize textures from given multi-view images. In the proposed NeRF texture representation, a scene with fine geometric details is disentangled into the meso-structure textures and the underlying base shape. We can synthesize NeRF-based textures through patch matching of latent features.
  arXiv  Detail & Related papers  (2024-12-13T09:41:48Z)
• TEXGen: a Generative Diffusion Model for Mesh Textures [63.43159148394021]
  We focus on the fundamental problem of learning in the UV texture space itself. We propose a scalable network architecture that interleaves convolutions on UV maps with attention layers on point clouds. We train a 700 million parameter diffusion model that can generate UV texture maps guided by text prompts and single-view images.
  arXiv  Detail & Related papers  (2024-11-22T05:22:11Z)
• Empirical curvelet based Fully Convolutional Network for supervised texture image segmentation [2.780132626494265]
  We propose a new approach to perform supervised texture classification/segmentation. The proposed idea is to feed a Fully Convolutional Network with specific texture descriptors. Our approach is evaluated on several datasets and compare the results to various state-of-the-art algorithms.
  arXiv  Detail & Related papers  (2024-10-28T21:49:40Z)
• Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Rendering [47.78392889256976]
  Paint-it is a text-driven high-fidelity texture map synthesis method for 3D rendering. Paint-it synthesizes texture maps from a text description by synthesis-through-optimization, exploiting the Score-Distillation Sampling (SDS) We show that DC-PBR inherently schedules the optimization curriculum according to texture frequency and naturally filters out the noisy signals from SDS.
  arXiv  Detail & Related papers  (2023-12-18T17:17:08Z)
• Pyramid Texture Filtering [86.15126028139736]
  We present a simple but effective technique to smooth out textures while preserving the prominent structures. Our method is built upon a key observation -- the coarsest level in a Gaussian pyramid often naturally eliminates textures and summarizes the main image structures. We show that our approach is effective to separate structure from texture of different scales, local contrasts, and forms, without degrading structures or introducing visual artifacts.
  arXiv  Detail & Related papers  (2023-05-11T02:05:30Z)
• Stochastic Texture Filtering [3.4202659118354104]
  Filtered texture lookups are integral to producing high-quality imagery. We show that filtering after evaluating lighting, rather than before BSDF evaluation as is current practice, gives a more accurate solution to the rendering equation. We demonstrate applications in both real-time and offline rendering and show that the additional error is minimal.
  arXiv  Detail & Related papers  (2023-05-09T23:50:25Z)
• Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement [78.48648360358193]
  We present a novel framework that generates textured surface meshes from images. Our approach begins by efficiently initializing the geometry and view-dependency appearance with a NeRF. We jointly refine the appearance with geometry and bake it into texture images for real-time rendering.
  arXiv  Detail & Related papers  (2023-03-03T17:14:44Z)
• FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstruction [46.3392612457273]
  This dataset contains over 50,000 high-quality texture UV-maps with even illuminations, neutral expressions, and cleaned facial regions. Our pipeline utilizes the recent advances in StyleGAN-based facial image editing approaches. Experiments show that our method improves the reconstruction accuracy over state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-11-25T03:21:05Z)
• Image Edge Restoring Filter [4.060948640328565]
  We propose the image Edge Restoring Filter (ERF) to restore the blur edge pixels in the output of local smoothing filters to be clear. The proposed filter can been implemented after many local smoothing filter.
  arXiv  Detail & Related papers  (2021-12-27T07:02:01Z)
• Unsharp Mask Guided Filtering [53.14430987860308]
  The goal of this paper is guided image filtering, which emphasizes the importance of structure transfer during filtering. We propose a new and simplified formulation of the guided filter inspired by unsharp masking. Our formulation enjoys a filtering prior to a low-pass filter and enables explicit structure transfer by estimating a single coefficient.
  arXiv  Detail & Related papers  (2021-06-02T19:15:34Z)
• Adaptive Debanding Filter [55.42929350861115]
  Banding artifacts manifest as staircase-like color bands on pictures or video frames. We propose a content-adaptive smoothing filtering followed by dithered quantization, as a post-processing module. Experimental results show that our proposed debanding filter outperforms state-of-the-art false contour removing algorithms both visually and quantitatively.
  arXiv  Detail & Related papers  (2020-09-22T20:44:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.