Differentiable Voronoi Ray Tracing Beyond Rasterization Speeds

• URL: http://arxiv.org/abs/2608.17682v1
• Date: Tue, 18 Aug 2026 11:55:58 GMT
• Title: Differentiable Voronoi Ray Tracing Beyond Rasterization Speeds
• Abstract summary: Real-time novel view synthesis is dominated by explicit primitives.<n>These primitives require specialized extensions for non-pinhole effects such as distortion, rolling shutter, and depth of field.<n>Ray-based rendering expresses these effects naturally but is generally assumed too slow for competitive real-time rendering.<n>We introduce VoroTracing, which co-designs the scene representation, optimization, and GPU execution to reduce these costs.
• Score: 14.722946445988262
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Real-time novel view synthesis is dominated by rasterized explicit primitives. These projection-based pipelines provide high throughput but require specialized extensions for non-pinhole effects such as distortion, rolling shutter, and depth of field. Ray-based rendering expresses these effects naturally but is generally assumed too slow for competitive real-time rendering. We analyze the factors governing throughput in differentiable Voronoi ray tracing and identify traversal length, per-cell work, and memory locality as principal determinants. Guided by this, we introduce VoroTracing, which co-designs the scene representation, optimization, and GPU execution to reduce these costs. Compact octahedral appearance textures reduce memory traffic, while surface-concentrated opacity promotes early termination. The fixed-budget representation is optimized without pruning or densification and rendered with a GPU implementation designed for coherent traversal. On Mip-NeRF 360, VoroTracing renders at 623 FPS on an RTX 5090, providing $3.2\times$ the throughput of the fastest prior ray-based method and $2.8\times$ that of 3D Gaussian Splatting, while maintaining competitive reconstruction quality. Our renderer supports fisheye, rolling-shutter, motion-blur, and depth-of-field effects through ray generation and sampling, requiring no specialized rasterization. These results show that real-time throughput can be achieved with the flexibility of ray-based rendering. We release our source code, see https://research.zenseact.com/publications/vorotracing

Related papers

• ConeGaussian: Anti-Aliased Gaussian Ray-Tracing for Generic Central Cameras [56.46810752790842]
  We present ConeGaussian, a camera-model-agnostic anti-aliasing framework for Gaussian ray-based rendering.<n>We derive a closed-form response under a locally linear, depth-local, moment-matched approximation of the finite pixel footprint.<n>Unlike in mip-splatting, our scene-space frequency floor and filtering enable trivial composition at render time, allowing us to remove excess blurring.
  arXiv  Detail & Related papers  (2026-09-11T18:05:07Z)
• 3D Gaussian Accelerated Ray Tracing: Fast training through particle-based backward propagation [0.00270839927451854]
  We present 3DGART, a practical training framework for ray-traced Gaussian rendering.<n>Our key idea is to reorganise backward propagation around primitives rather than pixels.<n>On Mip-NeRF 360, 3DGART achieves an $approx 3-3.5times$ raw training speedup over per-pixel baseline.
  arXiv  Detail & Related papers  (2026-08-18T02:50:46Z)
• RAP: 3D Rasterization Augmented End-to-End Planning [104.52778241744522]
  Imitation learning for end-to-end driving trains policies only on expert demonstrations.<n>We propose 3D Rasterization, which replaces costly rendering with lightweightization of annotated primitives.<n>RAP achieves state-of-the-art closed-loop and long-tail robustness, ranking first on four major benchmarks.
  arXiv  Detail & Related papers  (2025-10-05T19:31:24Z)
• 3DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splatting [15.124165321341646]
  We propose 3D Gaussian Unscented Transform (3DGUT), replacing the EWA splatting splatting with the Unscented Transform.<n>This enables the support of distorted time dependent effects such as rolling shutter, while retaining the efficiency of trivialization.
  arXiv  Detail & Related papers  (2024-12-17T03:21:25Z)
• Speedy-Splat: Fast 3D Gaussian Splatting with Sparse Pixels and Sparse Primitives [60.217580865237835]
  3D Gaussian Splatting (3D-GS) is a recent 3D scene reconstruction technique that enables real-time rendering of novel views by modeling scenes as parametric point clouds of differentiable 3D Gaussians.<n>We identify and address two key inefficiencies in 3D-GS to substantially improve rendering speed.<n>Our Speedy-Splat approach combines these techniques to accelerate average rendering speed by a drastic $mathit6.71times$ across scenes from the Mip-NeRF 360, Tanks & Temples, and Deep Blending datasets.
  arXiv  Detail & Related papers  (2024-11-30T20:25:56Z)
• ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splattings [48.72040500647568]
  We present ODGS, a novelization pipeline for omnidirectional images, with geometric interpretation. The entire pipeline is parallelized using, achieving optimization and speeds 100 times faster than NeRF-based methods. Results show ODGS restores fine details effectively, even when reconstructing large 3D scenes.
  arXiv  Detail & Related papers  (2024-10-28T02:45:13Z)
• EVER: Exact Volumetric Ellipsoid Rendering for Real-time View Synthesis [72.53316783628803]
  We present Exact Volumetric Ellipsoid Rendering (EVER), a method for real-time differentiable emission-only volume rendering.<n>Unlike recentization based approach by 3D Gaussian Splatting (3DGS), our primitive based representation allows for exact volume rendering.<n>We show that our method is more accurate with blending issues than 3DGS and follow-up work on view rendering.
  arXiv  Detail & Related papers  (2024-10-02T17:59:09Z)
• 3D Gaussian Ray Tracing: Fast Tracing of Particle Scenes [50.36933474990516]
  This work considers ray tracing the particles, building a bounding volume hierarchy and casting a ray for each pixel using high-performance ray tracing hardware. To efficiently handle large numbers of semi-transparent particles, we describe a specialized algorithm which encapsulates particles with bounding meshes. Experiments demonstrate the speed and accuracy of our approach, as well as several applications in computer graphics and vision.
  arXiv  Detail & Related papers  (2024-07-09T17:59:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.