UTrice: Unifying Primitives in Differentiable Ray Tracing and Rasterization via Triangles for Particle-Based 3D Scenes

• URL: http://arxiv.org/abs/2512.04421v1
• Date: Thu, 04 Dec 2025 03:33:10 GMT
• Title: UTrice: Unifying Primitives in Differentiable Ray Tracing and Rasterization via Triangles for Particle-Based 3D Scenes
• Authors: Changhe Liu, Ehsan Javanmardi, Naren Bao, Alex Orsholits, Manabu Tsukada,
• Abstract summary: Ray tracing 3D Gaussian particles enables realistic effects such as depth of field refractions, and flexible camera modeling for novel-view rendering.<n>Existing methods trace Gaussians through triangle geometry, which requires constructing complex intermediate meshes and performing costly tests.<n>We propose a differentiable triangle-based ray tracing pipeline that treats triangles as rendering primitives without relying on any proxy geometry.
• Score: 1.633289883726582
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Ray tracing 3D Gaussian particles enables realistic effects such as depth of field, refractions, and flexible camera modeling for novel-view synthesis. However, existing methods trace Gaussians through proxy geometry, which requires constructing complex intermediate meshes and performing costly intersection tests. This limitation arises because Gaussian-based particles are not well suited as unified primitives for both ray tracing and rasterization. In this work, we propose a differentiable triangle-based ray tracing pipeline that directly treats triangles as rendering primitives without relying on any proxy geometry. Our results show that the proposed method achieves significantly higher rendering quality than existing ray tracing approaches while maintaining real-time rendering performance. Moreover, our pipeline can directly render triangles optimized by the rasterization-based method Triangle Splatting, thus unifying the primitives used in novel-view synthesis.

Related papers

• GRTX: Efficient Ray Tracing for 3D Gaussian-Based Rendering [4.541956402929217]
  We present GRTX, a set of software and hardware optimizations that enable efficient ray tracing for 3D Gaussian-based rendering.<n>First, we introduce a novel approach for constructing streamlined acceleration structures for Gaussian primitives.<n>Second, we propose dedicated hardware support for checkpointing within ray tracing units.<n>Our evaluation shows that GRTX significantly improves ray tracing performance compared to the baseline with a negligible hardware cost.
  arXiv  Detail & Related papers  (2026-01-28T09:37:12Z)
• Radiance Meshes for Volumetric Reconstruction [56.51690637804858]
  We introduce radiance meshes, a technique for representing radiance fields with constant density tetrahedral cells.<n>Our model is able to perform exact and fast volume rendering using both synthesisization and ray-tracing.<n>Our rendering method exactly evaluates the volume equation and enables high quality, real-time view on standard consumer hardware.
  arXiv  Detail & Related papers  (2025-12-03T18:57:03Z)
• Triangle Splatting+: Differentiable Rendering with Opaque Triangles [54.18495204764292]
  We introduce Triangle Splatting+, which directly optimize triangles within a differentiable splatting framework.<n>Our method surpasses prior splatting approaches in visual fidelity while remaining efficient and fast to training.<n>The resulting semi-connected meshes support downstream applications such as physics-based simulation or interactive walkthroughs.
  arXiv  Detail & Related papers  (2025-09-29T17:43:46Z)
• BG-Triangle: Bézier Gaussian Triangle for 3D Vectorization and Rendering [60.240908644910874]
  Differentiable rendering enables efficient optimization by allowing gradients to be computed through the rendering process.<n>Existing solutions approximate or re-formulate traditional rendering operations using smooth, probabilistic proxies.<n>We present a novel hybrid representation that combines B'ezier triangle-based vector graphics primitives with Gaussian-based probabilistic models.
  arXiv  Detail & Related papers  (2025-03-18T06:53:52Z)
• RaySplats: Ray Tracing based Gaussian Splatting [6.808029514985239]
  3D Gaussian Splatting (3DGS) is a process that enables the direct creation of 3D objects from 2D images.<n>This paper introduces RaySplats, a model that employs ray-tracing based Splatting.
  arXiv  Detail & Related papers  (2025-01-31T15:05:06Z)
• LinPrim: Linear Primitives for Differentiable Volumetric Rendering [51.56484100374058]
  We introduce two new scene representations based on linear primitives.<n>We present a different octaiableizer that runs efficiently on GPU.<n>We demonstrate comparable performance to state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-01-27T18:49:38Z)
• Triplet: Triangle Patchlet for Mesh-Based Inverse Rendering and Scene Parameters Approximation [0.0]
  inverse rendering seeks to derive the physical properties of a scene, including light, geometry, textures, and materials. Meshes, as a traditional representation adopted by many simulation pipeline, still show limited influence in radiance field for inverse rendering. This paper introduces a novel framework called Triangle Patchlet (abbr. Triplet), a mesh-based representation, to comprehensively approximate these parameters.
  arXiv  Detail & Related papers  (2024-10-16T09:59:11Z)
• 3D Gaussian Ray Tracing: Fast Tracing of Particle Scenes [50.36933474990516]
  This work considers ray tracing the particles, building a bounding volume hierarchy and casting a ray for each pixel using high-performance ray tracing hardware. To efficiently handle large numbers of semi-transparent particles, we describe a specialized algorithm which encapsulates particles with bounding meshes. Experiments demonstrate the speed and accuracy of our approach, as well as several applications in computer graphics and vision.
  arXiv  Detail & Related papers  (2024-07-09T17:59:30Z)
• Extracting Triangular 3D Models, Materials, and Lighting From Images [59.33666140713829]
  We present an efficient method for joint optimization of materials and lighting from multi-view image observations. We leverage meshes with spatially-varying materials and environment that can be deployed in any traditional graphics engine.
  arXiv  Detail & Related papers  (2021-11-24T13:58:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.