Thinking Like Van Gogh: Structure-Aware Style Transfer via Flow-Guided 3D Gaussian Splatting

• URL: http://arxiv.org/abs/2601.10075v1
• Date: Thu, 15 Jan 2026 05:00:02 GMT
• Title: Thinking Like Van Gogh: Structure-Aware Style Transfer via Flow-Guided 3D Gaussian Splatting
• Abstract summary: Most existing 3D style transfer methods treat geometry as a rigid substrate for surface-level texture projection.<n>We propose a flow-guided geometric advection framework that operationalizes this principle in a mesh-free setting.<n>Our contributions are threefold: (1) a projection-based, mesh-free flow guidance mechanism that transfers 2D artistic motion into 3D Gaussian geometry; (2) a luminance-structure decoupling strategy that isolates geometric deformation from color optimization; and (3) a VLM-as-a-Judge evaluation framework that assesses artistic authenticity through aesthetic judgment instead of conventional pixel-level metrics.
• Score: 21.972195024342597
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In 1888, Vincent van Gogh wrote, "I am seeking exaggeration in the essential." This principle, amplifying structural form while suppressing photographic detail, lies at the core of Post-Impressionist art. However, most existing 3D style transfer methods invert this philosophy, treating geometry as a rigid substrate for surface-level texture projection. To authentically reproduce Post-Impressionist stylization, geometric abstraction must be embraced as the primary vehicle of expression. We propose a flow-guided geometric advection framework for 3D Gaussian Splatting (3DGS) that operationalizes this principle in a mesh-free setting. Our method extracts directional flow fields from 2D paintings and back-propagates them into 3D space, rectifying Gaussian primitives to form flow-aligned brushstrokes that conform to scene topology without relying on explicit mesh priors. This enables expressive structural deformation driven directly by painterly motion rather than photometric constraints. Our contributions are threefold: (1) a projection-based, mesh-free flow guidance mechanism that transfers 2D artistic motion into 3D Gaussian geometry; (2) a luminance-structure decoupling strategy that isolates geometric deformation from color optimization, mitigating artifacts during aggressive structural abstraction; and (3) a VLM-as-a-Judge evaluation framework that assesses artistic authenticity through aesthetic judgment instead of conventional pixel-level metrics, explicitly addressing the subjective nature of artistic stylization.

Related papers

• GHOST: Geometry-Guided Hallucination of Opaque Surface Textures [0.28675177318965045]
  We propose a novel geometry-guided preprocessing framework to transform transparent regions into opaque, structurally consistent representations.<n>Our method significantly enhances the accuracy of state-of-the-art depth estimation and reconstruction models on transparent objects by restoring essential photometric cues.
  arXiv  Detail & Related papers  (2026-07-13T05:50:19Z)
• CoIn: Comprehensive 2D-3D Inpainting with Gaussian Splatting Guidance [33.42204651464501]
  CoIn is a framework that bridges 2D inpainting models and 3DGS through a multi-stage consistency pipeline.<n>We introduce Reference Adaptive GS with Feature Attention to reconstruct a coarse 3D scene by adaptively weighing towards a reference view (2D -> 3D)<n>Finally, a Texture-Enhancing Discriminator refines the 3D scene to achieve high photometric realism (2D -> 3D)
  arXiv  Detail & Related papers  (2026-06-25T22:24:27Z)
• Image-Guided Geometric Stylization of 3D Meshes [23.354227809076345]
  We propose a geometric stylization framework that deforms a 3D mesh, allowing it to express the style of an image.<n>Our coarse-to-fine stylization pipeline can drastically deform the input 3D model to express a diverse range of geometric variations.<n>We also propose an approximate VAE encoder that provides efficient and reliable gradients from mesh renderings.
  arXiv  Detail & Related papers  (2026-04-09T04:44:42Z)
• Seamlessly Natural: Image Stitching with Natural Appearance Preservation [0.6089774484591287]
  SENA prioritizes structural fidelity in challenging real-world scenes characterized by parallax and depth variation.<n> SENA addresses fundamental limitations through three key contributions.<n>Experiments conducted on challenging datasets demonstrate that SENA achieves alignment accuracy comparable to leading homography-based methods.
  arXiv  Detail & Related papers  (2026-01-03T18:40:35Z)
• SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer [57.723850794113055]
  We propose a novel 3D style transfer pipeline that integrates prior knowledge from pretrained 2D diffusion models.<n>Our pipeline consists of two key stages: First, we leverage diffusion priors to generate stylized renderings of key viewpoints.<n>The second is instance-level style transfer, which effectively leverages instance-level consistency across stylized key views and transfers it onto the 3D representation.
  arXiv  Detail & Related papers  (2025-09-04T16:40:44Z)
• Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Rendering [51.223347330075576]
  Ref-Unlock is a novel geometry-aware reflection modeling framework based on 3D Gaussian Splatting.<n>Our approach employs a dual-branch representation with high-order spherical harmonics to capture high-frequency reflective details.<n>Our method thus offers an efficient and generalizable solution for realistic rendering of reflective scenes.
  arXiv  Detail & Related papers  (2025-07-08T15:45:08Z)
• Hybrid Explicit Representation for Ultra-Realistic Head Avatars [55.829497543262214]
  We introduce a novel approach to creating ultra-realistic head avatars and rendering them in real-time.<n> UV-mapped 3D mesh is utilized to capture sharp and rich textures on smooth surfaces, while 3D Gaussian Splatting is employed to represent complex geometric structures.<n>Experiments that our modeled results exceed those of state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-03-18T04:01:26Z)
• Geometry Transfer for Stylizing Radiance Fields [54.771563955208705]
  We introduce Geometry Transfer, a novel method that leverages geometric deformation for 3D style transfer. Our experiments show that Geometry Transfer enables a broader and more expressive range of stylizations.
  arXiv  Detail & Related papers  (2024-02-01T18:58:44Z)
• GAN2X: Non-Lambertian Inverse Rendering of Image GANs [85.76426471872855]
  We present GAN2X, a new method for unsupervised inverse rendering that only uses unpaired images for training. Unlike previous Shape-from-GAN approaches that mainly focus on 3D shapes, we take the first attempt to also recover non-Lambertian material properties by exploiting the pseudo paired data generated by a GAN. Experiments demonstrate that GAN2X can accurately decompose 2D images to 3D shape, albedo, and specular properties for different object categories, and achieves the state-of-the-art performance for unsupervised single-view 3D face reconstruction.
  arXiv  Detail & Related papers  (2022-06-18T16:58:49Z)
• 3D-GIF: 3D-Controllable Object Generation via Implicit Factorized Representations [31.095503715696722]
  We propose the factorized representations which are view-independent and light-disentangled, and training schemes with randomly sampled light conditions. We demonstrate the superiority of our method by visualizing factorized representations, re-lighted images, and albedo-textured meshes. This is the first work that extracts albedo-textured meshes with unposed 2D images without any additional labels or assumptions.
  arXiv  Detail & Related papers  (2022-03-12T15:23:17Z)
• MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation [69.35523133292389]
  We propose a framework that a priori models physical attributes of the face explicitly, thus providing disentanglement by design. Our method, MOST-GAN, integrates the expressive power and photorealism of style-based GANs with the physical disentanglement and flexibility of nonlinear 3D morphable models. It achieves photorealistic manipulation of portrait images with fully disentangled 3D control over their physical attributes, enabling extreme manipulation of lighting, facial expression, and pose variations up to full profile view.
  arXiv  Detail & Related papers  (2021-11-01T15:53:36Z)
• Exemplar-Based 3D Portrait Stylization [23.585334925548064]
  We present the first framework for one-shot 3D portrait style transfer. It can generate 3D face models with both the geometry exaggerated and the texture stylized. Our method achieves robustly good results on different artistic styles and outperforms existing methods.
  arXiv  Detail & Related papers  (2021-04-29T17:59:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.