M2StyleGS: Multi-Modality 3D Style Transfer with Gaussian Splatting

• URL: http://arxiv.org/abs/2604.03773v1
• Date: Sat, 04 Apr 2026 15:51:56 GMT
• Title: M2StyleGS: Multi-Modality 3D Style Transfer with Gaussian Splatting
• Abstract summary: We introduce a novel real-time styling technique M2StyleGS to generate a sequence of precisely color-mapped views.<n>M2StyleGS achieves better visual quality and surpasses the previous work by up to 32.92% in terms of consistency.
• Score: 21.399777116251858
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Conventional 3D style transfer methods rely on a fixed reference image to apply artistic patterns to 3D scenes. However, in practical applications such as virtual or augmented reality, users often prefer more flexible inputs, including textual descriptions and diverse imagery. In this work, we introduce a novel real-time styling technique M2StyleGS to generate a sequence of precisely color-mapped views. It utilizes 3D Gaussian Splatting (3DGS) as a 3D presentation and multi-modality knowledge refined by CLIP as a reference style. M2StyleGS resolves the abnormal transformation issue by employing a precise feature alignment, namely subdivisive flow, it strengthens the projection of the mapped CLIP text-visual combination feature to the VGG style feature. In addition, we introduce observation loss, which assists in the stylized scene better matching the reference style during the generation, and suppression loss, which suppresses the offset of reference color information throughout the decoding process. By integrating these approaches, M2StyleGS can employ text or images as references to generate a set of style-enhanced novel views. Our experiments show that M2StyleGS achieves better visual quality and surpasses the previous work by up to 32.92% in terms of consistency.

Related papers

• Improved 3D Scene Stylization via Text-Guided Generative Image Editing with Region-Based Control [47.14550252881733]
  We introduce techniques that enhance the quality of 3D stylization while maintaining view consistency and providing optional region-controlled style transfer.<n>Our method achieves stylization by re-training an initial 3D representation using stylized multi-view 2D images of the source views.<n>We propose Multi-Region Importance-Weighted Sliced Wasserstein Distance Loss, allowing styles to be applied to distinct image regions using segmentation masks from off-the-shelf models.
  arXiv  Detail & Related papers  (2025-09-04T15:01:01Z)
• FantasyStyle: Controllable Stylized Distillation for 3D Gaussian Splatting [7.778588010132252]
  We introduce textbfFantasyStyle, a 3DGS-based style transfer framework, and the first to rely entirely on diffusion model distillation.<n>We enhance cross-view consistency by applying a 3D filter to multi-view noisy latent, selectively reducing low-frequency components to mitigate stylized prior conflicts.<n>Our method consistently outperforms state-of-the-art approaches, achieving higher stylization quality and visual realism across various scenes and styles.
  arXiv  Detail & Related papers  (2025-08-11T16:11:08Z)
• Multi-StyleGS: Stylizing Gaussian Splatting with Multiple Styles [45.648346391757336]
  3D Gaussian Splatting(GS) has emerged as a promising and efficient method for realistic 3D scene modeling.<n>We introduce a novel 3D GS stylization solution termed Multi-StyleGS to tackle these challenges.
  arXiv  Detail & Related papers  (2025-06-07T15:54:34Z)
• StyleMe3D: Stylization with Disentangled Priors by Multiple Encoders on 3D Gaussians [23.1385740508835]
  StyleMe3D is a holistic framework for 3D GS style transfer.<n>It integrates multi-modal style conditioning, multi-level semantic alignment, and perceptual quality enhancement.<n>This work bridges photorealistic 3D GS and artistic stylization, unlocking applications in gaming, virtual worlds, and digital art.
  arXiv  Detail & Related papers  (2025-04-21T17:59:55Z)
• StylizedGS: Controllable Stylization for 3D Gaussian Splatting [56.87134037463792]
  StylizedGS is an efficient 3D neural style transfer framework with adaptable control over perceptual factors.<n>Our method achieves high-quality stylization results characterized by faithful brushstrokes and geometric consistency with flexible controls.
  arXiv  Detail & Related papers  (2024-04-08T06:32:11Z)
• StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting [141.05924680451804]
  StyleGaussian is a novel 3D style transfer technique. It allows instant transfer of any image's style to a 3D scene at 10 frames per second (fps)
  arXiv  Detail & Related papers  (2024-03-12T16:44:52Z)
• StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields [52.19291190355375]
  StyleRF (Style Radiance Fields) is an innovative 3D style transfer technique. It employs an explicit grid of high-level features to represent 3D scenes, with which high-fidelity geometry can be reliably restored via volume rendering. It transforms the grid features according to the reference style which directly leads to high-quality zero-shot style transfer.
  arXiv  Detail & Related papers  (2023-03-19T08:26:06Z)
• Third Time's the Charm? Image and Video Editing with StyleGAN3 [70.36056009463738]
  StyleGAN is arguably one of the most intriguing and well-studied generative models. We explore the recent StyleGAN3 architecture, compare it to its predecessor, and investigate its unique advantages, as well as drawbacks.
  arXiv  Detail & Related papers  (2022-01-31T18:44:59Z)
• Learning to Stylize Novel Views [82.24095446809946]
  We tackle a 3D scene stylization problem - generating stylized images of a scene from arbitrary novel views. We propose a point cloud-based method for consistent 3D scene stylization.
  arXiv  Detail & Related papers  (2021-05-27T23:58:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.