Rectifying Mask via Entropy for Distractor-Free 3DGS in Ambiguous Scenarios
- URL: http://arxiv.org/abs/2606.29496v2
- Date: Fri, 03 Jul 2026 02:08:02 GMT
- Title: Rectifying Mask via Entropy for Distractor-Free 3DGS in Ambiguous Scenarios
- Abstract summary: We present RefineSplat, a systematic framework that effectively constructs transient masks to identify diverse ambiguous distractors.<n>Unlike existing approaches that struggle to distinguish transient elements from static scenes due to color or semantic ambiguity, RefineSplat captures ambiguous distractors leveraging entropy and instance masks.
- Score: 16.103101034398524
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We present RefineSplat, a systematic framework that effectively constructs transient masks to identify diverse ambiguous distractors. To do this, we qualitatively and quantitatively analyze issues and propose a novel entropy-aware adaptive masking method. Unlike existing approaches that struggle to distinguish transient elements from static scenes due to color or semantic ambiguity, RefineSplat captures ambiguous distractors leveraging entropy and instance masks. Furthermore, we propose a simple yet effective entropy-aware density control to align Gaussians in ambiguous scenarios considering Entropy-aware positional gradients. Additionally, to rigorously validate our method, we first create and release the Ambiguous wild dataset, including 18 scenes where distractors and static scenes are hard to distinguish due to color or semantic resemblances. Experimental results on various datasets demonstrate that RefineSplat shows state-of-the-art performance, showing distractor-free novel view synthesis.
Related papers
- Hierarchical Consistency Learning for Test-time Adaptation in Camouflage Perception [50.278200968044665]
Camouflaged object detection (COD) aims to localize targets that exhibit minimal perceptual differences from backgrounds through physical attributes.<n>Existing methods, constrained by the static train-then-freeze paradigm, suffer from domain rigidity and dependency annotation.<n>We propose the hierarchical consistency learning framework, which integrates test-time adaptation for dynamic representation recalibration.
arXiv Detail & Related papers (2026-05-25T09:57:46Z) - EmoScene: A Dual-space Dataset for Controllable Affective Image Generation [36.90201432936213]
EmoScene is a large-scale dual-space emotion dataset that jointly encodes affective dimensions and perceptual attributes.<n>We show how discrete emotions occupy the VAD space and how affect systematically correlates with scene-level perceptual factors.
arXiv Detail & Related papers (2026-04-01T14:10:23Z) - RobustSplat++: Decoupling Densification, Dynamics, and Illumination for In-the-Wild 3DGS [85.90134051583368]
3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling.<n>Existing methods struggle with accurately modeling in-the-wild scenes affected by transient objects and illuminations.<n>We propose RobustSplat++, a robust solution based on several critical designs.
arXiv Detail & Related papers (2025-12-04T14:05:09Z) - Contrast-Prior Enhanced Duality for Mask-Free Shadow Removal [12.417806583744134]
Existing shadow removal methods often rely on shadow masks, which are challenging to acquire in real-world scenarios.<n> Exploring intrinsic image cues, such as local contrast information, presents a potential alternative for guiding shadow removal in the absence of explicit masks.<n>We propose the Adaptive Gated Dual-Branch Attention (AGBA) mechanism, which filters and re-weighs the contrast prior to effectively disentangle shadow features.
arXiv Detail & Related papers (2025-07-29T16:00:42Z) - RobustSplat: Decoupling Densification and Dynamics for Transient-Free 3DGS [79.15416002879239]
3D Gaussian Splatting has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling.<n>Existing methods struggle with accurately modeling scenes affected by transient objects, leading to artifacts in the rendered images.<n>We propose RobustSplat, a robust solution based on two critical designs.
arXiv Detail & Related papers (2025-06-03T11:13:48Z) - ForestSplats: Deformable transient field for Gaussian Splatting in the Wild [7.826711452520102]
3D-GS shows effectiveness in static scenes, but their performance significantly degrades in real-world environments.<n>We propose ForestSplats, a novel approach that leverages the deformable transient field and a superpixel-aware mask.
arXiv Detail & Related papers (2025-03-08T11:44:57Z) - Learning Relighting and Intrinsic Decomposition in Neural Radiance Fields [21.057216351934688]
Our research introduces a method that combines relighting with intrinsic decomposition.
By leveraging light variations in scenes to generate pseudo labels, our method provides guidance for intrinsic decomposition.
We validate our method on both synthetic and real-world datasets, achieving convincing results.
arXiv Detail & Related papers (2024-06-16T21:10:37Z) - ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detection [70.11264880907652]
Recent object (COD) attempts to segment objects visually blended into their surroundings, which is extremely complex and difficult in real-world scenarios.
We propose an effective unified collaborative pyramid network that mimics human behavior when observing vague images and camouflaged zooming in and out.
Our framework consistently outperforms existing state-of-the-art methods in image and video COD benchmarks.
arXiv Detail & Related papers (2023-10-31T06:11:23Z) - Towards General Visual-Linguistic Face Forgery Detection [95.73987327101143]
Deepfakes are realistic face manipulations that can pose serious threats to security, privacy, and trust.
Existing methods mostly treat this task as binary classification, which uses digital labels or mask signals to train the detection model.
We propose a novel paradigm named Visual-Linguistic Face Forgery Detection(VLFFD), which uses fine-grained sentence-level prompts as the annotation.
arXiv Detail & Related papers (2023-07-31T10:22:33Z) - RISP: Rendering-Invariant State Predictor with Differentiable Simulation
and Rendering for Cross-Domain Parameter Estimation [110.4255414234771]
Existing solutions require massive training data or lack generalizability to unknown rendering configurations.
We propose a novel approach that marries domain randomization and differentiable rendering gradients to address this problem.
Our approach achieves significantly lower reconstruction errors and has better generalizability among unknown rendering configurations.
arXiv Detail & Related papers (2022-05-11T17:59:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.