AutoWeather4D: Autonomous Driving Video Weather Conversion via G-Buffer Dual-Pass Editing

• URL: http://arxiv.org/abs/2603.26546v3
• Date: Thu, 02 Apr 2026 02:56:53 GMT
• Title: AutoWeather4D: Autonomous Driving Video Weather Conversion via G-Buffer Dual-Pass Editing
• Abstract summary: AutoWeather4D is a feed-forward 3D-aware weather editing framework designed to explicitly decouple geometry and illumination.<n>Experiments demonstrate that AutoWeather4D achieves comparable photorealism and structural consistency to generative baselines.
• Score: 40.7960078327044
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative video models have significantly advanced the photorealistic synthesis of adverse weather for autonomous driving; however, they consistently demand massive datasets to learn rare weather scenarios. While 3D-aware editing methods alleviate these data constraints by augmenting existing video footage, they are fundamentally bottlenecked by costly per-scene optimization and suffer from inherent geometric and illumination entanglement. In this work, we introduce AutoWeather4D, a feed-forward 3D-aware weather editing framework designed to explicitly decouple geometry and illumination. At the core of our approach is a G-buffer Dual-pass Editing mechanism. The Geometry Pass leverages explicit structural foundations to enable surface-anchored physical interactions, while the Light Pass analytically resolves light transport, accumulating the contributions of local illuminants into the global illumination to enable dynamic 3D local relighting. Extensive experiments demonstrate that AutoWeather4D achieves comparable photorealism and structural consistency to generative baselines while enabling fine-grained parametric physical control, serving as a practical data engine for autonomous driving.

Related papers

• LiveLight: Real-time Streaming Video Relighting with Interactive Control [50.08584152649119]
  We present LiveLight, the first diffusion-based framework for real-time streaming video relighting with interactive 3D lighting control.<n>We overcome three critical challenges: effectively injecting dynamic 3D lighting into a diffusion model, maintaining high-fidelity generation under a low NFE budget, and facilitating continuous streaming for interactive control.<n>Experiments on real-world and synthetic benchmarks demonstrate that LiveLight achieves state-of-the-art relighting quality while running at real-time speed.
  arXiv  Detail & Related papers  (2026-08-03T06:45:00Z)
• DriveWeaver: Point-Conditioned Video Inpainting for Controllable Vehicle Insertion in Autonomous Driving Simulation [9.201369685231532]
  DriveWeaver is a novel framework for controllable vehicle insertion in autonomous driving simulation.<n>We perform video inpainting conditioned on vehicle point clouds to generate temporally consistent vehicles.<n>Our method outperforms existing baselines in visual realism and geometric consistency.
  arXiv  Detail & Related papers  (2026-06-30T16:23:32Z)
• ReinDriveGen: Reinforcement Post-Training for Out-of-Distribution Driving Scene Generation [61.64162666162948]
  ReinDriveGen is a framework that enables full controllability over dynamic driving scenes.<n>Our approach constructs a dynamic 3D point cloud scene from multi-frame LiDAR data.<n>Our approach renders the edited scene into 2D condition images that guide a video diffusion model to synthesize realistic driving videos.
  arXiv  Detail & Related papers  (2026-04-01T16:48:20Z)
• HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles [63.88996084630768]
  Controllable driving scene generation is critical for realistic and scalable autonomous driving simulation.<n>We introduce HorizonForge, a unified framework that reconstructs scenes as editable Gaussian Splats and Meshes.<n>Experiments show that Gaussian-Mesh representation delivers substantially higher fidelity than alternative 3D representations.
  arXiv  Detail & Related papers  (2026-02-24T20:03:47Z)
• Nighttime Autonomous Driving Scene Reconstruction with Physically-Based Gaussian Splatting [19.61590675458685]
  We present a novel approach that integrates physically based rendering into 3DGS to enhance nighttime scene reconstruction for autonomous driving.<n>Our approach improves reconstruction quality for outdoor nighttime driving scenes, while maintaining real-time rendering.
  arXiv  Detail & Related papers  (2026-02-14T01:49:23Z)
• SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restoration [37.202523124756034]
  Current approaches often falter in large-angle novel view synthesis and suffer from geometric or lighting artifacts during asset manipulation.<n>We propose SymDrive, a unified diffusion-based framework capable of joint high-quality rendering and scene editing.<n>We demonstrate that SymDrive achieves photorealistic state-of-the-art performance in both novel-view enhancement and realistic 3D vehicle insertion.
  arXiv  Detail & Related papers  (2025-12-25T10:28:43Z)
• SceneCrafter: Controllable Multi-View Driving Scene Editing [44.91248700043744]
  We propose SceneCrafter, a versatile editor for realistic 3D-consistent manipulation of driving scenes captured from multiple cameras.<n>SceneCrafter achieves state-of-the-art realism, controllability, 3D consistency, and scene editing quality compared to existing baselines.
  arXiv  Detail & Related papers  (2025-06-24T10:23:47Z)
• GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Control [50.67481583744243]
  We introduce GeoDrive, which explicitly integrates robust 3D geometry conditions into driving world models.<n>We propose a dynamic editing module during training to enhance the renderings by editing the positions of the vehicles.<n>Our method significantly outperforms existing models in both action accuracy and 3D spatial awareness.
  arXiv  Detail & Related papers  (2025-05-28T14:46:51Z)
• StreetCrafter: Street View Synthesis with Controllable Video Diffusion Models [76.62929629864034]
  We introduce StreetCrafter, a controllable video diffusion model that utilizes LiDAR point cloud renderings as pixel-level conditions.<n>In addition, the utilization of pixel-level LiDAR conditions allows us to make accurate pixel-level edits to target scenes.<n>Our model enables flexible control over viewpoint changes, enlarging the view for satisfying rendering regions.
  arXiv  Detail & Related papers  (2024-12-17T18:58:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.