Parameter-Free Neural Lens Blur Rendering for High-Fidelity Composites

• URL: http://arxiv.org/abs/2511.17014v1
• Date: Fri, 21 Nov 2025 07:32:05 GMT
• Title: Parameter-Free Neural Lens Blur Rendering for High-Fidelity Composites
• Abstract summary: Consistent and natural camera lens blur is important for seamlessly blending 3D virtual objects into photographed real-scenes.<n>Existing pipelines often rely on camera parameters to compute the circle of confusion (CoC) for realistic lens blur rendering.<n>We propose a novel approach that directly estimates the CoC map from RGB images, bypassing the need for scene depth or camera metadata.
• Score: 9.308179344001795
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Consistent and natural camera lens blur is important for seamlessly blending 3D virtual objects into photographed real-scenes. Since lens blur typically varies with scene depth, the placement of virtual objects and their corresponding blur levels significantly affect the visual fidelity of mixed reality compositions. Existing pipelines often rely on camera parameters (e.g., focal length, focus distance, aperture size) and scene depth to compute the circle of confusion (CoC) for realistic lens blur rendering. However, such information is often unavailable to ordinary users, limiting the accessibility and generalizability of these methods. In this work, we propose a novel compositing approach that directly estimates the CoC map from RGB images, bypassing the need for scene depth or camera metadata. The CoC values for virtual objects are inferred through a linear relationship between its signed CoC map and depth, and realistic lens blur is rendered using a neural reblurring network. Our method provides flexible and practical solution for real-world applications. Experimental results demonstrate that our method achieves high-fidelity compositing with realistic defocus effects, outperforming state-of-the-art techniques in both qualitative and quantitative evaluations.

Related papers

• GS-RealBlur: A Flexible Data Acquisition Framework for Real-World Image Deblurring [57.238399638408616]
  We propose GS-RealBlur, a data acquisition framework for real-world image deblurring.<n>Specifically, we use a handheld camera to capture blurry images, and deploy a gimbal to densely capture sharp images of the same scene.<n>We reconstruct the 3D representation of sharp images and calibrate the camera pose of each blurry frame within this 3D.<n>The image rendered from this 3D according to the pose serves as the sharp counterpart.
  arXiv  Detail & Related papers  (2026-07-16T18:59:01Z)
• Realistic Compound-Lens Defocus Blur Synthesis [16.115267588640453]
  We propose a pipeline for synthesizing realistic defocus deblurring datasets for diverse compound lenses.<n>We generate CLDefocus, a large-scale synthetic dataset containing lens-diverse defocus image pairs.
  arXiv  Detail & Related papers  (2026-07-07T05:00:44Z)
• DoF-Gaussian: Controllable Depth-of-Field for 3D Gaussian Splatting [52.52398576505268]
  We introduce DoF-Gaussian, a controllable depth-of-field method for 3D-GS.<n>We develop a lens-based imaging model based on geometric optics principles to control DoF effects.<n>Our framework is customizable and supports various interactive applications.
  arXiv  Detail & Related papers  (2025-03-02T05:57:57Z)
• CoCoGaussian: Leveraging Circle of Confusion for Gaussian Splatting from Defocused Images [20.10949653170145]
  3D Gaussian Splatting (3DGS) has attracted significant attention for its high-quality novel view rendering.<n>We propose CoCoGaussian, a Circle of Confusion-aware Gaussian Splatting that enables precise 3D scene representation using only defocused images.<n> Experiments on both synthetic and real-world datasets demonstrate that CoCoGaussian achieves state-of-the-art performance across multiple benchmarks.
  arXiv  Detail & Related papers  (2024-12-20T16:25:20Z)
• GS-Blur: A 3D Scene-Based Dataset for Realistic Image Deblurring [50.72230109855628]
  We propose GS-Blur, a dataset of synthesized realistic blurry images created using a novel approach. We first reconstruct 3D scenes from multi-view images using 3D Gaussian Splatting (3DGS), then render blurry images by moving the camera view along the randomly generated motion trajectories. By adopting various camera trajectories in reconstructing our GS-Blur, our dataset contains realistic and diverse types of blur, offering a large-scale dataset that generalizes well to real-world blur.
  arXiv  Detail & Related papers  (2024-10-31T06:17:16Z)
• Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering [56.68286440268329]
  correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials. We propose using a personalized large diffusion model as guidance to a physically based inverse rendering process. Our method recovers scene lighting and tone-mapping parameters, allowing the photorealistic composition of arbitrary virtual objects in single frames or videos of indoor or outdoor scenes.
  arXiv  Detail & Related papers  (2024-08-19T05:15:45Z)
• Relighting Scenes with Object Insertions in Neural Radiance Fields [24.18050535794117]
  We propose a novel NeRF-based pipeline for inserting object NeRFs into scene NeRFs. The proposed method achieves realistic relighting effects in extensive experimental evaluations.
  arXiv  Detail & Related papers  (2024-06-21T00:58:58Z)
• Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes [62.769186261245416]
  We present a novel inverse rendering framework for large urban scenes capable of jointly reconstructing the scene geometry, spatially-varying materials, and HDR lighting from a set of posed RGB images with optional depth. Specifically, we use a neural field to account for the primary rays, and use an explicit mesh (reconstructed from the underlying neural field) for modeling secondary rays that produce higher-order lighting effects such as cast shadows.
  arXiv  Detail & Related papers  (2023-04-06T17:51:54Z)
• Depth-Aware Image Compositing Model for Parallax Camera Motion Blur [4.170640862518009]
  Camera motion introduces spatially varying blur due to the depth changes in the 3D world. We present a simple, yet accurate, Image ting Blur (ICB) model for depth-dependent varying blur.
  arXiv  Detail & Related papers  (2023-03-16T14:15:32Z)
• Natural & Adversarial Bokeh Rendering via Circle-of-Confusion Predictive Network [25.319666328268116]
  Bokeh effect is a shallow depth-of-field phenomenon that blurs out-of-focus part in photography. We study a totally new problem, i.e., natural & adversarial bokeh rendering. We propose a hybrid alternative by taking the respective advantages of data-driven and physical-aware methods.
  arXiv  Detail & Related papers  (2021-11-25T09:08:45Z)
• Neural Reflectance Fields for Appearance Acquisition [61.542001266380375]
  We present Neural Reflectance Fields, a novel deep scene representation that encodes volume density, normal and reflectance properties at any 3D point in a scene. We combine this representation with a physically-based differentiable ray marching framework that can render images from a neural reflectance field under any viewpoint and light.
  arXiv  Detail & Related papers  (2020-08-09T22:04:36Z)
• Rendering Natural Camera Bokeh Effect with Deep Learning [95.86933125733673]
  Bokeh is an important artistic effect used to highlight the main object of interest on the photo. Mobile cameras are unable to produce shallow depth-of-field photos due to a very small aperture diameter of their optics. We propose to learn a realistic shallow focus technique directly from the photos produced by DSLR cameras.
  arXiv  Detail & Related papers  (2020-06-10T07:28:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.