AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfer
- URL: http://arxiv.org/abs/2606.31959v1
- Date: Tue, 30 Jun 2026 17:01:28 GMT
- Title: AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfer
- Abstract summary: We introduce AnyBokeh, a physics-guided framework for any-to-any bokeh editing.<n>A generative editor conditioned on both source and target circle-of-confusion maps then performs relative blur synthesis.<n>Experiments show that AnyBokeh achieves faithful and controllable editing across any-to-any bokeh editing, all-in-focus-to-bokeh rendering, and defocus deblurring.
- Score: 56.41100467739059
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Depth-of-field control is a fundamental tool in photography, yet post-capture bokeh editing from a single image remains challenging. A practical editor should handle images captured under arbitrary focus and aperture settings. Existing methods typically assume an all-in-focus input, or first recover an all-in-focus image before rendering new bokeh. Such pipelines can discard useful blur cues from the source image and propagate reconstruction artifacts into the final edit. We introduce AnyBokeh, a physics-guided framework for any-to-any bokeh editing. Instead of treating source blur merely as a degradation to be removed, AnyBokeh estimates the source blur state with a signed circle-of-confusion map and a disparity map. By modeling the linear relation between signed circle of confusion and disparity difference, AnyBokeh estimates a source-specific optical fingerprint and transfers the source optical characteristics to the desired focus and aperture setting. A generative editor conditioned on both source and target circle-of-confusion maps then performs relative blur synthesis, enabling spatially adaptive deblurring, preservation, and defocus rendering. To support physically supervised learning, we further construct a high-fidelity synthetic dataset with accurate depth, focus distance, and full EXIF metadata. Experiments on real-world benchmarks show that AnyBokeh achieves faithful and controllable editing across any-to-any bokeh editing, all-in-focus-to-bokeh rendering, and defocus deblurring, while avoiding all-in-focus reconstruction and test-time bokeh-level calibration commonly required by existing approaches. The code and dataset will be available at https://github.com/itsmag11/AnyBokeh.
Related papers
- The RealDefocus Benchmark for Defocus Deblurring [49.159098203027504]
Single-Image Defocus Deblurring (SIDD) aims to recover an all-in-focus image from a single defocused observation.<n>We build on RealDefocus, a benchmark derived from the real-world RealBokeh dataset.
arXiv Detail & Related papers (2026-07-23T09:09:58Z) - Generative Refocusing: Flexible Defocus Control from a Single Image [12.798805351731668]
We introduce Generative Refocusing, a two-step process that uses DeNet to recover all-in-focus images from various inputs and BokehNet for creating controllable bokeh.<n>Our experiments show we achieve top performance in defocus deblurring, bokeh synthesis, and refocusing benchmarks.
arXiv Detail & Related papers (2025-12-18T18:59:59Z) - BokehFlow: Depth-Free Controllable Bokeh Rendering via Flow Matching [33.101056425502584]
Bokeh rendering simulates the shallow depth-of-field effect in photography, enhancing visual aesthetics and guiding viewer attention to regions of interest.<n>We propose BokehFlow, a framework for controllable bokeh rendering based on flow matching.<n>BokehFlow directly synthesizes photorealistic bokeh effects from all-in-focus images, eliminating the need for depth inputs.
arXiv Detail & Related papers (2025-11-19T03:18:58Z) - BokehDiff: Neural Lens Blur with One-Step Diffusion [62.59018200914645]
We introduce BokehDiff, a lens blur rendering method that achieves physically accurate and visually appealing outcomes.<n>Our method employs a physics-inspired self-attention module that aligns with the image formation process.<n>We adapt the diffusion model to the one-step inference scheme without introducing additional noise, and achieve results of high quality and fidelity.
arXiv Detail & Related papers (2025-07-24T03:23:19Z) - Bokehlicious: Photorealistic Bokeh Rendering with Controllable Apertures [51.16022611377722]
Bokeh rendering methods play a key role in creating the visually appealing, softly blurred backgrounds seen in professional photography.<n>We propose Bokehlicious, a highly efficient network that provides intuitive control over Bokeh strength through an Aperture-Aware Attention mechanism.<n>We present RealBokeh, a novel dataset featuring 23,000 high-resolution (24-MP) images captured by professional photographers.
arXiv Detail & Related papers (2025-03-20T12:00:45Z) - Variable Aperture Bokeh Rendering via Customized Focal Plane Guidance [18.390543681127976]
The proposed method has achieved competitive state-of-the-art performance with only 4.4M parameters, which is much lighter than mainstream computational bokeh models.
The proposed method has achieved competitive state-of-the-art performance with only 4.4M parameters, which is much lighter than mainstream computational bokeh models.
arXiv Detail & Related papers (2024-10-18T12:04:23Z) - Defocus to focus: Photo-realistic bokeh rendering by fusing defocus and
radiance priors [26.38833313692807]
Bokeh rendering mimics aesthetic shallow depth-of-field (DoF) in professional photography.
Existing methods suffer from simple flat background blur and blurred in-focus regions.
We present a Defocus to Focus (D2F) framework to learn realistic bokeh rendering.
arXiv Detail & Related papers (2023-06-07T15:15:13Z) - Natural & Adversarial Bokeh Rendering via Circle-of-Confusion Predictive
Network [25.319666328268116]
Bokeh effect is a shallow depth-of-field phenomenon that blurs out-of-focus part in photography.
We study a totally new problem, i.e., natural & adversarial bokeh rendering.
We propose a hybrid alternative by taking the respective advantages of data-driven and physical-aware methods.
arXiv Detail & Related papers (2021-11-25T09:08:45Z) - Selective Light Field Refocusing for Camera Arrays Using Bokeh Rendering
and Superresolution [27.944215174962995]
We propose a light field refocusing method to improve the imaging quality of camera arrays.
In our method, the unfocused region (bokeh) is rendered by using a depth-based anisotropic filter.
Our method achieves superior visual performance with acceptable computational cost as compared to other state-of-the-art methods.
arXiv Detail & Related papers (2021-08-09T10:19:21Z) - Defocus Blur Detection via Depth Distillation [64.78779830554731]
We introduce depth information into DBD for the first time.
In detail, we learn the defocus blur from ground truth and the depth distilled from a well-trained depth estimation network.
Our approach outperforms 11 other state-of-the-art methods on two popular datasets.
arXiv Detail & Related papers (2020-07-16T04:58:09Z) - Rendering Natural Camera Bokeh Effect with Deep Learning [95.86933125733673]
Bokeh is an important artistic effect used to highlight the main object of interest on the photo.
Mobile cameras are unable to produce shallow depth-of-field photos due to a very small aperture diameter of their optics.
We propose to learn a realistic shallow focus technique directly from the photos produced by DSLR cameras.
arXiv Detail & Related papers (2020-06-10T07:28:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.