Large-Area Fabrication-aware Computational Diffractive Optics
- URL: http://arxiv.org/abs/2505.22313v1
- Date: Wed, 28 May 2025 12:56:46 GMT
- Title: Large-Area Fabrication-aware Computational Diffractive Optics
- Authors: Kaixuan Wei, Hector A. Jimenez-Romero, Hadi Amata, Jipeng Sun, Qiang Fu, Felix Heide, Wolfgang Heidrich,
- Abstract summary: Differentiable optics, as an emerging paradigm, has made innovative optical designs possible across a broad range of applications.<n>Existing approaches have, however, mostly remained limited to laboratory prototypes, owing to a large quality gap between simulation and manufactured devices.<n>We propose a fabrication-aware design pipeline for diffractive optics fabricated by direct-write grayscale lithography.<n>We also propose a super-resolved neural lithography model that can accurately predict the 3D geometry generated by the fabrication process.
- Score: 42.604737292001175
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Differentiable optics, as an emerging paradigm that jointly optimizes optics and (optional) image processing algorithms, has made innovative optical designs possible across a broad range of applications. Many of these systems utilize diffractive optical components (DOEs) for holography, PSF engineering, or wavefront shaping. Existing approaches have, however, mostly remained limited to laboratory prototypes, owing to a large quality gap between simulation and manufactured devices. We aim at lifting the fundamental technical barriers to the practical use of learned diffractive optical systems. To this end, we propose a fabrication-aware design pipeline for diffractive optics fabricated by direct-write grayscale lithography followed by nano-imprinting replication, which is directly suited for inexpensive mass production of large area designs. We propose a super-resolved neural lithography model that can accurately predict the 3D geometry generated by the fabrication process. This model can be seamlessly integrated into existing differentiable optics frameworks, enabling fabrication-aware, end-to-end optimization of computational optical systems. To tackle the computational challenges, we also devise tensor-parallel compute framework centered on distributing large-scale FFT computation across many GPUs. As such, we demonstrate large scale diffractive optics designs up to 32.16 mm $\times$ 21.44 mm, simulated on grids of up to 128,640 by 85,760 feature points. We find adequate agreement between simulation and fabricated prototypes for applications such as holography and PSF engineering. We also achieve high image quality from an imaging system comprised only of a single DOE, with images processed only by a Wiener filter utilizing the simulation PSF. We believe our findings lift the fabrication limitations for real-world applications of diffractive optics and differentiable optical design.
Related papers
- Universal point spread function engineering for 3D optical information processing [0.0]
We report a method to synthesize an arbitrary set of spatially varying 3D PSFs between the input and output volumes of a spatially incoherent diffractive processor.<n>We rigorously analyze the PSF engineering capabilities of such diffractive processors within the diffraction limit of light.<n>Our framework and analysis would be important for future advancements in computational imaging, sensing and diffractive processing of 3D optical information.
arXiv Detail & Related papers (2025-02-09T20:42:09Z) - A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimization [19.83939112821776]
End-to-end optimization has emerged as a powerful data-driven method for computational imaging system design.<n>It is challenging to model both aberration and diffraction in light transport for end-to-end optimization of compound optics.<n>We propose a differentiable optics simulator that efficiently models both aberration and diffraction for compound optics.
arXiv Detail & Related papers (2024-12-13T00:57:47Z) - Efficient-3DiM: Learning a Generalizable Single-image Novel-view
Synthesizer in One Day [63.96075838322437]
We propose a framework to learn a single-image novel-view synthesizer.
Our framework is able to reduce the total training time from 10 days to less than 1 day.
arXiv Detail & Related papers (2023-10-04T17:57:07Z) - Neural Lithography: Close the Design-to-Manufacturing Gap in
Computational Optics with a 'Real2Sim' Learned Photolithography Simulator [2.033983045970252]
We introduce neural lithography to address the 'design-to-manufacturing' gap in computational optics.
We propose a fully differentiable design framework that integrates a pre-trained photolithography simulator into the model-based optical design loop.
arXiv Detail & Related papers (2023-09-29T15:50:26Z) - Revealing the preference for correcting separated aberrations in joint
optic-image design [19.852225245159598]
We characterize the optics with separated aberrations to achieve efficient joint design of complex systems such as smartphones and drones.
An image simulation system is presented to reproduce the genuine imaging procedure of lenses with large field-of-views.
Experiments reveal that the preference for correcting separated aberrations in joint design is as follows: longitudinal chromatic aberration, lateral chromatic aberration, spherical aberration, field curvature, and coma, with astigmatism coming last.
arXiv Detail & Related papers (2023-09-08T14:12:03Z) - Neural Lens Modeling [50.57409162437732]
NeuroLens is a neural lens model for distortion and vignetting that can be used for point projection and ray casting.
It can be used to perform pre-capture calibration using classical calibration targets, and can later be used to perform calibration or refinement during 3D reconstruction.
The model generalizes across many lens types and is trivial to integrate into existing 3D reconstruction and rendering systems.
arXiv Detail & Related papers (2023-04-10T20:09:17Z) - Generic Lithography Modeling with Dual-band Optics-Inspired Neural
Networks [52.200624127512874]
We introduce a dual-band optics-inspired neural network design that considers the optical physics underlying lithography.
Our approach yields the first published via/metal layer contour simulation at 1nm2/pixel resolution with any tile size.
We also achieve 85X simulation speedup over traditional lithography simulator with 1% accuracy loss.
arXiv Detail & Related papers (2022-03-12T08:08:50Z) - Diffractive optical system design by cascaded propagation [1.6385815610837167]
Fourier optics is typically used for designing thin elements, placed in the system's aperture, generating a shift-invariant Point Spread Function (PSF)
We propose and implement an efficient and differentiable propagation model based on the Collins integral, which enables the optimization of diffraction optical systems with unprecedented design freedom using backpropagation.
We demonstrate the applicability of our method, numerically and experimentally, by engineering shift-variant PSFs via thin plate elements placed in arbitrary planes inside complex imaging systems.
arXiv Detail & Related papers (2022-02-23T14:21:09Z) - Universal and Flexible Optical Aberration Correction Using Deep-Prior
Based Deconvolution [51.274657266928315]
We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors.
Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
arXiv Detail & Related papers (2021-04-07T12:00:38Z) - Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry.
New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications.
We present a novel technique to reconstruct the transfer matrix of linear optical networks.
arXiv Detail & Related papers (2020-10-01T16:04:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.