Integrated Forward-Inverse Network for Lensless Image Reconstruction

• URL: http://arxiv.org/abs/2607.04608v1
• Date: Mon, 06 Jul 2026 02:28:30 GMT
• Title: Integrated Forward-Inverse Network for Lensless Image Reconstruction
• Abstract summary: Integrated Forward-Inverse Network (IFIN) is a physics-guided architecture that interleaves differentiable forward projections with learnable inverse updates at every scale.<n>IFIN achieves state-of-the-art reconstruction quality on challenging lensless benchmarks.
• Score: 9.610123731413415
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Lensless imaging enables compact and versatile computational cameras by replacing bulky optics with thin coded elements. However, reconstruction from the resulting measurements is challenging: large-footprint point-spread functions (PSFs) produce highly multiplexed observations, making inversion severely ill-conditioned and sensitive to calibration errors and model mismatch. While deep learning approaches, including hybrid models that incorporate physics priors, have shown promise, explicitly maintaining data fidelity throughout the network hierarchy remains difficult. Here, we propose the Integrated Forward-Inverse Network (IFIN), a physics-guided architecture that interleaves differentiable forward projections with learnable inverse updates at every scale, enabling complementary cues to be exploited jointly in the measurement and image domains. This bidirectional coupling supports progressive, physics-consistent refinement and permits system-constrained PSF kernel adaptation under model uncertainty. On challenging lensless benchmarks, including a newly introduced dataset, IFIN achieves state-of-the-art reconstruction quality. We further observe competitive performance on Gaussian deblurring and simulated inline holography reconstruction, suggesting that the same interleaving principle can extend beyond lensless cameras.

Related papers

• OmniPoint: Universal Monocular Metric Pointcloud from Any Camera [79.24417597712802]
  We present OmniPoint, a unified framework designed to generalize metric reconstruction across diverse imaging sensors.<n>To overcome projection rigidity, OmniPoint abandons conventional planar depth regression.<n>It instead adopts a decoupled ray and distance representation alongside a decoupled training objective.
  arXiv  Detail & Related papers  (2026-09-08T19:45:58Z)
• Architectural Unification for Polarimetric Imaging Across Multiple Degradations [54.83037963738918]
  We propose a unified architectural framework for polarimetric imaging that is structurally shared across multiple degradation scenarios.<n>The model performs single-stage joint image-Stokes processing, avoiding error accumulation and explicitly preserving physical consistency.
  arXiv  Detail & Related papers  (2026-03-06T02:38:57Z)
• Scale Equivariance Regularization and Feature Lifting in High Dynamic Range Modulo Imaging [19.49437461280304]
  This work proposes a learning-based HDR restoration framework.<n>It incorporates two key strategies: (i) a scale-equivariant regularization that enforces consistency under exposure variations, and (ii) a feature lifting input design combining the raw modulo image, wrapped finite differences.
  arXiv  Detail & Related papers  (2026-01-30T14:45:29Z)
• Learning to Remove Lens Flare in Event Camera [56.9171469873838]
  We present E-DeflareDeflare, the first framework for removing lens flare from event camera data.<n>We first establish the theoretical foundation by deriving a physics-grounded forward model of the non-linear suppression mechanism.<n> Empowered by this benchmark, we design E-DeflareNet, which achieves state-of-the-art restoration performance.
  arXiv  Detail & Related papers  (2025-12-09T18:59:57Z)
• Total Variation Subgradient Guided Image Fusion for Dual-Camera CASSI System [3.414706880536149]
  Spectral imaging technology has long-faced fundamental challenges in balancing spectral, spatial, and temporal resolutions.<n>Traditional model-based methods exhibit limited performance due to reliance on handcrafted inherent image priors.<n>We propose a dual-camera CASSI reconstruction framework that integrates total variation (TV) subgradient theory.
  arXiv  Detail & Related papers  (2025-09-13T16:57:06Z)
• Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
  Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
  arXiv  Detail & Related papers  (2025-09-11T23:12:55Z)
• Rotation Equivariant Arbitrary-scale Image Super-Resolution [62.41329042683779]
  The arbitrary-scale image super-resolution (ASISR) aims to achieve arbitrary-scale high-resolution recoveries from a low-resolution input image.<n>We make efforts to construct a rotation equivariant ASISR method in this study.
  arXiv  Detail & Related papers  (2025-08-07T08:51:03Z)
• LensNet: An End-to-End Learning Framework for Empirical Point Spread Function Modeling and Lensless Imaging Reconstruction [32.85180149439811]
  Lensless imaging stands out as a promising alternative to conventional lens-based systems.<n>Traditional lensless techniques often require explicit calibrations and extensive pre-processing.<n>We propose LensNet, an end-to-end deep learning framework that integrates spatial-domain and frequency-domain representations.
  arXiv  Detail & Related papers  (2025-05-03T09:11:52Z)
• Invertible Neural Warp for NeRF [29.00183106905031]
  This paper tackles the simultaneous optimization of pose and Neural Radiance Fields (NeRF) We propose a novel over parameterized representation that models camera poses as learnable rigid warp functions. We present results on synthetic and real-world datasets, and demonstrate that our approach outperforms existing baselines in terms of pose estimation and high-fidelity reconstruction.
  arXiv  Detail & Related papers  (2024-07-17T07:14:08Z)
• Towards Physics-informed Cyclic Adversarial Multi-PSF Lensless Imaging [0.5371337604556311]
  We introduce a novel approach to multi-PSF lensless imaging, employing a dual discriminator cyclic adversarial framework. We propose a unique generator architecture with a sparse convolutional PSF-aware auxiliary branch, coupled with a forward model integrated into the training loop. Our method achieves comparable performance to existing PSF-agnostic generative methods for single PSF cases and demonstrates resilience to PSF changes without the need for retraining.
  arXiv  Detail & Related papers  (2024-07-09T10:07:28Z)
• Distance Weighted Trans Network for Image Completion [52.318730994423106]
  We propose a new architecture that relies on Distance-based Weighted Transformer (DWT) to better understand the relationships between an image's components. CNNs are used to augment the local texture information of coarse priors. DWT blocks are used to recover certain coarse textures and coherent visual structures.
  arXiv  Detail & Related papers  (2023-10-11T12:46:11Z)
• Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution [51.274657266928315]
  We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
  arXiv  Detail & Related papers  (2021-04-07T12:00:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.