Angle Sensitive Pixels for Lensless Imaging on Spherical Sensors
- URL: http://arxiv.org/abs/2306.15953v1
- Date: Wed, 28 Jun 2023 06:28:53 GMT
- Title: Angle Sensitive Pixels for Lensless Imaging on Spherical Sensors
- Authors: Yi Hua, Yongyi Zhao, Aswin C. Sankaranarayanan
- Abstract summary: OrbCam is a lensless architecture for imaging with spherical sensors.
We show that the diversity of pixel orientations on a curved surface is sufficient to improve the conditioning of the mapping between the scene and the sensor.
- Score: 22.329417756084094
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We propose OrbCam, a lensless architecture for imaging with spherical
sensors. Prior work in lensless imager techniques have focused largely on using
planar sensors; for such designs, it is important to use a modulation element,
e.g. amplitude or phase masks, to construct a invertible imaging system. In
contrast, we show that the diversity of pixel orientations on a curved surface
is sufficient to improve the conditioning of the mapping between the scene and
the sensor. Hence, when imaging on a spherical sensor, all pixels can have the
same angular response function such that the lensless imager is comprised of
pixels that are identical to each other and differ only in their orientations.
We provide the computational tools for the design of the angular response of
the pixels in a spherical sensor that leads to well-conditioned and
noise-robust measurements. We validate our design in both simulation and a lab
prototype. The implications of our design is that the lensless imaging can be
enabled easily for curved and flexible surfaces thereby opening up a new set of
application domains.
Related papers
- Curved Diffusion: A Generative Model With Optical Geometry Control [56.24220665691974]
The influence of different optical systems on the final scene appearance is frequently overlooked.
This study introduces a framework that intimately integrates a textto-image diffusion model with the particular lens used in image rendering.
arXiv Detail & Related papers (2023-11-29T13:06:48Z) - Aperture Diffraction for Compact Snapshot Spectral Imaging [27.321750056840706]
We demonstrate a compact, cost-effective snapshot spectral imaging system named Aperture Diffraction Imaging Spectrometer (ADIS)
A new optical design that each point in the object space is multiplexed to discrete encoding locations on the mosaic filter sensor is introduced.
The Cascade Shift-Shuffle Spectral Transformer (CSST) with strong perception of the diffraction degeneration is designed to solve a sparsity-constrained inverse problem.
arXiv Detail & Related papers (2023-09-27T16:48:46Z) - Thin On-Sensor Nanophotonic Array Cameras [36.981384762023794]
We introduce emphflat nanophotonic computational cameras as an alternative to commodity cameras.
The optical array is embedded on a metasurface that, at 700nm height, is flat and sits on the sensor cover glass at 2.5mm focal distance from the sensor.
We reconstruct a megapixel image from our flat imager with a emphlearned probabilistic reconstruction method that employs a generative diffusion model to sample an implicit prior.
arXiv Detail & Related papers (2023-08-05T06:04:07Z) - Learning rich optical embeddings for privacy-preserving lensless image
classification [17.169529483306103]
We exploit the unique multiplexing property of casting the optics as an encoder that produces learned embeddings directly at the camera sensor.
We do so in the context of image classification, where we jointly optimize the encoder's parameters and those of an image classifier in an end-to-end fashion.
Our experiments show that jointly learning the lensless optical encoder and the digital processing allows for lower resolution embeddings at the sensor, and hence better privacy as it is much harder to recover meaningful images from these measurements.
arXiv Detail & Related papers (2022-06-03T07:38:09Z) - Compound eye inspired flat lensless imaging with spatially-coded
Voronoi-Fresnel phase [32.914536774672925]
We report a lensless camera with spatially-coded Voronoi-Fresnel phase, partly inspired by biological apposition compound eye, to achieve superior image quality.
We demonstrate and verify the imaging performance with a prototype Voronoi-Fresnel lensless camera on a 1.6-megapixel image sensor in various illumination conditions.
arXiv Detail & Related papers (2021-09-28T13:13:58Z) - Interaction-free imaging of multi-pixel objects [58.720142291102135]
Quantum imaging is well-suited to study sensitive samples which require low-light conditions, like biological tissues.
In this context, interaction-free measurements (IFM) allow us infer the presence of an opaque object without the photon interacting with the sample.
Here we extend the IFM imaging schemes to multi-pixel, semi-transparent objects, by encoding the information about the pixels into an internal degree of freedom.
arXiv Detail & Related papers (2021-06-08T06:49:19Z) - How to Calibrate Your Event Camera [58.80418612800161]
We propose a generic event camera calibration framework using image reconstruction.
We show that neural-network-based image reconstruction is well suited for the task of intrinsic and extrinsic calibration of event cameras.
arXiv Detail & Related papers (2021-05-26T07:06:58Z) - Optical Flow Estimation from a Single Motion-blurred Image [66.2061278123057]
Motion blur in an image may have practical interests in fundamental computer vision problems.
We propose a novel framework to estimate optical flow from a single motion-blurred image in an end-to-end manner.
arXiv Detail & Related papers (2021-03-04T12:45:18Z) - PlenoptiCam v1.0: A light-field imaging framework [8.467466998915018]
Light-field cameras play a vital role for rich 3-D information retrieval in narrow range depth sensing applications.
Key obstacle in composing light-fields from exposures taken by a plenoptic camera is to calibrate computationally, align and rearrange four-dimensional image data.
Several attempts have been proposed to enhance the overall image quality by tailoring pipelines dedicated to particular plenoptic cameras.
arXiv Detail & Related papers (2020-10-14T09:23:18Z) - Every Pixel Matters: Center-aware Feature Alignment for Domain Adaptive
Object Detector [95.51517606475376]
A domain adaptive object detector aims to adapt itself to unseen domains that may contain variations of object appearance, viewpoints or backgrounds.
We propose a domain adaptation framework that accounts for each pixel via predicting pixel-wise objectness and centerness.
arXiv Detail & Related papers (2020-08-19T17:57:03Z) - Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset
for Spatially Varying Isotropic Materials [65.95928593628128]
We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique.
Our algorithm is suitable for perspective cameras and nearby point light sources.
arXiv Detail & Related papers (2020-01-18T12:26:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.