Measurement-Adapted Eigentask Representations for Photon-Limited Optical Readout

• URL: http://arxiv.org/abs/2605.10008v1
• Date: Mon, 11 May 2026 05:35:08 GMT
• Title: Measurement-Adapted Eigentask Representations for Photon-Limited Optical Readout
• Abstract summary: downstream inference depends on how noisy high-dimensional sensor measurements are represented before classification or decision-making.<n>We show that eigentasks provide a measurement-adapted representation for optical sensor outputs by ordering readout features according to their resolvability under noise.
• Score: 7.173241044998128
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Optical readout in low-light imaging is fundamentally limited by measurement noise, including photon shot noise, detector noise, and quantization error. In this regime, downstream inference depends not only on the optical front end, but also on how noisy high-dimensional sensor measurements are represented before classification or decision-making. Here we show that eigentasks provide a measurement-adapted representation for optical sensor outputs by ordering readout features according to their resolvability under noise. Using experimental data from a lens-based optical imaging system and a reanalysis of published data from a single-photon-detection neural network, we find that eigentask representations frequently outperform standard baselines including principal component analysis and filtering-based compression. The advantage is most pronounced in photon-limited, few-shot, and higher-difficulty classification regimes. In few-shot MPEG-7 classification, for example, the advantage over other methods reaches about 10 percentage points as the number of classes increases. In these settings, eigentasks yield more informative low-dimensional features and improve sample-efficient downstream learning. These results identify measurement-adapted representation as a promising strategy for optical inference when photon budget, acquisition time, and task complexity are constrained.

Related papers

• End-to-End Optimization of Incoherent Imaging for Classification Under Detector-Limited Readout [2.6207362827093044]
  This paper focuses on object classification, a central imaging task, and asks when end-to-end optimization of a phase mask for incoherent imaging improves performance.<n>We find that these gains arise primarily under constrained detector readout and are limited under full detector readout.
  arXiv  Detail & Related papers  (2026-06-08T17:48:14Z)
• Passive Imaging with Quantum Advantage [40.27113751459193]
  We propose and implement a method for reducing the effect of this noise by optically pre-processing the incoming light prior to detection.<n>Our scheme, termed Fourier Domain Division (FDD), partitions the Fourier plane into multiple regions for independent detection and subsequent post-processing for image reconstruction.<n>We demonstrate our method in microscopy, achieving 5-fold improvement of Fisher information on high spatial-frequency components.
  arXiv  Detail & Related papers  (2026-05-07T10:06:49Z)
• Quantum Compressed Sensing Enables Image Classification with a Single Photon [2.5112823693334163]
  We develop a photon level image classification method using quantum compressed sensing.<n>By exploiting the parallelism of photonic quantum superposition states, a single photon can be encoded the complete spatial information of a high-dimensional image.<n>It provides a foundation for intelligent sensing systems that operate under extreme photon budgets and harsh environments.
  arXiv  Detail & Related papers  (2026-04-28T10:33:20Z)
• Grayscale to Hyperspectral at Any Resolution Using a Phase-Only Lens [0.0]
  We study the problem of reconstructing a HxWx31 hyperspectral image from a HxW grayscale snapshot measurement.<n>We make efficient use of limited data by training a conditional denoising diffusion model that operates on small patches.<n>Experiments reveal that patch sizes as small as the PSFs support achieve excellent results.
  arXiv  Detail & Related papers  (2024-12-03T20:00:21Z)
• bit2bit: 1-bit quanta video reconstruction via self-supervised photon prediction [57.199618102578576]
  We propose bit2bit, a new method for reconstructing high-quality image stacks at original resolution from sparse binary quantatemporal image data. Inspired by recent work on Poisson denoising, we developed an algorithm that creates a dense image sequence from sparse binary photon data. We present a novel dataset containing a wide range of real SPAD high-speed videos under various challenging imaging conditions.
  arXiv  Detail & Related papers  (2024-10-30T17:30:35Z)
• Generalizable Non-Line-of-Sight Imaging with Learnable Physical Priors [52.195637608631955]
  Non-line-of-sight (NLOS) imaging has attracted increasing attention due to its potential applications. Existing NLOS reconstruction approaches are constrained by the reliance on empirical physical priors. We introduce a novel learning-based solution, comprising two key designs: Learnable Path Compensation (LPC) and Adaptive Phasor Field (APF)
  arXiv  Detail & Related papers  (2024-09-21T04:39:45Z)
• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• Deep Semantic Statistics Matching (D2SM) Denoising Network [70.01091467628068]
  We introduce the Deep Semantic Statistics Matching (D2SM) Denoising Network. It exploits semantic features of pretrained classification networks, then it implicitly matches the probabilistic distribution of clear images at the semantic feature space. By learning to preserve the semantic distribution of denoised images, we empirically find our method significantly improves the denoising capabilities of networks.
  arXiv  Detail & Related papers  (2022-07-19T14:35:42Z)
• A photosensor employing data-driven binning for ultrafast image recognition [0.0]
  Pixel binning is a technique widely used in optical image acquisition and spectroscopy. Here, we push the concept of binning to its limit by combining a large fraction of the sensor elements into a single superpixel. For a given pattern recognition task, its optimal shape is determined from training data using a machine learning algorithm.
  arXiv  Detail & Related papers  (2021-11-20T15:38:39Z)
• Light Lies: Optical Adversarial Attack [24.831391763610046]
  This paper introduces an optical adversarial attack, which physically alters the light field information arriving at the image sensor so that the classification model yields misclassification. We present experiments based on both simulation and a real hardware optical system, from which the feasibility of the proposed optical attack is demonstrated.
  arXiv  Detail & Related papers  (2021-06-18T04:20:49Z)
• DAQ: Distribution-Aware Quantization for Deep Image Super-Resolution Networks [49.191062785007006]
  Quantizing deep convolutional neural networks for image super-resolution substantially reduces their computational costs. Existing works either suffer from a severe performance drop in ultra-low precision of 4 or lower bit-widths, or require a heavy fine-tuning process to recover the performance. We propose a novel distribution-aware quantization scheme (DAQ) which facilitates accurate training-free quantization in ultra-low precision.
  arXiv  Detail & Related papers  (2020-12-21T10:19:42Z)
• Deep Bilateral Retinex for Low-Light Image Enhancement [96.15991198417552]
  Low-light images suffer from poor visibility caused by low contrast, color distortion and measurement noise. This paper proposes a deep learning method for low-light image enhancement with a particular focus on handling the measurement noise. The proposed method is very competitive to the state-of-the-art methods, and has significant advantage over others when processing images captured in extremely low lighting conditions.
  arXiv  Detail & Related papers  (2020-07-04T06:26:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.