Hardware-aware Coding Function Design for Compressive Single-Photon 3D Cameras

• URL: http://arxiv.org/abs/2510.12123v1
• Date: Tue, 14 Oct 2025 03:52:24 GMT
• Title: Hardware-aware Coding Function Design for Compressive Single-Photon 3D Cameras
• Authors: David Parra, Felipe Gutierrez-Barragan, Trevor Seets, Andreas Velten,
• Abstract summary: We present a constrained optimization approach for designing practical coding functions for compressive single-photon 3D imaging.<n>We show through extensive simulations that our coding functions consistently outperform traditional coding designs under both bandwidth and peak power constraints.
• Score: 3.630476667966841
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Single-photon cameras are becoming increasingly popular in time-of-flight 3D imaging because they can time-tag individual photons with extreme resolution. However, their performance is susceptible to hardware limitations, such as system bandwidth, maximum laser power, sensor data rates, and in-sensor memory and compute resources. Compressive histograms were recently introduced as a solution to the challenge of data rates through an online in-sensor compression of photon timestamp data. Although compressive histograms work within limited in-sensor memory and computational resources, they underperform when subjected to real-world illumination hardware constraints. To address this, we present a constrained optimization approach for designing practical coding functions for compressive single-photon 3D imaging. Using gradient descent, we jointly optimize an illumination and coding matrix (i.e., the coding functions) that adheres to hardware constraints. We show through extensive simulations that our coding functions consistently outperform traditional coding designs under both bandwidth and peak power constraints. This advantage is particularly pronounced in systems constrained by peak power. Finally, we show that our approach adapts to arbitrary parameterized impulse responses by evaluating it on a real-world system with a non-ideal impulse response function.

Related papers

• Towards Efficient and Effective Multi-Camera Encoding for End-to-End Driving [54.85072592658933]
  We present Flex, an efficient and effective scene encoder that addresses the computational bottleneck of processing high-volume multi-camera data in autonomous driving.<n>By design, our approach is geometry-agnostic, learning a compact scene representation directly from data without relying on the explicit 3D inductive biases.<n>Our findings challenge the prevailing assumption that 3D priors are necessary, demonstrating that a data-driven, joint encoding strategy offers a more scalable, efficient and effective path for future autonomous driving systems.
  arXiv  Detail & Related papers  (2025-12-11T18:59:46Z)
• RAVE: Rate-Adaptive Visual Encoding for 3D Gaussian Splatting [17.19039932786604]
  We propose a flexible compression scheme for 3DGS that supports at any rate between predefined bounds.<n>Our method is computationally lightweight, requires no retraining for any rate, and preserves rendering quality across a broad range of operating points.<n> Experiments demonstrate that the approach achieves efficient, high-quality compression while offering dynamic rate control, making it suitable for practical deployment in immersive applications.
  arXiv  Detail & Related papers  (2025-12-07T23:59:46Z)
• Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
  Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
  arXiv  Detail & Related papers  (2025-09-11T23:12:55Z)
• SpikeGS: Learning 3D Gaussian Fields from Continuous Spike Stream [20.552076533208687]
  A spike camera is a specialized high-speed visual sensor that offers advantages such as high temporal resolution and high dynamic range. We introduce SpikeGS, the method to learn 3D Gaussian fields solely from spike stream. Our method can reconstruct view synthesis results with fine texture details from a continuous spike stream captured by a moving spike camera.
  arXiv  Detail & Related papers  (2024-09-23T16:28:41Z)
• Single-Photon 3D Imaging with Equi-Depth Photon Histograms [4.432168053497992]
  Single-photon 3D cameras estimate the round-trip time of a laser pulse by forming equi-width (EW) histograms of detected photon timestamps. EW histograms require high bandwidth and in-pixel memory, making SPCs less attractive in resource-constrained settings. We propose a 3D sensing technique based on equi-depth (ED) histograms.
  arXiv  Detail & Related papers  (2024-08-28T22:02:38Z)
• Image-GS: Content-Adaptive Image Representation via 2D Gaussians [52.598772767324036]
  We introduce Image-GS, a content-adaptive image representation based on 2D Gaussians radiance.<n>It supports hardware-friendly rapid access for real-time usage, requiring only 0.3K MACs to decode a pixel.<n>We demonstrate its versatility with several applications, including texture compression, semantics-aware compression, and joint image compression and restoration.
  arXiv  Detail & Related papers  (2024-07-02T00:45:21Z)
• Efficient and accurate neural field reconstruction using resistive memory [52.68088466453264]
  Traditional signal reconstruction methods on digital computers face both software and hardware challenges. We propose a systematic approach with software-hardware co-optimizations for signal reconstruction from sparse inputs. This work advances the AI-driven signal restoration technology and paves the way for future efficient and robust medical AI and 3D vision applications.
  arXiv  Detail & Related papers  (2024-04-15T09:33:09Z)
• Count-Free Single-Photon 3D Imaging with Race Logic [6.204834501774316]
  A single-photon 3D camera determines the round-trip time of a laser pulse by capturing the arrival of individual photons at each camera pixel. In-pixel histogram processing is computationally expensive and requires large amount of memory per pixel. Here we present an online approach for distance estimation without explicitly storing photon counts.
  arXiv  Detail & Related papers  (2023-07-10T22:17:59Z)
• Real-Time Radiance Fields for Single-Image Portrait View Synthesis [85.32826349697972]
  We present a one-shot method to infer and render a 3D representation from a single unposed image in real-time. Given a single RGB input, our image encoder directly predicts a canonical triplane representation of a neural radiance field for 3D-aware novel view synthesis via volume rendering. Our method is fast (24 fps) on consumer hardware, and produces higher quality results than strong GAN-inversion baselines that require test-time optimization.
  arXiv  Detail & Related papers  (2023-05-03T17:56:01Z)
• Improved FRQI on superconducting processors and its restrictions in the NISQ era [62.997667081978825]
  We study the feasibility of the Flexible Representation of Quantum Images (FRQI) We also check experimentally what is the limit in the current noisy intermediate-scale quantum era. We propose a method for simplifying the circuits needed for the FRQI.
  arXiv  Detail & Related papers  (2021-10-29T10:42:43Z)
• Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systems [56.154190098338965]
  We show that our proposed time multiplexed coded aperture (TMCA) can be optimized end-to-end. TMCA induces better coded snapshots enabling superior reconstructions in two different applications: compressive light field imaging and hyperspectral imaging. This codification outperforms the state-of-the-art compressive imaging systems by more than 4dB in those applications.
  arXiv  Detail & Related papers  (2021-04-06T22:42:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.