Filtering Pixel Latent Variables for Unmixing Noisy and Undersampled Volumetric Images
- URL: http://arxiv.org/abs/2312.05357v2
- Date: Sat, 6 Apr 2024 02:42:44 GMT
- Title: Filtering Pixel Latent Variables for Unmixing Noisy and Undersampled Volumetric Images
- Authors: Catherine Bouchard, Andréanne Deschênes, Vincent Boulanger, Jean-Michel Bellavance, Flavie Lavoie-Cardinal, Christian Gagné,
- Abstract summary: In experimental physics, enhancing the acquisition resolution or expanding the number of detection channels often leads to diminished sampling rate and signal-to-noise ratio.
We propose applying band-pass filters to the latent space of a multi-dimensional convolutional neural network to disentangle overlapping signal components.
Using multi-dimensional convolution kernels to process all dimensions simultaneously enhances the network's ability to extract information from adjacent pixels, time- or spectral-bins.
- Score: 6.2916043414599
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The development of robust signal unmixing algorithms is essential for leveraging multimodal datasets acquired through a wide array of scientific imaging technologies, including hyperspectral or time-resolved acquisitions. In experimental physics, enhancing the spatio-temporal resolution or expanding the number of detection channels often leads to diminished sampling rate and signal-to-noise ratio, significantly affecting the efficacy of signal unmixing algorithms. We propose applying band-pass filters to the latent space of a multi-dimensional convolutional neural network to disentangle overlapping signal components, enabling the isolation and quantification of their individual contributions. Using multi-dimensional convolution kernels to process all dimensions simultaneously enhances the network's ability to extract information from adjacent pixels, time- or spectral-bins. This approach enables more effective separation of components in cases where individual pixels do not provide clear, well-resolved information. We showcase the method's practical use in experimental physics through two test cases that highlight the versatility of our approach: fluorescence lifetime microscopy and mode decomposition in optical fibers. The latent unmixing method extracts valuable information from complex signals that cannot be resolved by standard methods. Application of latent unmixing to real FLIM experiments will increase the number of distinguishable fluorescent markers. It will also open new possibilities in optics and photonics for multichannel separations at increased sampling rate.
Related papers
- A multidimensional approach to quantum state tomography of photoelectron wavepackets [0.0]
We propose a new and more efficient protocol that is able to reconstruct the continuous variable density matrix of a photoelectron in a single time delay scan.
It is based on measuring the coherences of a photoelectron absorption of an XUV pulse using a broadband infrared (IR) probe that is scanned in time and a narrowband IR reference that is temporally fixed to the XUV pulse.
arXiv Detail & Related papers (2024-05-02T03:15:02Z) - Single-sample image-fusion upsampling of fluorescence lifetime images [0.9054230754796732]
Fluorescence lifetime imaging microscopy provides detailed information about molecular interactions and biological processes.
A major bottleneck for FLIM is image resolution at high acquisition speeds.
Here we present single-sample image-fusion upsampling (SiSIFUS), a data-fusion approach to computational FLIM super-resolution.
arXiv Detail & Related papers (2024-04-19T10:19:18Z) - Fluctuation-based deconvolution in fluorescence microscopy using
plug-and-play denoisers [2.236663830879273]
spatial resolution of images of living samples obtained by fluorescence microscopes is physically limited due to the diffraction of visible light.
Several deconvolution and super-resolution techniques have been proposed to overcome this limitation.
arXiv Detail & Related papers (2023-03-20T15:43:52Z) - On-chip quantum information processing with distinguishable photons [55.41644538483948]
Multi-photon interference is at the heart of photonic quantum technologies.
Here, we experimentally demonstrate that detection can be implemented with a temporal resolution sufficient to interfere photons detuned on the scales necessary for cavity-based integrated photon sources.
We show how time-resolved detection of non-ideal photons can be used to improve the fidelity of an entangling operation and to mitigate the reduction of computational complexity in boson sampling experiments.
arXiv Detail & Related papers (2022-10-14T18:16:49Z) - All-optical image classification through unknown random diffusers using
a single-pixel diffractive network [13.7472825798265]
classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields.
Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor.
Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel.
arXiv Detail & Related papers (2022-08-08T08:26:08Z) - Toward deep-learning-assisted spectrally-resolved imaging of magnetic
noise [52.77024349608834]
We implement a deep neural network to efficiently reconstruct the spectral density of the underlying fluctuating magnetic field.
These results create opportunities for the application of machine-learning methods to color-center-based nanoscale sensing and imaging.
arXiv Detail & Related papers (2022-08-01T19:18:26Z) - Decoupled-and-Coupled Networks: Self-Supervised Hyperspectral Image
Super-Resolution with Subpixel Fusion [67.35540259040806]
We propose a subpixel-level HS super-resolution framework by devising a novel decoupled-and-coupled network, called DCNet.
As the name suggests, DC-Net first decouples the input into common (or cross-sensor) and sensor-specific components.
We append a self-supervised learning module behind the CSU net by guaranteeing the material consistency to enhance the detailed appearances of the restored HS product.
arXiv Detail & Related papers (2022-05-07T23:40:36Z) - Regularization by Denoising Sub-sampled Newton Method for Spectral CT
Multi-Material Decomposition [78.37855832568569]
We propose to solve a model-based maximum-a-posterior problem to reconstruct multi-materials images with application to spectral CT.
In particular, we propose to solve a regularized optimization problem based on a plug-in image-denoising function.
We show numerical and experimental results for spectral CT materials decomposition.
arXiv Detail & Related papers (2021-03-25T15:20:10Z) - Neural network-based on-chip spectroscopy using a scalable plasmonic
encoder [0.4397520291340694]
Conventional spectrometers are limited by trade-offs set by size, cost, signal-to-noise ratio (SNR), and spectral resolution.
Here, we demonstrate a deep learning-based spectral reconstruction framework using a compact and low-cost on-chip sensing scheme.
arXiv Detail & Related papers (2020-12-01T22:50:06Z) - Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output.
We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
arXiv Detail & Related papers (2020-03-15T23:07:56Z) - Multifold Acceleration of Diffusion MRI via Slice-Interleaved Diffusion
Encoding (SIDE) [50.65891535040752]
We propose a diffusion encoding scheme, called Slice-Interleaved Diffusion.
SIDE, that interleaves each diffusion-weighted (DW) image volume with slices encoded with different diffusion gradients.
We also present a method based on deep learning for effective reconstruction of DW images from the highly slice-undersampled data.
arXiv Detail & Related papers (2020-02-25T14:48:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.