λSplit: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy

• URL: http://arxiv.org/abs/2603.23647v1
• Date: Tue, 24 Mar 2026 18:42:27 GMT
• Title: λSplit: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy
• Abstract summary: In fluorescence microscopy, spectral unmixing aims to recover individual fluorophore concentrations from spectral images that capture mixed fluorophore emissions.<n>Split is a physics-informed deep generative model that learns a conditional distribution over concentration maps using a hierarchical Variational Autoencoder.<n>Split is compatible with spectral data produced by standard confocal microscopes, enabling immediate adoption without specialized hardware modifications.
• Score: 6.057692339318057
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In fluorescence microscopy, spectral unmixing aims to recover individual fluorophore concentrations from spectral images that capture mixed fluorophore emissions. Since classical methods operate pixel-wise and rely on least-squares fitting, their performance degrades with increasingly overlapping emission spectra and higher levels of noise, suggesting that a data-driven approach that can learn and utilize a structural prior might lead to improved results. Learning-based approaches for spectral imaging do exist, but they are either not optimized for microscopy data or are developed for very specific cases that are not applicable to fluorescence microscopy settings. To address this, we propose λSplit, a physics-informed deep generative model that learns a conditional distribution over concentration maps using a hierarchical Variational Autoencoder. A fully differentiable Spectral Mixer enforces consistency with the image formation process, while the learned structural priors enable state-of-the-art unmixing and implicit noise removal. We demonstrate λSplit on 3 real-world datasets that we synthetically cast into a total of 66 challenging spectral unmixing benchmarks. We compare our results against a total of 10 baseline methods, including classical methods and a range of learning-based methods. Our results consistently show competitive performance and improved robustness in high noise regimes, when spectra overlap considerably, or when the spectral dimensionality is lowered, making λSplit a new state-of-the-art for spectral unmixing of fluorescent microscopy data. Importantly, λSplit is compatible with spectral data produced by standard confocal microscopes, enabling immediate adoption without specialized hardware modifications.

Related papers

• A Practical Noise2Noise Denoising Pipeline for High-Throughput Raman Spectroscopy [0.0]
  The approach relies on a one-dimensional convolutional autoencoder trained using a Noise2Noise strategy.<n>From a reduced training subset composed of repeated short-exposure acquisitions, the model learns to reconstruct Raman spectra while efficiently suppressing noise.<n>Results demonstrate that integration times as short as 5 ms per spectrum, which are typically insufficient for reliable interpretation, yield denoised spectra with high fidelity to the reference data.
  arXiv  Detail & Related papers  (2026-05-18T15:03:43Z)
• Unmixing microinfrared spectroscopic images of cross-sections of historical oil paintings [38.319445753146404]
  We propose an unsupervised CNN autoencoder for blind unmixing of ATR-$$FTIR HSIs, estimating endmember spectra and their abundance maps.<n>We demonstrate the method on an ATR-$$FTIR cross-section from the Ghent Altarpiece attributed to the Van Eyck brothers.
  arXiv  Detail & Related papers  (2026-03-03T09:47:48Z)
• CARL: Camera-Agnostic Representation Learning for Spectral Image Analysis [69.02751635551724]
  Spectral imaging offers promising applications across diverse domains, including medicine and urban scene understanding.<n> variability in channel dimensionality and captured wavelengths among spectral cameras impede the development of AI-driven methodologies.<n>We introduce CARL, a model for Camera-Agnostic Representation Learning across RGB, multispectral, and hyperspectral imaging modalities.
  arXiv  Detail & Related papers  (2025-04-27T13:06:40Z)
• Unmixing Optical Signals from Undersampled Volumetric Measurements by Filtering the Pixel Latent Variables [5.74378659752939]
  Latent Unmixing is a new approach which applies bandpass filters to the latent space of a multidimensional convolutional neural network to disentangle overlapping signal components.<n>We showcase the method's practical use in experimental physics through two test cases that highlight the versatility of our approach.
  arXiv  Detail & Related papers  (2023-12-08T20:34:37Z)
• Image Processing and Machine Learning for Hyperspectral Unmixing: An Overview and the HySUPP Python Package [80.11512905623417]
  Unmixing estimates the fractional abundances of the endmembers within the pixel. This paper provides an overview of advanced and conventional unmixing approaches. We compare the performance of the unmixing techniques on three simulated and two real datasets.
  arXiv  Detail & Related papers  (2023-08-18T08:10:41Z)
• Fluctuation-based deconvolution in fluorescence microscopy using plug-and-play denoisers [2.236663830879273]
  spatial resolution of images of living samples obtained by fluorescence microscopes is physically limited due to the diffraction of visible light. Several deconvolution and super-resolution techniques have been proposed to overcome this limitation.
  arXiv  Detail & Related papers  (2023-03-20T15:43:52Z)
• Spectral Unmixing of Hyperspectral Images Based on Block Sparse Structure [1.491109220586182]
  This paper presents an innovative spectral unmixing approach for hyperspectral images (HSIs) based on block-sparse structure and sparse Bayesian learning strategy.
  arXiv  Detail & Related papers  (2022-04-10T09:37:41Z)
• Spectral Splitting and Aggregation Network for Hyperspectral Face Super-Resolution [82.59267937569213]
  High-resolution (HR) hyperspectral face image plays an important role in face related computer vision tasks under uncontrolled conditions. In this paper, we investigate how to adapt the deep learning techniques to hyperspectral face image super-resolution. We present a spectral splitting and aggregation network (SSANet) for HFSR with limited training samples.
  arXiv  Detail & Related papers  (2021-08-31T02:13:00Z)
• Regularization by Denoising Sub-sampled Newton Method for Spectral CT Multi-Material Decomposition [78.37855832568569]
  We propose to solve a model-based maximum-a-posterior problem to reconstruct multi-materials images with application to spectral CT. In particular, we propose to solve a regularized optimization problem based on a plug-in image-denoising function. We show numerical and experimental results for spectral CT materials decomposition.
  arXiv  Detail & Related papers  (2021-03-25T15:20:10Z)
• Neural network-based on-chip spectroscopy using a scalable plasmonic encoder [0.4397520291340694]
  Conventional spectrometers are limited by trade-offs set by size, cost, signal-to-noise ratio (SNR), and spectral resolution. Here, we demonstrate a deep learning-based spectral reconstruction framework using a compact and low-cost on-chip sensing scheme.
  arXiv  Detail & Related papers  (2020-12-01T22:50:06Z)
• Cross-Spectral Periocular Recognition with Conditional Adversarial Networks [59.17685450892182]
  We propose Conditional Generative Adversarial Networks, trained to con-vert periocular images between visible and near-infrared spectra. We obtain a cross-spectral periocular performance of EER=1%, and GAR>99% @ FAR=1%, which is comparable to the state-of-the-art with the PolyU database.
  arXiv  Detail & Related papers  (2020-08-26T15:02:04Z)
• Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
  We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output. We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
  arXiv  Detail & Related papers  (2020-03-15T23:07:56Z)
• Residual-Sparse Fuzzy $C$-Means Clustering Incorporating Morphological Reconstruction and Wavelet frames [146.63177174491082]
  Fuzzy $C$-Means (FCM) algorithm incorporates a morphological reconstruction operation and a tight wavelet frame transform. We present an improved FCM algorithm by imposing an $ell_0$ regularization term on the residual between the feature set and its ideal value. Experimental results reported for synthetic, medical, and color images show that the proposed algorithm is effective and efficient, and outperforms other algorithms.
  arXiv  Detail & Related papers  (2020-02-14T10:00:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.