Log-Gaussian Gamma Processes for Training Bayesian Neural Networks in Raman and CARS Spectroscopies

• URL: http://arxiv.org/abs/2310.08055v2
• Date: Thu, 21 Dec 2023 13:21:30 GMT
• Title: Log-Gaussian Gamma Processes for Training Bayesian Neural Networks in Raman and CARS Spectroscopies
• Authors: Teemu H\"ark\"onen, Erik M. Vartiainen, Lasse Lensu, Matthew T. Moores, and Lassi Roininen
• Abstract summary: We propose an approach utilizing gamma-distributed random variables, coupled with log-Gaussian modeling, to generate synthetic datasets suitable for training neural networks. We apply this methodology to both Raman and coherent anti-Stokes Raman scattering (CARS) spectra, using experimental spectra to estimate gamma process parameters.
• Score: 0.03994567502796063
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose an approach utilizing gamma-distributed random variables, coupled with log-Gaussian modeling, to generate synthetic datasets suitable for training neural networks. This addresses the challenge of limited real observations in various applications. We apply this methodology to both Raman and coherent anti-Stokes Raman scattering (CARS) spectra, using experimental spectra to estimate gamma process parameters. Parameter estimation is performed using Markov chain Monte Carlo methods, yielding a full Bayesian posterior distribution for the model which can be sampled for synthetic data generation. Additionally, we model the additive and multiplicative background functions for Raman and CARS with Gaussian processes. We train two Bayesian neural networks to estimate parameters of the gamma process which can then be used to estimate the underlying Raman spectrum and simultaneously provide uncertainty through the estimation of parameters of a probability distribution. We apply the trained Bayesian neural networks to experimental Raman spectra of phthalocyanine blue, aniline black, naphthol red, and red 264 pigments and also to experimental CARS spectra of adenosine phosphate, fructose, glucose, and sucrose. The results agree with deterministic point estimates for the underlying Raman and CARS spectral signatures.

Related papers

• von Mises Quasi-Processes for Bayesian Circular Regression [57.88921637944379]
  We explore a family of expressive and interpretable distributions over circle-valued random functions. The resulting probability model has connections with continuous spin models in statistical physics. For posterior inference, we introduce a new Stratonovich-like augmentation that lends itself to fast Markov Chain Monte Carlo sampling.
  arXiv  Detail & Related papers  (2024-06-19T01:57:21Z)
• Stein Random Feature Regression [18.477250397403722]
  Stein random features (SRF) can be used to generate high-quality RFF samples and flexibly approximate non-analytical spectral measure posteriors. SRFs require only the evaluation of log-probability gradients to perform both kernel approximation and Bayesian kernel learning. We empirically validate the effectiveness of SRFs by comparing them to baselines on kernel approximation and well-known GP regression problems.
  arXiv  Detail & Related papers  (2024-06-01T13:24:48Z)
• Toward using GANs in astrophysical Monte-Carlo simulations [0.0]
  We show that generative adversarial network (GAN) is capable of statistically replicating the Maxwell-J"uttner distribution. The average value of the Kolmogorov-Smirnov test is 0.5 for samples generated by the neural network, showing that the generated distribution cannot be distinguished from the true distribution.
  arXiv  Detail & Related papers  (2024-02-16T23:07:53Z)
• Learning Radio Environments by Differentiable Ray Tracing [56.40113938833999]
  We introduce a novel gradient-based calibration method, complemented by differentiable parametrizations of material properties, scattering and antenna patterns. We have validated our method using both synthetic data and real-world indoor channel measurements, employing a distributed multiple-input multiple-output (MIMO) channel sounder.
  arXiv  Detail & Related papers  (2023-11-30T13:50:21Z)
• Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation [59.45669299295436]
  We propose a Monte Carlo PDE solver for training unsupervised neural solvers. We use the PDEs' probabilistic representation, which regards macroscopic phenomena as ensembles of random particles. Our experiments on convection-diffusion, Allen-Cahn, and Navier-Stokes equations demonstrate significant improvements in accuracy and efficiency.
  arXiv  Detail & Related papers  (2023-02-10T08:05:19Z)
• Gaussian Process Regression for Absorption Spectra Analysis of Molecular Dimers [68.8204255655161]
  We discuss an approach based on a machine learning technique, where the parameters for the numerical calculations are chosen from Gaussian Process Regression (GPR) This approach does not only quickly converge to an optimal parameter set, but in addition provides information about the complete parameter space. We find that indeed the GPR gives reliable results which are in agreement with direct calculations of these parameters using quantum chemical methods.
  arXiv  Detail & Related papers  (2021-12-14T17:46:45Z)
• Inverting brain grey matter models with likelihood-free inference: a tool for trustable cytoarchitecture measurements [62.997667081978825]
  characterisation of the brain grey matter cytoarchitecture with quantitative sensitivity to soma density and volume remains an unsolved challenge in dMRI. We propose a new forward model, specifically a new system of equations, requiring a few relatively sparse b-shells. We then apply modern tools from Bayesian analysis known as likelihood-free inference (LFI) to invert our proposed model.
  arXiv  Detail & Related papers  (2021-11-15T09:08:27Z)
• Online parameter inference for the simulation of a Bunsen flame using heteroscedastic Bayesian neural network ensembles [2.1485350418225244]
  This paper proposes a data-driven machine learning method for the online inference of the parameters of a G-equation model of a ducted, premixed flame. The proposed method provides cheap and online parameter and uncertainty estimates matching results obtained with the ensemble Kalman filter, at less computational cost.
  arXiv  Detail & Related papers  (2021-04-26T16:47:43Z)
• Sampling-free Variational Inference for Neural Networks with Multiplicative Activation Noise [51.080620762639434]
  We propose a more efficient parameterization of the posterior approximation for sampling-free variational inference. Our approach yields competitive results for standard regression problems and scales well to large-scale image classification tasks.
  arXiv  Detail & Related papers  (2021-03-15T16:16:18Z)
• Feature visualization of Raman spectrum analysis with deep convolutional neural network [0.0]
  We demonstrate a recognition and feature visualization method that uses a deep convolutional neural network for Raman spectrum analysis. The method is first examined for simple Lorentzian spectra, then applied to the spectra of pharmaceutical compounds and numerically mixed amino acids.
  arXiv  Detail & Related papers  (2020-07-27T08:15:38Z)
• Differentiable Programming for Hyperspectral Unmixing using a Physics-based Dispersion Model [9.96234892716562]
  In this paper, spectral variation is considered from a physics-based approach and incorporated into an end-to-end spectral unmixing algorithm. A technique for inverse rendering using a convolutional neural network is introduced to enhance performance and speed when training data is available. Results achieve state-of-the-art on both infrared and visible-to-near-infrared (VNIR) datasets.
  arXiv  Detail & Related papers  (2020-07-12T14:16:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.