NoMoPy: Noise Modeling in Python
- URL: http://arxiv.org/abs/2311.00084v1
- Date: Tue, 31 Oct 2023 18:52:05 GMT
- Title: NoMoPy: Noise Modeling in Python
- Abstract summary: NoMoPy is a code for fitting, analyzing, and generating noise modeled as a hidden Markov model (HMM)
Here, we describe in detail functionality implemented in NoMoPy and provide examples of its use and performance on example problems.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: NoMoPy is a code for fitting, analyzing, and generating noise modeled as a
hidden Markov model (HMM) or, more generally, factorial hidden Markov model
(FHMM). This code, written in Python, implements approximate and exact
expectation maximization (EM) algorithms for performing the parameter
estimation process, model selection procedures via cross-validation, and
parameter confidence region estimation. Here, we describe in detail the
functionality implemented in NoMoPy and provide examples of its use and
performance on example problems.
Related papers
- Probabilistic Model Checking Taken by Storm [5.706572558369409]
This tutorial focuses on Markov decision processes (MDP), which are popular in a variety of fields.<n>Storm is a decade-old model checker that excels in performance and a rich Python-based ecosystem.
arXiv Detail & Related papers (2026-03-16T17:22:21Z) - Value-Distributional Model-Based Reinforcement Learning [59.758009422067]
Quantifying uncertainty about a policy's long-term performance is important to solve sequential decision-making tasks.
We study the problem from a model-based Bayesian reinforcement learning perspective.
We propose Epistemic Quantile-Regression (EQR), a model-based algorithm that learns a value distribution function.
arXiv Detail & Related papers (2023-08-12T14:59:19Z) - PyVBMC: Efficient Bayesian inference in Python [8.924669503280333]
PyVBMC is a Python implementation of the Variational Bayesian Monte Carlo (VBMC) algorithm for posterior and model inference.
VBMC is designed for efficient parameter estimation and model assessment when model evaluations are mildly-to-very expensive.
arXiv Detail & Related papers (2023-03-16T17:37:22Z) - Evaluating Representations with Readout Model Switching [19.907607374144167]
In this paper, we propose to use the Minimum Description Length (MDL) principle to devise an evaluation metric.
We design a hybrid discrete and continuous-valued model space for the readout models and employ a switching strategy to combine their predictions.
The proposed metric can be efficiently computed with an online method and we present results for pre-trained vision encoders of various architectures.
arXiv Detail & Related papers (2023-02-19T14:08:01Z) - Fully Bayesian Autoencoders with Latent Sparse Gaussian Processes [23.682509357305406]
Autoencoders and their variants are among the most widely used models in representation learning and generative modeling.
We propose a novel Sparse Gaussian Process Bayesian Autoencoder model in which we impose fully sparse Gaussian Process priors on the latent space of a Bayesian Autoencoder.
arXiv Detail & Related papers (2023-02-09T09:57:51Z) - PAMI: partition input and aggregate outputs for model interpretation [69.42924964776766]
In this study, a simple yet effective visualization framework called PAMI is proposed based on the observation that deep learning models often aggregate features from local regions for model predictions.
The basic idea is to mask majority of the input and use the corresponding model output as the relative contribution of the preserved input part to the original model prediction.
Extensive experiments on multiple tasks confirm the proposed method performs better than existing visualization approaches in more precisely finding class-specific input regions.
arXiv Detail & Related papers (2023-02-07T08:48:34Z) - Learning Summary Statistics for Bayesian Inference with Autoencoders [58.720142291102135]
We use the inner dimension of deep neural network based Autoencoders as summary statistics.
To create an incentive for the encoder to encode all the parameter-related information but not the noise, we give the decoder access to explicit or implicit information that has been used to generate the training data.
arXiv Detail & Related papers (2022-01-28T12:00:31Z) - Inverting brain grey matter models with likelihood-free inference: a
tool for trustable cytoarchitecture measurements [62.997667081978825]
characterisation of the brain grey matter cytoarchitecture with quantitative sensitivity to soma density and volume remains an unsolved challenge in dMRI.
We propose a new forward model, specifically a new system of equations, requiring a few relatively sparse b-shells.
We then apply modern tools from Bayesian analysis known as likelihood-free inference (LFI) to invert our proposed model.
arXiv Detail & Related papers (2021-11-15T09:08:27Z) - MoEfication: Conditional Computation of Transformer Models for Efficient
Inference [66.56994436947441]
Transformer-based pre-trained language models can achieve superior performance on most NLP tasks due to large parameter capacity, but also lead to huge computation cost.
We explore to accelerate large-model inference by conditional computation based on the sparse activation phenomenon.
We propose to transform a large model into its mixture-of-experts (MoE) version with equal model size, namely MoEfication.
arXiv Detail & Related papers (2021-10-05T02:14:38Z) - Active and sparse methods in smoothed model checking [2.28438857884398]
We consider extensions to smoothed model checking based on sparse variational methods and active learning.
Online extensions of sparse variational Gaussian process inference algorithms are demonstrated to provide a scalable method for implementing active learning approaches for smoothed model checking.
arXiv Detail & Related papers (2021-04-20T13:03:25Z) - Scaling Hidden Markov Language Models [118.55908381553056]
This work revisits the challenge of scaling HMMs to language modeling datasets.
We propose methods for scaling HMMs to massive state spaces while maintaining efficient exact inference, a compact parameterization, and effective regularization.
arXiv Detail & Related papers (2020-11-09T18:51:55Z) - Adaptive Physics-Informed Neural Networks for Markov-Chain Monte Carlo [2.741266294612776]
We focus on a class of parameter estimation problems for which computing the likelihood function requires solving a PDE.
The proposed method consists of: (1) constructing an offline PINN-UQ model as an approximation to the forward model; and (2) refining this approximate model on the fly using samples generated from the MCMC sampler.
We numerically demonstrate the performance of the proposed APINN method in solving a parameter estimation problem for a system governed by the Poisson equation.
arXiv Detail & Related papers (2020-08-03T15:25:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.