Pliable rejection sampling
- URL: http://arxiv.org/abs/2604.22385v1
- Date: Fri, 24 Apr 2026 09:21:53 GMT
- Title: Pliable rejection sampling
- Abstract summary: We present pliable rejection sampling (PRS), a new approach to rejection sampling.<n>PRS builds on rejection sampling and comes with a guarantee on the number of accepted samples.
- Score: 61.01438712621603
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Rejection sampling is a technique for sampling from difficult distributions. However, its use is limited due to a high rejection rate. Common adaptive rejection sampling methods either work only for very specific distributions or without performance guarantees. In this paper, we present pliable rejection sampling (PRS), a new approach to rejection sampling, where we learn the sampling proposal using a kernel estimator. Since our method builds on rejection sampling, the samples obtained are with high probability i.i.d. and distributed according to f. Moreover, PRS comes with a guarantee on the number of accepted samples.
Related papers
- Accelerating Speculative Diffusions via Block Verification [77.23389794645801]
Speculative decoding speeds up LLM inference by using a draft model to generate tokens, with an acceptance-rejection scheme.<n>Existing diffusion adaptations either use inefficient sampling techniques or rely on an alternative scheme.<n>We introduce a novel scheme that efficiently implements the original speculative sampling mechanism for diffusion models.
arXiv Detail & Related papers (2026-06-11T14:54:13Z) - Cactus: Accelerating Auto-Regressive Decoding with Constrained Acceptance Speculative Sampling [29.45621080100186]
Speculative sampling (SpS) has been successful in accelerating the decoding throughput of auto-regressive large language models.<n>We propose Cactus (constrained acceptance speculative sampling), a method that guarantees controlled divergence from the verifier distribution.
arXiv Detail & Related papers (2026-04-05T03:37:30Z) - Flipping Against All Odds: Reducing LLM Coin Flip Bias via Verbalized Rejection Sampling [59.133428586090226]
Large language models (LLMs) can often accurately describe probability distributions using natural language.<n>This mismatch limits their use in tasks requiring reliableity, such as Monte Carlo methods, agent-based simulations, and randomized decision-making.<n>We introduce Verbalized Rejection Sampling (VRS), a natural-language adaptation of classical rejection sampling.
arXiv Detail & Related papers (2025-06-11T17:59:58Z) - Enhanced Importance Sampling through Latent Space Exploration in Normalizing Flows [69.8873421870522]
importance sampling is a rare event simulation technique used in Monte Carlo simulations.<n>We propose a method for more efficient sampling by updating the proposal distribution in the latent space of a normalizing flow.
arXiv Detail & Related papers (2025-01-06T21:18:02Z) - Random Sampling for Diffusion-based Adversarial Purification [21.401448516056686]
Denoising Diffusion Probabilistic Models (DDPMs) have gained great attention in adversarial purification.<n>Inspired by the stability of the Denoising Diffusion Implicit Model (DDIM), we propose an opposite sampling scheme called random sampling.<n>In brief, random sampling will sample from a random noisy space during each diffusion process, while DDPM and DDIM sampling will continuously sample from the adjacent or original noisy space.
arXiv Detail & Related papers (2024-11-28T07:04:09Z) - Optimal Budgeted Rejection Sampling for Generative Models [54.050498411883495]
Rejection sampling methods have been proposed to improve the performance of discriminator-based generative models.
We first propose an Optimal Budgeted Rejection Sampling scheme that is provably optimal.
Second, we propose an end-to-end method that incorporates the sampling scheme into the training procedure to further enhance the model's overall performance.
arXiv Detail & Related papers (2023-11-01T11:52:41Z) - Sampling from Discrete Energy-Based Models with Quality/Efficiency
Trade-offs [3.491202838583993]
Energy-Based Models (EBMs) allow for extremely flexible specifications of probability distributions.
They do not provide a mechanism for obtaining exact samples from these distributions.
We propose a new approximate sampling technique, Quasi Rejection Sampling (QRS), that allows for a trade-off between sampling efficiency and sampling quality.
arXiv Detail & Related papers (2021-12-10T17:51:37Z) - Reparameterized Sampling for Generative Adversarial Networks [71.30132908130581]
We propose REP-GAN, a novel sampling method that allows general dependent proposals by REizing the Markov chains into the latent space of the generator.
Empirically, extensive experiments on synthetic and real datasets demonstrate that our REP-GAN largely improves the sample efficiency and obtains better sample quality simultaneously.
arXiv Detail & Related papers (2021-07-01T10:34:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.