Rejections Based on Predictive Uncertainty Enable Reliable Routine Soil Spectroscopy

• URL: http://arxiv.org/abs/2606.21179v1
• Date: Fri, 19 Jun 2026 07:42:56 GMT
• Title: Rejections Based on Predictive Uncertainty Enable Reliable Routine Soil Spectroscopy
• Abstract summary: We introduce reject-to-remeasure: an AI-based measurement framework that combines probabilistic modelling with uncertainty-guided rejection.<n>Rejected samples are subsequently remeasured using conventional laboratory procedures.<n>On a regional visible-near-infrared spectral soil library from Québec, we demonstrate that reject-to-remeasure can facilitate the integration of optical spectroscopy into routine laboratory.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Soil properties relevant to agricultural and environmental applications are conventionally measured using elaborate laboratory methods involving physical and chemical processing. While highly accurate, these conventional methods are costly and time-consuming. In contrast, optical spectroscopy paired with machine learning enables rapid and cost-effective predictions of multiple soil properties. However, spectroscopic modelling is often considered unreliable, as the predictive accuracy varies between soil properties and individual samples. To balance this trade-off between cost and reliability, we introduce reject-to-remeasure: an AI-based measurement framework that combines probabilistic modelling with uncertainty-guided rejection. In this framework, soil samples are first analysed using spectroscopy, after which predictions are rejected if their predictive uncertainty exceeds predefined quality constraints. Rejected samples are subsequently remeasured using conventional laboratory procedures. On a regional visible-near-infrared spectral soil library from Québec, we demonstrate that reject-to-remeasure with modern foundation models (TabPFNv2.5 and TabICLv2) can facilitate the integration of optical spectroscopy into routine laboratory workflows while meeting user-defined accuracy requirements and reducing measurement costs.

Related papers

• Spectroscopy Analysis with Machine Learning Regression for the Quantification of Carbon and Nitrogen Contents in Inceptisol and Oxisol Soil Types: Comparing Different Preprocessing and Validation methods as well as Feature Importance [0.35971250637104313]
  Near-Infrared (NIR) spectroscopy has emerged as a promising alternative to traditional soil analysis methods.<n>This work proposes a machine learning (ML) approach to calibrate predictive models for carbon (C) and nitrogen (N) content in Oxisols and Inceptisols.
  arXiv  Detail & Related papers  (2026-07-01T11:54:44Z)
• Beyond Point Estimates: Benchmarking Uncertainty Quantification Methods on the AION-1 Astronomical Foundation Model [47.71489969727656]
  Conformalized Quantile Regression (CQR) delivers the best coverage in the bin with the poorest model predictions.<n>Only the Locally Valid and Discriminative (LVD) framework provides finite-sample emphlocal validity.
  arXiv  Detail & Related papers  (2026-06-05T18:29:19Z)
• The Value of Mechanistic Priors in Sequential Decision Making [41.418304743101174]
  Hybrid mechanistic models, physical priors with learned residuals, promise to reduce the data required for good decisions, but have no computable criterion to test this.<n>We characterize the value of mechanistic priors in sequential decision-making within both and burn-in regimes.
  arXiv  Detail & Related papers  (2026-05-11T05:43:53Z)
• Score-based diffusion models for diffuse optical tomography with uncertainty quantification [0.8443238959374133]
  We introduce a novel regularization approach that prevents overfitting of the score function by constructing a mixed score composed of a learned and a model-based component.<n>Experiments demonstrate that a data-driven prior distribution results in posterior samples with low variance, compared to classical model-based estimation.
  arXiv  Detail & Related papers  (2026-02-03T12:14:07Z)
• Improving Minimax Estimation Rates for Contaminated Mixture of Multinomial Logistic Experts via Expert Heterogeneity [49.809923981964715]
  Contaminated mixture of experts (MoE) is motivated by transfer learning methods where a pre-trained model, acting as a frozen expert, is integrated with an adapter model, functioning as a trainable expert, in order to learn a new task.<n>In this work, we characterize uniform convergence rates for estimating parameters under challenging settings where ground-truth parameters vary with the sample size.<n>We also establish corresponding minimax lower bounds to ensure that these rates are minimax optimal.
  arXiv  Detail & Related papers  (2026-01-31T23:45:50Z)
• Inductive Domain Transfer In Misspecified Simulation-Based Inference [29.26298096319145]
  We propose a fully inductive and amortized SBI framework that integrates calibration and distributional alignment into a single, end-to-end trainable model.<n>Our approach matches or surpasses the performance of RoPE, as well as other standard SBI and non- SBI estimators.
  arXiv  Detail & Related papers  (2025-08-21T14:06:42Z)
• Uncertainty-Driven Modeling of Microporosity and Permeability in Clastic Reservoirs Using Random Forest [3.4137115855910762]
  The aim of this study is to develop a cost-effective machine learning model to predict complex reservoir properties.<n>The model achieved a high level of accuracy in predicting microporosity (93%) and permeability levels (88%).
  arXiv  Detail & Related papers  (2025-03-21T09:05:04Z)
• Prediction-Powered Causal Inferences [59.98498488132307]
  We focus on Prediction-Powered Causal Inferences (PPCI)<n>We first show that conditional calibration guarantees valid PPCI at population level.<n>We then introduce a sufficient representation constraint transferring validity across experiments.
  arXiv  Detail & Related papers  (2025-02-10T10:52:17Z)
• Addressing Misspecification in Simulation-based Inference through Data-driven Calibration [43.811367860375825]
  This work introduces robust posterior estimation(RoPE), a framework that overcomes model misspecification with a small real-world calibration set of ground-truth parameter measurements.<n>Results on four synthetic tasks and two real-world problems with ground-truth labels demonstrate that RoPE outperforms baselines and consistently returns informative and calibrated credible intervals.
  arXiv  Detail & Related papers  (2024-05-14T16:04:39Z)
• Generative structured normalizing flow Gaussian processes applied to spectroscopic data [4.0773490083614075]
  In the physical sciences, limited training data may not adequately characterize future observed data. It is critical that models adequately indicate uncertainty, particularly when they may be asked to extrapolate. We demonstrate the methodology on laser-induced breakdown spectroscopy data from the ChemCam instrument onboard the Mars rover Curiosity.
  arXiv  Detail & Related papers  (2022-12-14T23:57:46Z)
• Comparing Spectroscopy Measurements in the Prediction of in Vitro Dissolution Profile using Artificial Neural Networks [0.0]
  Dissolution testing is part of the target product quality that is essential in approving new products in the pharmaceutical industry. The prediction of the dissolution profile based on spectroscopic data is an alternative to the current destructive and time-consuming method. Raman and near-infrared (NIR) spectroscopies are two fast and complementary methods that provide information on the tablets' physical and chemical properties.
  arXiv  Detail & Related papers  (2022-10-19T04:34:04Z)
• Minimax Estimation of Conditional Moment Models [40.95498063465325]
  We introduce a min-max criterion function, under which the estimation problem can be thought of as solving a zero-sum game. We analyze the statistical estimation rate of the resulting estimator for arbitrary hypothesis spaces. We show how our modified mean squared error rate, combined with conditions that bound the ill-posedness of the inverse problem, lead to mean squared error rates.
  arXiv  Detail & Related papers  (2020-06-12T14:02:38Z)
• Machine Learning and Deep Learning methods for predictive modelling from Raman spectra in bioprocessing [0.0]
  This work focused on pretreatment methods of Raman spectra for the facilitation of the regression task using Machine Learning and Deep Learning methods. In the majority of cases, this robustness allowed to outperform conventional Raman models in terms of prediction error and prediction robustness.
  arXiv  Detail & Related papers  (2020-05-06T16:15:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.