Tabular foundation models for robust calibration of near-infrared chemical sensing data

• URL: http://arxiv.org/abs/2605.21544v1
• Date: Wed, 20 May 2026 09:48:18 GMT
• Title: Tabular foundation models for robust calibration of near-infrared chemical sensing data
• Abstract summary: Near-infrared spectroscopy is increasingly used as a rapid, non-destructive chemical sensing technology.<n>Tablet foundation models can provide a new calibration strategy for NIR chemical sensing.<n>We benchmark TabPFN on 66 NIR datasets covering 54 regression and 12 classification tasks.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Near-infrared spectroscopy is increasingly used as a rapid, non-destructive chemical sensing technology for the analysis of food, pharmaceutical, biological, and environmental samples. However, the practical deployment of NIR sensors still depends on calibration models able to handle high-dimensional, collinear spectra, limited sample sizes, preprocessing dependence, spectral outliers, and extrapolation beyond the calibration domain. Here, we evaluate whether tabular foundation models can provide a new calibration strategy for NIR chemical sensing. We benchmark TabPFN on 66 NIR datasets covering 54 regression and 12 classification tasks, and compare direct inference on raw spectra with preprocessing-optimized inference against PLS/PLS-DA, Ridge, Catboost, and one-dimensional convolutional neural networks. The study uses a unified validation framework in which preprocessing and model selection are performed exclusively on calibration data before external test evaluation. In regression, preprocessing-optimized TabPFN achieves the best overall average rank and significantly outperforms PLS, CatBoost, TabPFN on raw spectra, and CNN-1D, while remaining statistically comparable to Ridge. In classification, TabPFN applied directly to raw spectra provides the best average rank, with performance close to the optimized variant. Robustness analyses show that TabPFN provides strong average predictive performance but that its advantage decreases on spectral outliers and extrapolated samples, where classical chemometric models remain competitive. These results suggest that tabular foundation models can complement established chemometric workflows for NIR chemical sensing, especially in small- to medium-sized calibration settings, while highlighting the need for spectroscopy-specific priors and uncertainty-aware deployment strategies.

Related papers

• PCQA-R1: Advancing Generalized 3D Point Cloud Quality Assessment with Reinforcement Learning [51.75061005702151]
  No-reference point cloud quality assessment (PCQA) has been an active topic in recent years and is used to measure and optimize the visual experience of point clouds.<n>We present PCQA-R1, the first reinforcement learning LMM for 3D point cloud quality assessment to simultaneously model quality understanding and scoring.
  arXiv  Detail & Related papers  (2026-08-19T07:21:58Z)
• From field-scale to large-scale spectral libraries: Tabular foundation models in soil spectroscopy [0.6377541605829954]
  Visible and near-infrared (vis-NIR) and mid-infrared (MIR) spectroscopy enable rapid, cost-effective prediction of soil properties.<n> translating high-dimensional, highly collinear spectra into accurate soil property predictions remains challenging.<n>We investigated regression models and dimensionality reduction approaches for spectroscopic modeling across 85 regression tasks.
  arXiv  Detail & Related papers  (2026-08-01T11:56:50Z)
• Using Data-Derived Priors to Guide CNN Architecture Design for NIR Chemometrics [0.0]
  Convolutional neural networks (CNN) for near-infrared (NIR) chemometrics are often designed using generic architectural rules.<n>We tested whether spectral datasets differ in sampling, smoothness, redundancy, and sample size.<n>We computed descriptors of dataset size, spectral length and spacing, entropy, intrinsic rank, autocorrelation, and wavelet-scale structure.
  arXiv  Detail & Related papers  (2026-07-28T12:17:22Z)
• Spectroscopy Analysis with Machine Learning Regression for the Quantification of Carbon and Nitrogen Contents in Inceptisol and Oxisol Soil Types: Comparing Different Preprocessing and Validation methods as well as Feature Importance [0.35971250637104313]
  Near-Infrared (NIR) spectroscopy has emerged as a promising alternative to traditional soil analysis methods.<n>This work proposes a machine learning (ML) approach to calibrate predictive models for carbon (C) and nitrogen (N) content in Oxisols and Inceptisols.
  arXiv  Detail & Related papers  (2026-07-01T11:54:44Z)
• Reframing preprocessing selection as model-internal calibration in near-infrared spectroscopy: A large-scale benchmark of operator-adaptive PLS and Ridge models [0.2609784101826761]
  This paper studies the case where that search can be collapsed into one calibration step.<n> Linear operator-adaptive calibration gives comparable prediction quality to exhaustive preprocessing screening.
  arXiv  Detail & Related papers  (2026-05-13T14:23:00Z)
• Gradient Clipping Beyond Vector Norms: A Spectral Approach for Matrix-Valued Parameters [48.3175117923623]
  Most gradient clipping rules treat all parameters as heavy vectors and ignore the matrix structure of modern vectors.<n>We show empirically that data outliers often amplify only a small number of leading singular values.<n>Motivated by this phenomenon, we propose clipping, which stabilizes by singular values.
  arXiv  Detail & Related papers  (2026-05-12T09:24:59Z)
• Generalization from Low- to Moderate-Resolution Spectra with Neural Networks for Stellar Parameter Estimation: A Case Study with DESI [33.83813864639123]
  Cross-survey generalization is a critical challenge in stellar spectral analysis, particularly in cases such as transferring from low to moderate-resolution surveys.<n>We investigate this problem using pre-trained models, focusing on simple neural networks such as multilayer perceptrons (MLPs)<n>Specifically, we pre-trains on either LRS or their embeddings and fine-tune them for application to DESI stellar spectra.<n>We find that pre-trained on LAMOST LRS achieve strong performance, even without fine-tuning, and that modest fine-tuning with DESI spectra further improves the results.
  arXiv  Detail & Related papers  (2026-02-16T18:58:47Z)
• Spectral Gating Networks [65.9496901693099]
  We introduce Spectral Gating Networks (SGN) to introduce frequency-rich expressivity in feed-forward networks.<n>SGN augments a standard activation pathway with a compact spectral pathway and learnable gates that allow the model to start from a stable base behavior.<n>It consistently improves accuracy-efficiency trade-offs under comparable computational budgets.
  arXiv  Detail & Related papers  (2026-02-07T20:00:49Z)
• From Noisy Traces to Stable Gradients: Bias-Variance Optimized Preference Optimization for Aligning Large Reasoning Models [90.45197506653341]
  Large reasoning models generate intermediate reasoning traces before producing final answers.<n> aligning LRMs with human preferences, a crucial prerequisite for model deployment, remains underexplored.<n>A common workaround optimized a single sampled trajectory, which introduces substantial gradient variance from trace sampling.
  arXiv  Detail & Related papers  (2025-10-06T17:58:01Z)
• Approximated Orthogonal Projection Unit: Stabilizing Regression Network Training Using Natural Gradient [3.9858496473361402]
  We propose a novel NN named the Approximated Orthogonal Projection Unit (AOPU) which has solid mathematical basis and presents superior training stability. We prove that AOPU attains minimum variance estimation (MVE) in NN, wherein the truncated gradient approximates the natural gradient (NG) Empirical results on two chemical process datasets clearly show that AOPU outperforms other models in achieving stable convergence.
  arXiv  Detail & Related papers  (2024-09-23T03:42:50Z)
• Minimally Supervised Learning using Topological Projections in Self-Organizing Maps [55.31182147885694]
  We introduce a semi-supervised learning approach based on topological projections in self-organizing maps (SOMs) Our proposed method first trains SOMs on unlabeled data and then a minimal number of available labeled data points are assigned to key best matching units (BMU) Our results indicate that the proposed minimally supervised model significantly outperforms traditional regression techniques.
  arXiv  Detail & Related papers  (2024-01-12T22:51:48Z)
• Model-Based Reparameterization Policy Gradient Methods: Theory and Practical Algorithms [88.74308282658133]
  Reization (RP) Policy Gradient Methods (PGMs) have been widely adopted for continuous control tasks in robotics and computer graphics. Recent studies have revealed that, when applied to long-term reinforcement learning problems, model-based RP PGMs may experience chaotic and non-smooth optimization landscapes. We propose a spectral normalization method to mitigate the exploding variance issue caused by long model unrolls.
  arXiv  Detail & Related papers  (2023-10-30T18:43:21Z)
• Sampling from Gaussian Process Posteriors using Stochastic Gradient Descent [43.097493761380186]
  gradient algorithms are an efficient method of approximately solving linear systems. We show that gradient descent produces accurate predictions, even in cases where it does not converge quickly to the optimum. Experimentally, gradient descent achieves state-of-the-art performance on sufficiently large-scale or ill-conditioned regression tasks.
  arXiv  Detail & Related papers  (2023-06-20T15:07:37Z)
• Spectrum-BERT: Pre-training of Deep Bidirectional Transformers for Spectral Classification of Chinese Liquors [0.0]
  We propose a pre-training method of deep bidirectional transformers for spectral classification of Chinese liquors, abbreviated as Spectrum-BERT. We elaborately design two pre-training tasks, Next Curve Prediction (NCP) and Masked Curve Model (MCM), so that the model can effectively utilize unlabeled samples. In the comparative experiments, the proposed Spectrum-BERT significantly outperforms the baselines in multiple metrics.
  arXiv  Detail & Related papers  (2022-10-22T13:11:25Z)
• Exploring the Uncertainty Properties of Neural Networks' Implicit Priors in the Infinite-Width Limit [47.324627920761685]
  We use recent theoretical advances that characterize the function-space prior to an ensemble of infinitely-wide NNs as a Gaussian process. This gives us a better understanding of the implicit prior NNs place on function space. We also examine the calibration of previous approaches to classification with the NNGP.
  arXiv  Detail & Related papers  (2020-10-14T18:41:54Z)
• Convolutional neural networks for classification and regression analysis of one-dimensional spectral data [0.0]
  Convolutional neural networks (CNNs) are widely used for image recognition and text analysis. The performance of a CNN was investigated for classification and regression analysis of spectral data.
  arXiv  Detail & Related papers  (2020-05-15T13:20:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.