Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?

• URL: http://arxiv.org/abs/2606.24995v1
• Date: Tue, 23 Jun 2026 15:52:35 GMT
• Title: Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?
• Abstract summary: Tabular foundation models (TFMs) achieve strong performance on microbiome abundance data, yet their robustness under realistic distribution shift remains poorly characterized.<n>We introduce a benchmark that evaluates the robustness of TFMs to biologically inspired perturbations across six gut microbiome datasets spanning four disease contexts.
• Score: 2.4513329242158512
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Tabular foundation models (TFMs) achieve strong performance on microbiome abundance data, yet their robustness under realistic distribution shift remains poorly characterized. We introduce a benchmark that evaluates the robustness of TFMs to biologically inspired perturbations across six gut microbiome datasets spanning four disease contexts. In this in-context learning setting, models receive unperturbed support sets as context and are evaluated on perturbed query samples. To isolate robustness beyond "shortcut" features, we preserve the most discriminative taxa and apply three controlled perturbation strategies: (i) removal of high-abundance (uninformative) taxa, (ii) sparsification via increased zero-inflation, and (iii) zero-imputation via spurious non-zero injections. Our results show that protecting discriminative features is insufficient to guarantee stability under support-query shift: across datasets, all perturbations degrade model performance, with zero-imputation consistently the most harmful, indicating that corrupting global feature structure can break generalization even when key taxa are retained. Sparsification disproportionately affects TFMs relative to a classical random forest baseline, suggesting greater sensitivity to zero-inflation-type shifts. The code is publicly available at: https://github.com/UMMISCO/metagenomics-fm/.

Related papers

• Impute-EM: Native Mixed-State Diffusion Models for Heterogeneous Data Imputation [71.74203645336385]
  Impute-EM alternates between imputing missing entries with the current model and refitting a diffusion backbone on completed data.<n>We characterize the update and show that the observed mask-indexed marginals match the targets at the limit.
  arXiv  Detail & Related papers  (2026-09-14T09:39:13Z)
• FMMO: Detecting the Divergence Between Local Attribution and Global Drift [2.007262412327553]
  Post-deployment drift poses a critical risk to algorithmic accountability.<n>We demonstrate that popular local attribution methods can exhibit misleading stability even as model reliability collapses.<n>We propose a Framework for Model Monitoring and Observability (FMMO) designed to expose the divergence between local explanation stability and global distribution shifts.
  arXiv  Detail & Related papers  (2026-09-05T16:25:59Z)
• Destroy Me: Automatic Artifact Generation for Histopathology Images [0.0]
  "Destroy Me" is a framework for realistic artifact synthesis and robust data augmentation.<n>We show that models trained on "destroyed" patches consistently outperform baselines on independent real-world datasets.
  arXiv  Detail & Related papers  (2026-08-27T10:12:09Z)
• Provable Sparse Inversion and Token Relabel Enhanced One-shot Federated Learning with ViTs [77.42033827176806]
  One-Shot Federated Learning, where a central server learns a global model in a single communication round, has emerged as a promising paradigm.<n>We propose a novel Federated Model Inversion and Token Relabel framework, which trains the global model by fully exploiting all patches of synthetic images.
  arXiv  Detail & Related papers  (2026-05-11T15:49:08Z)
• Improving Machine Learning Performance with Synthetic Augmentation [0.0]
  We formalize synthetic augmentation as a modification of the effective training distribution.<n>Additional samples may reduce estimation error, but they may also shift the population objective.<n>We show that synthetic augmentation is beneficial only in variance-dominant regimes.<n>Rare-regime targeting can improve domain-specific metrics but may conflict with unconditional permutation inference.
  arXiv  Detail & Related papers  (2026-04-16T00:23:01Z)
• Noise Immunity in In-Context Tabular Learning: An Empirical Robustness Analysis of TabPFN's Attention Mechanisms [0.0]
  Tabular foundation models (TFMs) generalize across heterogeneous datasets through in-context learning (ICL)<n>We study TabPFN and its attention mechanisms for binary classification problems with controlled synthetic perturbations.<n>We analyze internal signals including attention concentration and attention-based feature ranking metrics.
  arXiv  Detail & Related papers  (2026-04-06T17:16:37Z)
• A feature-stable and explainable machine learning framework for trustworthy decision-making under incomplete clinical data [0.14658400971135646]
  We present CACTUS (Comprehensive Abstraction and Classification Tool for Uncovering Structures), an explainable machine learning framework.<n>CACTUS integrates feature abstraction, interpretable classification, and systematic feature stability analysis to quantify how consistently informative features are preserved as data quality degrades.<n>We demonstrate that CACTUS achieves competitive or superior predictive performance while maintaining markedly higher stability of top-ranked features as missingness increases.
  arXiv  Detail & Related papers  (2026-02-19T13:48:10Z)
• Causal Data Augmentation for Robust Fine-Tuning of Tabular Foundation Models [45.21399037022976]
  CausalMixFT is a method that enhances fine-tuning robustness and downstream performance.<n>It generates structurally consistent synthetic samples using Structural Causal Models (SCMs) fitted on the target dataset.<n> evaluated across 33 classification datasets from TabArena and over 2300 fine-tuning runs.
  arXiv  Detail & Related papers  (2026-01-07T17:16:39Z)
• Learning Robust Diffusion Models from Imprecise Supervision [75.53546939251146]
  DMIS is a unified framework for training robust Conditional Diffusion Models from Imprecise Supervision.<n>Our framework is derived from likelihood and decomposes the objective into generative and classification components.<n>Experiments on diverse forms of imprecise supervision, covering tasks covering image generation, weakly supervised learning, and dataset condensation demonstrate that DMIS consistently produces high-quality and class-discriminative samples.
  arXiv  Detail & Related papers  (2025-10-03T14:00:32Z)
• Revisiting Multivariate Time Series Forecasting with Missing Values [65.30332997607141]
  Missing values are common in real-world time series.<n>Current approaches have developed an imputation-then-prediction framework that uses imputation modules to fill in missing values, followed by forecasting on the imputed data.<n>This framework overlooks a critical issue: there is no ground truth for the missing values, making the imputation process susceptible to errors that can degrade prediction accuracy.<n>We introduce Consistency-Regularized Information Bottleneck (CRIB), a novel framework built on the Information Bottleneck principle.
  arXiv  Detail & Related papers  (2025-09-27T20:57:48Z)
• Robust Molecular Property Prediction via Densifying Scarce Labeled Data [53.24886143129006]
  In drug discovery, compounds most critical for advancing research often lie beyond the training set.<n>We propose a novel bilevel optimization approach that leverages unlabeled data to interpolate between in-distribution (ID) and out-of-distribution (OOD) data.
  arXiv  Detail & Related papers  (2025-06-13T15:27:40Z)
• Unlabelled Data Improves Bayesian Uncertainty Calibration under Covariate Shift [100.52588638477862]
  We develop an approximate Bayesian inference scheme based on posterior regularisation. We demonstrate the utility of our method in the context of transferring prognostic models of prostate cancer across globally diverse populations.
  arXiv  Detail & Related papers  (2020-06-26T13:50:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.