PertReason: A Knowledge-Grounded Benchmark and Framework for Cell-State-Conditioned Mechanistic Reasoning of Perturbation Effects
- URL: http://arxiv.org/abs/2607.18777v1
- Date: Tue, 21 Jul 2026 06:59:25 GMT
- Title: PertReason: A Knowledge-Grounded Benchmark and Framework for Cell-State-Conditioned Mechanistic Reasoning of Perturbation Effects
- Abstract summary: We introduce PertReason, a knowledge-grounded benchmark and framework suite for cell-state-conditioned reasoning.<n>PertReasonQA is a benchmark that tests whether models can generate mechanistically faithful explanations.<n>We present PertReasonLM, a large language model trained to align outcome predictions with context-specific mechanistic reasoning.
- Score: 11.347908338100515
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Evaluating machine learning in scientific domains requires separating correct predictions from correct reasons under realistic distribution shifts. We introduce PertReason, a knowledge-grounded benchmark and framework suite for cell-state--conditioned reasoning about perturbation effects. At its core, PertReasonQA is a benchmark that tests whether models can generate mechanistically faithful explanations while remaining robust to complex shifts, such as new cells and unseen perturbations. PertReasonQA combines single-cell genetic and chemical perturbation data across multiple cellular contexts with knowledge graphs, and dynamically conditions pathways on cell-specific basal states to avoid generic memorization. Evaluations on state-of-the-art models reveal systematic gaps between predictive accuracy and mechanistic reasoning. Specifically, these models exhibit failure modes largely invisible to standard benchmarks, such as deriving correct answers through flawed logic, ignoring cellular context, and generating directionally inconsistent mechanisms. As a reference probe of the benchmark, we present PertReasonLM, a large language model trained to align outcome predictions with context-specific mechanistic reasoning. Our model targets the identified failure modes by grounding rationales in context-specific pathways and tightening agreement between outcomes and mechanisms. Together, we provide a diagnostic framework for exposing and mitigating failures in faithful reasoning in data-rich scientific systems.
Related papers
- Accurate, Interdisciplinary and Transparent Structure-property Understanding with Deep Native Structural Reasoning [103.788281428856]
We introduce SciReasoner, a scientific foundation model for native structural reasoning across proteins, small molecules and inorganic crystals.<n>SciReasoner discretizes coordinates, topologies and periodic connectivities into a unified structure-aware vocabulary.<n>Across 86 benchmarks, SciReasoner achieves state-of-the-art performance on 67 tasks.
arXiv Detail & Related papers (2026-07-08T17:59:59Z) - Plausibility Is Not Prediction: Contrastive Evidence for LLM-Based Cellular Perturbation Reasoning [27.902219493068824]
Perturbation experiments are central to understanding cellular mechanisms.<n>They remain costly and sparse, motivating prediction of gene expression responses for unobserved conditions.<n>We introduce CORE, which reframes prediction as a comparison task by organizing evidence into positive and negative outcomes from related perturbations.
arXiv Detail & Related papers (2026-05-31T06:13:26Z) - Learning Latent Dynamical Causal Processes for Single-Cell Perturbation Prediction [40.68914450179759]
Single-cell perturbation prediction aims to infer how cells respond to unseen interventions.<n>We propose a latent dynamical causal generative model for single-cell perturbation data.<n>Under suitable conditions, the latent causal variables are recoverable up to standard equivalence classes.
arXiv Detail & Related papers (2026-05-25T08:32:23Z) - AROMA: Augmented Reasoning Over a Multimodal Architecture for Virtual Cell Genetic Perturbation Modeling [10.19071074895934]
We propose AROMA, an Augmented Reasoning Over a Multimodal Architecture for virtual cell genetic perturbation modeling.<n>AROMA integrates textual evidence, graph-topology information, and protein sequence features to model perturbation-target dependencies.<n>It is trained with a two-stage optimization strategy to yield predictions that are both accurate and interpretable.
arXiv Detail & Related papers (2026-04-22T07:10:45Z) - MAT-Cell: A Multi-Agent Tree-Structured Reasoning Framework for Batch-Level Single-Cell Annotation [81.82645086402366]
We propose MAT-Cell, a neuro-symbolic reasoning framework that reframes single-cell analysis into constructive, verifiable proof generation.<n> MAT-Cell injects symbolic constraints through adaptive Retrieval-Augmented Generation (RAG) to ground neural reasoning in biological axioms and reduce transcriptomic noise.<n>It significantly outperforms state-of-the-art (SOTA) models and maintains robust per-formance in challenging scenarios.
arXiv Detail & Related papers (2026-04-07T04:56:06Z) - Reason-IAD: Knowledge-Guided Dynamic Latent Reasoning for Explainable Industrial Anomaly Detection [85.29900916231655]
Reason-IAD is a knowledge-guided dynamic latent reasoning framework for explainable industrial anomaly detection.<n>Experiments demonstrate that Reason-IAD consistently outperforms state-of-the-art methods.
arXiv Detail & Related papers (2026-02-10T14:54:17Z) - Latent Causal Diffusions for Single-Cell Perturbation Modeling [83.47931153555321]
We present a generative model that frames single-cell gene expression as a stationary diffusion process observed under measurement noise.<n> LCD outperforms established approaches in predicting the distributional shifts of unseen perturbation combinations in single-cell RNA-sequencing screens.<n>We develop an approach we call causal linearization via perturbation responses (CLIPR), which yields an approximation of the direct causal effects between all genes.
arXiv Detail & Related papers (2026-01-20T16:15:38Z) - Causal Graph Neural Networks for Healthcare [2.446787923076599]
Causal graph neural networks address this triple crisis of distribution shift, discrimination, and inscrutability.<n>This Review examines methodological foundations spanning structural causal models, disentangled causal representation learning, and techniques for interventional prediction and counterfactual reasoning on graphs.
arXiv Detail & Related papers (2025-11-04T12:34:46Z) - TxPert: Leveraging Biochemical Relationships for Out-of-Distribution Transcriptomic Perturbation Prediction [11.083533122552396]
We present TxPert, a new state-of-the-art method that leverages multiple biological knowledge networks to predict responses under OOD scenarios.<n>In particular, we present: (i) TxPert, a new state-of-the-art method that leverages multiple biological knowledge networks to predict responses under OOD scenarios; (ii) an in-depth analysis demonstrating the impact of graphs, model architecture, and data on performance; and (iii) an expanded benchmarking framework that strengthens evaluation standards for perturbation modeling.
arXiv Detail & Related papers (2025-05-20T21:13:23Z) - Generative Intervention Models for Causal Perturbation Modeling [80.72074987374141]
In many applications, it is a priori unknown which mechanisms of a system are modified by an external perturbation.<n>We propose a generative intervention model (GIM) that learns to map these perturbation features to distributions over atomic interventions.
arXiv Detail & Related papers (2024-11-21T10:37:57Z) - On the Generalization and Adaption Performance of Causal Models [99.64022680811281]
Differentiable causal discovery has proposed to factorize the data generating process into a set of modules.
We study the generalization and adaption performance of such modular neural causal models.
Our analysis shows that the modular neural causal models outperform other models on both zero and few-shot adaptation in low data regimes.
arXiv Detail & Related papers (2022-06-09T17:12:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.