Peeling Context from Cause for Multimodal Molecular Property Prediction

• URL: http://arxiv.org/abs/2511.06692v1
• Date: Mon, 10 Nov 2025 04:29:33 GMT
• Title: Peeling Context from Cause for Multimodal Molecular Property Prediction
• Abstract summary: We introduce CLaP (Causal Layerwise Peeling), a framework that separates causal signal from context in a layerwise manner.<n>CLaP consistently improves MAE, MSE, and $R2$ over competitive baselines.<n>It produces atom-level causal saliency maps that highlight substructures responsible for predictions.
• Score: 12.900046337617546
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep models are used for molecular property prediction, yet they are often difficult to interpret and may rely on spurious context rather than causal structure, which reduces reliability under distribution shift and harms predictive performance. We introduce CLaP (Causal Layerwise Peeling), a framework that separates causal signal from context in a layerwise manner and integrates diverse graph representations of molecules. At each layer, a causal block performs a soft split into causal and non-causal branches, fuses causal evidence across modalities, and progressively removes batch-coupled context to focus on label-relevant structure, thereby limiting shortcut signals and stabilizing layerwise refinement. Across four molecular benchmarks, CLaP consistently improves MAE, MSE, and $R^2$ over competitive baselines. The model also produces atom-level causal saliency maps that highlight substructures responsible for predictions, providing actionable guidance for targeted molecular edits. Case studies confirm the accuracy of these maps and their alignment with chemical intuition. By peeling context from cause at every layer, the model yields predictors that are both accurate and interpretable for molecular design.

Related papers

• Do LLMs Truly Generalize in the Molecular Domain? A Perturbation-Based Analysis [35.63799709687231]
  We introduce a Molecular Perturbation framework that generates structural variants of training molecules under controlled Graph Edit Distance (GED)<n>Our analysis shows that even a single edit can cause substantial performance drops on common molecular tasks, revealing a narrow local trust region and fragile sensitivity to structural changes.<n>Our experiments also examine whether ICT confers robustness under controlled structural perturbations.
  arXiv  Detail & Related papers  (2026-07-02T07:16:28Z)
• SLASH the Sink: Sharpening Structural Attention Inside LLMs [55.75072688988806]
  Large Language Models (LLMs) show remarkable semantic understanding but struggle with structural understanding when processing graph topologies in a serialized format.<n>We propose StructuraL Attention SHarpening (SLASH), which amplifies this internal structural understanding via a plug-and-play attention redistribution.
  arXiv  Detail & Related papers  (2026-05-11T12:59:07Z)
• Proteo-R1: Reasoning Foundation Models for De Novo Protein Design [129.2825640976092]
  We introduce bfProteo-R1, a reasoning-guided protein design framework.<n>It decouples emphmolecular understanding from emphgeometric generation.<n>Proteo-R1 achieves stable, interpretable, and modular integration of reasoning with state-of-the-art geometric generative models.
  arXiv  Detail & Related papers  (2026-05-01T06:52:27Z)
• CausalFlip: A Benchmark for LLM Causal Judgment Beyond Semantic Matching [50.65932158912512]
  We propose a new causal reasoning benchmark, CausalFlip, to encourage the development of new large language models.<n>CaulFlip consists of causal judgment questions built over event triples that could form different confounder, chain, and collider relations.<n>We evaluate LLMs under multiple training paradigms, including answer-only training, explicit Chain-of-Thought supervision, and a proposed internalized causal reasoning approach.
  arXiv  Detail & Related papers  (2026-02-23T18:06:15Z)
• Context-aware Graph Causality Inference for Few-Shot Molecular Property Prediction [8.42839603549236]
  We propose CaMol, a context-aware graph causality inference framework.<n>First, we introduce a context graph that encodes chemical knowledge by linking functional groups, molecules, and properties.<n>Second, we propose a learnable atom masking strategy to disentangle causal substructures from confounding ones.<n>Third, we introduce a distribution intervener that applies backdoor adjustment by combining causal substructures with chemically grounded confounders.
  arXiv  Detail & Related papers  (2026-01-16T09:49:50Z)
• How well can off-the-shelf LLMs elucidate molecular structures from mass spectra using chain-of-thought reasoning? [51.286853421822705]
  Large language models (LLMs) have shown promise for reasoning-intensive scientific tasks, but their capability for chemical interpretation is still unclear.<n>We introduce a Chain-of-Thought (CoT) prompting framework and benchmark that evaluate how LLMs reason about mass spectral data to predict molecular structures.<n>Our evaluation across metrics of SMILES validity, formula consistency, and structural similarity reveals that while LLMs can produce syntactically valid and partially plausible structures, they fail to achieve chemical accuracy or link reasoning to correct molecular predictions.
  arXiv  Detail & Related papers  (2026-01-09T20:08:42Z)
• Knowledge-Augmented Long-CoT Generation for Complex Biomolecular Reasoning [51.673503054645415]
  Biomolecular mechanisms require multi-step reasoning across molecular interactions, signaling cascades, and metabolic pathways.<n>Existing approaches often exacerbate these issues: reasoning steps may deviate from biological facts or fail to capture long mechanistic dependencies.<n>We propose a Knowledge-Augmented Long-CoT Reasoning framework that integrates LLMs with knowledge graph-based multi-hop reasoning chains.
  arXiv  Detail & Related papers  (2025-11-11T09:26:32Z)
• Enhancing Chemical Explainability Through Counterfactual Masking [1.1024591739346294]
  We propose counterfactual masking, a framework that replaces masked substructures with chemically reasonable fragments.<n>Our approach bridges the gap between explainability and molecular design, offering a principled and generative path toward explainable machine learning in chemistry.
  arXiv  Detail & Related papers  (2025-08-25T23:41:36Z)
• Fragment-Wise Interpretability in Graph Neural Networks via Molecule Decomposition and Contribution Analysis [0.9217021281095907]
  SEAL (Substructure Explanation via Attribution Learning) is a new interpretable graph neural network that attributes model predictions to meaningful molecular subgraphs.<n> SEAL decomposes input graphs into chemically relevant fragments and estimates their causal influence on the output.
  arXiv  Detail & Related papers  (2025-08-20T19:15:53Z)
• Aligned Manifold Property and Topology Point Clouds for Learning Molecular Properties [55.2480439325792]
  This work introduces AMPTCR, a molecular surface representation that combines local quantum-derived scalar fields and custom topological descriptors within an aligned point cloud format.<n>For molecular weight, results confirm that AMPTCR encodes physically meaningful data, with a validation R2 of 0.87.<n>In the bacterial inhibition task, AMPTCR enables both classification and direct regression of E. coli inhibition values.
  arXiv  Detail & Related papers  (2025-07-22T04:35:50Z)
• Learning Flexible Forward Trajectories for Masked Molecular Diffusion [35.326540193307345]
  Masked diffusion models (MDMs) have achieved notable progress in modeling discrete data, while their potential in molecular generation remains underexplored.<n>We introduce the surprising result that naively applying standards MDMs severely degrades the performance.<n>We propose Masked Element-wise Learnable Diffusion (MELD) that orchestrates per-element corruption trajectories to avoid collision between distinct molecular graphs.
  arXiv  Detail & Related papers  (2025-05-22T15:30:17Z)
• On Error Propagation of Diffusion Models [77.91480554418048]
  We develop a theoretical framework to mathematically formulate error propagation in the architecture of DMs. We apply the cumulative error as a regularization term to reduce error propagation. Our proposed regularization reduces error propagation, significantly improves vanilla DMs, and outperforms previous baselines.
  arXiv  Detail & Related papers  (2023-08-09T15:31:17Z)
• Improving Molecular Contrastive Learning via Faulty Negative Mitigation and Decomposed Fragment Contrast [17.142976840521264]
  We propose iMolCLR: improvement of Molecular Contrastive Learning of Representations with graph neural networks (GNNs) Experiments have shown that the proposed strategies significantly improve the performance of GNN models. iMolCLR intrinsically embeds scaffolds and functional groups that can reason molecule similarities.
  arXiv  Detail & Related papers  (2022-02-18T18:33:27Z)
• Estimation of Bivariate Structural Causal Models by Variational Gaussian Process Regression Under Likelihoods Parametrised by Normalising Flows [74.85071867225533]
  Causal mechanisms can be described by structural causal models. One major drawback of state-of-the-art artificial intelligence is its lack of explainability.
  arXiv  Detail & Related papers  (2021-09-06T14:52:58Z)
• Causal Expectation-Maximisation [70.45873402967297]
  We show that causal inference is NP-hard even in models characterised by polytree-shaped graphs. We introduce the causal EM algorithm to reconstruct the uncertainty about the latent variables from data about categorical manifest variables. We argue that there appears to be an unnoticed limitation to the trending idea that counterfactual bounds can often be computed without knowledge of the structural equations.
  arXiv  Detail & Related papers  (2020-11-04T10:25:13Z)
• Structural Causal Models Are (Solvable by) Credal Networks [70.45873402967297]
  Causal inferences can be obtained by standard algorithms for the updating of credal nets. This contribution should be regarded as a systematic approach to represent structural causal models by credal networks. Experiments show that approximate algorithms for credal networks can immediately be used to do causal inference in real-size problems.
  arXiv  Detail & Related papers  (2020-08-02T11:19:36Z)
• CausalVAE: Structured Causal Disentanglement in Variational Autoencoder [52.139696854386976]
  The framework of variational autoencoder (VAE) is commonly used to disentangle independent factors from observations. We propose a new VAE based framework named CausalVAE, which includes a Causal Layer to transform independent factors into causal endogenous ones. Results show that the causal representations learned by CausalVAE are semantically interpretable, and their causal relationship as a Directed Acyclic Graph (DAG) is identified with good accuracy.
  arXiv  Detail & Related papers  (2020-04-18T20:09:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.