Solvaformer: an SE(3)-equivariant graph transformer for small molecule solubility prediction

• URL: http://arxiv.org/abs/2511.09774v1
• Date: Fri, 14 Nov 2025 01:08:58 GMT
• Title: Solvaformer: an SE(3)-equivariant graph transformer for small molecule solubility prediction
• Authors: Jonathan Broadbent, Michael Bailey, Mingxuan Li, Abhishek Paul, Louis De Lescure, Paul Chauvin, Lorenzo Kogler-Anele, Yasser Jangjou, Sven Jager,
• Abstract summary: Solvaformer is a geometry-aware graph transformer that models solutions as multiple molecules with independent SE(3) symmetries.<n>We train Solvaformer to predict both solubility (log S) and solvation free energy, using an alternating-batch regimen that trains on quantum-mechanical data and on experimental measurements.<n>Solvaformer attains the strongest overall performance among the learned models and approaches a DFT-assisted gradient-boosting baseline.
• Score: 2.274456001127632
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate prediction of small molecule solubility using material-sparing approaches is critical for accelerating synthesis and process optimization, yet experimental measurement is costly and many learning approaches either depend on quantumderived descriptors or offer limited interpretability. We introduce Solvaformer, a geometry-aware graph transformer that models solutions as multiple molecules with independent SE(3) symmetries. The architecture combines intramolecular SE(3)-equivariant attention with intermolecular scalar attention, enabling cross-molecular communication without imposing spurious relative geometry. We train Solvaformer in a multi-task setting to predict both solubility (log S) and solvation free energy, using an alternating-batch regimen that trains on quantum-mechanical data (CombiSolv-QM) and on experimental measurements (BigSolDB 2.0). Solvaformer attains the strongest overall performance among the learned models and approaches a DFT-assisted gradient-boosting baseline, while outperforming an EquiformerV2 ablation and sequence-based alternatives. In addition, token-level attention produces chemically coherent attributions: case studies recover known intra- vs. inter-molecular hydrogen-bonding patterns that govern solubility differences in positional isomers. Taken together, Solvaformer provides an accurate, scalable, and interpretable approach to solution-phase property prediction by uniting geometric inductive bias with a mixed dataset training strategy on complementary computational and experimental data.

Related papers

• Learning Inter-Atomic Potentials without Explicit Equivariance [24.438029202222555]
  We introduce TransIP: Transformer-based Inter-Atomic Potentials, a novel training paradigm for interatomic potentials.<n>Our approach guides a generic non-equivariant Transformer-based model to learn SO(3)-equivariance by optimizing its representations in the embedding space.<n>Compared to a data augmentation baseline, TransIP achieves 40% to 60% improvement in performance across varying OMol25 dataset sizes.
  arXiv  Detail & Related papers  (2025-09-25T22:15:10Z)
• Sampling 3D Molecular Conformers with Diffusion Transformers [13.536503487456622]
  Diffusion Transformers (DiTs) have demonstrated strong performance in generative modeling.<n>Applying DiTs to molecules introduces novel challenges, such as integrating discrete molecular graph information with continuous 3D geometry.<n>We propose DiTMC, a framework that adapts DiTs to address these challenges through a modular architecture.
  arXiv  Detail & Related papers  (2025-06-18T11:47:59Z)
• Towards Unified and Lossless Latent Space for 3D Molecular Latent Diffusion Modeling [90.23688195918432]
  3D molecule generation is crucial for drug discovery and material science.<n>Existing approaches typically maintain separate latent spaces for invariant and equivariant modalities.<n>We propose textbfUAE-3D, a multi-modal VAE that compresses 3D molecules into latent sequences from a unified latent space.
  arXiv  Detail & Related papers  (2025-03-19T08:56:13Z)
• Many-body Expansion Based Machine Learning Models for Octahedral Transition Metal Complexes [0.0]
  We present a modification to autocorrelation for machine learning various spin state dependent properties of octa transition metal complexes (TMCs) The new strategy is based on the many-body expansion (MBE) and allows one to tune the captured stereoisomer information by changing the truncation order of the MBE. Because the new approach incorporates insights from electronic structure theory, these models exhibit systematic generalization from homoleptic to heteroleptic complexes.
  arXiv  Detail & Related papers  (2024-10-12T21:54:22Z)
• Interpolation and differentiation of alchemical degrees of freedom in machine learning interatomic potentials [0.980222898148295]
  We report the use of continuous and differentiable alchemical degrees of freedom in atomistic materials simulations.<n>The proposed method introduces alchemical atoms with corresponding weights into the input graph, alongside modifications to the message-passing and readout mechanisms of MLIPs.<n>The end-to-end differentiability of MLIPs enables efficient calculation of the gradient of energy with respect to the compositional weights.
  arXiv  Detail & Related papers  (2024-04-16T17:24:22Z)
• From Peptides to Nanostructures: A Euclidean Transformer for Fast and Stable Machine Learned Force Fields [5.013279299982324]
  We propose a transformer architecture called SO3krates that combines sparse equivariant representations with a self-attention mechanism. SO3krates achieves a unique combination of accuracy, stability, and speed that enables insightful analysis of quantum properties of matter on extended time and system size scales.
  arXiv  Detail & Related papers  (2023-09-21T09:22:05Z)
• Calculating non-linear response functions for multi-dimensional electronic spectroscopy using dyadic non-Markovian quantum state diffusion [68.8204255655161]
  We present a methodology for simulating multi-dimensional electronic spectra of molecular aggregates with coupling electronic excitation to a structured environment. A crucial aspect of our approach is that we propagate the NMQSD equation in a doubled system Hilbert space but with the same noise.
  arXiv  Detail & Related papers  (2022-07-06T15:30:38Z)
• Equivariant Diffusion for Molecule Generation in 3D [74.289191525633]
  This work introduces a diffusion model for molecule computation generation in 3D that is equivariant to Euclidean transformations. Experimentally, the proposed method significantly outperforms previous 3D molecular generative methods regarding the quality of generated samples and efficiency at training time.
  arXiv  Detail & Related papers  (2022-03-31T12:52:25Z)
• A deep learning driven pseudospectral PCE based FFT homogenization algorithm for complex microstructures [68.8204255655161]
  It is shown that the proposed method is able to predict central moments of interest while being magnitudes faster to evaluate than traditional approaches. It is shown, that the proposed method is able to predict central moments of interest while being magnitudes faster to evaluate than traditional approaches.
  arXiv  Detail & Related papers  (2021-10-26T07:02:14Z)
• GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensembles [60.12186997181117]
  Prediction of a molecule's 3D conformer ensemble from the molecular graph holds a key role in areas of cheminformatics and drug discovery. Existing generative models have several drawbacks including lack of modeling important molecular geometry elements. We propose GeoMol, an end-to-end, non-autoregressive and SE(3)-invariant machine learning approach to generate 3D conformers.
  arXiv  Detail & Related papers  (2021-06-08T14:17:59Z)
• Learning Neural Generative Dynamics for Molecular Conformation Generation [89.03173504444415]
  We study how to generate molecule conformations (textiti.e., 3D structures) from a molecular graph. We propose a novel probabilistic framework to generate valid and diverse conformations given a molecular graph.
  arXiv  Detail & Related papers  (2021-02-20T03:17:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.