MolDA: Molecular Understanding and Generation via Large Language Diffusion Model

• URL: http://arxiv.org/abs/2604.04403v2
• Date: Tue, 07 Apr 2026 14:28:35 GMT
• Title: MolDA: Molecular Understanding and Generation via Large Language Diffusion Model
• Abstract summary: MolDA is a novel framework that replaces the conventional AR backbone with a discrete Large Language Diffusion Model.<n>It ensures global structural coherence, chemical validity, and robust reasoning across molecule generation, captioning, and property prediction.
• Score: 7.901276712572294
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Large Language Models (LLMs) have significantly advanced molecular discovery, but existing multimodal molecular architectures fundamentally rely on autoregressive (AR) backbones. This strict left-to-right inductive bias is sub-optimal for generating chemically valid molecules, as it struggles to account for non-local global constraints (e.g., ring closures) and often accumulates structural errors during sequential generation. To address these limitations, we propose MolDA (Molecular language model with masked Diffusion with mAsking), a novel multimodal framework that replaces the conventional AR backbone with a discrete Large Language Diffusion Model. MolDA extracts comprehensive structural representations using a hybrid graph encoder, which captures both local and global topologies, and aligns them into the language token space via a Q-Former. Furthermore, we mathematically reformulate Molecular Structure Preference Optimization specifically for the masked diffusion. Through bidirectional iterative denoising, MolDA ensures global structural coherence, chemical validity, and robust reasoning across molecule generation, captioning, and property prediction.

Related papers

• MolEmb: Multimodal Large Language Models Can Be Strong Molecular Embedding Models [21.71979155816693]
  Molecular embedding models can serve as foundational infrastructure for computational chemistry and drug discovery.<n>We ask whether multimodal large language models (MLLMs) can serve as emphgeneral molecular embedding models.<n>We introduce textbfMolEmb, a lightweight framework that adapts MLLMs by aligning molecular profiles with textual descriptions in a shared embedding space.
  arXiv  Detail & Related papers  (2026-08-24T09:21:04Z)
• Molecular Representations in Implicit Functional Space via Hyper-Networks [53.70982267248536]
  We argue that molecular learning can instead be formulated as learning in function space.<n>We instantiate this formulation with MolField, a hyper-network-based framework that learns distributions over molecular fields.<n>Our results show that treating molecules as continuous functions fundamentally changes how molecular representations generalize across tasks.
  arXiv  Detail & Related papers  (2026-01-29T21:13:37Z)
• From Tokens to Blocks: A Block-Diffusion Perspective on Molecular Generation [17.14830371749135]
  GPT-based molecular language models (MLM) have shown strong molecular design performance by learning chemical syntax and semantics from large-scale data.<n>Here, we propose SoftMol, a unified framework that co-designs molecular representation, model architecture, and search strategy for target-aware generation.<n>SoftMol achieves 100% chemical validity, improves binding affinity by 9.7%, yields a 2-3x increase in molecular diversity, and delivers a 6.6x speedup in inference efficiency.
  arXiv  Detail & Related papers  (2026-01-29T16:42:24Z)
• KnowMol: Advancing Molecular Large Language Models with Multi-Level Chemical Knowledge [73.51130155601824]
  We introduce KnowMol-100K, a large-scale dataset with 100K fine-grained molecular annotations across multiple levels.<n>We also propose chemically-informative molecular representation, effectively addressing limitations in existing molecular representation strategies.<n>KnowMol achieves superior performance across molecular understanding and generation tasks.
  arXiv  Detail & Related papers  (2025-10-22T11:23:58Z)
• HyperDiffusionFields (HyDiF): Diffusion-Guided Hypernetworks for Learning Implicit Molecular Neural Fields [12.849722578846178]
  We introduce HyperDiffusionFields (HyDiF), a framework that models 3D molecular conformers as continuous fields.<n>At the core of our approach is the Molecular Directional Field (MDF), a vector field that maps any point in space to the direction of the nearest atom of a particular type.<n>We demonstrate that our approach scales to larger biomolecules, illustrating a promising direction for field-based molecular modeling.
  arXiv  Detail & Related papers  (2025-10-20T21:41:10Z)
• Mol-CADiff: Causality-Aware Autoregressive Diffusion for Molecule Generation [13.401822039640297]
  Mol-CADiff is a novel diffusion-based framework that uses causal attention mechanisms for text-conditional molecular generation.<n>Our approach explicitly models the causal relationship between textual prompts and molecular structures, overcoming key limitations in existing methods.<n>Our experiments demonstrate that Mol-CADiff outperforms state-of-the-art methods in generating diverse, novel, and chemically valid molecules.
  arXiv  Detail & Related papers  (2025-03-07T15:10:37Z)
• DiffMS: Diffusion Generation of Molecules Conditioned on Mass Spectra [60.39311767532607]
  We present DiffMS, a formula-restricted encoder-decoder generative network that achieves state-of-the-art performance on this task.<n>To develop a robust decoder that bridges latent embeddings and molecular structures, we pretrain the diffusion decoder with fingerprint-structure pairs.<n>Experiments on established benchmarks show that DiffMS outperforms existing models on de novo molecule generation.
  arXiv  Detail & Related papers  (2025-02-13T18:29:48Z)
• Text-Guided Multi-Property Molecular Optimization with a Diffusion Language Model [20.250683535089617]
  We propose a text-guided multi-property molecular optimization method utilizing transformer-based diffusion language model (TransDLM)<n>By fusing physically and chemically detailed semantics with specialized molecular representations, TransDLM effectively integrates diverse information sources to guide precise optimization.
  arXiv  Detail & Related papers  (2024-10-17T14:30:27Z)
• LDMol: A Text-to-Molecule Diffusion Model with Structurally Informative Latent Space Surpasses AR Models [55.5427001668863]
  We present a novel latent diffusion model dubbed LDMol for text-conditioned molecule generation.<n> Experiments show that LDMol outperforms the existing autoregressive baselines on the text-to-molecule generation benchmark.<n>We show that LDMol can be applied to downstream tasks such as molecule-to-text retrieval and text-guided molecule editing.
  arXiv  Detail & Related papers  (2024-05-28T04:59:13Z)
• Domain-Agnostic Molecular Generation with Chemical Feedback [44.063584808910896]
  MolGen is a pre-trained molecular language model tailored specifically for molecule generation. It internalizes structural and grammatical insights through the reconstruction of over 100 million molecular SELFIES. Our chemical feedback paradigm steers the model away from molecular hallucinations, ensuring alignment between the model's estimated probabilities and real-world chemical preferences.
  arXiv  Detail & Related papers  (2023-01-26T17:52:56Z)
• MolCPT: Molecule Continuous Prompt Tuning to Generalize Molecular Representation Learning [77.31492888819935]
  We propose a novel paradigm of "pre-train, prompt, fine-tune" for molecular representation learning, named molecule continuous prompt tuning (MolCPT) MolCPT defines a motif prompting function that uses the pre-trained model to project the standalone input into an expressive prompt. Experiments on several benchmark datasets show that MolCPT efficiently generalizes pre-trained GNNs for molecular property prediction.
  arXiv  Detail & Related papers  (2022-12-20T19:32:30Z)
• MIMOSA: Multi-constraint Molecule Sampling for Molecule Optimization [51.00815310242277]
  generative models and reinforcement learning approaches made initial success, but still face difficulties in simultaneously optimizing multiple drug properties. We propose the MultI-constraint MOlecule SAmpling (MIMOSA) approach, a sampling framework to use input molecule as an initial guess and sample molecules from the target distribution.
  arXiv  Detail & Related papers  (2020-10-05T20:18:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.