Multimodal Alignment and Preference Optimization for Zero-Shot Conditional RNA Generation

• URL: http://arxiv.org/abs/2605.23961v1
• Date: Tue, 12 May 2026 10:54:09 GMT
• Title: Multimodal Alignment and Preference Optimization for Zero-Shot Conditional RNA Generation
• Abstract summary: We frame conditional RNA sequence generation as a multi-stage alignment problem, introducing Moirain.<n>Our approach begins with large-scale pretraining on diverse RNA corpora to capture sequence plausibility.<n>To achieve target-specific generation, we employ a multimodal SFT architecture that conditions RNA synthesis on protein structural and sequential features.
• Score: 17.221063819653626
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: The design of RNA molecules that interact with specific proteins is a critical challenge in experimental and computational biology. Despite recent progress in natural language modeling and deep learning-based protein design, there remains significant room to improve the frequency of successful interactions and the authenticity of generated sequences for functional applications. In this work, we frame conditional RNA sequence generation as a multi-stage alignment problem, introducing Moirain: a suite of models optimized via multimodal supervised fine-tuning (SFT) and Direct Preference Optimization (DPO). Our approach begins with large-scale pretraining on diverse RNA corpora to capture the fundamental grammars of sequence plausibility. To achieve target-specific generation, we employ a multimodal SFT architecture that conditions RNA synthesis on protein structural and sequential features. Finally, we leverage DPO to refine the model using synthetic interaction data: taking advantage of DPO's unique ability to navigate non-aligned preference spaces, we improve functional fitness without collapsing the learned natural distribution. Extensive evaluation of the Moirain series (Moirain-Base, -Multi, and -DPO) demonstrates that our framework consistently produces novel, diverse, and biologically plausible RNA sequences with superior binding affinities compared to existing baselines.

Related papers

• mRNAutilus: Multi-Objective-Guided Discrete Generation of mRNA with Optimized Therapeutic Properties [3.5240650455251625]
  We present mRNA generation via unrolled trajectories and informed latent updates (mRNAutilus)<n>mRNAutilus is a framework for simultaneous codon optimization and de novo UTR design directly from sequence.<n>We demonstrate generality in therapeutic settings, including prime editing (PEMax) and programmable proteome modulation.
  arXiv  Detail & Related papers  (2026-05-29T13:32:39Z)
• Scaling Atomistic Protein Binder Design with Generative Pretraining and Test-Time Compute [64.59043351161004]
  We propose Proteina-Complexa, a novel fully atomistic binder generation method unifying both paradigms.<n>Proteina-Complexa sets a new state of the art in computational binder design benchmarks.<n>We also demonstrate interface hydrogen bond optimization, fold class-guided binder generation, and extensions to small molecule targets and enzyme design tasks.
  arXiv  Detail & Related papers  (2026-03-30T01:54:03Z)
• RiboSphere: Learning Unified and Efficient Representations of RNA Structures [57.40815107640066]
  RNA backbones are highly flexible, non-canonical interactions are prevalent, and experimentally determined 3D structures are comparatively scarce.<n>We introduce emphRiboSphere, a framework that learns emphdiscrete geometric representations of RNA by combining vector quantization with flow matching.
  arXiv  Detail & Related papers  (2026-03-20T04:36:35Z)
• Structure-based RNA Design by Step-wise Optimization of Latent Diffusion Model [22.539981000962374]
  RNA inverse folding is critical for therapeutics, gene regulation, and synthetic biology.<n>Current methods, focused on sequence recovery, struggle to address structural objectives.<n>We propose a reinforcement learning framework integrated with a latent diffusion model.
  arXiv  Detail & Related papers  (2026-01-27T06:04:02Z)
• Self Distillation Fine-Tuning of Protein Language Models Improves Versatility in Protein Design [61.2846583160056]
  Supervised fine-tuning (SFT) is a standard approach for adapting large language models to specialized domains.<n>This is in part because high-quality annotated data are far more difficult to obtain for proteins than for natural language.<n>We present a simple and general recipe for fast SFT of PLMs, designed to improve the fidelity, reliability, and novelty of generated protein sequences.
  arXiv  Detail & Related papers  (2025-12-10T05:34:47Z)
• CodonMoE: DNA Language Models for mRNA Analyses [4.046100165562807]
  Genomic language models (gLMs) face a fundamental efficiency challenge: either maintain separate specialized models for each biological modality (DNA and RNA) or develop large multi-modal architectures.<n>We introduce CodonMoE, a lightweight adapter that transforms DNA language models into effective RNA analyzers without RNA-specific pretraining.<n>Our approach provides a principled path toward unifying genomic language modeling, leveraging more abundant DNA data and reducing computational overhead.
  arXiv  Detail & Related papers  (2025-08-06T01:40:12Z)
• Differentiable Folding for Nearest Neighbor Model Optimization [0.6291443816903801]
  The Nearest Neighbor model is the $textitde facto$ thermodynamic model of RNA secondary structure formation.<n>Here, we leverage recent advances in $textitdifferentiable folding$ to devise an efficient, scalable, and flexible means of parameter optimization.<n>Our method yields a significantly improved parameter set that outperforms existing baselines on all metrics.
  arXiv  Detail & Related papers  (2025-03-12T05:36:12Z)
• BAnG: Bidirectional Anchored Generation for Conditional RNA Design [15.92155083519678]
  Existing computational approaches require a substantial amount of previously known interacting RNA sequences for each specific protein.<n>We develop RNA-BAnG, a deep learning-based model designed to generate RNA sequences for protein interactions without these requirements.
  arXiv  Detail & Related papers  (2025-02-28T17:51:00Z)
• Life-Code: Central Dogma Modeling with Multi-Omics Sequence Unification [55.98854157265578]
  Life-Code is a comprehensive framework that spans different biological functions.<n>We propose a unified pipeline to integrate multi-omics data by reverse-transcribing RNA and reverse-translating amino acids into nucleotide-based sequences.<n>Life-Code achieves state-of-the-art results on various tasks across three omics, highlighting its potential for advancing multi-omics analysis and interpretation.
  arXiv  Detail & Related papers  (2025-02-11T06:53:59Z)
• Latent Diffusion Models for Controllable RNA Sequence Generation [33.38594748558547]
  RNA is a key intermediary between DNA and protein, exhibiting high sequence diversity and complex three-dimensional structures. We develop a latent diffusion model for generating and optimizing discrete RNA sequences of variable lengths. Empirical results confirm that RNAdiffusion generates non-coding RNAs that align with natural distributions across various biological metrics.
  arXiv  Detail & Related papers  (2024-09-15T19:04:50Z)
• RNACG: A Universal RNA Sequence Conditional Generation model based on Flow-Matching [0.0]
  We propose RNACG (RNA Generator), a universal framework for RNA sequence design based on flow matching.<n>By unifying sequence generation under a single framework, RNACG enables the integration of multiple RNA design paradigms.
  arXiv  Detail & Related papers  (2024-07-29T09:46:46Z)
• Diversifying Design of Nucleic Acid Aptamers Using Unsupervised Machine Learning [54.247560894146105]
  Inverse design of short single-stranded RNA and DNA sequences (aptamers) is the task of finding sequences that satisfy a set of desired criteria. We propose to use an unsupervised machine learning model known as the Potts model to discover new, useful sequences with controllable sequence diversity.
  arXiv  Detail & Related papers  (2022-08-10T13:30:58Z)
• EBM-Fold: Fully-Differentiable Protein Folding Powered by Energy-based Models [53.17320541056843]
  We propose a fully-differentiable approach for protein structure optimization, guided by a data-driven generative network. Our EBM-Fold approach can efficiently produce high-quality decoys, compared against traditional Rosetta-based structure optimization routines.
  arXiv  Detail & Related papers  (2021-05-11T03:40:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.