Protein-Conditioned Multi-Objective Reinforcement Learning for Full-Length mRNA Design
- URL: http://arxiv.org/abs/2605.01513v1
- Date: Sat, 02 May 2026 16:05:51 GMT
- Title: Protein-Conditioned Multi-Objective Reinforcement Learning for Full-Length mRNA Design
- Abstract summary: We propose ProMORNA, a multi-objective generation framework that produces complete mRNA transcripts directly from a target sequence.<n>Our approach begins by training a BART-style encoder-decoder model on over 6 million natural protein-mRNA pairs.<n>As a case study, we evaluated ProMORNA on the widely used firefly luciferase target, excluding it from both our supervised training data and the prompt pool.
- Score: 2.9395143551178333
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Designing therapeutic messenger RNA (mRNA) requires creating full-length transcripts that carefully balance stability, translation efficiency, and immune safety. To address this challenge, we propose ProMORNA, a multi-objective generation framework that produces complete mRNA transcripts \textit{de novo} directly from a target protein sequence. Our approach begins by training a BART-style encoder-decoder model on over 6 million natural protein-mRNA pairs. We then introduce Multi-Objective Group Relative Policy Optimization (MO-GRPO) to simultaneously optimize for various biological objectives in a unified way. As a case study, we evaluated ProMORNA on the widely used firefly luciferase target, excluding it from both our supervised training data and the prompt pool. The results indicate that ProMORNA improves the \textit{in silico} Pareto frontier for predicted half-life and translation efficiency relative to standard supervised baselines. Additionally, it achieves higher predicted functional scores than a state-of-the-art baseline under the same evaluation pipeline. These computational findings demonstrate the feasibility of using multi-objective reinforcement learning for full-length mRNA design on unseen targets.
Related papers
- RIBOSPAN: A Long-Context RNA Foundation Model for Versatile RNA Modeling [26.58224679878256]
We present RIBOSPAN, a bidirectional RNA foundation model pretrained with context lengths up to 10,240 nt.<n> RIBOSPAN combines dense bidirectional self-attention, single-nucleotide tokenization, and attention-isolated sequence packing to enable high-resolution modeling of complete long RNAs.<n>Frozen RNA-type evaluations show that RIBOSPAN learns state-of-the-art RNA representations, with a particularly clear advantage on long RNAs.
arXiv Detail & Related papers (2026-08-24T06:30:00Z) - mRNAutilus: Multi-Objective-Guided Discrete Generation of mRNA with Optimized Therapeutic Properties [3.5240650455251625]
We present mRNA generation via unrolled trajectories and informed latent updates (mRNAutilus)<n>mRNAutilus is a framework for simultaneous codon optimization and de novo UTR design directly from sequence.<n>We demonstrate generality in therapeutic settings, including prime editing (PEMax) and programmable proteome modulation.
arXiv Detail & Related papers (2026-05-29T13:32:39Z) - RNA-FM: Flow-Matching Generative Model for Genome-wide RNA-Seq Prediction [48.07329582311906]
We propose RNA-FM, a flow-matching generative framework for genome-wide bulk RNA-seq prediction from whole-slide images.<n> RNA-FM formulates transcriptomic prediction as a continuous-time conditional transport problem.<n>It enables scalable and biologically interpretable genome-wide gene expression imputation.
arXiv Detail & Related papers (2026-05-12T06:48:58Z) - Self Distillation Fine-Tuning of Protein Language Models Improves Versatility in Protein Design [61.2846583160056]
Supervised fine-tuning (SFT) is a standard approach for adapting large language models to specialized domains.<n>This is in part because high-quality annotated data are far more difficult to obtain for proteins than for natural language.<n>We present a simple and general recipe for fast SFT of PLMs, designed to improve the fidelity, reliability, and novelty of generated protein sequences.
arXiv Detail & Related papers (2025-12-10T05:34:47Z) - A New Deep-learning-Based Approach For mRNA Optimization: High Fidelity, Computation Efficiency, and Multiple Optimization Factors [12.26159226306187]
We introduce textbfRNop, a novel deep learning-based method for mRNA optimization.<n>We collect a large-scale dataset containing over 3 million sequences and design four specialized loss functions, the GPLoss, CAILoss, tAILoss, and MFELoss.<n>RNop ensures high sequence fidelity, achieves significant computational throughput up to 47.32 sequences/s, and yields optimized mRNA sequences.
arXiv Detail & Related papers (2025-05-29T08:21:11Z) - BAnG: Bidirectional Anchored Generation for Conditional RNA Design [15.92155083519678]
Existing computational approaches require a substantial amount of previously known interacting RNA sequences for each specific protein.<n>We develop RNA-BAnG, a deep learning-based model designed to generate RNA sequences for protein interactions without these requirements.
arXiv Detail & Related papers (2025-02-28T17:51:00Z) - Helix-mRNA: A Hybrid Foundation Model For Full Sequence mRNA Therapeutics [3.2508287756500165]
mRNA-based vaccines have become a major focus in the pharmaceutical industry.<n> optimizing mRNA sequences for those properties remains a complex challenge.<n>We present Helix-mRNA, a structured state-space-based and attention hybrid model to address these challenges.
arXiv Detail & Related papers (2025-02-19T14:51:41Z) - LoRA-BERT: a Natural Language Processing Model for Robust and Accurate Prediction of long non-coding RNAs [11.346750562942345]
Long non-coding RNAs (lncRNAs) serve as crucial regulators in numerous biological processes.
Deep learning-based approaches have been introduced to classify lncRNAs.
LoRA-BERT is designed to capture the importance of nucleotide-level information during sequence classification.
arXiv Detail & Related papers (2024-11-11T22:17:01Z) - BEACON: Benchmark for Comprehensive RNA Tasks and Language Models [60.02663015002029]
We introduce the first comprehensive RNA benchmark BEACON (textbfBEnchmtextbfArk for textbfCOmprehensive RtextbfNA Task and Language Models).<n>First, BEACON comprises 13 distinct tasks derived from extensive previous work covering structural analysis, functional studies, and engineering applications.<n>Second, we examine a range of models, including traditional approaches like CNNs, as well as advanced RNA foundation models based on language models, offering valuable insights into the task-specific performances of these models.<n>Third, we investigate the vital RNA language model components
arXiv Detail & Related papers (2024-06-14T19:39:19Z) - Structure-informed Language Models Are Protein Designers [69.70134899296912]
We present LM-Design, a generic approach to reprogramming sequence-based protein language models (pLMs)
We conduct a structural surgery on pLMs, where a lightweight structural adapter is implanted into pLMs and endows it with structural awareness.
Experiments show that our approach outperforms the state-of-the-art methods by a large margin.
arXiv Detail & Related papers (2023-02-03T10:49:52Z) - RDesign: Hierarchical Data-efficient Representation Learning for
Tertiary Structure-based RNA Design [65.41144149958208]
This study aims to systematically construct a data-driven RNA design pipeline.
We crafted a benchmark dataset and designed a comprehensive structural modeling approach to represent the complex RNA tertiary structure.
We incorporated extracted secondary structures with base pairs as prior knowledge to facilitate the RNA design process.
arXiv Detail & Related papers (2023-01-25T17:19:49Z) - Accurate RNA 3D structure prediction using a language model-based deep learning approach [50.193512039121984]
RhoFold+ is an RNA language model-based deep learning method that accurately predicts 3D structures of single-chain RNAs from sequences.<n>RhoFold+ offers a fully automated end-to-end pipeline for RNA 3D structure prediction.
arXiv Detail & Related papers (2022-07-04T17:15:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.