Extending Sequence Length is Not All You Need: Effective Integration of Multimodal Signals for Gene Expression Prediction

• URL: http://arxiv.org/abs/2602.21550v1
• Date: Wed, 25 Feb 2026 04:16:21 GMT
• Title: Extending Sequence Length is Not All You Need: Effective Integration of Multimodal Signals for Gene Expression Prediction
• Abstract summary: We show that for current models, long sequence modeling can decrease performance.<n>Instead, we find that multimodal epigenomic signals near target genes prove more essential.<n>We propose Prism, a framework that learns multiple combinations of high-dimensional epigenomic features to represent distinct background proximal states.
• Score: 15.79385231366071
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Gene expression prediction, which predicts mRNA expression levels from DNA sequences, presents significant challenges. Previous works often focus on extending input sequence length to locate distal enhancers, which may influence target genes from hundreds of kilobases away. Our work first reveals that for current models, long sequence modeling can decrease performance. Even carefully designed algorithms only mitigate the performance degradation caused by long sequences. Instead, we find that proximal multimodal epigenomic signals near target genes prove more essential. Hence we focus on how to better integrate these signals, which has been overlooked. We find that different signal types serve distinct biological roles, with some directly marking active regulatory elements while others reflect background chromatin patterns that may introduce confounding effects. Simple concatenation may lead models to develop spurious associations with these background patterns. To address this challenge, we propose Prism, a framework that learns multiple combinations of high-dimensional epigenomic features to represent distinct background chromatin states and uses backdoor adjustment to mitigate confounding effects. Our experimental results demonstrate that proper modeling of multimodal epigenomic signals achieves state-of-the-art performance using only short sequences for gene expression prediction.

Related papers

• Interpretable DNA Sequence Classification via Dynamic Feature Generation in Decision Trees [48.331026745746776]
  DEFT is a novel framework that adaptively generates high-level sequence features during tree construction.<n>We show that DEFT discovers human-interpretable and highly predictive sequence features across a diverse range of genomic tasks.
  arXiv  Detail & Related papers  (2026-04-13T20:58:01Z)
• Interpretable Perturbation Modeling Through Biomedical Knowledge Graphs [2.9275990558029075]
  multimodal embeddings are integrated into biomedical knowledge graphs.<n>We train a graph attention network to learn the delta expression profile of landmark genes for a given drug-cell pair.<n>Our framework provides a path toward mechanistic drug modeling.
  arXiv  Detail & Related papers  (2025-12-24T04:42:25Z)
• GenAR: Next-Scale Autoregressive Generation for Spatial Gene Expression Prediction [15.143858141542532]
  GenAR is a multi-scale autoregressive framework that refines predictions from coarse to fine.<n>We introduce GenAR, a multi-scale autoregressive framework that refines predictions from coarse to fine.<n>GenAR achieves principled state-of-the-art performance, offering potential implications for precision medicine and cost-effective molecular profiling.
  arXiv  Detail & Related papers  (2025-10-05T18:28:21Z)
• Evaluating DNA function understanding in genomic language models using evolutionarily implausible sequences [0.25489046505746704]
  We introduce a benchmark called Nullsettes, which assesses how well models can predict in silico loss-of-function (LOF) mutations.<n>We find that most fail to consistently detect strong LOF mutations.<n>All models show a sharp drop in predictive accuracy as the likelihood assigned to the original (nonmutant) sequence decreases.
  arXiv  Detail & Related papers  (2025-06-12T01:28:04Z)
• GRAPE: Heterogeneous Graph Representation Learning for Genetic Perturbation with Coding and Non-Coding Biotype [51.58774936662233]
  Building gene regulatory networks (GRN) is essential to understand and predict the effects of genetic perturbations.<n>In this work, we leverage pre-trained large language model and DNA sequence model to extract features from gene descriptions and DNA sequence data.<n>We introduce gene biotype information for the first time in genetic perturbation, simulating the distinct roles of genes with different biotypes in regulating cellular processes.
  arXiv  Detail & Related papers  (2025-05-06T03:35:24Z)
• Predicting gene essentiality and drug response from perturbation screens in preclinical cancer models with LEAP: Layered Ensemble of Autoencoders and Predictors [4.882734501598445]
  Existing predictive models suffer from limited, generalisability and interpretability.<n>We introduce a framework of Layered Ensemble of Autoencoders and Predictors (LEAP)<n>LEAP consistently improves prediction performances in unscreened cell lines across modelling strategies.
  arXiv  Detail & Related papers  (2025-02-21T18:12:36Z)
• Learning to Discover Regulatory Elements for Gene Expression Prediction [59.470991831978516]
  Seq2Exp is a Sequence to Expression network designed to discover and extract regulatory elements that drive target gene expression.<n>Our approach captures the causal relationship between epigenomic signals, DNA sequences and their associated regulatory elements.
  arXiv  Detail & Related papers  (2025-02-19T03:25:49Z)
• GENERator: A Long-Context Generative Genomic Foundation Model [66.46537421135996]
  We present GENERator, a generative genomic foundation model featuring a context length of 98k base pairs (bp) and 1.2B parameters.<n>Trained on an expansive dataset comprising 386B bp of DNA, the GENERator demonstrates state-of-the-art performance across both established and newly proposed benchmarks.<n>It also shows significant promise in sequence optimization, particularly through the prompt-responsive generation of enhancer sequences with specific activity profiles.
  arXiv  Detail & Related papers  (2025-02-11T05:39:49Z)
• Predicting Genetic Mutation from Whole Slide Images via Biomedical-Linguistic Knowledge Enhanced Multi-label Classification [119.13058298388101]
  We develop a Biological-knowledge enhanced PathGenomic multi-label Transformer to improve genetic mutation prediction performances. BPGT first establishes a novel gene encoder that constructs gene priors by two carefully designed modules. BPGT then designs a label decoder that finally performs genetic mutation prediction by two tailored modules.
  arXiv  Detail & Related papers  (2024-06-05T06:42:27Z)
• Reprogramming Pretrained Language Models for Antibody Sequence Infilling [72.13295049594585]
  Computational design of antibodies involves generating novel and diverse sequences, while maintaining structural consistency. Recent deep learning models have shown impressive results, however the limited number of known antibody sequence/structure pairs frequently leads to degraded performance. In our work we address this challenge by leveraging Model Reprogramming (MR), which repurposes pretrained models on a source language to adapt to the tasks that are in a different language and have scarce data.
  arXiv  Detail & Related papers  (2022-10-05T20:44:55Z)
• Diversifying Design of Nucleic Acid Aptamers Using Unsupervised Machine Learning [54.247560894146105]
  Inverse design of short single-stranded RNA and DNA sequences (aptamers) is the task of finding sequences that satisfy a set of desired criteria. We propose to use an unsupervised machine learning model known as the Potts model to discover new, useful sequences with controllable sequence diversity.
  arXiv  Detail & Related papers  (2022-08-10T13:30:58Z)
• SemanticCAP: Chromatin Accessibility Prediction Enhanced by Features Learning from a Language Model [3.0643865202019698]
  We propose a new solution named SemanticCAP to identify accessible regions of the genome. It introduces a gene language model which models the context of gene sequences, thus being able to provide an effective representation of gene sequences. Compared with other systems under public benchmarks, our model proved to have better performance.
  arXiv  Detail & Related papers  (2022-04-05T11:47:58Z)
• SimpleChrome: Encoding of Combinatorial Effects for Predicting Gene Expression [8.326669256957352]
  We present SimpleChrome, a deep learning model that learns the histone modification representations of genes. The features learned from the model allow us to better understand the latent effects of cross-gene interactions and direct gene regulation on the target gene expression.
  arXiv  Detail & Related papers  (2020-12-15T23:30:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.