Subcellularly Resolved Single-Cell Embedding Learning with Transcriptomic data, Protein Structure and Localization Information
- URL: http://arxiv.org/abs/2609.02344v1
- Date: Wed, 02 Sep 2026 09:20:48 GMT
- Title: Subcellularly Resolved Single-Cell Embedding Learning with Transcriptomic data, Protein Structure and Localization Information
- Abstract summary: We propose a framework for learning subcellularly resolved cell embeddings.<n>We employ a cross-attention architecture to integrate transcriptomic, sequence, and structural modalities.<n>The resulting embeddings represent each cell through its fine-grained subcellular organization.
- Score: 12.122016806635996
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Existing cell embedding methods predominantly rely on transcriptomic or proteomic measurements and represent each cell as a holistic entity, thereby overlooking the subcellular localization of individual molecules. Moreover, they rarely incorporate protein structural information, despite its fundamental role in determining molecular interactions and functions. In this work, we propose a multimodal framework for learning subcellularly resolved cell embeddings by jointly leveraging RNA expression profiles, protein sequence representations, and protein structural information. Specifically, we employ a cross-attention architecture to integrate transcriptomic, sequence, and structural modalities and model their interactions within distinct subcellular compartments. The resulting embeddings represent each cell through its fine-grained subcellular organization, capturing both molecular expression patterns and the functional properties of the associated proteins. By learning cell representations at subcellular resolution, our framework preserves spatially organized biological information while integrating complementary signals across multiple molecular levels. To the best of our knowledge, this is the first framework that produces subcellularly resolved cell embeddings by jointly incorporating transcriptomic information, protein sequence representations, and protein structural knowledge within a unified cross-modal learning paradigm.
Related papers
- CAPSUL: A Comprehensive Human Protein Benchmark for Subcellular Localization [50.559485139565076]
We introduce a new benchmark called $mathbfCAPSUL$, a dataset that integrates diverse 3D structural representations with fine-grained subcellular localization annotations.<n>We evaluate this benchmark using a variety of state-of-the-art sequence-based and structure-based models, showcasing the importance of involving structural features in this task.<n> Lastly, we showcase the powerful interpretability of structure-based methods through a case study on the Golgi apparatus.
arXiv Detail & Related papers (2026-03-19T07:33:04Z) - GLProtein: Global-and-Local Structure Aware Protein Representation Learning [24.573029012303]
We argue that the structural information of proteins is not only limited to their 3D information but also encompasses information from amino acid molecules (local information) to protein-protein structure similarity (global information)<n>We propose textbfGLProtein, the first framework in protein pre-training that incorporates both global structural similarity and local amino acid details to enhance prediction accuracy and functional insights.
arXiv Detail & Related papers (2025-05-17T14:45:13Z) - SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representation [97.99658944212675]
We introduce a novel pre-training strategy for protein foundation models.
It emphasizes the interactions among amino acid residues to enhance the extraction of both short-range and long-range co-evolutionary features.
Trained on a large-scale protein sequence dataset, our model demonstrates superior generalization ability.
arXiv Detail & Related papers (2024-10-31T15:22:03Z) - Long-context Protein Language Modeling Using Bidirectional Mamba with Shared Projection Layers [76.95505296417866]
Self-supervised training of language models (LMs) has seen great success for protein sequences in learning meaningful representations and for generative drug design.<n>Most protein LMs are based on the Transformer architecture trained on individual proteins with short context lengths.<n>In this work, we propose LC-PLM based on an alternative protein LM architecture, BiMamba-S, built upon selective structured state-space models.
arXiv Detail & Related papers (2024-10-29T16:43:28Z) - Multimodal Analysis of White Blood Cell Differentiation in Acute Myeloid Leukemia Patients using a β-Variational Autoencoder [38.13262557169157]
We introduce an unsupervised method that explores and reconstructs morphological and transcriptomic data.
Our method is based on a beta-variational autoencoder (ss-VAE) with a customized loss function.
It provides a unique tool to improve the understanding of white blood cell maturation for biomedicine and diagnostics.
arXiv Detail & Related papers (2024-08-13T08:24:52Z) - Multicell-Fold: geometric learning in folding multicellular life [0.34952465649465553]
How a group of cells fold into specific structures is a central question in biology that defines how living organisms form.
We propose a geometric deep learning model that can predict multicellular folding and embryogenesis.
We successfully use our model to achieve two important tasks, interpretable 4-D morphological sequence alignment, and predicting local cell rearrangements.
arXiv Detail & Related papers (2024-07-09T17:21:49Z) - Zyxin is all you need: machine learning adherent cell mechanics [0.0]
We develop a data-driven biophysical modeling approach to learn the mechanical behavior of adherent cells.
We first train neural networks to predict forces generated by adherent cells from images of cytoskeletal proteins.
We next develop two approaches - one explicitly constrained by physics, the other more continuum - that help construct data-driven models of cellular forces.
arXiv Detail & Related papers (2023-03-01T02:08:40Z) - State-specific protein-ligand complex structure prediction with a
multi-scale deep generative model [68.28309982199902]
We present NeuralPLexer, a computational approach that can directly predict protein-ligand complex structures.
Our study suggests that a data-driven approach can capture the structural cooperativity between proteins and small molecules, showing promise in accelerating the design of enzymes, drug molecules, and beyond.
arXiv Detail & Related papers (2022-09-30T01:46:38Z) - Learning Geometrically Disentangled Representations of Protein Folding
Simulations [72.03095377508856]
This work focuses on learning a generative neural network on a structural ensemble of a drug-target protein.
Model tasks involve characterizing the distinct structural fluctuations of the protein bound to various drug molecules.
Results show that our geometric learning-based method enjoys both accuracy and efficiency for generating complex structural variations.
arXiv Detail & Related papers (2022-05-20T19:38:00Z) - Deep Contextual Learners for Protein Networks [16.599890339599586]
We introduce AWARE, a graph neural message passing approach to inject cellular and tissue context into protein embeddings.
AWARE learns protein, cell type, and tissue embeddings that uphold cell type and tissue hierarchies.
We demonstrate AWARE on the novel task of predicting whether a gene is associated with a disease and where it most likely manifests in the human body.
arXiv Detail & Related papers (2021-06-04T04:26:27Z) - BERTology Meets Biology: Interpreting Attention in Protein Language
Models [124.8966298974842]
We demonstrate methods for analyzing protein Transformer models through the lens of attention.
We show that attention captures the folding structure of proteins, connecting amino acids that are far apart in the underlying sequence, but spatially close in the three-dimensional structure.
We also present a three-dimensional visualization of the interaction between attention and protein structure.
arXiv Detail & Related papers (2020-06-26T21:50:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.