CryoProt: A Protein Pretraining Framework with Cross-Box Interactions on Cryo-EM Density Maps

• URL: http://arxiv.org/abs/2606.00955v1
• Date: Sun, 31 May 2026 02:13:04 GMT
• Title: CryoProt: A Protein Pretraining Framework with Cross-Box Interactions on Cryo-EM Density Maps
• Abstract summary: We propose CryoProt, a protein pretraining framework designed for cryo-EM density maps.<n>CryoProt introduces a Map based on multi-head latent attention (MLA), where box-level representations interact through a shared latent space.<n>Results demonstrate that CryoProt consistently outperforms existing state-of-the-art methods across multiple benchmarks.
• Score: 22.579493804465738
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite the growing availability of cryo-electron microscopy (cryo-EM) density maps, effectively leveraging them for protein representation remains challenging. First, current methods lack a general-purpose protein pretraining framework tailored for cryo-EM density maps, designed for protein-related property prediction. Second, existing approaches typically partition density maps into local box regions and model them independently, overlooking interactions across boxes which are essential for capturing global structural context in cryo-EM density map. To address these challenges, we propose CryoProt, a protein pretraining framework designed for cryo-EM density maps. CryoProt introduces a Map Encoder based on multi-head latent attention (MLA), where box-level representations interact through a shared latent space, enabling explicit modeling of cross-box dependencies within the density map. Furthermore, we adopt a multi-task pretraining strategy to learn generalizable representations that can be effectively transferred to diverse downstream tasks, such as protein flexibility prediction, where cryo-EM density maps are not required and can be inferred implicitly by the pretrained model. Experimental results demonstrate that CryoProt consistently outperforms existing state-of-the-art methods across multiple benchmarks, achieving up to 12% improvement over the best-performing baselines, highlighting the importance of modeling cross-box interactions in cryo-EM data. The source code is publicly available at https://anonymous.4open.science/r/CryoProt.

Related papers

• Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought [55.65577137924979]
  We propose a framework that enables MLLMs to reason over images using continuous numerical coordinates.<n> NV-CoT expands the MLLM action space from discrete vocabulary tokens to a continuous Euclidean space.<n>Experiments on three benchmarks demonstrate that NV-CoT significantly improves localization precision and final answer accuracy.
  arXiv  Detail & Related papers  (2026-02-27T12:04:07Z)
• CryoLVM: Self-supervised Learning from Cryo-EM Density Maps with Large Vision Models [20.31346781705925]
  We present CryoLVM, a foundation model that learns rich structural representations from experimental density maps with resolved structures.<n>We demonstrate CryoLVM's effectiveness across three critical cryo-EM tasks: density map sharpening, density map super-resolution, and missing wedge restoration.
  arXiv  Detail & Related papers  (2026-02-02T13:36:36Z)
• Density-based Object Detection in Crowded Scenes [54.037103707572136]
  We propose density-guided anchors (DGA) and density-guided NMS (DG-NMS)<n>DGA computes optimal anchor assignments and reweighing, as well as an adaptive NMS.<n>Experiments on the challenging CrowdHuman dataset with Citypersons dataset demonstrate that our proposed density-guided detector is effective and robust to crowdedness.
  arXiv  Detail & Related papers  (2025-04-14T02:41:49Z)
• CryoSAMU: Enhancing 3D Cryo-EM Density Maps of Protein Structures at Intermediate Resolution with Structure-Aware Multimodal U-Nets [10.433861497458212]
  Enhancing cryogenic electron microscopy (cryo-EM) 3D density maps at intermediate resolution is crucial in protein structure determination.<n>Recent advances in deep learning have led to the development of automated approaches for enhancing experimental cryo-EM density maps.<n>We propose CryoSAMU, a novel method designed to enhance 3D cryo-EM density maps of protein structures using structure-aware multimodal U-Nets.
  arXiv  Detail & Related papers  (2025-03-26T07:33:36Z)
• Rethinking Cell Counting Methods: Decoupling Counting and Localization [20.458912966915843]
  We propose a conceptually simple yet effective decoupled learning scheme for automated cell counting.<n>In contrast to jointly learning counting and density map estimation, we show that decoupling these objectives surprisingly improves results.<n>Our key insight is that decoupled learning alleviates the need to learn counting on high-resolution density maps directly.
  arXiv  Detail & Related papers  (2025-03-18T07:50:03Z)
• Efficient Masked AutoEncoder for Video Object Counting and A Large-Scale Benchmark [52.339936954958034]
  The dynamic imbalance of the fore-background is a major challenge in video object counting.<n>We propose a density-embedded Efficient Masked Autoencoder Counting (E-MAC) framework in this paper.<n>In addition, we first propose a large video bird counting dataset, DroneBird, in natural scenarios for migratory bird protection.
  arXiv  Detail & Related papers  (2024-11-20T06:08:21Z)
• CryoFM: A Flow-based Foundation Model for Cryo-EM Densities [50.291974465864364]
  We present CryoFM, a foundation model designed as a generative model, learning the distribution of high-quality density maps.<n>Built on flow matching, CryoFM is trained to accurately capture the prior distribution of biomolecular density maps.
  arXiv  Detail & Related papers  (2024-10-11T08:53:58Z)
• Hi-Map: Hierarchical Factorized Radiance Field for High-Fidelity Monocular Dense Mapping [51.739466714312805]
  We introduce Hi-Map, a novel monocular dense mapping approach based on Neural Radiance Field (NeRF) Hi-Map is exceptional in its capacity to achieve efficient and high-fidelity mapping using only posed RGB inputs.
  arXiv  Detail & Related papers  (2024-01-06T12:32:25Z)
• $CrowdDiff$: Multi-hypothesis Crowd Density Estimation using Diffusion Models [26.55769846846542]
  Crowd counting is a fundamental problem in crowd analysis which is typically accomplished by estimating a crowd density map and summing over the density values. We present $CrowdDiff$ that generates the crowd density map as a reverse diffusion process. In addition, owing to the nature of the diffusion model, we introduce producing multiple density maps to improve the counting performance.
  arXiv  Detail & Related papers  (2023-03-22T17:58:01Z)
• Density-Based Clustering with Kernel Diffusion [59.4179549482505]
  A naive density corresponding to the indicator function of a unit $d$-dimensional Euclidean ball is commonly used in density-based clustering algorithms. We propose a new kernel diffusion density function, which is adaptive to data of varying local distributional characteristics and smoothness.
  arXiv  Detail & Related papers  (2021-10-11T09:00:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.