ProFusion: 3D Reconstruction of Protein Complex Structures from Multi-view AFM Images

• URL: http://arxiv.org/abs/2509.15242v1
• Date: Wed, 17 Sep 2025 16:40:08 GMT
• Title: ProFusion: 3D Reconstruction of Protein Complex Structures from Multi-view AFM Images
• Authors: Jaydeep Rade, Md Hasibul Hasan Hasib, Meric Ozturk, Baboucarr Faal, Sheng Yang, Dipali G. Sashital, Vincenzo Venditti, Baoyu Chen, Soumik Sarkar, Adarsh Krishnamurthy, Anwesha Sarkar,
• Abstract summary: ProFusion is a framework that integrates a deep learning model with Atomic Force Microscopy (AFM)<n>We generate a dataset of 542,000 proteins with multi-view synthetic AFM images.<n>We train a conditional diffusion model to synthesize novel views from unposed inputs and an instance-specific Neural Radiance Field (NeRF) model to reconstruct 3D structures.
• Score: 8.107910260554346
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: AI-based in silico methods have improved protein structure prediction but often struggle with large protein complexes (PCs) involving multiple interacting proteins due to missing 3D spatial cues. Experimental techniques like Cryo-EM are accurate but costly and time-consuming. We present ProFusion, a hybrid framework that integrates a deep learning model with Atomic Force Microscopy (AFM), which provides high-resolution height maps from random orientations, naturally yielding multi-view data for 3D reconstruction. However, generating a large-scale AFM imaging data set sufficient to train deep learning models is impractical. Therefore, we developed a virtual AFM framework that simulates the imaging process and generated a dataset of ~542,000 proteins with multi-view synthetic AFM images. We train a conditional diffusion model to synthesize novel views from unposed inputs and an instance-specific Neural Radiance Field (NeRF) model to reconstruct 3D structures. Our reconstructed 3D protein structures achieve an average Chamfer Distance within the AFM imaging resolution, reflecting high structural fidelity. Our method is extensively validated on experimental AFM images of various PCs, demonstrating strong potential for accurate, cost-effective protein complex structure prediction and rapid iterative validation using AFM experiments.

Related papers

• HistoSpeckle-Net: Mutual Information-Guided Deep Learning for high-fidelity reconstruction of complex OrganAMNIST images via perturbed Multimode Fibers [0.0]
  HistoSpeckle-Net is a deep learning architecture designed to reconstruct structurally rich medical images from MMF speckles.<n>Our experiments on the complex OrganAMNIST dataset demonstrate that HistoSpeckle-Net achieves higher fidelity than baseline models.
  arXiv  Detail & Related papers  (2025-11-25T12:20:50Z)
• Two Datasets Are Better Than One: Method of Double Moments for 3-D Reconstruction in Cryo-EM [7.860722289301566]
  We introduce a new data fusion framework, termed the method of double moments (MoDM)<n>MoDM reconstructs molecular structures from two instances of the second-order moment of projection images.<n>We develop a convex-relaxation-based algorithm that achieves accurate recovery using only second-order statistics.
  arXiv  Detail & Related papers  (2025-11-02T20:10:34Z)
• DiffSpectra: Molecular Structure Elucidation from Spectra using Diffusion Models [66.41802970528133]
  Molecular structure elucidation from spectra is a foundational problem in chemistry.<n>Traditional methods rely heavily on expert interpretation and lack scalability.<n>We present DiffSpectra, a generative framework that directly infers both 2D and 3D molecular structures from multi-modal spectral data.
  arXiv  Detail & Related papers  (2025-07-09T13:57:20Z)
• CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easy [58.86576215228903]
  We introduce CryoFastAR, the first geometric foundation model that can directly predict poses from Cryo-EM noisy images for Fast ab initio Reconstruction.<n>By integrating multi-view features and training on large-scale simulated cryo-EM data with realistic noise and CTF modulations, CryoFastAR enhances pose estimation accuracy and generalization.
  arXiv  Detail & Related papers  (2025-06-06T08:32:32Z)
• DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusion [53.70278210626701]
  We propose a data-driven multi-view reasoning approach that directly infers 3D scene geometry and camera poses from multi-view images.<n>Our framework, DiffusionSfM, parameterizes scene geometry and cameras as pixel-wise ray origins and endpoints in a global frame.<n>We empirically validate DiffusionSfM on both synthetic and real datasets, demonstrating that it outperforms classical and learning-based approaches.
  arXiv  Detail & Related papers  (2025-05-08T17:59:47Z)
• GAS: Generative Avatar Synthesis from a Single Image [54.95198111659466]
  We present a framework for synthesizing view-consistent and temporally coherent avatars from a single image.<n>Our approach combines the reconstruction power of regression-based 3D human reconstruction with the generative capabilities of a diffusion model.
  arXiv  Detail & Related papers  (2025-02-10T19:00:39Z)
• 3D Reconstruction of Protein Structures from Multi-view AFM Images using Neural Radiance Fields (NeRFs) [8.257409049477827]
  We investigate using atomic force microscopy (AFM) combined with deep learning to predict the 3D structures of protein complexes (PCs) AFM generates height maps that depict the PCs in various random orientations, providing a rich information for training a neural network to predict the 3D structures. The performance of UpFusion is evaluated through zero-shot predictions of 3D protein structures using AFM images.
  arXiv  Detail & Related papers  (2024-08-12T15:53:24Z)
• MSDiff: Multi-Scale Diffusion Model for Ultra-Sparse View CT Reconstruction [5.5805994093893885]
  We propose an ultra-sparse view CT reconstruction method utilizing multi-scale dif-fusion models (MSDiff) The proposed model ingeniously integrates information from both comprehensive sampling and selectively sparse sampling tech-niques. By leveraging the inherent correlations within the projec-tion data, we have designed an equidistant mask, enabling the model to focus its attention more effectively.
  arXiv  Detail & Related papers  (2024-05-09T14:52:32Z)
• A Generative Machine Learning Model for Material Microstructure 3D Reconstruction and Performance Evaluation [4.169915659794567]
  The dimensional extension from 2D to 3D is viewed as a highly challenging inverse problem from the current technological perspective. A novel generative model that integrates the multiscale properties of U-net with and the generative capabilities of GAN has been proposed. The model's accuracy is further improved by combining the image regularization loss with the Wasserstein distance loss.
  arXiv  Detail & Related papers  (2024-02-24T13:42:34Z)
• Multi-View Neural 3D Reconstruction of Micro-/Nanostructures with Atomic Force Microscopy [34.22380991792944]
  We propose a multi-view neural-network-based framework with Atomic Force Microscopy (MVN-AFM) MVN-AFM uses an iterative method to align multi-view data and eliminate AFM artifacts simultaneously. Experiments show that MVN-AFM effectively eliminates artifacts present in raw AFM images and reconstructs various micro-/nanostructures.
  arXiv  Detail & Related papers  (2024-01-21T16:46:04Z)
• Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction [77.69363640021503]
  3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images. We present SSDNeRF, a unified approach that employs an expressive diffusion model to learn a generalizable prior of neural radiance fields (NeRF) from multi-view images of diverse objects.
  arXiv  Detail & Related papers  (2023-04-13T17:59:01Z)
• CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representations [49.49939711956354]
  Cryo-electron microscopy (cryo-EM) allows for the high-resolution reconstruction of 3D structures of proteins and other biomolecules. It is still challenging to reconstruct the continuous motions of 3D structures from noisy and randomly oriented 2D cryo-EM images. We propose CryoFormer, a new approach for continuous heterogeneous cryo-EM reconstruction.
  arXiv  Detail & Related papers  (2023-03-28T18:59:17Z)
• 3D Reconstruction of Protein Complex Structures Using Synthesized Multi-View AFM Images [9.91587631689811]
  We train a neural network for 3D reconstruction called Pix2Vox++ using the synthesized multi-view 2D AFM images dataset. We compare the predicted structure obtained using a different number of views and get the intersection over union (IoU) value of 0.92 on the training dataset and 0.52 on the validation dataset.
  arXiv  Detail & Related papers  (2022-11-26T20:50:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.