CryoCCD: Conditional Cycle-consistent Diffusion with Biophysical Modeling for Cryo-EM Synthesis
- URL: http://arxiv.org/abs/2505.23444v2
- Date: Fri, 20 Jun 2025 01:15:53 GMT
- Title: CryoCCD: Conditional Cycle-consistent Diffusion with Biophysical Modeling for Cryo-EM Synthesis
- Authors: Runmin Jiang, Genpei Zhang, Yuntian Yang, Siqi Wu, Yuheng Zhang, Wanyue Feng, Yizhou Zhao, Xi Xiao, Xiao Wang, Tianyang Wang, Xingjian Li, Min Xu,
- Abstract summary: We propose CryoCCD, a synthesis framework that integrates biophysical modeling with generative techniques.<n>CryoCCD produces multi-scale cryo-EM micrographs that reflect realistic biophysical variability.<n>Experiments show that CryoCCD generates structurally accurate micrographs and enhances performance in downstream tasks.
- Score: 24.767861540998478
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Cryo-electron microscopy (cryo-EM) offers near-atomic resolution imaging of macromolecules, but developing robust models for downstream analysis is hindered by the scarcity of high-quality annotated data. While synthetic data generation has emerged as a potential solution, existing methods often fail to capture both the structural diversity of biological specimens and the complex, spatially varying noise inherent in cryo-EM imaging. To overcome these limitations, we propose CryoCCD, a synthesis framework that integrates biophysical modeling with generative techniques. Specifically, CryoCCD produces multi-scale cryo-EM micrographs that reflect realistic biophysical variability through compositional heterogeneity, cellular context, and physics-informed imaging. To generate realistic noise, we employ a conditional diffusion model, enhanced by cycle consistency to preserve structural fidelity and mask-aware contrastive learning to capture spatially adaptive noise patterns. Extensive experiments show that CryoCCD generates structurally accurate micrographs and enhances performance in downstream tasks, outperforming state-of-the-art baselines in both particle picking and reconstruction.
Related papers
- CryoGS: Gaussian Splatting for Cryo-EM Homogeneous Reconstruction [55.2480439325792]
cryogenic electron microscopy (cryo-EM) facilitates the determination of macromolecular structures at near-atomic resolution.<n>The core computational task in single-particle cryo-EM is to reconstruct the 3D electrostatic potential of a molecule.<n>We introduce cryoGS, a GMM-based method that integrates Gaussian splatting with the physics of cryo-EM image formation.
arXiv Detail & Related papers (2025-08-06T23:24:43Z) - Adaptive Attention Residual U-Net for curvilinear structure segmentation in fluorescence microscopy and biomedical images [0.0]
We create datasets consisting of hundreds of synthetic images of fluorescently labelled microtubules within cells.<n>These datasets are precisely annotated and closely mimic real microscopy images, including realistic noise.<n>The second dataset presents an additional challenge, simulating varying fluorescence intensities along filaments that complicate segmentation.<n>We develop a novel advanced architecture: the Adaptive Squeeze-and-Excitation Residual U-Net.
arXiv Detail & Related papers (2025-07-10T14:26:50Z) - CryoFM: A Flow-based Foundation Model for Cryo-EM Densities [50.291974465864364]
We present CryoFM, a foundation model designed as a generative model, learning the distribution of high-quality density maps.<n>Built on flow matching, CryoFM is trained to accurately capture the prior distribution of biomolecular density maps.
arXiv Detail & Related papers (2024-10-11T08:53:58Z) - StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Model [62.25424831998405]
StealthDiffusion is a framework that modifies AI-generated images into high-quality, imperceptible adversarial examples.
It is effective in both white-box and black-box settings, transforming AI-generated images into high-quality adversarial forgeries.
arXiv Detail & Related papers (2024-08-11T01:22:29Z) - CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EM [3.424647356090208]
Cryo-electron microscopy (cryo-EM) is a powerful technique for determining high-resolution 3D biomolecular structures from imaging data.<n>Here, we introduce CryoBench, a suite of datasets, metrics, and benchmarks for heterogeneous reconstruction in cryo-EM.
arXiv Detail & Related papers (2024-08-10T11:48:14Z) - Diffusion-driven lensless fiber endomicroscopic quantitative phase imaging towards digital pathology [43.237550839304774]
We propose a speckle-conditioned diffusion model (SpecDiffusion) to reconstruct phase images directly from speckles captured at the detection side of a multi-core fiber (MCF)<n>Unlike conventional neural networks, SpecDiffusion employs iterative phase denoising steps for speckle-driven phase reconstruction.<n>SpecDiffusion provides high-fidelity phase reconstruction results and shows powerful generalization capacity for unseen objects.
arXiv Detail & Related papers (2024-07-26T01:42:31Z) - CryoMAE: Few-Shot Cryo-EM Particle Picking with Masked Autoencoders [8.896148074086762]
We introduce cryoMAE, a novel approach based on few-shot learning to enable efficient selection of single particles in cryo-EM images.
Contrary to conventional NN-based techniques, cryoMAE requires only a minimal set of positive particle images for training yet demonstrates high performance in particle detection.
Experiments on large-scale cryo-EM datasets show that cryoMAE outperforms existing state-of-the-art (SOTA) methods, improving 3D reconstruction resolution by up to 22.4%.
arXiv Detail & Related papers (2024-04-15T23:23:31Z) - Robust single-particle cryo-EM image denoising and restoration [11.173867153077692]
Cryo-electron microscopy (cryo-EM) has achieved near-atomic level resolution of biomolecules by reconstructing 2D micrographs.
However, the resolution and accuracy of the reconstructed particles are significantly reduced due to the extremely low signal-to-noise ratio (SNR) and complex noise structure of cryo-EM images.
We introduce a diffusion model with post-processing framework to effectively denoise and restore single particle cryo-EM images.
arXiv Detail & Related papers (2024-01-02T08:33:36Z) - CryoGEM: Physics-Informed Generative Cryo-Electron Microscopy [38.57626501108458]
We introduce physics-informed generative cryo-electron microscopy (CryoGEM)
CryoGEM integrates physics-based cryo-EM simulation with a generative unpaired noise translation to generate realistic noises.
Experiments show that CryoGEM is capable of generating authentic cryo-EM images.
arXiv Detail & Related papers (2023-12-04T07:52:56Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - OADAT: Experimental and Synthetic Clinical Optoacoustic Data for
Standardized Image Processing [62.993663757843464]
Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion.
OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues.
No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
arXiv Detail & Related papers (2022-06-17T08:11:26Z) - Residual-Sparse Fuzzy $C$-Means Clustering Incorporating Morphological
Reconstruction and Wavelet frames [146.63177174491082]
Fuzzy $C$-Means (FCM) algorithm incorporates a morphological reconstruction operation and a tight wavelet frame transform.
We present an improved FCM algorithm by imposing an $ell_0$ regularization term on the residual between the feature set and its ideal value.
Experimental results reported for synthetic, medical, and color images show that the proposed algorithm is effective and efficient, and outperforms other algorithms.
arXiv Detail & Related papers (2020-02-14T10:00:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.