2.5D U-Net with Depth Reduction for 3D CryoET Object Identification

• URL: http://arxiv.org/abs/2502.13484v1
• Date: Wed, 19 Feb 2025 07:13:08 GMT
• Title: 2.5D U-Net with Depth Reduction for 3D CryoET Object Identification
• Authors: Yusuke Uchida, Takaaki Fukui,
• Abstract summary: We introduce the 4th place solution from the CZII - CryoET Object Identification competition.<n>Our solution adopted a heatmap-based keypoint detection approach, utilizing an ensemble of two different types of 2.5D U-Net models with depth reduction.
• Score: 0.4910937238451484
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cryo-electron tomography (cryoET) is a crucial technique for unveiling the structure of protein complexes. Automatically analyzing tomograms captured by cryoET is an essential step toward understanding cellular structures. In this paper, we introduce the 4th place solution from the CZII - CryoET Object Identification competition, which was organized to advance the development of automated tomogram analysis techniques. Our solution adopted a heatmap-based keypoint detection approach, utilizing an ensemble of two different types of 2.5D U-Net models with depth reduction. Despite its highly unified and simple architecture, our method achieved 4th place, demonstrating its effectiveness.

Related papers

• DualGazeNet: A Biologically Inspired Dual-Gaze Query Network for Salient Object Detection [52.32976488996896]
  We introduce DualGazeNet, a pure Transformer framework for salient object detection.<n>Experiments on five RGB benchmarks show that DualGazeNet consistently surpasses 25 state-of-the-art CNN- and Transformer-based methods.
  arXiv  Detail & Related papers  (2025-11-24T08:08:22Z)
• Towards Foundation Models for Cryo-ET Subtomogram Analysis [36.85797849551338]
  We introduce CryoEngine, a large-scale synthetic data generator that produces over 904k subtomograms from 452 particle classes for pretraining.<n>Second, we design an Adaptive Phase Tokenization-enhanced Vision Transformer (APT-ViT), which incorporates adaptive phase tokenization as an equivariance-enhancing module.<n>Third, we introduce a Noise-Resilient Contrastive Learning (NRCL) strategy to stabilize representation learning under severe noise conditions.
  arXiv  Detail & Related papers  (2025-09-29T05:47:45Z)
• Review of Deep Learning Applications to Structural Proteomics Enabled by Cryogenic Electron Microscopy and Tomography [9.273554898053678]
  "cryoEM revolution" has produced exponential growth in high-resolution structural data through advances in cryogenic electron microscopy (cryoEM) and tomography (cryoET)<n>Deep learning integration into structural resolution addresses longstanding challenges including low signal-to-noise ratios, preferred orientation artifacts, and missing-wedge problems.<n>This review examines AI applications across the entire cryoEM pipeline, from automated particle picking using convolutional neural networks to computational solutions for preferred orientation bias.
  arXiv  Detail & Related papers  (2025-07-25T16:15:09Z)
• Beyond Current Boundaries: Integrating Deep Learning and AlphaFold for Enhanced Protein Structure Prediction from Low-Resolution Cryo-EM Maps [0.351124620232225]
  DeepTracer-LowResEnhance is a framework that synergizes a deep learning-enhanced map refinement technique with the power of AlphaFold. This methodology is designed to markedly improve the construction of models from low-resolution cryo-EM maps.
  arXiv  Detail & Related papers  (2024-10-30T06:52:46Z)
• CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference [30.195615398809043]
  Cryo-EM is an increasingly popular method for determining the atomic resolution 3D structure of macromolecular complexes. Recent developments in cryo-EM have focused on deep learning for which amortized inference has been used to predict pose. Here, we propose a new semi-amortized method, cryoSPIN, in which reconstruction begins with amortized inference and then switches to a form of auto-decoding.
  arXiv  Detail & Related papers  (2024-06-15T00:44:32Z)
• Tracing and segmentation of molecular patterns in 3-dimensional cryo-et/em density maps through algorithmic image processing and deep learning-based techniques [0.0]
  dissertation focuses on developing sophisticated computational techniques for tracing actin filaments. Three novel methodologies have been developed: BundleTrac, for tracing bundle-like actin filaments found in Stereocilium, Spaghetti Tracer, for tracing filaments that move individually with loosely cohesive movements, and Struwwel Tracer, for tracing randomly orientated actin filaments in the actin network. The second component of the dissertation introduces a convolutional neural network (CNN) based segmentation model to determine the location of protein secondary structures, such as helices and beta-sheets, in medium-resolution (5-10 Angstrom) 3-dimensional cryo-electron microscopy
  arXiv  Detail & Related papers  (2024-03-26T00:41:54Z)
• A Deep Learning Method for Simultaneous Denoising and Missing Wedge Reconstruction in Cryogenic Electron Tomography [23.75819355889607]
  We propose a deep-learning approach for simultaneous denoising and missing wedge reconstruction called DeepDeWedge. The algorithm requires no ground truth data and is based on fitting a neural network to the 2D projections using a self-supervised loss.
  arXiv  Detail & Related papers  (2023-11-09T17:34:57Z)
• Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysis [0.0]
  This paper introduces a novel approach that uses a 10-dimensional feature vector to represent the orientation and applies a Quadratically-Constrained Quadratic Program to derive the predicted orientation as a unit quaternion, supplemented by an uncertainty metric. Our numerical analysis demonstrates that our methodology effectively recovers orientations from 2D cryo-EM images in an end-to-end manner. Importantly, the inclusion of uncertainty allows for direct clean-up of the dataset at the 3D level.
  arXiv  Detail & Related papers  (2023-07-19T09:09:24Z)
• CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representations [49.49939711956354]
  Cryo-electron microscopy (cryo-EM) allows for the high-resolution reconstruction of 3D structures of proteins and other biomolecules. It is still challenging to reconstruct the continuous motions of 3D structures from noisy and randomly oriented 2D cryo-EM images. We propose CryoFormer, a new approach for continuous heterogeneous cryo-EM reconstruction.
  arXiv  Detail & Related papers  (2023-03-28T18:59:17Z)
• Tracking perovskite crystallization via deep learning-based feature detection on 2D X-ray scattering data [137.47124933818066]
  We propose an automated pipeline for the analysis of X-ray diffraction images based on the Faster R-CNN deep learning architecture. We demonstrate our method on real-time tracking of organic-inorganic perovskite structure crystallization and test it on two applications.
  arXiv  Detail & Related papers  (2022-02-22T15:39:00Z)
• 3D Structure from 2D Microscopy images using Deep Learning [0.0]
  Recent advances in Artificial Intelligence have been applied to retrieving accurate 3D structures from microscopy images. Herewe present a deep learning solution for reconstructing the protein com-plexes from a number of 2D single molecule localization microscopy images.
  arXiv  Detail & Related papers  (2021-10-14T14:55:41Z)
• A parameter refinement method for Ptychography based on Deep Learning concepts [55.41644538483948]
  coarse parametrisation in propagation distance, position errors and partial coherence frequently menaces the experiment viability. A modern Deep Learning framework is used to correct autonomously the setup incoherences, thus improving the quality of a ptychography reconstruction. We tested our system on both synthetic datasets and also on real data acquired at the TwinMic beamline of the Elettra synchrotron facility.
  arXiv  Detail & Related papers  (2021-05-18T10:15:17Z)
• Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detection [86.25022248968908]
  We learn context- and depth-aware feature representation to solve the problem of monocular 3D object detection. We show state-of-the-art results among the monocular-based approaches on the KITTI benchmark dataset.
  arXiv  Detail & Related papers  (2021-03-30T16:20:24Z)
• Anchor-free Small-scale Multispectral Pedestrian Detection [88.7497134369344]
  We propose a method for effective and efficient multispectral fusion of the two modalities in an adapted single-stage anchor-free base architecture. We aim at learning pedestrian representations based on object center and scale rather than direct bounding box predictions. Results show our method's effectiveness in detecting small-scaled pedestrians.
  arXiv  Detail & Related papers  (2020-08-19T13:13:01Z)
• Cross-Modality 3D Object Detection [63.29935886648709]
  We present a novel two-stage multi-modal fusion network for 3D object detection. The whole architecture facilitates two-stage fusion. Our experiments on the KITTI dataset show that the proposed multi-stage fusion helps the network to learn better representations.
  arXiv  Detail & Related papers  (2020-08-16T11:01:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.