Dual-Stream Pyramid Registration Network

• URL: http://arxiv.org/abs/1909.11966v2
• Date: Sat, 1 Apr 2023 11:28:05 GMT
• Title: Dual-Stream Pyramid Registration Network
• Authors: Miao Kang and Xiaojun Hu and Weilin Huang and Matthew R. Scott and Mauricio Reyes
• Abstract summary: We propose a Dual-Stream Pyramid Registration Network (referred as Dual-PRNet) for unsupervised 3D medical image registration. We design a two-stream architecture able to compute multi-scale registration fields from convolutional feature pyramids. The proposed Dual-PRNet is evaluated on two standard benchmarks for brain MRI registration.
• Score: 34.65021683954268
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a Dual-Stream Pyramid Registration Network (referred as Dual-PRNet) for unsupervised 3D medical image registration. Unlike recent CNN-based registration approaches, such as VoxelMorph, which explores a single-stream encoder-decoder network to compute a registration fields from a pair of 3D volumes, we design a two-stream architecture able to compute multi-scale registration fields from convolutional feature pyramids. Our contributions are two-fold: (i) we design a two-stream 3D encoder-decoder network which computes two convolutional feature pyramids separately for a pair of input volumes, resulting in strong deep representations that are meaningful for deformation estimation; (ii) we propose a pyramid registration module able to predict multi-scale registration fields directly from the decoding feature pyramids. This allows it to refine the registration fields gradually in a coarse-to-fine manner via sequential warping, and enable the model with the capability for handling significant deformations between two volumes, such as large displacements in spatial domain or slice space. The proposed Dual-PRNet is evaluated on two standard benchmarks for brain MRI registration, where it outperforms the state-of-the-art approaches by a large margin, e.g., having improvements over recent VoxelMorph [2] with 0.683->0.778 on the LPBA40, and 0.511->0.631 on the Mindboggle101, in term of average Dice score. Code is available at: https://github.com/kangmiao15/Dual-Stream-PRNet-Plus.

Related papers

• Diff-Reg v2: Diffusion-Based Matching Matrix Estimation for Image Matching and 3D Registration [33.8118117906136]
  We introduce an innovative paradigm that leverages a diffusion model in matrix space for robust matching matrix estimation. Specifically, we apply the diffusion model in the doubly matrix space for 3D-3D and 2D-3D registration tasks. For all three registration tasks, we provide adaptive matching matrix embedding implementations tailored to the specific characteristics of each task.
  arXiv  Detail & Related papers  (2025-03-06T06:13:27Z)
• ProtoOcc: Accurate, Efficient 3D Occupancy Prediction Using Dual Branch Encoder-Prototype Query Decoder [8.494947115633682]
  ProtoOcc is a novel 3D occupancy prediction model designed to predict the occupancy states and semantic classes of 3D voxels. ProtoOcc achieves state-of-the-art performance with 45.02% mIoU on the Occ3D-nuScenes benchmark.
  arXiv  Detail & Related papers  (2024-12-11T20:55:21Z)
• Efficient Transformer Encoders for Mask2Former-style models [57.54752243522298]
  ECO-M2F is a strategy to self-select the number of hidden layers in the encoder conditioned on the input image. The proposed approach reduces expected encoder computational cost while maintaining performance. It is flexible in architecture configurations, and can be extended beyond the segmentation task to object detection.
  arXiv  Detail & Related papers  (2024-04-23T17:26:34Z)
• Pyramid Attention Network for Medical Image Registration [4.142556531859984]
  We propose a pyramid attention network (PAN) for deformable medical image registration. PAN incorporates a dual-stream pyramid encoder with channel-wise attention to boost the feature representation. Our method achieves favorable registration performance, while outperforming several CNN-based and Transformer-based registration networks.
  arXiv  Detail & Related papers  (2024-02-14T08:46:18Z)
• RoCNet: 3D Robust Registration of Point-Clouds using Deep Learning [5.494111035517598]
  This paper introduces a new method for 3D point cloud registration based on deep learning. We conduct experiments on the ModelNet40 dataset, and our proposed architecture shows very promising results.
  arXiv  Detail & Related papers  (2023-03-14T15:07:51Z)
• Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training [56.81809311892475]
  Masked Autoencoders (MAE) have shown great potentials in self-supervised pre-training for language and 2D image transformers. We propose Point-M2AE, a strong Multi-scale MAE pre-training framework for hierarchical self-supervised learning of 3D point clouds.
  arXiv  Detail & Related papers  (2022-05-28T11:22:53Z)
• A Volumetric Transformer for Accurate 3D Tumor Segmentation [25.961484035609672]
  This paper presents a Transformer architecture for medical image segmentation. The Transformer has a U-shaped volumetric encoder-decoder design that processes the input voxels in their entirety. We show that our model transfer better representations across-datasets and are robust against data corruptions.
  arXiv  Detail & Related papers  (2021-11-26T02:49:51Z)
• Subpixel object segmentation using wavelets and multi resolution analysis [4.970364068620608]
  We propose a novel deep learning framework for fast prediction of boundaries of two-dimensional simply connected domains. The boundaries are modelled as (piecewise) smooth closed curves using wavelets and the so-called Pyramid Algorithm. Our model demonstrates up to 5x faster inference speed compared to the U-Net, while maintaining similar performance in terms of Dice score and Hausdorff distance.
  arXiv  Detail & Related papers  (2021-10-28T15:43:21Z)
• PlueckerNet: Learn to Register 3D Line Reconstructions [57.20244406275875]
  This paper proposes a neural network based method to solve the problem of Aligning two partially-overlapped 3D line reconstructions in Euclidean space. Experiments on both indoor and outdoor datasets show that the registration (rotation and translation) precision of our method outperforms baselines significantly.
  arXiv  Detail & Related papers  (2020-12-02T11:31:56Z)
• DeepGMR: Learning Latent Gaussian Mixture Models for Registration [113.74060941036664]
  Point cloud registration is a fundamental problem in 3D computer vision, graphics and robotics. In this paper, we introduce Deep Gaussian Mixture Registration (DeepGMR), the first learning-based registration method. Our proposed method shows favorable performance when compared with state-of-the-art geometry-based and learning-based registration methods.
  arXiv  Detail & Related papers  (2020-08-20T17:25:16Z)
• Suppress and Balance: A Simple Gated Network for Salient Object Detection [89.88222217065858]
  We propose a simple gated network (GateNet) to solve both issues at once. With the help of multilevel gate units, the valuable context information from the encoder can be optimally transmitted to the decoder. In addition, we adopt the atrous spatial pyramid pooling based on the proposed "Fold" operation (Fold-ASPP) to accurately localize salient objects of various scales.
  arXiv  Detail & Related papers  (2020-07-16T02:00:53Z)
• Encoder-Decoder Based Convolutional Neural Networks with Multi-Scale-Aware Modules for Crowd Counting [6.893512627479196]
  We propose two modified neural networks for accurate and efficient crowd counting. The first model is named M-SFANet, which is attached with atrous spatial pyramid pooling (ASPP) and context-aware module (CAN) The second model is called M-SegNet, which is produced by replacing the bilinear upsampling in SFANet with max unpooling that is used in SegNet.
  arXiv  Detail & Related papers  (2020-03-12T03:00:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.