Deep Feature based Cross-slide Registration
- URL: http://arxiv.org/abs/2202.09971v2
- Date: Tue, 22 Feb 2022 22:52:19 GMT
- Title: Deep Feature based Cross-slide Registration
- Authors: Ruqayya Awan, Shan E Ahmed Raza, Johannes Lotz and Nasir M. Rajpoot
- Abstract summary: Cross-slide image analysis provides additional information by analysing the expression of different biomarkers as compared to a single slide analysis.
We propose a deep feature based registration (DFBR) method which utilises data-driven features to estimate the rigid transformation.
- Score: 13.271717388861557
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Cross-slide image analysis provides additional information by analysing the
expression of different biomarkers as compared to a single slide analysis.
Slides stained with different biomarkers are analysed side by side which may
reveal unknown relations between the different biomarkers. During the slide
preparation, a tissue section may be placed at an arbitrary orientation as
compared to other sections of the same tissue block. The problem is compounded
by the fact that tissue contents are likely to change from one section to the
next and there may be unique artefacts on some of the slides. This makes
registration of each section to a reference section of the same tissue block an
important pre-requisite task before any cross-slide analysis. We propose a deep
feature based registration (DFBR) method which utilises data-driven features to
estimate the rigid transformation. We adopted a multi-stage strategy for
improving the quality of registration. We also developed a visualisation tool
to view registered pairs of WSIs at different magnifications. With the help of
this tool, one can apply a transformation on the fly without the need to
generate transformed source WSI in a pyramidal form. We compared the
performance of data-driven features with that of hand-crafted features on the
COMET dataset. Our approach can align the images with low registration errors.
Generally, the success of non-rigid registration is dependent on the quality of
rigid registration. To evaluate the efficacy of the DFBR method, the first two
steps of the ANHIR winner's framework are replaced with our DFBR to register
challenge provided image pairs. The modified framework produce comparable
results to that of challenge winning team.
Related papers
- Transformation trees -- documentation of multimodal image registration [0.0]
Multimodal image registration plays a key role in creating digital patient models.
We propose the use of transformation trees as a method for structured recording and management of transformations.
arXiv Detail & Related papers (2025-01-31T13:49:16Z) - MUSTER: Longitudinal Deformable Registration by Composition of Consecutive Deformations [0.0]
This study introduces Multi-Session Temporal Registration (MUSTER), a novel method for longitudinal analysis of changes in medical images.
MUSTER improves upon conventional pairwise registration by incorporating more than two imaging sessions to recover longitudinal deformations.
We show that MUSTER can effectively identify patterns of neuro-degeneration from T1-weighted images and that these changes correlate with changes in cognition.
arXiv Detail & Related papers (2024-12-19T09:22:19Z) - Semantic Segmentation Based Quality Control of Histopathology Whole Slide Images [2.953447779233234]
We developed a software pipeline for quality control (QC) of histopathology whole slide images (WSIs)
It segments various regions, such as blurs of different levels, tissue regions, tissue folds, and pen marks.
It was evaluated in all TCGAs, which is the largest publicly available WSI dataset containing more than 11,000 histopathology images from 28 organs.
arXiv Detail & Related papers (2024-10-04T10:03:04Z) - RegWSI: Whole Slide Image Registration using Combined Deep Feature- and Intensity-Based Methods: Winner of the ACROBAT 2023 Challenge [1.7625447004432986]
A robust, efficient, and accurate registration method is highly desired by the scientific community and hospitals specializing in digital pathology.
We propose a two-step hybrid method consisting of (i) deep learning- and feature-based initial alignment algorithm, and (ii) intensity-based nonrigid registration.
The proposed method does not require any fine-tuning to a particular dataset and can be used directly for any desired tissue type and stain.
arXiv Detail & Related papers (2024-04-19T16:19:30Z) - Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration [50.62725807357586]
This article presents a general Bayesian learning framework for multi-modal groupwise image registration.
We propose a novel hierarchical variational auto-encoding architecture to realise the inference procedure of the latent variables.
Experiments were conducted to validate the proposed framework, including four different datasets from cardiac, brain, and abdominal medical images.
arXiv Detail & Related papers (2024-01-04T08:46:39Z) - Dual-scale Enhanced and Cross-generative Consistency Learning for Semi-supervised Medical Image Segmentation [49.57907601086494]
Medical image segmentation plays a crucial role in computer-aided diagnosis.
We propose a novel Dual-scale Enhanced and Cross-generative consistency learning framework for semi-supervised medical image (DEC-Seg)
arXiv Detail & Related papers (2023-12-26T12:56:31Z) - Deep Angiogram: Trivializing Retinal Vessel Segmentation [1.8479315677380455]
We propose a contrastive variational auto-encoder that can filter out irrelevant features and synthesize a latent image, named deep angiogram.
The generalizability of the synthetic network is improved by the contrastive loss that makes the model less sensitive to variations of image contrast and noisy features.
arXiv Detail & Related papers (2023-07-01T06:13:10Z) - Affinity Feature Strengthening for Accurate, Complete and Robust Vessel
Segmentation [48.638327652506284]
Vessel segmentation is crucial in many medical image applications, such as detecting coronary stenoses, retinal vessel diseases and brain aneurysms.
We present a novel approach, the affinity feature strengthening network (AFN), which jointly models geometry and refines pixel-wise segmentation features using a contrast-insensitive, multiscale affinity approach.
arXiv Detail & Related papers (2022-11-12T05:39:17Z) - Automatic Multi-Stain Registration of Whole Slide Images in
Histopathology [0.0]
automatic, and fast cross-staining alignment of enormous gigapixel Whole Slide Images (WSIs) at single-cell precision is challenging.
In this paper, we propose a two-step automatic feature-based cross-staining alignment to assist localization of even tiny metastatic lymph node.
arXiv Detail & Related papers (2021-07-29T19:38:30Z) - CryoNuSeg: A Dataset for Nuclei Instance Segmentation of Cryosectioned
H&E-Stained Histological Images [2.809445852388983]
We introduce CryoNuSeg, the first fully annotated FS-derived cryosectioned and H&E-stained nuclei instance segmentation dataset.
The dataset contains images from 10 human organs that were not exploited in other publicly available datasets.
arXiv Detail & Related papers (2021-01-02T12:34:06Z) - Semantic Change Detection with Asymmetric Siamese Networks [71.28665116793138]
Given two aerial images, semantic change detection aims to locate the land-cover variations and identify their change types with pixel-wise boundaries.
This problem is vital in many earth vision related tasks, such as precise urban planning and natural resource management.
We present an asymmetric siamese network (ASN) to locate and identify semantic changes through feature pairs obtained from modules of widely different structures.
arXiv Detail & Related papers (2020-10-12T13:26:30Z) - Instance-Aware Graph Convolutional Network for Multi-Label
Classification [55.131166957803345]
Graph convolutional neural network (GCN) has effectively boosted the multi-label image recognition task.
We propose an instance-aware graph convolutional neural network (IA-GCN) framework for multi-label classification.
arXiv Detail & Related papers (2020-08-19T12:49:28Z) - Pathological Retinal Region Segmentation From OCT Images Using Geometric
Relation Based Augmentation [84.7571086566595]
We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape.
The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
arXiv Detail & Related papers (2020-03-31T11:50:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.