Nuclei-Location Based Point Set Registration of Multi-Stained Whole Slide Images
- URL: http://arxiv.org/abs/2404.17041v1
- Date: Thu, 25 Apr 2024 21:06:53 GMT
- Title: Nuclei-Location Based Point Set Registration of Multi-Stained Whole Slide Images
- Authors: Adith Jeyasangar, Abdullah Alsalemi, Shan E Ahmed Raza,
- Abstract summary: Whole Slide Images (WSIs) provide exceptional detail for studying tissue architecture at the cell level.
To study tumour microenvironment (TME) with the context of various protein biomarkers and cell sub-types, analysis and registration of features using multi-stained WSIs is often required.
Traditional registration methods mainly focus on global rigid/non-rigid registration but struggle with aligning slides with complex tissue deformations at the nuclei level.
This paper focuses on local level non-rigid registration using a nuclei-location based point set registration approach for aligning multi-stained WSIs.
- Score: 0.452624578758371
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Whole Slide Images (WSIs) provide exceptional detail for studying tissue architecture at the cell level. To study tumour microenvironment (TME) with the context of various protein biomarkers and cell sub-types, analysis and registration of features using multi-stained WSIs is often required. Multi-stained WSI pairs normally suffer from rigid and non-rigid deformities in addition to slide artefacts and control tissue which present challenges at precise registration. Traditional registration methods mainly focus on global rigid/non-rigid registration but struggle with aligning slides with complex tissue deformations at the nuclei level. However, nuclei level non-rigid registration is essential for downstream tasks such as cell sub-type analysis in the context of protein biomarker signatures. This paper focuses on local level non-rigid registration using a nuclei-location based point set registration approach for aligning multi-stained WSIs. We exploit the spatial distribution of nuclei that is prominent and consistent (to a large level) across different stains to establish a spatial correspondence. We evaluate our approach using the HYRECO dataset consisting of 54 re-stained images of H\&E and PHH3 image pairs. The approach can be extended to other IHC and IF stained WSIs considering a good nuclei detection algorithm is accessible. The performance of the model is tested against established registration algorithms and is shown to outperform the model for nuclei level registration.
Related papers
- A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis [82.01597026329158]
We introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS) for pathology-specific text-to-image synthesis.<n>CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy.<n>This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations.
arXiv Detail & Related papers (2025-12-15T10:22:43Z) - CORE - A Cell-Level Coarse-to-Fine Image Registration Engine for Multi-stain Image Alignment [0.3010928327681199]
CORE is a coarse-to-fine framework for accurate nuclei-level registration across diverse multimodal whole-slide image (WSI) datasets.<n>We show that CORE outperforms current state-of-the-art methods in terms of generalisability, precision, and robustness in bright-field and immunofluorescence microscopy WSIs.
arXiv Detail & Related papers (2025-11-05T19:47:41Z) - SG-CLDFF: A Novel Framework for Automated White Blood Cell Classification and Segmentation [0.0]
Saliency-Guided Cross-Layer Deep Feature Fusion framework (SG-CLDFF)<n>A lightweight hybrid backbone (Swin-style) produces multi-resolution representations, which are fused by a ResNeXt-CCinspired cross-layer fusion module.<n>Interpretability is enforced through Grad-CAM visualizations and saliency consistency checks, allowing model decisions to be inspected at the regional level.
arXiv Detail & Related papers (2025-10-20T08:07:39Z) - Instance-Aware Robust Consistency Regularization for Semi-Supervised Nuclei Instance Segmentation [53.94176748542936]
We propose an Instance-Aware Robust Consistency Regularization Network (IRCR-Net) for accurate instance-level nuclei segmentation.<n>We incorporate morphological prior knowledge of nuclei in pathological images and utilize these priors to assess the quality of pseudo-labels generated from unlabeled data.
arXiv Detail & Related papers (2025-10-10T12:32:32Z) - STAR: A Fast and Robust Rigid Registration Framework for Serial Histopathological Images [2.4947556305222345]
Serial Tissue Alignment for rigid registration (STAR) is a fast and robust open-source framework for multi-WSI alignment.<n> evaluated on the ANHIR 2019 and ABAT 2022 datasets spanning multiple organs and scanning conditions.<n> STAR consistently produced stable alignments within minutes per slide, demonstrating robustness to cross-stain variability and partial tissue overlap.
arXiv Detail & Related papers (2025-09-03T02:32:24Z) - Leveraging Vision-Language Embeddings for Zero-Shot Learning in Histopathology Images [7.048241543461529]
We propose a novel framework called Multi-Resolution Prompt-guided Hybrid Embedding (MR-PHE) to address these challenges in zero-shot histopathology image classification.
We introduce a hybrid embedding strategy that integrates global image embeddings with weighted patch embeddings.
A similarity-based patch weighting mechanism assigns attention-like weights to patches based on their relevance to class embeddings.
arXiv Detail & Related papers (2025-03-13T12:18:37Z) - From Traditional to Deep Learning Approaches in Whole Slide Image Registration: A Methodological Review [7.441179174680556]
Whole slide image (WSI) registration is an essential task for analysing the tumour microenvironment (TME) in histopathology.
It involves the alignment of spatial information between WSIs of the same section or serial sections of a tissue sample.
The goal is to identify neighbouring nuclei along the Z-axis for creating a 3D image or identifying subclasses of cells in the TME.
arXiv Detail & Related papers (2025-02-26T13:24:16Z) - RegWSI: Whole Slide Image Registration using Combined Deep Feature- and Intensity-Based Methods: Winner of the ACROBAT 2023 Challenge [1.7625447004432986]
A robust, efficient, and accurate registration method is highly desired by the scientific community and hospitals specializing in digital pathology.
We propose a two-step hybrid method consisting of (i) deep learning- and feature-based initial alignment algorithm, and (ii) intensity-based nonrigid registration.
The proposed method does not require any fine-tuning to a particular dataset and can be used directly for any desired tissue type and stain.
arXiv Detail & Related papers (2024-04-19T16:19:30Z) - Histopathology Whole Slide Image Analysis with Heterogeneous Graph
Representation Learning [78.49090351193269]
We propose a novel graph-based framework to leverage the inter-relationships among different types of nuclei for WSI analysis.
Specifically, we formulate the WSI as a heterogeneous graph with "nucleus-type" attribute to each node and a semantic attribute similarity to each edge.
Our framework outperforms the state-of-the-art methods with considerable margins on various tasks.
arXiv Detail & Related papers (2023-07-09T14:43:40Z) - Structure-aware registration network for liver DCE-CT images [50.28546654316009]
We propose a novel structure-aware registration method by incorporating structural information of related organs with segmentation-guided deep registration network.
Our proposed method can achieve higher registration accuracy and preserve anatomical structure more effectively than state-of-the-art methods.
arXiv Detail & Related papers (2023-03-08T14:08:56Z) - Which Pixel to Annotate: a Label-Efficient Nuclei Segmentation Framework [70.18084425770091]
Deep neural networks have been widely applied in nuclei instance segmentation of H&E stained pathology images.
It is inefficient and unnecessary to label all pixels for a dataset of nuclei images which usually contain similar and redundant patterns.
We propose a novel full nuclei segmentation framework that chooses only a few image patches to be annotated, augments the training set from the selected samples, and achieves nuclei segmentation in a semi-supervised manner.
arXiv Detail & Related papers (2022-12-20T14:53:26Z) - Joint segmentation and discontinuity-preserving deformable registration:
Application to cardiac cine-MR images [74.99415008543276]
Most deep learning-based registration methods assume that the deformation fields are smooth and continuous everywhere in the image domain.
We propose a novel discontinuity-preserving image registration method to tackle this challenge, which ensures globally discontinuous and locally smooth deformation fields.
A co-attention block is proposed in the segmentation component of the network to learn the structural correlations in the input images.
We evaluate our method on the task of intra-subject-temporal image registration using large-scale cinematic cardiac magnetic resonance image sequences.
arXiv Detail & Related papers (2022-11-24T23:45:01Z) - From WSI-level to Patch-level: Structure Prior Guided Binuclear Cell
Fine-grained Detection [8.810499770542553]
Binuclear cell (BC) detection plays a significant role in predicting the risk of leukemia and other malignant tumors.
We propose a two-stage detection method inspired by the structure prior to BC based on deep learning.
The coarse detection network is a multi-task detection framework based on circular bounding boxes for cells detection, and central key points for nucleus detection.
arXiv Detail & Related papers (2022-08-26T12:32:05Z) - Domain Adaptive Nuclei Instance Segmentation and Classification via
Category-aware Feature Alignment and Pseudo-labelling [65.40672505658213]
We propose a novel deep neural network, namely Category-Aware feature alignment and Pseudo-Labelling Network (CAPL-Net) for UDA nuclei instance segmentation and classification.
Our approach outperforms state-of-the-art UDA methods with a remarkable margin.
arXiv Detail & Related papers (2022-07-04T07:05:06Z) - ScoreNet: Learning Non-Uniform Attention and Augmentation for
Transformer-Based Histopathological Image Classification [11.680355561258427]
High-resolution images hinder progress in digital pathology.
patch-based processing often incorporates multiple instance learning (MIL) to aggregate local patch-level representations yielding image-level prediction.
This paper proposes a transformer-based architecture specifically tailored for histological image classification.
It combines fine-grained local attention with a coarse global attention mechanism to learn meaningful representations of high-resolution images at an efficient computational cost.
arXiv Detail & Related papers (2022-02-15T16:55:09Z) - Automatic Multi-Stain Registration of Whole Slide Images in
Histopathology [0.0]
automatic, and fast cross-staining alignment of enormous gigapixel Whole Slide Images (WSIs) at single-cell precision is challenging.
In this paper, we propose a two-step automatic feature-based cross-staining alignment to assist localization of even tiny metastatic lymph node.
arXiv Detail & Related papers (2021-07-29T19:38:30Z) - CryoNuSeg: A Dataset for Nuclei Instance Segmentation of Cryosectioned
H&E-Stained Histological Images [2.809445852388983]
We introduce CryoNuSeg, the first fully annotated FS-derived cryosectioned and H&E-stained nuclei instance segmentation dataset.
The dataset contains images from 10 human organs that were not exploited in other publicly available datasets.
arXiv Detail & Related papers (2021-01-02T12:34:06Z) - Unsupervised Instance Segmentation in Microscopy Images via Panoptic
Domain Adaptation and Task Re-weighting [86.33696045574692]
We propose a Cycle Consistency Panoptic Domain Adaptive Mask R-CNN (CyC-PDAM) architecture for unsupervised nuclei segmentation in histopathology images.
We first propose a nuclei inpainting mechanism to remove the auxiliary generated objects in the synthesized images.
Secondly, a semantic branch with a domain discriminator is designed to achieve panoptic-level domain adaptation.
arXiv Detail & Related papers (2020-05-05T11:08:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.