Advances in Kidney Biopsy Lesion Assessment through Dense Instance Segmentation
- URL: http://arxiv.org/abs/2309.17166v3
- Date: Wed, 18 Dec 2024 04:38:38 GMT
- Title: Advances in Kidney Biopsy Lesion Assessment through Dense Instance Segmentation
- Abstract summary: Lesion scores made by renal pathologists are semi-quantitative and exhibit high inter-observer variability.<n> DiffRegFormer is a computational-friendly framework that can efficiently recognize over 500 objects across three anatomical classes.<n>Our approach outperforms previous methods, achieving an Average Precision of 52.1% (detection) and 46.8% (segmentation)
- Score: 0.3926357402982764
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Renal biopsies are the gold standard for the diagnosis of kidney diseases. Lesion scores made by renal pathologists are semi-quantitative and exhibit high inter-observer variability. Automating lesion classification within segmented anatomical structures can provide decision support in quantification analysis, thereby reducing inter-observer variability. Nevertheless, classifying lesions in regions-of-interest (ROIs) is clinically challenging due to (a) a large amount of densely packed anatomical objects, (b) class imbalance across different compartments (at least 3), (c) significant variation in size and shape of anatomical objects and (d) the presence of multi-label lesions per anatomical structure. Existing models cannot address these complexities in an efficient and generic manner. This paper presents an analysis for a \textbf{generalized solution} to datasets from various sources (pathology departments) with different types of lesions. Our approach utilizes two sub-networks: dense instance segmentation and lesion classification. We introduce \textbf{DiffRegFormer}, an end-to-end dense instance segmentation sub-network designed for multi-class, multi-scale objects within ROIs. Combining diffusion models, transformers, and RCNNs, DiffRegFormer {is a computational-friendly framework that can efficiently recognize over 500 objects across three anatomical classes, i.e., glomeruli, tubuli, and arteries, within ROIs.} In a dataset of 303 ROIs from 148 Jones' silver-stained renal Whole Slide Images (WSIs), our approach outperforms previous methods, achieving an Average Precision of 52.1\% (detection) and 46.8\% (segmentation). Moreover, our lesion classification sub-network achieves 89.2\% precision and 64.6\% recall on 21889 object patches out of the 303 ROIs. Lastly, our model demonstrates direct domain transfer to PAS-stained renal WSIs without fine-tuning.
Related papers
- B-MIM: Biased Masked Image Modeling for Generalizable Segmentation of Fine-Grained Anatomical Structures [42.844780603412325]
Self-supervised pretraining enables transferable representations for medical imaging.<n>Most CT encoders remain biased toward coarse semantic understanding.<n>We introduce Biased Masked Image Modeling to reduce global semantic alignment.
arXiv Detail & Related papers (2026-08-25T10:20:05Z) - AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation [58.56402940400457]
3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis.<n>We introduce AnaDiffusion, an anatomically compositional latent diffusion framework that factorizes the generation process into distinct, anatomically meaningful regions.<n>AnaDiffusion produces both explicit part assets and a globally coherent volume, enabling controllable part editing.
arXiv Detail & Related papers (2026-08-24T09:16:42Z) - A General Model for Retinal Segmentation and Quantification [40.957724455503346]
We present RetSAM, a general retinal segmentation and quantification framework for fundus imaging.<n>It delivers robust multi-target segmentation and standardized biomarker extraction, supporting downstream ophthalmologic studies and oculomics correlation analyses.<n>The resulting biomarkers enable systematic correlation analyses across major ophthalmic diseases, including diabetic retinopathy, age-related macular degeneration, glaucoma, and myopia.
arXiv Detail & Related papers (2026-01-31T10:24:02Z) - Partial Decoder Attention Network with Contour-weighted Loss Function for Data-Imbalance Medical Image Segmentation [24.53378031153159]
Medical images often suffer from data imbalance issues, such as large volume disparities among organs or tissues, and uneven sample distributions across different anatomical structures.<n>This imbalance tends to bias the model toward larger organs or more frequently represented structures, while overlooking smaller or less represented structures.<n>We propose a novel contour-weighted segmentation approach, which improves the model's capability to represent small and underrepresented structures.
arXiv Detail & Related papers (2026-01-20T13:21:12Z) - Robust Kidney Abnormality Segmentation: A Validation Study of an AI-Based Framework [3.225563371295004]
Kidney volume could serve as an important biomarker for renal diseases.<n>Currently, clinical practice often relies on subjective visual assessment for evaluating kidney size and abnormalities.<n>This research aims to develop a robust, thoroughly validated kidney abnormality segmentation algorithm.
arXiv Detail & Related papers (2025-05-12T13:53:19Z) - MSWAL: 3D Multi-class Segmentation of Whole Abdominal Lesions Dataset [41.69818086021188]
We introduce MSWAL, the first 3D Multi-class of the Whole Abdominal Lesions dataset.<n>MSWAL broadens the coverage of various common lesion types, such as gallstones, kidney stones, liver tumors, kidney tumors, pancreatic cancer, liver cysts, and kidney cysts.<n>We propose Inception nnU-Net, a novel segmentation framework that effectively integrates an Inception module with the nnU-Net architecture to extract information from different fields.
arXiv Detail & Related papers (2025-03-17T06:31:25Z) - KaLDeX: Kalman Filter based Linear Deformable Cross Attention for Retina Vessel Segmentation [46.57880203321858]
We propose a novel network (KaLDeX) for vascular segmentation leveraging a Kalman filter based linear deformable cross attention (LDCA) module.
Our approach is based on two key components: Kalman filter (KF) based linear deformable convolution (LD) and cross-attention (CA) modules.
The proposed method is evaluated on retinal fundus image datasets (DRIVE, CHASE_BD1, and STARE) as well as the 3mm and 6mm of the OCTA-500 dataset.
arXiv Detail & Related papers (2024-10-28T16:00:42Z) - Anatomy-guided Pathology Segmentation [56.883822515800205]
We develop a generalist segmentation model that combines anatomical and pathological information, aiming to enhance the segmentation accuracy of pathological features.
Our Anatomy-Pathology Exchange (APEx) training utilizes a query-based segmentation transformer which decodes a joint feature space into query-representations for human anatomy.
In doing so, we are able to report the best results across the board on FDG-PET-CT and Chest X-Ray pathology segmentation tasks with a margin of up to 3.3% as compared to strong baseline methods.
arXiv Detail & Related papers (2024-07-08T11:44:15Z) - Multi-Stain Multi-Level Convolutional Network for Multi-Tissue Breast Cancer Image Segmentation [5.572436001833252]
We propose a novel convolutional neural network (CNN) based Multi-class Tissue model for histopathology.
Our model is able to separate bad regions such as folds, artifacts, blurry regions, bubbles, etc. from tissue regions using multi-level context.
Our training pipeline used 12 million patches generated using context-aware augmentations which made our model stain and scanner invariant.
arXiv Detail & Related papers (2024-06-09T15:35:49Z) - Deep Learning for Vascular Segmentation and Applications in Phase
Contrast Tomography Imaging [33.23991248643144]
We present a thorough literature review, highlighting the state of machine learning techniques across diverse organs.
Our goal is to provide a foundation on the topic and identify a robust baseline model for application to vascular segmentation in a new imaging modality.
HiP CT enables 3D imaging of complete organs at an unprecedented resolution of ca. 20mm per voxel.
arXiv Detail & Related papers (2023-11-22T11:15:38Z) - AttResDU-Net: Medical Image Segmentation Using Attention-based Residual
Double U-Net [0.0]
This paper proposes an attention-based residual Double U-Net architecture (AttResDU-Net) that improves on the existing medical image segmentation networks.
We conducted experiments on three datasets: CVC Clinic-DB, ISIC 2018, and the 2018 Data Science Bowl datasets and achieved Dice Coefficient scores of 94.35%, 91.68%, and 92.45% respectively.
arXiv Detail & Related papers (2023-06-25T14:28:08Z) - Meta-information-aware Dual-path Transformer for Differential Diagnosis
of Multi-type Pancreatic Lesions in Multi-phase CT [41.199716328468895]
We develop a dual-path transformer to exploit the feasibility of classification and segmentation of pancreatic lesions.
The proposed method consists of a CNN-based segmentation path (S-path) and a transformer-based classification path (C-path)
Our results show that our method can enable accurate classification and segmentation of the full taxonomy of pancreatic lesions.
arXiv Detail & Related papers (2023-03-02T03:34:28Z) - TotalSegmentator: robust segmentation of 104 anatomical structures in CT
images [48.50994220135258]
We present a deep learning segmentation model for body CT images.
The model can segment 104 anatomical structures relevant for use cases such as organ volumetry, disease characterization, and surgical or radiotherapy planning.
arXiv Detail & Related papers (2022-08-11T15:16:40Z) - External Attention Assisted Multi-Phase Splenic Vascular Injury
Segmentation with Limited Data [72.99534552950138]
The spleen is one of the most commonly injured solid organs in blunt abdominal trauma.
accurate segmentation of splenic vascular injury is challenging for the following reasons.
arXiv Detail & Related papers (2022-01-04T02:35:56Z) - Explainable multiple abnormality classification of chest CT volumes with
AxialNet and HiResCAM [89.2175350956813]
We introduce the challenging new task of explainable multiple abnormality classification in volumetric medical images.
We propose a multiple instance learning convolutional neural network, AxialNet, that allows identification of top slices for each abnormality.
We then aim to improve the model's learning through a novel mask loss that leverages HiResCAM and 3D allowed regions.
arXiv Detail & Related papers (2021-11-24T01:14:33Z) - Cross-Site Severity Assessment of COVID-19 from CT Images via Domain
Adaptation [64.59521853145368]
Early and accurate severity assessment of Coronavirus disease 2019 (COVID-19) based on computed tomography (CT) images offers a great help to the estimation of intensive care unit event.
To augment the labeled data and improve the generalization ability of the classification model, it is necessary to aggregate data from multiple sites.
This task faces several challenges including class imbalance between mild and severe infections, domain distribution discrepancy between sites, and presence of heterogeneous features.
arXiv Detail & Related papers (2021-09-08T07:56:51Z) - Automatic size and pose homogenization with spatial transformer network
to improve and accelerate pediatric segmentation [51.916106055115755]
We propose a new CNN architecture that is pose and scale invariant thanks to the use of Spatial Transformer Network (STN)
Our architecture is composed of three sequential modules that are estimated together during training.
We test the proposed method in kidney and renal tumor segmentation on abdominal pediatric CT scanners.
arXiv Detail & Related papers (2021-07-06T14:50:03Z) - Deep Implicit Statistical Shape Models for 3D Medical Image Delineation [47.78425002879612]
3D delineation of anatomical structures is a cardinal goal in medical imaging analysis.
Prior to deep learning, statistical shape models that imposed anatomical constraints and produced high quality surfaces were a core technology.
We present deep implicit statistical shape models (DISSMs), a new approach to delineation that marries the representation power of CNNs with the robustness of SSMs.
arXiv Detail & Related papers (2021-04-07T01:15:06Z) - Deeply supervised UNet for semantic segmentation to assist
dermatopathological assessment of Basal Cell Carcinoma (BCC) [2.031570465477242]
We focus on detecting Basal Cell Carcinoma (BCC) through semantic segmentation using several models based on the UNet architecture.
We analyze two different encoders for the first part of the UNet network and two additional training strategies.
The best model achieves over 96%, accuracy, sensitivity, and specificity on the test set.
arXiv Detail & Related papers (2021-03-05T15:39:55Z) - Fully Automated and Standardized Segmentation of Adipose Tissue
Compartments by Deep Learning in Three-dimensional Whole-body MRI of
Epidemiological Cohort Studies [11.706960468832301]
Quantification and localization of different adipose tissue compartments from whole-body MR images is of high interest to examine metabolic conditions.
We propose a 3D convolutional neural network (DCNet) to provide a robust and objective segmentation.
Fast (5-7seconds) and reliable adipose tissue segmentation can be obtained with high Dice overlap.
arXiv Detail & Related papers (2020-08-05T17:30:14Z) - Detecting Scatteredly-Distributed, Small, andCritically Important
Objects in 3D OncologyImaging via Decision Stratification [23.075722503902714]
We focus on the detection and segmentation of oncology-significant (or suspicious cancer metastasized) lymph nodes.
We propose a divide-and-conquer decision stratification approach that divides OSLNs into tumor-proximal and tumor-distal categories.
We present a novel global-local network (GLNet) that combines high-level lesion characteristics with features learned from localized 3D image patches.
arXiv Detail & Related papers (2020-05-27T23:12:11Z) - Cross-stained Segmentation from Renal Biopsy Images Using Multi-level
Adversarial Learning [13.30545860115548]
We design a robust and flexible model for cross-stained segmentation.
It is able to improve segmentation performance on target type of stained images and use unlabeled data to achieve similar accuracy to labeled data.
arXiv Detail & Related papers (2020-02-20T06:49:48Z) - VerSe: A Vertebrae Labelling and Segmentation Benchmark for
Multi-detector CT Images [121.31355003451152]
Large Scale Vertebrae Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020.
We present the the results of this evaluation and further investigate the performance-variation at vertebra-level, scan-level, and at different fields-of-view.
arXiv Detail & Related papers (2020-01-24T21:09:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.