USCNet: Transformer-Based Multimodal Fusion with Segmentation Guidance for Urolithiasis Classification

• URL: http://arxiv.org/abs/2604.07141v1
• Date: Wed, 08 Apr 2026 14:33:44 GMT
• Title: USCNet: Transformer-Based Multimodal Fusion with Segmentation Guidance for Urolithiasis Classification
• Abstract summary: Current methods for analyzing kidney stones depend on postoperative specimens.<n>We introduce a new approach called the Urinary Stone and Classification Network (USCNet)<n>USCNet integrates Computed Tomography (CT) images with clinical data from Electronic Health Records (EHR)
• Score: 37.84077140280879
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Kidney stone disease ranks among the most prevalent conditions in urology, and understanding the composition of these stones is essential for creating personalized treatment plans and preventing recurrence. Current methods for analyzing kidney stones depend on postoperative specimens, which prevents rapid classification before surgery. To overcome this limitation, we introduce a new approach called the Urinary Stone Segmentation and Classification Network (USCNet). This innovative method allows for precise preoperative classification of kidney stones by integrating Computed Tomography (CT) images with clinical data from Electronic Health Records (EHR). USCNet employs a Transformer-based multimodal fusion framework with CT-EHR attention and segmentation-guided attention modules for accurate classification. Moreover, a dynamic loss function is introduced to effectively balance the dual objectives of segmentation and classification. Experiments on an in-house kidney stone dataset show that USCNet demonstrates outstanding performance across all evaluation metrics, with its classification efficacy significantly surpassing existing mainstream methods. This study presents a promising solution for the precise preoperative classification of kidney stones, offering substantial clinical benefits. The source code has been made publicly available: https://github.com/ZhangSongqi0506/KidneyStone.

Related papers

• Evaluation of Few-Shot Learning Methods for Kidney Stone Type Recognition in Ureteroscopy [1.077541993594101]
  This contribution presents a deep learning method based on few-shot learning, aimed at producing sufficiently discriminative features for identifying kidney stone types in endoscopic images.<n>The results demonstrate that Prototypical Networks, using up to 25% of the training data, can achieve performance equal to or better than traditional deep learning models trained with the complete dataset.
  arXiv  Detail & Related papers  (2025-05-23T13:59:02Z)
• Robust Kidney Abnormality Segmentation: A Validation Study of an AI-Based Framework [3.225563371295004]
  Kidney volume could serve as an important biomarker for renal diseases.<n>Currently, clinical practice often relies on subjective visual assessment for evaluating kidney size and abnormalities.<n>This research aims to develop a robust, thoroughly validated kidney abnormality segmentation algorithm.
  arXiv  Detail & Related papers  (2025-05-12T13:53:19Z)
• Multi-task Explainable Skin Lesion Classification [54.76511683427566]
  We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data. The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
  arXiv  Detail & Related papers  (2023-10-11T05:49:47Z)
• SegPrompt: Using Segmentation Map as a Better Prompt to Finetune Deep Models for Kidney Stone Classification [62.403510793388705]
  Deep learning has produced encouraging results for kidney stone classification using endoscope images. The shortage of annotated training data poses a severe problem in improving the performance and generalization ability of the trained model. We propose SegPrompt to alleviate the data shortage problems by exploiting segmentation maps from two aspects.
  arXiv  Detail & Related papers  (2023-03-15T01:30:48Z)
• Improving Classification Model Performance on Chest X-Rays through Lung Segmentation [63.45024974079371]
  We propose a deep learning approach to enhance abnormal chest x-ray (CXR) identification performance through segmentations. Our approach is designed in a cascaded manner and incorporates two modules: a deep neural network with criss-cross attention modules (XLSor) for localizing lung region in CXR images and a CXR classification model with a backbone of a self-supervised momentum contrast (MoCo) model pre-trained on large-scale CXR data sets.
  arXiv  Detail & Related papers  (2022-02-22T15:24:06Z)
• Medulloblastoma Tumor Classification using Deep Transfer Learning with Multi-Scale EfficientNets [63.62764375279861]
  We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions. Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
  arXiv  Detail & Related papers  (2021-09-10T13:07:11Z)
• Multi-class motion-based semantic segmentation for ureteroscopy and laser lithotripsy [0.7874708385247353]
  We propose an end-to-end CNN-based framework for the segmentation of stones and laser fiber. We show that our proposed model generalizes better on a new clinical dataset showing a mean improvement of 25.4%, 20%, and 11% over UNet, HybResUNet, and DeepLabv3+, respectively.
  arXiv  Detail & Related papers  (2021-04-02T22:47:21Z)
• Assessing deep learning methods for the identification of kidney stones in endoscopic images [0.0]
  Knowing the type (i.e., the biochemical composition) of kidney stones is crucial to prevent relapses. During ureteroscopies, kidney stones are fragmented, extracted from the urinary tract, and their composition is determined using a morpho-constitutional analysis. This paper discusses and compares five classification methods including deep convolutional neural networks (DCNN)-based approaches and traditional (non DCNN-based) ones.
  arXiv  Detail & Related papers  (2021-03-01T17:31:01Z)
• Self-Supervised Learning for Segmentation [3.8026993716513933]
  The anatomical asymmetry of kidneys is leveraged to define an effective proxy task for kidney segmentation via self-supervised learning. A siamese convolutional neural network (CNN) is used to classify a given pair of kidney sections from CT volumes as being kidneys of the same or different sides.
  arXiv  Detail & Related papers  (2021-01-14T04:28:47Z)
• An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
  We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks. We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem. We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
  arXiv  Detail & Related papers  (2020-12-06T18:55:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.