CaresAI at SMM4H-HeaRD 2026: Predicting TNM Staging

• URL: http://arxiv.org/abs/2607.03466v1
• Date: Fri, 03 Jul 2026 16:25:35 GMT
• Title: CaresAI at SMM4H-HeaRD 2026: Predicting TNM Staging
• Abstract summary: This study aims to predict Tumor, Node, and Metastasis (TNM) stage labels independently, with the Cancer Genome Atlas (TCGA) pathology report as the sixth shared task of SMM4H-HeaRD 2026.<n>We explore both classical and deep learning approaches using Term Frequency-Inverse Document Frequency (TF-IDF) features and embeddings from ClinicalBERT, BioBERT, and PubMedBERT.<n>Our results show that individual embeddings perform similarly to the TNM label classification, while their combination improves its predictive ability.
• Score: 2.7998963147546143
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This study aims to predict Tumor, Node, and Metastasis (TNM) stage labels independently, with the Cancer Genome Atlas (TCGA) pathology report as the sixth shared task of SMM4H-HeaRD 2026. The problem is framed as three multi-label classification tasks. We explore both classical and deep learning approaches using Term Frequency-Inverse Document Frequency (TF-IDF) features and embeddings from ClinicalBERT, BioBERT, and PubMedBERT. These representations are used with Logistic Regression (LR), Light Gradient Boosting Machine (LightGBM), Feed-Forward Neural Networks (FFNN), and Wide Residual Networks (WRN). Our results show that individual embeddings perform similarly to the TNM label classification, while their combination improves its predictive ability. WRN achieves AUROC scores of 0.839 (T), 0.8502 (N), and 0.803 (M) with F1-scores of 0.622, 0.702, and 0.9337, respectively, for the training phase. LightGBM with TF-IDF performs best with AUROC scores of 0.9368 (T), 0.9524 (N), and 0.8311 (M) and F1-scores of 0.7559 (T), 0.7384 (N), and 0.7017 (M) during the training phase. Furthermore, the result of the Codabench for the test sets indicates a Macro-F1 score of 0.978, 0.957, and 0.879 for the T, N, and M categories respectively for test set 1; while test set 2 records a Macro-F1 score for T, N, and M is 0.807, 0.767, 1.0 respectively. However, performance declined during the evaluation phase of the test sets, a drop from 0.938 to 0.858 of test set 1 to 2, for the Macro-F1 score across all stages; suggesting limitations in model generalizability, sensitivity to class imbalance, and challenges in processing lengthy clinical documents. Although this study provides an efficient baseline model and a reproducible pipeline, further optimization and validation are required before it can be considered suitable for use in a real-world clinical setting.

Related papers

• A cross-modal generative model for incomplete and degraded prostate MRI with multicentre clinical validation [48.14053205497089]
  MSCNet is a sequence-conditioned cross-modal generative framework for reconstructing unavailable contrasts and restoring degraded acquisitions.<n>Overall image quality met the prespecified non-inferiority criterion for DWI, ADC and T2W completion, but not T1W.
  arXiv  Detail & Related papers  (2026-08-17T08:11:25Z)
• A Leakage-Aware Comparative Benchmark of Machine Learning, Deep Learning, and Transformer Models for Reliable Leukemia Detection [0.0]
  Automated classification of acute lymphoblastic leukemia (ALL) from peripheral blood smear images has often reported near-perfect performance on the C-NMC 2019 dataset.<n>We show that such results can be inflated by patient-level data leakage caused by random image-level partitioning.<n>We establish a leakage-aware benchmark under a strict subject-disjoint protocol.
  arXiv  Detail & Related papers  (2026-06-23T04:53:49Z)
• Cascade Classification of Dermoscopic Images of Skin Neoplasms with Controllable Sensitivity and External Clinical Validation [36.94429692322632]
  Four architectures were compared in three schemes: binary (malignant/benign), single-stage four-class (benign, MEL, SCC, BCC), and a two-stage cascade (binary triage, then three-class differentiation MEL/ SCC/BCC)<n>All models used ImageNet-pretrained weights and a single augmentation protocol on aggregated open ISIC Archive data.<n>On ISIC MILK10k, direct 11-class classification yields mean-class sensitivity 0.525.
  arXiv  Detail & Related papers  (2026-06-11T09:55:57Z)
• Early Detection of Alzheimer's Disease Using Explainable Machine Learning on Clinical Biomarkers: A Multi-Class Classification Study Using the Alzheimer's Disease Neuroimaging Initiative (ADNI) Dataset [0.0]
  Alzheimer's disease affects over 55 million people worldwide.<n>Machine learning model trained on routine clinical assessments achieves near-perfect three-class Alzheimer's detection.
  arXiv  Detail & Related papers  (2026-04-14T10:54:14Z)
• Generalizable Diabetes Risk Stratification via Hybrid Machine Learning Models [0.0]
  Diabetes affects over 537 million people worldwide and is projected to reach 783 million by 2045.<n>We compare two hybrid classifiers and assess their generalizability on an external cohort.
  arXiv  Detail & Related papers  (2025-09-24T21:18:52Z)
• Predicting Length of Stay in Neurological ICU Patients Using Classical Machine Learning and Neural Network Models: A Benchmark Study on MIMIC-IV [49.1574468325115]
  This study explores multiple ML approaches for predicting LOS in ICU specifically for the patients with neurological diseases based on the MIMIC-IV dataset.<n>The evaluated models include classic ML algorithms (K-Nearest Neighbors, Random Forest, XGBoost and CatBoost) and Neural Networks (LSTM, BERT and Temporal Fusion Transformer)
  arXiv  Detail & Related papers  (2025-05-23T14:06:42Z)
• Evaluation of QCNN-LSTM for Disability Forecasting in Multiple Sclerosis Using Sequential Multisequence MRI [0.0]
  Long ShortTerm Memory (LSTM) models were studied to provide sequential relationships for each timepoint in MRIs of patients with Multiple Sclerosis (MS) Our hypothesis is that quantum models will provide competitive performance.
  arXiv  Detail & Related papers  (2024-01-22T17:14:47Z)
• A Federated Learning Framework for Stenosis Detection [70.27581181445329]
  This study explores the use of Federated Learning (FL) for stenosis detection in coronary angiography images (CA) Two heterogeneous datasets from two institutions were considered: dataset 1 includes 1219 images from 200 patients, which we acquired at the Ospedale Riuniti of Ancona (Italy) dataset 2 includes 7492 sequential images from 90 patients from a previous study available in the literature.
  arXiv  Detail & Related papers  (2023-10-30T11:13:40Z)
• Neural Network-Based Histologic Remission Prediction In Ulcerative Colitis [38.150634108667774]
  Histologic remission is a new therapeutic target in ulcerative colitis (UC) Endocytoscopy (EC) is a novel ultra-high magnification endoscopic technique. We propose a neural network model that can assess histological disease activity in EC images.
  arXiv  Detail & Related papers  (2023-08-28T15:54:14Z)
• Attention-based Saliency Maps Improve Interpretability of Pneumothorax Classification [52.77024349608834]
  To investigate chest radiograph (CXR) classification performance of vision transformers (ViT) and interpretability of attention-based saliency. ViTs were fine-tuned for lung disease classification using four public data sets: CheXpert, Chest X-Ray 14, MIMIC CXR, and VinBigData. ViTs had comparable CXR classification AUCs compared with state-of-the-art CNNs.
  arXiv  Detail & Related papers  (2023-03-03T12:05:41Z)
• Vision Transformers for femur fracture classification [59.99241204074268]
  The Vision Transformer (ViT) was able to correctly predict 83% of the test images. Good results were obtained in sub-fractures with the largest and richest dataset ever.
  arXiv  Detail & Related papers  (2021-08-07T10:12:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.