iSight: Towards expert-AI co-assessment for improved immunohistochemistry staining interpretation
- URL: http://arxiv.org/abs/2602.04063v1
- Date: Tue, 03 Feb 2026 22:49:08 GMT
- Title: iSight: Towards expert-AI co-assessment for improved immunohistochemistry staining interpretation
- Abstract summary: We introduce HPA10M, a dataset that contains 10,495,672 IHC images from the Human Protein Atlas.<n>Based on HPA10M, we trained iSight a multi-task learning framework for automated IHC staining assessment.<n>iSight achieved 85.5% accuracy for location, 76.6% for intensity, and 75.7% for quantity, outperforming fine-tuned foundation models.
- Score: 31.55467851797712
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Immunohistochemistry (IHC) provides information on protein expression in tissue sections and is commonly used to support pathology diagnosis and disease triage. While AI models for H\&E-stained slides show promise, their applicability to IHC is limited due to domain-specific variations. Here we introduce HPA10M, a dataset that contains 10,495,672 IHC images from the Human Protein Atlas with comprehensive metadata included, and encompasses 45 normal tissue types and 20 major cancer types. Based on HPA10M, we trained iSight, a multi-task learning framework for automated IHC staining assessment. iSight combines visual features from whole-slide images with tissue metadata through a token-level attention mechanism, simultaneously predicting staining intensity, location, quantity, tissue type, and malignancy status. On held-out data, iSight achieved 85.5\% accuracy for location, 76.6\% for intensity, and 75.7\% for quantity, outperforming fine-tuned foundation models (PLIP, CONCH) by 2.5--10.2\%. In addition, iSight demonstrates well-calibrated predictions with expected calibration errors of 0.0150-0.0408. Furthermore, in a user study with eight pathologists evaluating 200 images from two datasets, iSight outperformed initial pathologist assessments on the held-out HPA dataset (79\% vs 68\% for location, 70\% vs 57\% for intensity, 68\% vs 52\% for quantity). Inter-pathologist agreement also improved after AI assistance in both held-out HPA (Cohen's $κ$ increased from 0.63 to 0.70) and Stanford TMAD datasets (from 0.74 to 0.76), suggesting expert--AI co-assessment can improve IHC interpretation. This work establishes a foundation for AI systems that can improve IHC diagnostic accuracy and highlights the potential for integrating iSight into clinical workflows to enhance the consistency and reliability of IHC assessment.
Related papers
- Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment [55.16957949238588]
We propose DMCoStain, a novel Data-Model Co-optimization framework for Stain transfer.<n>It iteratively co-refines training data and model capability, improving staining accuracy and interpretability in both pathological and structural consistency.<n>To support MEGFS, we construct ImmunoInstruction, the first large-scale IPE instruction-following dataset with 150K VQA samples.
arXiv Detail & Related papers (2026-07-28T07:54:43Z) - Clinical Validation of the Melanoscope AI Mobile Dermoscopy Clinical Decision Support System [0.0]
Early detection of malignant skin lesions is critical for prognosis.<n>Dermatologist shortages in Russian regions limit screening coverage.<n>Mobile dermoscopy clinical decision support systems offer a promising approach.
arXiv Detail & Related papers (2026-05-26T18:29:53Z) - A Clinically Validated Foundation Model for Comprehensive Lung Pathology Interpretation [36.95302007351382]
PulmoFoundation is a prospectively validated, randomized controlled trial (RCT)-evaluated foundation model for comprehensive lung pathology assessment.<n>Our model achieves clinical-grade performance in core diagnostic tasks across biopsy, frozen section, and surgical resection slides.
arXiv Detail & Related papers (2026-05-25T14:04:56Z) - Validating a Deep Learning Algorithm to Identify Patients with Glaucoma using Systemic Electronic Health Records [0.0]
We evaluated whether a glaucoma risk assessment (GRA) model trained on All of Us national data can identify patients at high probability of glaucoma.<n>A pretrained GRA model was fine-tuned on the Stanford cohort and tested on a held-out set using demographics, systemic diagnoses, medications, laboratory results, and physical examination measurements.
arXiv Detail & Related papers (2026-04-22T05:07:20Z) - FUGC: Benchmarking Semi-Supervised Learning Methods for Cervical Segmentation [63.7829089874007]
This paper introduces the Fetal Ultrasound Grand Challenge (FUGC), the first benchmark for semi-supervised learning in cervical segmentation.<n>FUGC provides a dataset of 890 TVS images, including 500 training images, 90 validation images, and 300 test images.<n> Methods were evaluated using the Dice Similarity Coefficient (DSC), Hausdorff Distance (HD), and runtime (RT), with a weighted combination of 0.4/0.4/0.2.
arXiv Detail & Related papers (2026-01-22T01:34:39Z) - Explainable Admission-Level Predictive Modeling for Prolonged Hospital Stay in Elderly Populations: Challenges in Low- and Middle-Income Countries [65.4286079244589]
Prolonged length of stay (pLoS) is a significant factor associated with the risk of adverse in-hospital events.<n>We develop and explain a predictive model for pLos using admission-level patient and hospital administrative data.
arXiv Detail & Related papers (2026-01-07T23:35:24Z) - XAI-Driven Skin Disease Classification: Leveraging GANs to Augment ResNet-50 Performance [2.7930955543692817]
This study proposes a trustworthy and highly accurate Computer-Aided Diagnosis (CAD) system to overcome limitations.<n>The approach utilizes Deep Convolutional Generative Adversarial Networks (DCGANs) for per class data augmentation to resolve the critical class imbalance problem.<n>The system achieved a high overall Accuracy of 92.50 % and a Macro-AUC of 98.82 %, successfully outperforming various prior benchmarked architectures.
arXiv Detail & Related papers (2025-11-29T20:46:30Z) - AI-Powered Early Detection of Critical Diseases using Image Processing and Audio Analysis [0.4356470230135012]
This paper presents a multimodal artificial intelligence (AI) diagnostic framework integrating image analysis, thermal imaging, and audio signal processing.<n>A fine-tuned MobileNetV2 convolutional neural network was trained on the ISIC 2019 dataset for skin lesion classification.<n>A support vector machine (SVM) with handcrafted features was employed for thermal clot detection, achieving 86.4% accuracy.<n>The framework provides a promising step toward scalable, real-time, and accessible AI-based pre-diagnostic healthcare solutions.
arXiv Detail & Related papers (2025-10-29T06:09:17Z) - Curriculum Learning with Synthetic Data for Enhanced Pulmonary Nodule Detection in Chest Radiographs [0.0]
This study evaluates whether integrating curriculum learning with synthetic augmentation can enhance the detection of difficult pulmonary nodules.<n>A Faster R-CNN with a Feature Pyramid Network (FPN) backbone was trained on a hybrid dataset.
arXiv Detail & Related papers (2025-10-09T02:06:13Z) - A Disease-Centric Vision-Language Foundation Model for Precision Oncology in Kidney Cancer [54.58205672910646]
RenalCLIP is a visual-language foundation model for characterization, diagnosis and prognosis of renal mass.<n>It achieved better performance and superior generalizability across 10 core tasks spanning the full clinical workflow of kidney cancer.
arXiv Detail & Related papers (2025-08-22T17:48:19Z) - A Novel Attention-Augmented Wavelet YOLO System for Real-time Brain Vessel Segmentation on Transcranial Color-coded Doppler [49.03919553747297]
We propose an AI-powered, real-time CoW auto-segmentation system capable of efficiently capturing cerebral arteries.<n>No prior studies have explored AI-driven cerebrovascular segmentation using Transcranial Color-coded Doppler (TCCD)<n>The proposed AAW-YOLO demonstrated strong performance in segmenting both ipsilateral and contralateral CoW vessels.
arXiv Detail & Related papers (2025-08-19T14:41:22Z) - Cross-Modality Learning for Predicting IHC Biomarkers from H&E-Stained Whole-Slide Images [4.650292435891902]
HistoStainAlign predicts IHC staining patterns directly from H&E whole-slide images.<n>HistoStainAlign achieved weighted F1 scores of 0.735 [95% Confidence Interval (CI): 0.670-0.799], 0.830 [95% CI: 0.772-0.886], and 0.723 [95% CI: 0.607-0.836], respectively for these three IHC stains.
arXiv Detail & Related papers (2025-06-18T20:01:14Z) - Integrating Deep Learning with Fundus and Optical Coherence Tomography for Cardiovascular Disease Prediction [47.7045293755736]
Early identification of patients at risk of cardiovascular diseases (CVD) is crucial for effective preventive care, reducing healthcare burden, and improving patients' quality of life.
This study demonstrates the potential of retinal optical coherence tomography ( OCT) imaging combined with fundus photographs for identifying future adverse cardiac events.
We propose a novel binary classification network based on a Multi-channel Variational Autoencoder (MCVAE), which learns a latent embedding of patients' fundus and OCT images to classify individuals into two groups: those likely to develop CVD in the future and those who are not.
arXiv Detail & Related papers (2024-10-18T12:37:51Z) - Predicting risk of cardiovascular disease using retinal OCT imaging [40.71667870702634]
Cardiovascular diseases (CVD) are the leading cause of death globally.<n>Optical coherence tomography ( OCT) has gained recognition as a potential tool for early CVD risk prediction.<n>We investigated the potential of OCT as an additional imaging technique to predict future CVD events.
arXiv Detail & Related papers (2024-03-26T14:42:46Z) - Addressing Uncertainty in Imbalanced Histopathology Image Classification
of HER2 Breast Cancer: An interpretable Ensemble Approach with Threshold
Filtered Single Instance Evaluation (SIE) [0.0]
Early diagnosis can alleviate the mortality rate by helping patients make efficient treatment decisions.
HER2 has become one the most lethal subtype of Breast Cancer.
DenseNet201 and Xception have been ensembled into a single classifier.
arXiv Detail & Related papers (2023-08-01T19:44:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.