Domain-specific optimization and diverse evaluation of self-supervised
models for histopathology
- URL: http://arxiv.org/abs/2310.13259v1
- Date: Fri, 20 Oct 2023 03:38:07 GMT
- Title: Domain-specific optimization and diverse evaluation of self-supervised
models for histopathology
- Authors: Jeremy Lai, Faruk Ahmed, Supriya Vijay, Tiam Jaroensri, Jessica Loo,
Saurabh Vyawahare, Saloni Agarwal, Fayaz Jamil, Yossi Matias, Greg S.
Corrado, Dale R. Webster, Jonathan Krause, Yun Liu, Po-Hsuan Cameron Chen,
Ellery Wulczyn, David F. Steiner
- Abstract summary: Task-specific deep learning models in histopathology offer promising opportunities for improving diagnosis, clinical research, and precision medicine.
We describe the development and evaluation of foundation models for histopathology via self-supervised learning (SSL)
- Score: 9.450129206898115
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Task-specific deep learning models in histopathology offer promising
opportunities for improving diagnosis, clinical research, and precision
medicine. However, development of such models is often limited by availability
of high-quality data. Foundation models in histopathology that learn general
representations across a wide range of tissue types, diagnoses, and
magnifications offer the potential to reduce the data, compute, and technical
expertise necessary to develop task-specific deep learning models with the
required level of model performance. In this work, we describe the development
and evaluation of foundation models for histopathology via self-supervised
learning (SSL). We first establish a diverse set of benchmark tasks involving
17 unique tissue types and 12 unique cancer types and spanning different
optimal magnifications and task types. Next, we use this benchmark to explore
and evaluate histopathology-specific SSL methods followed by further evaluation
on held out patch-level and weakly supervised tasks. We found that standard SSL
methods thoughtfully applied to histopathology images are performant across our
benchmark tasks and that domain-specific methodological improvements can
further increase performance. Our findings reinforce the value of using
domain-specific SSL methods in pathology, and establish a set of high quality
foundation models to enable further research across diverse applications.
Related papers
- A Clinical Benchmark of Public Self-Supervised Pathology Foundation Models [2.124312824026935]
We present a collection of pathology datasets comprising clinical slides associated with clinically relevant endpoints including cancer diagnoses and a variety of biomarkers generated during standard hospital operation from two medical centers.
We leverage these datasets to systematically assess the performance of public pathology foundation models and provide insights into best practices for training new foundation models and selecting appropriate pretrained models.
arXiv Detail & Related papers (2024-07-09T02:33:13Z) - A Survey of Models for Cognitive Diagnosis: New Developments and Future Directions [66.40362209055023]
This paper aims to provide a survey of current models for cognitive diagnosis, with more attention on new developments using machine learning-based methods.
By comparing the model structures, parameter estimation algorithms, model evaluation methods and applications, we provide a relatively comprehensive review of the recent trends in cognitive diagnosis models.
arXiv Detail & Related papers (2024-07-07T18:02:00Z) - Adapting Self-Supervised Learning for Computational Pathology [3.009236957464476]
Self-supervised learning (SSL) has emerged as a key technique for training networks that can generalize well to diverse tasks without task-specific supervision.
We present an investigation of modifications to SSL for pathology data, specifically focusing on the DINOv2 algorithm.
arXiv Detail & Related papers (2024-05-02T19:22:39Z) - RudolfV: A Foundation Model by Pathologists for Pathologists [13.17203220753175]
We present a novel approach to designing foundation models for computational pathology.
Our model "RudolfV" surpasses existing state-of-the-art foundation models across different benchmarks.
arXiv Detail & Related papers (2024-01-08T18:31:38Z) - PathAsst: A Generative Foundation AI Assistant Towards Artificial
General Intelligence of Pathology [15.419350834457136]
We present PathAsst, a multimodal generative foundation AI assistant to revolutionize diagnostic and predictive analytics in pathology.
The development of PathAsst involves three pivotal steps: data acquisition, CLIP model adaptation, and the training of PathAsst's multimodal generative capabilities.
The experimental results of PathAsst show the potential of harnessing AI-powered generative foundation model to improve pathology diagnosis and treatment processes.
arXiv Detail & Related papers (2023-05-24T11:55:50Z) - Benchmarking Self-Supervised Learning on Diverse Pathology Datasets [10.868779327544688]
Self-supervised learning has shown to be an effective method for utilizing unlabeled data.
We execute the largest-scale study of SSL pre-training on pathology image data.
For the first time, we apply SSL to the challenging task of nuclei instance segmentation.
arXiv Detail & Related papers (2022-12-09T06:38:34Z) - Model-Based Deep Learning: On the Intersection of Deep Learning and
Optimization [101.32332941117271]
Decision making algorithms are used in a multitude of different applications.
Deep learning approaches that use highly parametric architectures tuned from data without relying on mathematical models are becoming increasingly popular.
Model-based optimization and data-centric deep learning are often considered to be distinct disciplines.
arXiv Detail & Related papers (2022-05-05T13:40:08Z) - Continual Learning with Bayesian Model based on a Fixed Pre-trained
Feature Extractor [55.9023096444383]
Current deep learning models are characterised by catastrophic forgetting of old knowledge when learning new classes.
Inspired by the process of learning new knowledge in human brains, we propose a Bayesian generative model for continual learning.
arXiv Detail & Related papers (2022-04-28T08:41:51Z) - LifeLonger: A Benchmark for Continual Disease Classification [59.13735398630546]
We introduce LifeLonger, a benchmark for continual disease classification on the MedMNIST collection.
Task and class incremental learning of diseases address the issue of classifying new samples without re-training the models from scratch.
Cross-domain incremental learning addresses the issue of dealing with datasets originating from different institutions while retaining the previously obtained knowledge.
arXiv Detail & Related papers (2022-04-12T12:25:05Z) - A multi-stage machine learning model on diagnosis of esophageal
manometry [50.591267188664666]
The framework includes deep-learning models at the swallow-level stage and feature-based machine learning models at the study-level stage.
This is the first artificial-intelligence-style model to automatically predict CC diagnosis of HRM study from raw multi-swallow data.
arXiv Detail & Related papers (2021-06-25T20:09:23Z) - Quality meets Diversity: A Model-Agnostic Framework for Computerized
Adaptive Testing [60.38182654847399]
Computerized Adaptive Testing (CAT) is emerging as a promising testing application in many scenarios.
We propose a novel framework, namely Model-Agnostic Adaptive Testing (MAAT) for CAT solution.
arXiv Detail & Related papers (2021-01-15T06:48:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.