HistoCartography: A Toolkit for Graph Analytics in Digital Pathology

• URL: http://arxiv.org/abs/2107.10073v1
• Date: Wed, 21 Jul 2021 13:34:14 GMT
• Title: HistoCartography: A Toolkit for Graph Analytics in Digital Pathology
• Authors: Guillaume Jaume, Pushpak Pati, Valentin Anklin, Antonio Foncubierta, Maria Gabrani
• Abstract summary: HistoCartography is a standardized python API with necessary preprocessing, machine learning and explainability tools to facilitate graph-analytics in computational pathology. We have benchmarked the computational time and performance on multiple datasets across different imaging types and histopathology tasks.
• Score: 0.6299766708197883
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Advances in entity-graph based analysis of histopathology images have brought in a new paradigm to describe tissue composition, and learn the tissue structure-to-function relationship. Entity-graphs offer flexible and scalable representations to characterize tissue organization, while allowing the incorporation of prior pathological knowledge to further support model interpretability and explainability. However, entity-graph analysis requires prerequisites for image-to-graph translation and knowledge of state-of-the-art machine learning algorithms applied to graph-structured data, which can potentially hinder their adoption. In this work, we aim to alleviate these issues by developing HistoCartography, a standardized python API with necessary preprocessing, machine learning and explainability tools to facilitate graph-analytics in computational pathology. Further, we have benchmarked the computational time and performance on multiple datasets across different imaging types and histopathology tasks to highlight the applicability of the API for building computational pathology workflows.

Related papers

• Interpretability analysis on a pathology foundation model reveals biologically relevant embeddings across modalities [1.4602325266401266]
  We analyze the features from a ViT-Small encoder obtained from a pathology Foundation Model via application to two datasets. We discover an interpretable representation of cell and tissue morphology, along with gene expression within the model embedding space.
  arXiv  Detail & Related papers  (2024-07-15T15:03:01Z)
• Towards a text-based quantitative and explainable histopathology image analysis [4.064178811354613]
  We propose a Text-based Quantitative and Explainable histopathology image analysis, which we call TQx. The retrieved words are then used to quantify the histopathology images and generate understandable feature embeddings. The results demonstrate that TQx is able to quantify and analyze histopathology images comparable to the prevalent visual models in computational pathology.
  arXiv  Detail & Related papers  (2024-07-10T04:33:43Z)
• Knowledge-enhanced Visual-Language Pretraining for Computational Pathology [68.6831438330526]
  We consider the problem of visual representation learning for computational pathology, by exploiting large-scale image-text pairs gathered from public resources. We curate a pathology knowledge tree that consists of 50,470 informative attributes for 4,718 diseases requiring pathology diagnosis from 32 human tissues.
  arXiv  Detail & Related papers  (2024-04-15T17:11:25Z)
• From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models [98.41645229835493]
  Data visualization in the form of charts plays a pivotal role in data analysis, offering critical insights and aiding in informed decision-making. Large foundation models, such as large language models, have revolutionized various natural language processing tasks. This survey paper serves as a comprehensive resource for researchers and practitioners in the fields of natural language processing, computer vision, and data analysis.
  arXiv  Detail & Related papers  (2024-03-18T17:57:09Z)
• Towards Graph Foundation Models: A Survey and Beyond [66.37994863159861]
  Foundation models have emerged as critical components in a variety of artificial intelligence applications. The capabilities of foundation models to generalize and adapt motivate graph machine learning researchers to discuss the potential of developing a new graph learning paradigm. This article introduces the concept of Graph Foundation Models (GFMs), and offers an exhaustive explanation of their key characteristics and underlying technologies.
  arXiv  Detail & Related papers  (2023-10-18T09:31:21Z)
• Kartezio: Evolutionary Design of Explainable Pipelines for Biomedical Image Analysis [0.0]
  We introduce Kartezio, a computational strategy that generates transparent and easily interpretable image processing pipelines. The pipelines thus generated exhibit comparable precision to state-of-the-art Deep Learning approaches on instance segmentation tasks. We also deployed Kartezio to solve semantic and instance segmentation problems in four real-world Use Cases.
  arXiv  Detail & Related papers  (2023-02-28T17:02:35Z)
• Automated Coronary Arteries Labeling Via Geometric Deep Learning [13.515293812745343]
  We propose an intuitive graph representation method, well suited to use with 3D coordinate data obtained from angiography scans. We subsequently seek to analyze subject-specific graphs using geometric deep learning. The proposed models leverage expert annotated labels from 141 patients to learn representations of each coronary segment, while capturing the effects of anatomical variability within the training data.
  arXiv  Detail & Related papers  (2022-12-01T09:31:08Z)
• Contrastive Brain Network Learning via Hierarchical Signed Graph Pooling Model [64.29487107585665]
  Graph representation learning techniques on brain functional networks can facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Here, we propose an interpretable hierarchical signed graph representation learning model to extract graph-level representations from brain functional networks. In order to further improve the model performance, we also propose a new strategy to augment functional brain network data for contrastive learning.
  arXiv  Detail & Related papers  (2022-07-14T20:03:52Z)
• Graph-in-Graph (GiG): Learning interpretable latent graphs in non-Euclidean domain for biological and healthcare applications [52.65389473899139]
  Graphs are a powerful tool for representing and analyzing unstructured, non-Euclidean data ubiquitous in the healthcare domain. Recent works have shown that considering relationships between input data samples have a positive regularizing effect for the downstream task. We propose Graph-in-Graph (GiG), a neural network architecture for protein classification and brain imaging applications.
  arXiv  Detail & Related papers  (2022-04-01T10:01:37Z)
• A Survey on Graph-Based Deep Learning for Computational Histopathology [36.58189530598098]
  We have witnessed a rapid expansion of the use of machine learning and deep learning for the analysis of digital pathology and biopsy image patches. Traditional learning over patch-wise features using convolutional neural networks limits the model when attempting to capture global contextual information. We provide a conceptual grounding of graph-based deep learning and discuss its current success for tumor localization and classification, tumor invasion and staging, image retrieval, and survival prediction.
  arXiv  Detail & Related papers  (2021-07-01T07:50:35Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.