Graph Neural Networks for UnsupervisedDomain Adaptation of
Histopathological ImageAnalytics
- URL: http://arxiv.org/abs/2008.09304v1
- Date: Fri, 21 Aug 2020 04:53:44 GMT
- Title: Graph Neural Networks for UnsupervisedDomain Adaptation of
Histopathological ImageAnalytics
- Authors: Dou Xu, Chang Cai, Chaowei Fang, Bin Kong, Jihua Zhu, Zhongyu Li
- Abstract summary: We present a novel method for the unsupervised domain adaptation for histological image analysis.
It is based on a backbone for embedding images into a feature space, and a graph neural layer for propa-gating the supervision signals of images with labels.
In experiments, our methodachieves state-of-the-art performance on four public datasets.
- Score: 22.04114134677181
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Annotating histopathological images is a time-consuming andlabor-intensive
process, which requires broad-certificated pathologistscarefully examining
large-scale whole-slide images from cells to tissues.Recent frontiers of
transfer learning techniques have been widely investi-gated for image
understanding tasks with limited annotations. However,when applied for the
analytics of histology images, few of them can effec-tively avoid the
performance degradation caused by the domain discrep-ancy between the source
training dataset and the target dataset, suchas different tissues, staining
appearances, and imaging devices. To thisend, we present a novel method for the
unsupervised domain adaptationin histopathological image analysis, based on a
backbone for embeddinginput images into a feature space, and a graph neural
layer for propa-gating the supervision signals of images with labels. The graph
model isset up by connecting every image with its close neighbors in the
embed-ded feature space. Then graph neural network is employed to synthesizenew
feature representation from every image. During the training stage,target
samples with confident inferences are dynamically allocated withpseudo labels.
The cross-entropy loss function is used to constrain thepredictions of source
samples with manually marked labels and targetsamples with pseudo labels.
Furthermore, the maximum mean diversityis adopted to facilitate the extraction
of domain-invariant feature repre-sentations, and contrastive learning is
exploited to enhance the categorydiscrimination of learned features. In
experiments of the unsupervised do-main adaptation for histopathological image
classification, our methodachieves state-of-the-art performance on four public
datasets
Related papers
- UnSegGNet: Unsupervised Image Segmentation using Graph Neural Networks [9.268228808049951]
This research contributes to the broader field of unsupervised medical imaging and computer vision.
It presents an innovative methodology for image segmentation that aligns with real-world challenges.
The proposed method holds promise for diverse applications, including medical imaging, remote sensing, and object recognition.
arXiv Detail & Related papers (2024-05-09T19:02:00Z) - Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems [80.62854148838359]
Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate.
We use dimensionality-reduction techniques to measure the overlap between the target eye images and synthetic training data.
Our methods result in robust, improved performance when tackling the discrepancy between simulation and real-world data samples.
arXiv Detail & Related papers (2024-03-23T22:32:06Z) - Nucleus-aware Self-supervised Pretraining Using Unpaired Image-to-image
Translation for Histopathology Images [3.8391355786589805]
We propose a novel nucleus-aware self-supervised pretraining framework for histopathology images.
The framework aims to capture the nuclear morphology and distribution information through unpaired image-to-image translation.
The experiments on 7 datasets show that the proposed pretraining method outperforms supervised ones on Kather classification, multiple instance learning, and 5 dense-prediction tasks.
arXiv Detail & Related papers (2023-09-14T02:31:18Z) - Graph Self-Supervised Learning for Endoscopic Image Matching [1.8275108630751844]
We propose a novel self-supervised approach that combines Convolutional Neural Networks for capturing local visual appearance and attention-based Graph Neural Networks for modeling spatial relationships between key-points.
Our approach is trained in a fully self-supervised scheme without the need for labeled data.
Our approach outperforms state-of-the-art handcrafted and deep learning-based methods, demonstrating exceptional performance in terms of precision rate (1) and matching score (99.3%)
arXiv Detail & Related papers (2023-06-19T19:53:41Z) - Adaptive Face Recognition Using Adversarial Information Network [57.29464116557734]
Face recognition models often degenerate when training data are different from testing data.
We propose a novel adversarial information network (AIN) to address it.
arXiv Detail & Related papers (2023-05-23T02:14:11Z) - Human-machine Interactive Tissue Prototype Learning for Label-efficient
Histopathology Image Segmentation [18.755759024796216]
Deep neural networks have greatly advanced histopathology image segmentation but usually require abundant data.
We present a label-efficient tissue prototype dictionary building pipeline and propose to use the obtained prototypes to guide histopathology image segmentation.
We show that our human-machine interactive tissue prototype learning method can achieve comparable segmentation performance as the fully-supervised baselines.
arXiv Detail & Related papers (2022-11-26T06:17:21Z) - Learning Hierarchical Graph Representation for Image Manipulation
Detection [50.04902159383709]
The objective of image manipulation detection is to identify and locate the manipulated regions in the images.
Recent approaches mostly adopt the sophisticated Convolutional Neural Networks (CNNs) to capture the tampering artifacts left in the images.
We propose a hierarchical Graph Convolutional Network (HGCN-Net), which consists of two parallel branches.
arXiv Detail & Related papers (2022-01-15T01:54:25Z) - Few-shot Medical Image Segmentation using a Global Correlation Network
with Discriminative Embedding [60.89561661441736]
We propose a novel method for few-shot medical image segmentation.
We construct our few-shot image segmentor using a deep convolutional network trained episodically.
We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
arXiv Detail & Related papers (2020-12-10T04:01:07Z) - Self-Path: Self-supervision for Classification of Pathology Images with
Limited Annotations [4.713391888104896]
We propose a self-supervised CNN approach to leverage unlabeled data for learning generalizable and domain invariant representations in pathology images.
We introduce novel domain specific self-supervision tasks that leverage contextual, multi-resolution and semantic features in pathology images.
arXiv Detail & Related papers (2020-08-12T21:02:32Z) - Multi-label Thoracic Disease Image Classification with Cross-Attention
Networks [65.37531731899837]
We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images.
We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
arXiv Detail & Related papers (2020-07-21T14:37:00Z) - Phase Consistent Ecological Domain Adaptation [76.75730500201536]
We focus on the task of semantic segmentation, where annotated synthetic data are aplenty, but annotating real data is laborious.
The first criterion, inspired by visual psychophysics, is that the map between the two image domains be phase-preserving.
The second criterion aims to leverage ecological statistics, or regularities in the scene which are manifest in any image of it, regardless of the characteristics of the illuminant or the imaging sensor.
arXiv Detail & Related papers (2020-04-10T06:58:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.