Xeno-learning: knowledge transfer across species in deep learning-based spectral image analysis

• URL: http://arxiv.org/abs/2410.19789v2
• Date: Sat, 07 Jun 2025 11:19:06 GMT
• Title: Xeno-learning: knowledge transfer across species in deep learning-based spectral image analysis
• Authors: Jan Sellner, Alexander Studier-Fischer, Ahmad Bin Qasim, Silvia Seidlitz, Nicholas Schreck, Minu Tizabi, Manuel Wiesenfarth, Annette Kopp-Schneider, Janne Heinecke, Jule Brandt, Samuel Knödler, Caelan Max Haney, Gabriel Salg, Berkin Özdemir, Maximilian Dietrich, Maurice Stephan Michel, Felix Nickel, Karl-Friedrich Kowalewski, Lena Maier-Hein,
• Abstract summary: "xeno-learning" is a cross-species knowledge transfer paradigm inspired by xeno-transplantation.<n>We show that although spectral signatures of organs differ across species, relative changes resulting from pathologies or surgical manipulation are comparable.<n>The resulting ethical, monetary, and performance benefits promise a high impact of the proposed knowledge transfer paradigm.
• Score: 27.30616253053021
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Novel optical imaging techniques, such as hyperspectral imaging (HSI) combined with machine learning-based (ML) analysis, have the potential to revolutionize clinical surgical imaging. However, these novel modalities face a shortage of large-scale, representative clinical data for training ML algorithms, while preclinical animal data is abundantly available through standardized experiments and allows for controlled induction of pathological tissue states, which is not ethically possible in patients. To leverage this situation, we propose a novel concept called "xeno-learning", a cross-species knowledge transfer paradigm inspired by xeno-transplantation, where organs from a donor species are transplanted into a recipient species. Using a total of 13,874 HSI images from humans as well as porcine and rat models, we show that although spectral signatures of organs differ substantially across species, relative changes resulting from pathologies or surgical manipulation (e.g., malperfusion; injection of contrast agent) are comparable. Such changes learnt in one species can thus be transferred to a new species via a novel "physiology-based data augmentation" method, enabling the large-scale secondary use of preclinical animal data for humans. The resulting ethical, monetary, and performance benefits promise a high impact of the proposed knowledge transfer paradigm on future developments in the field.

Related papers

• Transfer Orthology Networks [0.09229852843814061]
  Transfer Orthology Networks (TRON) is a neural network architecture designed for cross-species transfer learning.<n>TRON learns a linear transformation that maps gene expression from the source to the target species' gene space.<n>We are in the process of collecting cross-species transcriptomic/phenotypic data to gain experimental validation of the TRON architecture.
  arXiv  Detail & Related papers  (2025-10-17T17:24:55Z)
• VET-DINO: Learning Anatomical Understanding Through Multi-View Distillation in Veterinary Imaging [0.17999333451993946]
  VET-DINO is a framework that leverages the availability of multiple standardized views from the same study.<n>We demonstrate our approach on a dataset of 5 million veterinary radiographs from 668,000 canine studies.<n>We show that learning from real multi-view pairs leads to superior anatomical understanding compared to purely synthetic augmentations.
  arXiv  Detail & Related papers  (2025-05-21T08:23:48Z)
• Canine EEG Helps Human: Cross-Species and Cross-Modality Epileptic Seizure Detection via Multi-Space Alignment [16.44245071161907]
  Epilepsy significantly impacts global health, affecting about 65 million people worldwide, along with various animal species. Here we propose a multi-space alignment approach based on cross-species and cross-modality electroencephalogram (EEG) data to enhance the detection capabilities and understanding of epileptic seizures.
  arXiv  Detail & Related papers  (2024-12-18T13:25:07Z)
• Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
  This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection. Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels. Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
  arXiv  Detail & Related papers  (2024-03-19T09:28:19Z)
• Affine-Consistent Transformer for Multi-Class Cell Nuclei Detection [76.11864242047074]
  We propose a novel Affine-Consistent Transformer (AC-Former), which directly yields a sequence of nucleus positions. We introduce an Adaptive Affine Transformer (AAT) module, which can automatically learn the key spatial transformations to warp original images for local network training. Experimental results demonstrate that the proposed method significantly outperforms existing state-of-the-art algorithms on various benchmarks.
  arXiv  Detail & Related papers  (2023-10-22T02:27:02Z)
• Reducing Intraspecies and Interspecies Covariate Shift in Traumatic Brain Injury EEG of Humans and Mice Using Transfer Euclidean Alignment [4.264615907591813]
  High variability across subjects poses a significant challenge when it comes to deploying machine learning models for classification tasks in the real world. In such instances, machine learning models that exhibit exceptional performance on a specific dataset may not necessarily demonstrate similar proficiency when applied to a distinct dataset for the same task. We introduce Transfer Euclidean Alignment - a transfer learning technique to tackle the problem of the robustness of human biomedical data for training deep learning models.
  arXiv  Detail & Related papers  (2023-10-03T19:48:02Z)
• Multi-Domain Norm-referenced Encoding Enables Data Efficient Transfer Learning of Facial Expression Recognition [62.997667081978825]
  We propose a biologically-inspired mechanism for transfer learning in facial expression recognition. Our proposed architecture provides an explanation for how the human brain might innately recognize facial expressions on varying head shapes. Our model achieves a classification accuracy of 92.15% on the FERG dataset with extreme data efficiency.
  arXiv  Detail & Related papers  (2023-04-05T09:06:30Z)
• Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
  We propose a domain transfer approach based on conditional invertible neural networks (cINNs) Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood. Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
  arXiv  Detail & Related papers  (2023-03-17T18:00:27Z)
• DrasCLR: A Self-supervised Framework of Learning Disease-related and Anatomy-specific Representation for 3D Medical Images [23.354686734545176]
  We present a novel SSL framework, named DrasCLR, for 3D medical imaging. We propose two domain-specific contrastive learning strategies: one aims to capture subtle disease patterns inside a local anatomical region, and the other aims to represent severe disease patterns that span larger regions.
  arXiv  Detail & Related papers  (2023-02-21T01:32:27Z)
• Variational Autoencoder Learns Better Feature Representations for EEG-based Obesity Classification [0.8399688944263843]
  Research has been conducted to investigate resting state EEG (electroencephalogram) signals with an aim to identify possible neurological characteristics associated with obesity. We propose a deep learning-based framework to extract the resting state EEG features for obese and lean subject classification.
  arXiv  Detail & Related papers  (2023-02-01T22:48:45Z)
• Ultrafast Image Categorization in Biology and Neural Models [0.0]
  We re-trained the standard VGG 16 CNN on two independent tasks that are ecologically relevant to humans. We show that re-training the network achieves a human-like level of performance, comparable to that reported in psychophysical tasks.
  arXiv  Detail & Related papers  (2022-05-07T11:19:40Z)
• Translational Lung Imaging Analysis Through Disentangled Representations [0.0]
  We present a model capable of extracting disentangled information from images of different animal models and the mechanisms that generate the images. It is optimized from images of pathological lung infected by Tuberculosis and is able: a) from an input slice, infer its position in a volume, the animal model to which it belongs, the damage present and even more, generate a mask covering the whole lung.
  arXiv  Detail & Related papers  (2022-03-03T11:56:20Z)
• Modeling the Evolution of Retina Neural Network [0.0]
  retinal circuitry shows many similar structures across a broad array of species. We design a method using genetic algorithm that leads to architectures whose functions are similar to biological retina. We discuss how our framework can come into goal-driven search and sustainable enhancement of neural network models in machine learning.
  arXiv  Detail & Related papers  (2020-11-24T23:57:54Z)
• Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction [55.94378672172967]
  We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients. We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks. Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
  arXiv  Detail & Related papers  (2020-09-02T02:50:30Z)
• Transferring Dense Pose to Proximal Animal Classes [83.84439508978126]
  We show that it is possible to transfer the knowledge existing in dense pose recognition for humans, as well as in more general object detectors and segmenters, to the problem of dense pose recognition in other classes. We do this by establishing a DensePose model for the new animal which is also geometrically aligned to humans. We also introduce two benchmark datasets labelled in the manner of DensePose for the class chimpanzee and use them to evaluate our approach.
  arXiv  Detail & Related papers  (2020-02-28T21:43:53Z)
• Automatic image-based identification and biomass estimation of invertebrates [70.08255822611812]
  Time-consuming sorting and identification of taxa pose strong limitations on how many insect samples can be processed. We propose to replace the standard manual approach of human expert-based sorting and identification with an automatic image-based technology. We use state-of-the-art Resnet-50 and InceptionV3 CNNs for the classification task.
  arXiv  Detail & Related papers  (2020-02-05T21:38:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.