Learning Channel Importance for High Content Imaging with Interpretable Deep Input Channel Mixing

• URL: http://arxiv.org/abs/2308.16637v1
• Date: Thu, 31 Aug 2023 11:11:38 GMT
• Title: Learning Channel Importance for High Content Imaging with Interpretable Deep Input Channel Mixing
• Authors: Daniel Siegismund, Mario Wieser, Stephan Heyse, Stephan Steigele
• Abstract summary: We present a novel approach which utilizes multi-spectral information of high content images to interpret a certain aspect of cellular biology. We introduce DCmix, a lightweight, scaleable and end-to-end trainable mixing layer which enables interpretable predictions in high content imaging.
• Score: 1.2963000794351183
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Uncovering novel drug candidates for treating complex diseases remain one of the most challenging tasks in early discovery research. To tackle this challenge, biopharma research established a standardized high content imaging protocol that tags different cellular compartments per image channel. In order to judge the experimental outcome, the scientist requires knowledge about the channel importance with respect to a certain phenotype for decoding the underlying biology. In contrast to traditional image analysis approaches, such experiments are nowadays preferably analyzed by deep learning based approaches which, however, lack crucial information about the channel importance. To overcome this limitation, we present a novel approach which utilizes multi-spectral information of high content images to interpret a certain aspect of cellular biology. To this end, we base our method on image blending concepts with alpha compositing for an arbitrary number of channels. More specifically, we introduce DCMIX, a lightweight, scaleable and end-to-end trainable mixing layer which enables interpretable predictions in high content imaging while retaining the benefits of deep learning based methods. We employ an extensive set of experiments on both MNIST and RXRX1 datasets, demonstrating that DCMIX learns the biologically relevant channel importance without scarifying prediction performance.

Related papers

• PathSegDiff: Pathology Segmentation using Diffusion model representations [63.20694440934692]
  We propose PathSegDiff, a novel approach for histopathology image segmentation that leverages Latent Diffusion Models (LDMs) as pre-trained featured extractors. Our method utilizes a pathology-specific LDM, guided by a self-supervised encoder, to extract rich semantic information from H&E stained histopathology images. Our experiments demonstrate significant improvements over traditional methods on the BCSS and GlaS datasets.
  arXiv  Detail & Related papers  (2025-04-09T14:58:21Z)
• Private, Efficient and Scalable Kernel Learning for Medical Image Analysis [1.7999333451993955]
  OKRA (Orthonormal K-fRAmes) is a novel randomized encoding-based approach for kernel-based machine learning. It significantly enhances scalability and speed compared to current state-of-the-art solutions.
  arXiv  Detail & Related papers  (2024-10-21T10:03:03Z)
• ChAda-ViT : Channel Adaptive Attention for Joint Representation Learning of Heterogeneous Microscopy Images [2.954116522244175]
  We propose ChAda-ViT, a novel Channel Adaptive Vision Transformer architecture. We also introduce IDRCell100k, a bioimage dataset with a rich set of 79 experiments covering 7 microscope modalities. Our architecture, trained in a self-supervised manner, outperforms existing approaches in several biologically relevant downstream tasks.
  arXiv  Detail & Related papers  (2023-11-26T10:38:47Z)
• Attention De-sparsification Matters: Inducing Diversity in Digital Pathology Representation Learning [31.192429592497692]
  DiRL is a Diversity-inducing Representation Learning technique for histopathology imaging. We propose a prior-guided dense pretext task for SSL, designed to match the multiple corresponding representations between the views.
  arXiv  Detail & Related papers  (2023-09-12T17:59:10Z)
• Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotations [12.571349114534597]
  We present a lightweight simulation of the retinal vascular network based on space colonization for faster and more realistic OCTA synthesis. We demonstrate the superior segmentation performance of our approach in extensive quantitative and qualitative experiments on three public datasets.
  arXiv  Detail & Related papers  (2023-06-19T14:01:47Z)
• Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
  We propose a domain transfer approach based on conditional invertible neural networks (cINNs) Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood. Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
  arXiv  Detail & Related papers  (2023-03-17T18:00:27Z)
• Metadata-guided Consistency Learning for High Content Images [1.5207770161985628]
  Cross-Domain Consistency Learning (CDCL) is a self-supervised approach that is able to learn in the presence of batch effects. CDCL enforces the learning of biological similarities while disregarding undesirable batch-specific signals. These features are organised according to their morphological changes and are more useful for downstream tasks.
  arXiv  Detail & Related papers  (2022-12-22T10:39:10Z)
• OADAT: Experimental and Synthetic Clinical Optoacoustic Data for Standardized Image Processing [62.993663757843464]
  Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion. OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues. No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
  arXiv  Detail & Related papers  (2022-06-17T08:11:26Z)
• Preservation of High Frequency Content for Deep Learning-Based Medical Image Classification [74.84221280249876]
  An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists. We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
  arXiv  Detail & Related papers  (2022-05-08T15:29:54Z)
• Intelligent Masking: Deep Q-Learning for Context Encoding in Medical Image Analysis [48.02011627390706]
  We develop a novel self-supervised approach that occludes targeted regions to improve the pre-training procedure. We show that training the agent against the prediction model can significantly improve the semantic features extracted for downstream classification tasks.
  arXiv  Detail & Related papers  (2022-03-25T19:05:06Z)
• Exploring Inter-Channel Correlation for Diversity-preserved KnowledgeDistillation [91.56643684860062]
  Inter-Channel Correlation for Knowledge Distillation(ICKD) is developed. ICKD captures intrinsic distribution of the featurespace and sufficient diversity properties of features in the teacher network. We are the first method based on knowl-edge distillation boosts ResNet18 beyond 72% Top-1 ac-curacy on ImageNet classification.
  arXiv  Detail & Related papers  (2022-02-08T07:01:56Z)
• Deep Low-Shot Learning for Biological Image Classification and Visualization from Limited Training Samples [52.549928980694695]
  In situ hybridization (ISH) gene expression pattern images from the same developmental stage are compared. labeling training data with precise stages is very time-consuming even for biologists. We propose a deep two-step low-shot learning framework to accurately classify ISH images using limited training images.
  arXiv  Detail & Related papers  (2020-10-20T06:06:06Z)
• Explaining Clinical Decision Support Systems in Medical Imaging using Cycle-Consistent Activation Maximization [112.2628296775395]
  Clinical decision support using deep neural networks has become a topic of steadily growing interest. clinicians are often hesitant to adopt the technology because its underlying decision-making process is considered to be intransparent and difficult to comprehend. We propose a novel decision explanation scheme based on CycleGAN activation which generates high-quality visualizations of classifier decisions even in smaller data sets.
  arXiv  Detail & Related papers  (2020-10-09T14:39:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.