Switched auxiliary loss for robust training of transformer models for histopathological image segmentation

• URL: http://arxiv.org/abs/2308.10994v2
• Date: Wed, 14 Aug 2024 11:54:05 GMT
• Title: Switched auxiliary loss for robust training of transformer models for histopathological image segmentation
• Abstract summary: Functional tissue Units (FTUs) are cell population neighborhoods local to a particular organ performing its main function. We have developed a model to segment multi-organ FTUs across 5 organs by utilizing the 'HuBMAP + HPA - Hacking the Human Body' competition dataset. Our model achieved a dice score of 0.793 on the public dataset and 0.778 on the private dataset.
• Score: 0.060467329188882764
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Functional tissue Units (FTUs) are cell population neighborhoods local to a particular organ performing its main function.The FTUs provide crucial information to the pathologist in understanding the disease affecting a particular organ by providing information at the cellular level.In our research, we have developed a model to segment multi-organ FTUs across 5 organs namely: the kidney, large intestine, lung, prostate and spleen by utilizing the 'HuBMAP + HPA - Hacking the Human Body' competition dataset.We propose adding switched auxiliary loss for training models like the transformers to overcome the diminishing gradient problem which poses a challenge towards optimal training of deep models.Overall, our model achieved a dice score of 0.793 on the public dataset and 0.778 on the private dataset.The results supports the robustness of the proposed training methodology.The findings also bolster the use of transformers models for dense prediction tasks in the field of medical image analysis.The study assists in understanding the relationships between cell and tissue organization thereby providing a useful medium to look at the impact of cellular functions on human health.

Related papers

• CellPainTR: Generalizable Representation Learning for Cross-Dataset Cell Painting Analysis [51.56484100374058]
  We introduce CellPainTR, a Transformer-based architecture designed to learn foundational representations of cellular morphology.<n>Our work represents a significant step towards creating truly foundational models for image-based profiling, enabling more reliable and scalable cross-study biological analysis.
  arXiv  Detail & Related papers  (2025-09-02T03:30:07Z)
• CellPilot [3.2096430458509317]
  This work introduces CellPilot, a framework that bridges the gap between automatic and interactive segmentation. Our model was trained on over 675,000 masks of nine diverse cell and gland segmentation datasets, spanning 16 organs. We make the model and a graphical user interface designed to assist practitioners in creating large-scale annotated datasets available as open-source.
  arXiv  Detail & Related papers  (2024-11-23T10:31:10Z)
• From Tissue Plane to Organ World: A Benchmark Dataset for Multimodal Biomedical Image Registration using Deep Co-Attention Networks [17.718448707146017]
  Histology-to-organ registration poses an extra challenge, as any given histologic section can capture only a small portion of a human organ. We create the ATOM benchmark dataset, sourced from diverse institutions, with the primary objective of transforming this challenge into a machine learning problem. The performance of our RegisMCAN model demonstrates the potential of deep learning to accurately predict where a subregion extracted from an organ image was obtained from within the overall 3D volume.
  arXiv  Detail & Related papers  (2024-06-06T14:21:15Z)
• Tertiary Lymphoid Structures Generation through Graph-based Diffusion [54.37503714313661]
  In this work, we leverage state-of-the-art graph-based diffusion models to generate biologically meaningful cell-graphs. We show that the adopted graph diffusion model is able to accurately learn the distribution of cells in terms of their tertiary lymphoid structures (TLS) content.
  arXiv  Detail & Related papers  (2023-10-10T14:37:17Z)
• Customizing General-Purpose Foundation Models for Medical Report Generation [64.31265734687182]
  The scarcity of labelled medical image-report pairs presents great challenges in the development of deep and large-scale neural networks. We propose customizing off-the-shelf general-purpose large-scale pre-trained models, i.e., foundation models (FMs) in computer vision and natural language processing.
  arXiv  Detail & Related papers  (2023-06-09T03:02:36Z)
• HST-MRF: Heterogeneous Swin Transformer with Multi-Receptive Field for Medical Image Segmentation [5.51045524851432]
  We propose a Heterogeneous Swin Transformer with Multi-Receptive Field (HST-MRF) model for medical image segmentation. The main purpose is to solve the problem of loss of structural information caused by patch segmentation using transformer. Experimental results show that our proposed method outperforms state-of-the-art models and can achieve superior performance.
  arXiv  Detail & Related papers  (2023-04-10T14:30:03Z)
• OCELOT: Overlapped Cell on Tissue Dataset for Histopathology [13.691924123273004]
  We release OCELOT, a dataset dedicated to the study of cell-tissue relationships for cell detection in histopathology. We propose multi-task learning approaches that benefit from learning both cell and tissue tasks simultaneously. On the OCELOT test set in particular, we show up to 6.79 improvement in F1-score.
  arXiv  Detail & Related papers  (2023-03-23T08:57:11Z)
• External Attention Assisted Multi-Phase Splenic Vascular Injury Segmentation with Limited Data [72.99534552950138]
  The spleen is one of the most commonly injured solid organs in blunt abdominal trauma. accurate segmentation of splenic vascular injury is challenging for the following reasons.
  arXiv  Detail & Related papers  (2022-01-04T02:35:56Z)
• Generalized Organ Segmentation by Imitating One-shot Reasoning using Anatomical Correlation [55.1248480381153]
  We propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes. We show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task.
  arXiv  Detail & Related papers  (2021-03-30T13:41:12Z)
• Cell abundance aware deep learning for cell detection on highly imbalanced pathological data [0.0]
  In digital pathology, less abundant cell types can be of biological significance. We proposed a deep learning pipeline that considers the abundance of cell types during model training. We found that scaling deep learning loss function by the abundance of cells improves cell detection performance.
  arXiv  Detail & Related papers  (2021-02-23T13:07:52Z)
• Adversarial Sample Enhanced Domain Adaptation: A Case Study on Predictive Modeling with Electronic Health Records [57.75125067744978]
  We propose a data augmentation method to facilitate domain adaptation. adversarially generated samples are used during domain adaptation. Results confirm the effectiveness of our method and the generality on different tasks.
  arXiv  Detail & Related papers  (2021-01-13T03:20:20Z)
• An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
  We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks. We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem. We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
  arXiv  Detail & Related papers  (2020-12-06T18:55:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.