On the Optimal Combination of Cross-Entropy and Soft Dice Losses for Lesion Segmentation with Out-of-Distribution Robustness

• URL: http://arxiv.org/abs/2209.06078v2
• Date: Wed, 14 Sep 2022 16:27:05 GMT
• Title: On the Optimal Combination of Cross-Entropy and Soft Dice Losses for Lesion Segmentation with Out-of-Distribution Robustness
• Authors: Adrian Galdran, Gustavo Carneiro, Miguel \'Angel Gonz\'alez Ballester
• Abstract summary: We study the impact of different loss functions on lesion segmentation from medical images. We analyze the impact of the minimization of different loss functions on in-distribution performance. Our findings are surprising: CE-Dice loss combinations that excel in segmenting in-distribution images have a poor performance when dealing with Out-of-Distribution data.
• Score: 15.08731999725517
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We study the impact of different loss functions on lesion segmentation from medical images. Although the Cross-Entropy (CE) loss is the most popular option when dealing with natural images, for biomedical image segmentation the soft Dice loss is often preferred due to its ability to handle imbalanced scenarios. On the other hand, the combination of both functions has also been successfully applied in this kind of tasks. A much less studied problem is the generalization ability of all these losses in the presence of Out-of-Distribution (OoD) data. This refers to samples appearing in test time that are drawn from a different distribution than training images. In our case, we train our models on images that always contain lesions, but in test time we also have lesion-free samples. We analyze the impact of the minimization of different loss functions on in-distribution performance, but also its ability to generalize to OoD data, via comprehensive experiments on polyp segmentation from endoscopic images and ulcer segmentation from diabetic feet images. Our findings are surprising: CE-Dice loss combinations that excel in segmenting in-distribution images have a poor performance when dealing with OoD data, which leads us to recommend the adoption of the CE loss for this kind of problems, due to its robustness and ability to generalize to OoD samples. Code associated to our experiments can be found at https://github.com/agaldran/lesion_losses_ood .

Related papers

• Robust T-Loss for Medical Image Segmentation [56.524774292536264]
  This paper presents a new robust loss function, the T-Loss, for medical image segmentation. The proposed loss is based on the negative log-likelihood of the Student-t distribution and can effectively handle outliers in the data. Our experiments show that the T-Loss outperforms traditional loss functions in terms of dice scores on two public medical datasets.
  arXiv  Detail & Related papers  (2023-06-01T14:49:40Z)
• Realistic Data Enrichment for Robust Image Segmentation in Histopathology [2.248423960136122]
  We propose a new approach, based on diffusion models, which can enrich an imbalanced dataset with plausible examples from underrepresented groups. Our method can simply expand limited clinical datasets making them suitable to train machine learning pipelines.
  arXiv  Detail & Related papers  (2023-04-19T09:52:50Z)
• What can we learn about a generated image corrupting its latent representation? [57.1841740328509]
  We investigate the hypothesis that we can predict image quality based on its latent representation in the GANs bottleneck. We achieve this by corrupting the latent representation with noise and generating multiple outputs.
  arXiv  Detail & Related papers  (2022-10-12T14:40:32Z)
• Impact of loss function in Deep Learning methods for accurate retinal vessel segmentation [1.1470070927586016]
  We compare Binary Cross Entropy, Dice, Tversky, and Combo loss using the deep learning architectures (i.e. U-Net, Attention U-Net, and Nested UNet) with the DRIVE dataset. The results showed that there is a significant difference in the selection of loss function.
  arXiv  Detail & Related papers  (2022-06-01T14:47:18Z)
• FedMed-ATL: Misaligned Unpaired Brain Image Synthesis via Affine Transform Loss [58.58979566599889]
  We propose a novel self-supervised learning (FedMed) for brain image synthesis. An affine transform loss (ATL) was formulated to make use of severely distorted images without violating privacy legislation. The proposed method demonstrates advanced performance in both the quality of synthesized results under a severely misaligned and unpaired data setting.
  arXiv  Detail & Related papers  (2022-01-29T13:45:39Z)
• The Effect of the Loss on Generalization: Empirical Study on Synthetic Lung Nodule Data [13.376247652484274]
  We show that different loss functions lead to different features being learned and consequently affect the generalization ability of the classifier on unseen data. This study provides some important insights into the design of deep learning solutions for medical imaging tasks.
  arXiv  Detail & Related papers  (2021-08-10T17:58:01Z)
• Adversarial Semantic Data Augmentation for Human Pose Estimation [96.75411357541438]
  We propose Semantic Data Augmentation (SDA), a method that augments images by pasting segmented body parts with various semantic granularity. We also propose Adversarial Semantic Data Augmentation (ASDA), which exploits a generative network to dynamiclly predict tailored pasting configuration. State-of-the-art results are achieved on challenging benchmarks.
  arXiv  Detail & Related papers  (2020-08-03T07:56:04Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Universal Loss Reweighting to Balance Lesion Size Inequality in 3D Medical Image Segmentation [50.63623720394348]
  We propose a loss reweighting approach to increase the ability of the network to detect small lesions. We report the benefit from our method for well-known loss functions, including Dice Loss, Focal Loss, and Asymmetric Similarity Loss. Our experiments show that inverse weighting considerably increases the detection quality, while preserves the delineation quality on a state-of-the-art level.
  arXiv  Detail & Related papers  (2020-07-20T12:08:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.