ECONet: Efficient Convolutional Online Likelihood Network for Scribble-based Interactive Segmentation

• URL: http://arxiv.org/abs/2201.04584v1
• Date: Wed, 12 Jan 2022 17:21:28 GMT
• Title: ECONet: Efficient Convolutional Online Likelihood Network for Scribble-based Interactive Segmentation
• Authors: Muhammad Asad, Lucas Fidon, Tom Vercauteren
• Abstract summary: Automatic segmentation of lung lesions associated with COVID-19 in CT images requires large amount of annotated volumes. We propose an efficient convolutional neural networks (CNNs) that can be learned online while the annotator provides scribble-based interaction. We show that it outperforms existing methods on the task of annotating lung lesions associated with COVID-19, achieving 16% higher Dice score while reducing execution time by 3$times$ and requiring 9000 lesser scribbles-based labelled voxels.
• Score: 6.016521285275371
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automatic segmentation of lung lesions associated with COVID-19 in CT images requires large amount of annotated volumes. Annotations mandate expert knowledge and are time-intensive to obtain through fully manual segmentation methods. Additionally, lung lesions have large inter-patient variations, with some pathologies having similar visual appearance as healthy lung tissues. This poses a challenge when applying existing semi-automatic interactive segmentation techniques for data labelling. To address these challenges, we propose an efficient convolutional neural networks (CNNs) that can be learned online while the annotator provides scribble-based interaction. To accelerate learning from only the samples labelled through user-interactions, a patch-based approach is used for training the network. Moreover, we use weighted cross-entropy loss to address the class imbalance that may result from user-interactions. During online inference, the learned network is applied to the whole input volume using a fully convolutional approach. We compare our proposed method with state-of-the-art and show that it outperforms existing methods on the task of annotating lung lesions associated with COVID-19, achieving 16% higher Dice score while reducing execution time by 3$\times$ and requiring 9000 lesser scribbles-based labelled voxels. Due to the online learning aspect, our approach adapts quickly to user input, resulting in high quality segmentation labels. Source code will be made available upon acceptance.

Related papers

• AD-Net: Attention-based dilated convolutional residual network with guided decoder for robust skin lesion segmentation [0.0]
  This research presents a robust approach utilizing a dilated convolutional residual network. It incorporates an attention-based spatial feature enhancement block (ASFEB) and employs a guided decoder strategy. The effectiveness of the proposed AD-Net was evaluated using four public benchmark datasets.
  arXiv  Detail & Related papers  (2024-09-09T08:21:17Z)
• FunnelNet: An End-to-End Deep Learning Framework to Monitor Digital Heart Murmur in Real-Time [5.408260756721024]
  Heart murmurs are abnormal sounds caused by turbulent blood flow within the heart. This study aims to develop a novel end-to-end real-time heart murmur detection approach using traditional and depthwise convolutional networks.
  arXiv  Detail & Related papers  (2024-05-10T03:12:17Z)
• ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning [54.68180752416519]
  Panoptic segmentation is a cutting-edge computer vision task. We introduce a novel and efficient method for continual panoptic segmentation based on Visual Prompt Tuning, dubbed ECLIPSE. Our approach involves freezing the base model parameters and fine-tuning only a small set of prompt embeddings, addressing both catastrophic forgetting and plasticity.
  arXiv  Detail & Related papers  (2024-03-29T11:31:12Z)
• Scale-aware Test-time Click Adaptation for Pulmonary Nodule and Mass Segmentation [35.381677272157866]
  Pulmonary nodules and masses are crucial imaging features in lung cancer screening. Despite the success of deep learning-based medical image segmentation, the robust performance on various sizes of lesions is still challenging. We propose a multi-scale neural network with scale-aware test-time adaptation to address this challenge.
  arXiv  Detail & Related papers  (2023-07-28T16:04:34Z)
• Incrementally-Computable Neural Networks: Efficient Inference for Dynamic Inputs [75.40636935415601]
  Deep learning often faces the challenge of efficiently processing dynamic inputs, such as sensor data or user inputs. We take an incremental computing approach, looking to reuse calculations as the inputs change. We apply this approach to the transformers architecture, creating an efficient incremental inference algorithm with complexity proportional to the fraction of modified inputs.
  arXiv  Detail & Related papers  (2023-07-27T16:30:27Z)
• Adaptive Multi-scale Online Likelihood Network for AI-assisted Interactive Segmentation [3.3909100561725127]
  Existing interactive segmentation methods leverage automatic segmentation and user interactions for label refinement. We propose an adaptive multi-scale online likelihood network (MONet) that adaptively learns in a data-efficient online setting. Our approach achieved 5.86% higher Dice score with 24.67% less perceived NASA-TLX workload score than the state-of-the-art.
  arXiv  Detail & Related papers  (2023-03-23T22:20:56Z)
• Improved Speech Emotion Recognition using Transfer Learning and Spectrogram Augmentation [56.264157127549446]
  Speech emotion recognition (SER) is a challenging task that plays a crucial role in natural human-computer interaction. One of the main challenges in SER is data scarcity. We propose a transfer learning strategy combined with spectrogram augmentation.
  arXiv  Detail & Related papers  (2021-08-05T10:39:39Z)
• Dense Regression Activation Maps For Lesion Segmentation in CT scans of COVID-19 patients [9.313053265087262]
  We propose a weakly-supervised segmentation method based on dense regression activation maps (dRAM) Our method substantially improves the intersection over union from 0.335 in the CAM-based weakly supervised segmentation method to 0.495.
  arXiv  Detail & Related papers  (2021-05-25T08:29:35Z)
• Weakly-supervised Learning For Catheter Segmentation in 3D Frustum Ultrasound [74.22397862400177]
  We propose a novel Frustum ultrasound based catheter segmentation method. The proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume.
  arXiv  Detail & Related papers  (2020-10-19T13:56:22Z)
• LRTD: Long-Range Temporal Dependency based Active Learning for Surgical Workflow Recognition [67.86810761677403]
  We propose a novel active learning method for cost-effective surgical video analysis. Specifically, we propose a non-local recurrent convolutional network (NL-RCNet), which introduces non-local block to capture the long-range temporal dependency. We validate our approach on a large surgical video dataset (Cholec80) by performing surgical workflow recognition task.
  arXiv  Detail & Related papers  (2020-04-21T09:21:22Z)
• 3D medical image segmentation with labeled and unlabeled data using autoencoders at the example of liver segmentation in CT images [58.720142291102135]
  This work investigates the potential of autoencoder-extracted features to improve segmentation with a convolutional neural network. A convolutional autoencoder was used to extract features from unlabeled data and a multi-scale, fully convolutional CNN was used to perform the target task of 3D liver segmentation in CT images.
  arXiv  Detail & Related papers  (2020-03-17T20:20:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.